Nov 14 23:35:37 user nova-compute[75341]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75341) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 14 23:35:37 user nova-compute[75341]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75341) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 14 23:35:37 user nova-compute[75341]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75341) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 14 23:35:37 user nova-compute[75341]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 14 23:35:37 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:35:37 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:35:38 user nova-compute[75341]: INFO nova.virt.driver [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 14 23:35:38 user nova-compute[75341]: INFO nova.compute.provider_config [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] Acquiring lock "singleton_lock" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] Acquired lock "singleton_lock" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] Releasing lock "singleton_lock" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] Full set of CONF: {{(pid=75341) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] ******************************************************************************** {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] Configuration options gathered from: {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] ================================================================================ {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] allow_resize_to_same_host      = True {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] arq_binding_timeout            = 300 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] backdoor_port                  = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] backdoor_socket                = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] block_device_allocate_retries  = 300 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] block_device_allocate_retries_interval = 5 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] cert                           = self.pem {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] compute_monitors               = [] {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] config_dir                     = [] {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] config_drive_format            = iso9660 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] config_source                  = [] {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] console_host                   = user {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] control_exchange               = nova {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] cpu_allocation_ratio           = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] daemon                         = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] debug                          = True {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] default_access_ip_network_name = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] default_availability_zone      = nova {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] default_ephemeral_format       = ext4 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] default_green_pool_size        = 1000 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] default_schedule_zone          = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] disk_allocation_ratio          = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] enable_new_services            = True {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] enabled_apis                   = ['osapi_compute'] {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] enabled_ssl_apis               = [] {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] flat_injected                  = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] force_config_drive             = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] force_raw_images               = True {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] graceful_shutdown_timeout      = 5 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] heal_instance_info_cache_interval = 60 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] host                           = user {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] instance_build_timeout         = 0 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] instance_delete_interval       = 300 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] instance_format                = [instance: %(uuid)s]  {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] instance_name_template         = instance-%08x {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] instance_usage_audit           = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] instance_usage_audit_period    = month {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] internal_service_availability_zone = internal {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] key                            = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] live_migration_retry_count     = 30 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] log_config_append              = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] log_dir                        = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] log_file                       = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] log_options                    = True {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] log_rotate_interval            = 1 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] log_rotate_interval_type       = days {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] log_rotation_type              = none {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] long_rpc_timeout               = 1800 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] max_concurrent_builds          = 10 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] max_concurrent_live_migrations = 1 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] max_concurrent_snapshots       = 5 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] max_local_block_devices        = 3 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] max_logfile_count              = 30 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] max_logfile_size_mb            = 200 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] maximum_instance_delete_attempts = 5 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] metadata_listen                = 0.0.0.0 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] metadata_listen_port           = 8775 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] metadata_workers               = 3 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] migrate_max_retries            = -1 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] mkisofs_cmd                    = genisoimage {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] my_ip                          = 10.0.0.210 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] network_allocate_retries       = 0 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] osapi_compute_listen_port      = 8774 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] osapi_compute_unique_server_name_scope =  {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] osapi_compute_workers          = 3 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] password_length                = 12 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] periodic_enable                = True {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] periodic_fuzzy_delay           = 60 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] pointer_model                  = ps2mouse {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] preallocate_images             = none {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] publish_errors                 = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] pybasedir                      = /opt/stack/nova {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] ram_allocation_ratio           = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] rate_limit_burst               = 0 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] rate_limit_except_level        = CRITICAL {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] rate_limit_interval            = 0 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] reboot_timeout                 = 0 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] reclaim_instance_interval      = 0 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] record                         = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] reimage_timeout_per_gb         = 60 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] report_interval                = 120 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] rescue_timeout                 = 0 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] reserved_host_cpus             = 0 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] reserved_host_disk_mb          = 0 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] reserved_host_memory_mb        = 512 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] reserved_huge_pages            = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] resize_confirm_window          = 0 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] resize_fs_using_block_device   = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] resume_guests_state_on_host_boot = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] rpc_response_timeout           = 60 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] run_external_periodic_tasks    = True {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] running_deleted_instance_action = reap {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] running_deleted_instance_poll_interval = 1800 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] running_deleted_instance_timeout = 0 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] scheduler_instance_sync_interval = 120 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] service_down_time              = 720 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] servicegroup_driver            = db {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] shelved_offload_time           = 0 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] shelved_poll_interval          = 3600 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] shutdown_timeout               = 0 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] source_is_ipv6                 = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] ssl_only                       = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] state_path                     = /opt/stack/data/nova {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] sync_power_state_interval      = 600 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] sync_power_state_pool_size     = 1000 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] syslog_log_facility            = LOG_USER {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] tempdir                        = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] timeout_nbd                    = 10 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] transport_url                  = **** {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] update_resources_interval      = 0 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] use_cow_images                 = True {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] use_eventlog                   = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] use_journal                    = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] use_json                       = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] use_rootwrap_daemon            = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] use_stderr                     = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] use_syslog                     = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vcpu_pin_set                   = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vif_plugging_is_fatal          = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vif_plugging_timeout           = 0 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] virt_mkfs                      = [] {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] volume_usage_poll_interval     = 0 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] watch_log_file                 = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] web                            = /usr/share/spice-html5 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_concurrency.disable_process_locking = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] api.auth_strategy              = keystone {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] api.compute_link_prefix        = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] api.dhcp_domain                = novalocal {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] api.enable_instance_password   = True {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] api.glance_link_prefix         = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] api.instance_list_per_project_cells = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] api.list_records_by_skipping_down_cells = True {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] api.local_metadata_per_cell    = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] api.max_limit                  = 1000 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] api.metadata_cache_expiration  = 15 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] api.neutron_default_tenant_id  = default {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] api.use_forwarded_for          = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] api.use_neutron_default_nets   = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] api.vendordata_dynamic_targets = [] {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] api.vendordata_jsonfile_path   = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] cache.backend                  = dogpile.cache.memcached {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] cache.backend_argument         = **** {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] cache.config_prefix            = cache.oslo {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] cache.dead_timeout             = 60.0 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] cache.debug_cache_backend      = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] cache.enable_retry_client      = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] cache.enable_socket_keepalive  = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] cache.enabled                  = True {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] cache.expiration_time          = 600 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] cache.hashclient_retry_attempts = 2 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] cache.memcache_dead_retry      = 300 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] cache.memcache_password        =  {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] cache.memcache_pool_maxsize    = 10 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] cache.memcache_sasl_enabled    = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] cache.memcache_username        =  {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] cache.proxies                  = [] {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] cache.retry_attempts           = 2 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] cache.retry_delay              = 0.0 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] cache.socket_keepalive_count   = 1 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] cache.socket_keepalive_idle    = 1 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] cache.socket_keepalive_interval = 1 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] cache.tls_allowed_ciphers      = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] cache.tls_cafile               = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] cache.tls_certfile             = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] cache.tls_enabled              = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] cache.tls_keyfile              = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] cinder.auth_section            = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] cinder.auth_type               = password {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] cinder.cafile                  = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] cinder.certfile                = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] cinder.collect_timing          = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] cinder.cross_az_attach         = True {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] cinder.debug                   = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] cinder.endpoint_template       = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] cinder.http_retries            = 3 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] cinder.insecure                = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] cinder.keyfile                 = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] cinder.os_region_name          = RegionOne {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] cinder.split_loggers           = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] cinder.timeout                 = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] compute.cpu_dedicated_set      = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] compute.cpu_shared_set         = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] compute.image_type_exclude_list = [] {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] compute.max_concurrent_disk_ops = 0 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] compute.max_disk_devices_to_attach = -1 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] compute.resource_provider_association_refresh = 300 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] compute.shutdown_retry_interval = 10 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] conductor.workers              = 3 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] console.allowed_origins        = [] {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] console.ssl_ciphers            = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] console.ssl_minimum_version    = default {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] consoleauth.token_ttl          = 600 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] cyborg.cafile                  = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] cyborg.certfile                = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] cyborg.collect_timing          = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] cyborg.connect_retries         = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] cyborg.connect_retry_delay     = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] cyborg.endpoint_override       = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] cyborg.insecure                = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] cyborg.keyfile                 = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] cyborg.max_version             = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] cyborg.min_version             = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] cyborg.region_name             = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] cyborg.service_name            = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] cyborg.service_type            = accelerator {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] cyborg.split_loggers           = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] cyborg.status_code_retries     = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] cyborg.status_code_retry_delay = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] cyborg.timeout                 = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] cyborg.version                 = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] database.backend               = sqlalchemy {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] database.connection            = **** {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] database.connection_debug      = 0 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] database.connection_parameters =  {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] database.connection_recycle_time = 3600 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] database.connection_trace      = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] database.db_inc_retry_interval = True {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] database.db_max_retries        = 20 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] database.db_max_retry_interval = 10 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] database.db_retry_interval     = 1 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] database.max_overflow          = 50 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] database.max_pool_size         = 5 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] database.max_retries           = 10 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] database.mysql_wsrep_sync_wait = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] database.pool_timeout          = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] database.retry_interval        = 10 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] database.slave_connection      = **** {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] database.sqlite_synchronous    = True {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] api_database.backend           = sqlalchemy {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] api_database.connection        = **** {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] api_database.connection_debug  = 0 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] api_database.connection_parameters =  {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] api_database.connection_recycle_time = 3600 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] api_database.connection_trace  = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] api_database.db_inc_retry_interval = True {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] api_database.db_max_retries    = 20 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] api_database.db_max_retry_interval = 10 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] api_database.db_retry_interval = 1 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] api_database.max_overflow      = 50 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] api_database.max_pool_size     = 5 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] api_database.max_retries       = 10 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] api_database.pool_timeout      = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] api_database.retry_interval    = 10 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] api_database.slave_connection  = **** {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] api_database.sqlite_synchronous = True {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] devices.enabled_mdev_types     = [] {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] ephemeral_storage_encryption.enabled = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] glance.api_servers             = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] glance.cafile                  = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] glance.certfile                = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] glance.collect_timing          = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] glance.connect_retries         = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] glance.connect_retry_delay     = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] glance.debug                   = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] glance.default_trusted_certificate_ids = [] {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] glance.enable_certificate_validation = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] glance.enable_rbd_download     = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] glance.endpoint_override       = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] glance.insecure                = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] glance.keyfile                 = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] glance.max_version             = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] glance.min_version             = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] glance.num_retries             = 3 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] glance.rbd_ceph_conf           =  {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] glance.rbd_connect_timeout     = 5 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] glance.rbd_pool                =  {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] glance.rbd_user                =  {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] glance.region_name             = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] glance.service_name            = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] glance.service_type            = image {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] glance.split_loggers           = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] glance.status_code_retries     = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] glance.status_code_retry_delay = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] glance.timeout                 = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] glance.verify_glance_signatures = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] glance.version                 = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] guestfs.debug                  = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] hyperv.config_drive_cdrom      = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] hyperv.config_drive_inject_password = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] hyperv.enable_instance_metrics_collection = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] hyperv.enable_remotefx         = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] hyperv.instances_path_share    =  {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] hyperv.iscsi_initiator_list    = [] {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] hyperv.limit_cpu_features      = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] hyperv.power_state_check_timeframe = 60 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] hyperv.use_multipath_io        = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] hyperv.volume_attach_retry_count = 10 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] hyperv.vswitch_name            = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] mks.enabled                    = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] image_cache.manager_interval   = 2400 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] image_cache.precache_concurrency = 1 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] image_cache.remove_unused_base_images = True {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] image_cache.subdirectory_name  = _base {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] ironic.api_max_retries         = 60 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] ironic.api_retry_interval      = 2 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] ironic.auth_section            = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] ironic.auth_type               = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] ironic.cafile                  = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] ironic.certfile                = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] ironic.collect_timing          = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] ironic.conductor_group         = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] ironic.connect_retries         = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] ironic.connect_retry_delay     = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] ironic.endpoint_override       = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] ironic.insecure                = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] ironic.keyfile                 = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] ironic.max_version             = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] ironic.min_version             = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] ironic.peer_list               = [] {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] ironic.region_name             = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] ironic.serial_console_state_timeout = 10 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] ironic.service_name            = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] ironic.service_type            = baremetal {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] ironic.split_loggers           = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] ironic.status_code_retries     = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] ironic.status_code_retry_delay = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] ironic.timeout                 = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] ironic.version                 = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] key_manager.fixed_key          = **** {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] barbican.barbican_api_version  = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] barbican.barbican_endpoint     = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] barbican.barbican_endpoint_type = public {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] barbican.barbican_region_name  = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] barbican.cafile                = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] barbican.certfile              = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] barbican.collect_timing        = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] barbican.insecure              = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] barbican.keyfile               = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] barbican.number_of_retries     = 60 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] barbican.retry_delay           = 1 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] barbican.send_service_user_token = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] barbican.split_loggers         = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] barbican.timeout               = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] barbican.verify_ssl            = True {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] barbican.verify_ssl_path       = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] barbican_service_user.auth_section = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] barbican_service_user.auth_type = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] barbican_service_user.cafile   = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] barbican_service_user.certfile = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] barbican_service_user.collect_timing = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] barbican_service_user.insecure = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] barbican_service_user.keyfile  = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] barbican_service_user.split_loggers = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] barbican_service_user.timeout  = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vault.approle_role_id          = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vault.approle_secret_id        = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vault.cafile                   = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vault.certfile                 = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vault.collect_timing           = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vault.insecure                 = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vault.keyfile                  = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vault.kv_mountpoint            = secret {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vault.kv_path                  = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vault.kv_version               = 2 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vault.namespace                = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vault.root_token_id            = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vault.split_loggers            = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vault.ssl_ca_crt_file          = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vault.timeout                  = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vault.use_ssl                  = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] keystone.auth_section          = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] keystone.auth_type             = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] keystone.cafile                = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] keystone.certfile              = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] keystone.collect_timing        = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] keystone.connect_retries       = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] keystone.connect_retry_delay   = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] keystone.endpoint_override     = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] keystone.insecure              = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] keystone.keyfile               = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] keystone.max_version           = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] keystone.min_version           = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] keystone.region_name           = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] keystone.service_name          = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] keystone.service_type          = identity {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] keystone.split_loggers         = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] keystone.status_code_retries   = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] keystone.status_code_retry_delay = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] keystone.timeout               = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] keystone.version               = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.connection_uri         =  {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.cpu_mode               = custom {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: WARNING oslo_config.cfg [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.cpu_power_governor_high = performance {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.cpu_power_governor_low = powersave {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.cpu_power_management   = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.device_detach_attempts = 8 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.device_detach_timeout  = 20 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.disk_cachemodes        = [] {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.disk_prefix            = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.enabled_perf_events    = [] {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.file_backed_memory     = 0 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.gid_maps               = [] {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.hw_disk_discard        = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.hw_machine_type        = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.images_rbd_glance_store_name =  {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.images_rbd_pool        = rbd {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.images_type            = default {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.images_volume_group    = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.inject_key             = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.inject_partition       = -2 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.inject_password        = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.iscsi_iface            = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.iser_use_multipath     = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.live_migration_bandwidth = 0 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.live_migration_downtime = 500 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.live_migration_inbound_addr = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.live_migration_permit_post_copy = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.live_migration_scheme  = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.live_migration_timeout_action = abort {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.live_migration_tunnelled = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: WARNING oslo_config.cfg [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 14 23:35:38 user nova-compute[75341]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 14 23:35:38 user nova-compute[75341]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 14 23:35:38 user nova-compute[75341]: and ``live_migration_inbound_addr`` respectively.
Nov 14 23:35:38 user nova-compute[75341]: ).  Its value may be silently ignored in the future.
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.live_migration_with_native_tls = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.max_queues             = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.nfs_mount_options      = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.num_memory_encrypted_guests = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.num_pcie_ports         = 0 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.pmem_namespaces        = [] {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.quobyte_client_cfg     = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.rbd_secret_uuid        = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.rbd_user               = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.remote_filesystem_transport = ssh {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.rescue_image_id        = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.rescue_kernel_id       = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.rescue_ramdisk_id      = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.rx_queue_size          = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.smbfs_mount_options    =  {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.snapshot_compression   = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.snapshot_image_format  = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.sparse_logical_volumes = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.swtpm_enabled          = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.swtpm_group            = tss {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.swtpm_user             = tss {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.sysinfo_serial         = unique {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.tb_cache_size          = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.tx_queue_size          = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.uid_maps               = [] {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.use_virtio_for_bridges = True {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.virt_type              = kvm {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.volume_clear           = zero {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.volume_clear_size      = 0 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.volume_use_multipath   = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.vzstorage_cache_path   = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.vzstorage_mount_user   = stack {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] neutron.auth_section           = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] neutron.auth_type              = password {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] neutron.cafile                 = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] neutron.certfile               = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] neutron.collect_timing         = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] neutron.connect_retries        = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] neutron.connect_retry_delay    = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] neutron.default_floating_pool  = public {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] neutron.endpoint_override      = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] neutron.extension_sync_interval = 600 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] neutron.http_retries           = 3 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] neutron.insecure               = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] neutron.keyfile                = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] neutron.max_version            = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] neutron.min_version            = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] neutron.ovs_bridge             = br-int {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] neutron.physnets               = [] {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] neutron.region_name            = RegionOne {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] neutron.service_metadata_proxy = True {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] neutron.service_name           = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] neutron.service_type           = network {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] neutron.split_loggers          = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] neutron.status_code_retries    = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] neutron.status_code_retry_delay = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] neutron.timeout                = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] neutron.version                = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] notifications.bdms_in_notifications = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] notifications.default_level    = INFO {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] notifications.notification_format = unversioned {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] notifications.notify_on_state_change = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] pci.alias                      = [] {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] pci.device_spec                = [] {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] pci.report_in_placement        = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] placement.auth_section         = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] placement.auth_type            = password {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] placement.cafile               = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] placement.certfile             = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] placement.collect_timing       = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] placement.connect_retries      = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] placement.connect_retry_delay  = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] placement.default_domain_id    = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] placement.default_domain_name  = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] placement.domain_id            = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] placement.domain_name          = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] placement.endpoint_override    = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] placement.insecure             = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] placement.keyfile              = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] placement.max_version          = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] placement.min_version          = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] placement.password             = **** {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] placement.project_domain_id    = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] placement.project_domain_name  = Default {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] placement.project_id           = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] placement.project_name         = service {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] placement.region_name          = RegionOne {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] placement.service_name         = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] placement.service_type         = placement {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] placement.split_loggers        = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] placement.status_code_retries  = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] placement.status_code_retry_delay = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] placement.system_scope         = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] placement.timeout              = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] placement.trust_id             = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] placement.user_domain_id       = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] placement.user_domain_name     = Default {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] placement.user_id              = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] placement.username             = placement {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] placement.version              = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] quota.cores                    = 20 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] quota.count_usage_from_placement = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] quota.injected_file_content_bytes = 10240 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] quota.injected_file_path_length = 255 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] quota.injected_files           = 5 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] quota.instances                = 10 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] quota.key_pairs                = 100 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] quota.metadata_items           = 128 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] quota.ram                      = 51200 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] quota.recheck_quota            = True {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] quota.server_group_members     = 10 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] quota.server_groups            = 10 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] rdp.enabled                    = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] scheduler.image_metadata_prefilter = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] scheduler.max_attempts         = 3 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] scheduler.max_placement_results = 1000 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] scheduler.query_placement_for_image_type_support = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] scheduler.workers              = 3 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] filter_scheduler.host_subset_size = 1 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] filter_scheduler.isolated_hosts = [] {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] filter_scheduler.isolated_images = [] {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] filter_scheduler.pci_in_placement = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] filter_scheduler.track_instance_changes = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] metrics.required               = True {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] metrics.weight_multiplier      = 1.0 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] metrics.weight_setting         = [] {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] serial_console.enabled         = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] serial_console.port_range      = 10000:20000 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] serial_console.serialproxy_port = 6083 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] service_user.auth_section      = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] service_user.auth_type         = password {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] service_user.cafile            = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] service_user.certfile          = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] service_user.collect_timing    = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] service_user.insecure          = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] service_user.keyfile           = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] service_user.send_service_user_token = True {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] service_user.split_loggers     = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] service_user.timeout           = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] spice.agent_enabled            = True {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] spice.enabled                  = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] spice.html5proxy_port          = 6082 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] spice.image_compression        = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] spice.jpeg_compression         = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] spice.playback_compression     = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] spice.server_listen            = 127.0.0.1 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] spice.streaming_mode           = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] spice.zlib_compression         = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] upgrade_levels.baseapi         = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] upgrade_levels.cert            = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] upgrade_levels.compute         = auto {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] upgrade_levels.conductor       = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] upgrade_levels.scheduler       = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vendordata_dynamic_auth.auth_section = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vendordata_dynamic_auth.auth_type = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vendordata_dynamic_auth.cafile = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vendordata_dynamic_auth.certfile = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vendordata_dynamic_auth.insecure = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vendordata_dynamic_auth.keyfile = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vendordata_dynamic_auth.timeout = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vmware.api_retry_count         = 10 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vmware.ca_file                 = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vmware.cache_prefix            = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vmware.cluster_name            = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vmware.connection_pool_size    = 10 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vmware.console_delay_seconds   = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vmware.datastore_regex         = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vmware.host_ip                 = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vmware.host_password           = **** {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vmware.host_port               = 443 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vmware.host_username           = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vmware.insecure                = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vmware.integration_bridge      = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vmware.maximum_objects         = 100 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vmware.pbm_default_policy      = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vmware.pbm_enabled             = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vmware.pbm_wsdl_location       = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vmware.serial_port_proxy_uri   = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vmware.serial_port_service_uri = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vmware.task_poll_interval      = 0.5 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vmware.use_linked_clone        = True {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vmware.vnc_keymap              = en-us {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vmware.vnc_port                = 5900 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vmware.vnc_port_total          = 10000 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vnc.auth_schemes               = ['none'] {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vnc.enabled                    = True {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vnc.novncproxy_port            = 6080 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vnc.server_listen              = 0.0.0.0 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vnc.vencrypt_ca_certs          = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vnc.vencrypt_client_cert       = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vnc.vencrypt_client_key        = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] workarounds.disable_rootwrap   = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] workarounds.enable_numa_live_migration = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] workarounds.libvirt_disable_apic = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] wsgi.client_socket_timeout     = 900 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] wsgi.default_pool_size         = 1000 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] wsgi.keep_alive                = True {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] wsgi.max_header_line           = 16384 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] wsgi.ssl_ca_file               = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] wsgi.ssl_cert_file             = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] wsgi.ssl_key_file              = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] wsgi.tcp_keepidle              = 600 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] zvm.ca_file                    = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] zvm.cloud_connector_url        = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] zvm.reachable_timeout          = 300 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_policy.enforce_new_defaults = True {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_policy.enforce_scope      = True {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_policy.policy_default_rule = default {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_policy.policy_file        = policy.yaml {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] profiler.connection_string     = messaging:// {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] profiler.enabled               = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] profiler.es_doc_type           = notification {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] profiler.es_scroll_size        = 10000 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] profiler.es_scroll_time        = 2m {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] profiler.filter_error_trace    = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] profiler.hmac_keys             = **** {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] profiler.sentinel_service_name = mymaster {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] profiler.socket_timeout        = 0.1 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] profiler.trace_requests        = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] profiler.trace_sqlalchemy      = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] profiler_jaeger.process_tags   = {} {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] profiler_jaeger.service_name_prefix = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] profiler_otlp.service_name_prefix = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] remote_debug.host              = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] remote_debug.port              = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_messaging_rabbit.ssl      = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_messaging_notifications.retry = -1 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_messaging_notifications.transport_url = **** {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_limit.auth_section        = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_limit.auth_type           = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_limit.cafile              = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_limit.certfile            = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_limit.collect_timing      = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_limit.connect_retries     = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_limit.connect_retry_delay = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_limit.endpoint_id         = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_limit.endpoint_override   = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_limit.insecure            = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_limit.keyfile             = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_limit.max_version         = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_limit.min_version         = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_limit.region_name         = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_limit.service_name        = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_limit.service_type        = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_limit.split_loggers       = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_limit.status_code_retries = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_limit.status_code_retry_delay = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_limit.timeout             = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_limit.valid_interfaces    = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_limit.version             = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_reports.file_event_handler = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] oslo_reports.log_dir           = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vif_plug_ovs_privileged.group  = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] vif_plug_ovs_privileged.user   = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] os_vif_linux_bridge.flat_interface = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] os_vif_ovs.isolate_vif         = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] os_vif_ovs.per_port_bridge     = False {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] os_brick.lock_path             = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] privsep_osbrick.capabilities   = [21] {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] privsep_osbrick.group          = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] privsep_osbrick.helper_command = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] privsep_osbrick.user           = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] nova_sys_admin.group           = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] nova_sys_admin.helper_command  = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] nova_sys_admin.user            = None {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG oslo_service.service [None req-61c63ace-54d4-41d9-9ea4-55125a07f8db None None] ******************************************************************************** {{(pid=75341) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 14 23:35:38 user nova-compute[75341]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 14 23:35:38 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Connecting to libvirt: qemu:///system {{(pid=75341) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f1893e1ef80> {{(pid=75341) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 14 23:35:38 user nova-compute[75341]: libvirt:  error : internal error: could not initialize domain event timer
Nov 14 23:35:38 user nova-compute[75341]: WARNING nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 14 23:35:38 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f1893e1ef80> {{(pid=75341) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Starting native event thread {{(pid=75341) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Starting green dispatch thread {{(pid=75341) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 14 23:35:38 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Starting connection event dispatch thread {{(pid=75341) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 14 23:35:38 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Connection event '1' reason 'None'
Nov 14 23:35:38 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 14 23:35:38 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.mount [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Initialising _HostMountState generation 0 {{(pid=75341) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 14 23:35:45 user nova-compute[75341]: INFO nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Libvirt host capabilities <capabilities>
Nov 14 23:35:45 user nova-compute[75341]:   <host>
Nov 14 23:35:45 user nova-compute[75341]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 14 23:35:45 user nova-compute[75341]:     <cpu>
Nov 14 23:35:45 user nova-compute[75341]:       <arch>x86_64</arch>
Nov 14 23:35:45 user nova-compute[75341]:       <model>IvyBridge-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <vendor>Intel</vendor>
Nov 14 23:35:45 user nova-compute[75341]:       <microcode version='1070'/>
Nov 14 23:35:45 user nova-compute[75341]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 14 23:35:45 user nova-compute[75341]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature name='ss'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature name='vmx'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature name='pcid'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature name='osxsave'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature name='hypervisor'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature name='arat'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature name='tsc_adjust'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature name='md-clear'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature name='stibp'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature name='arch-capabilities'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature name='ssbd'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature name='invtsc'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature name='rsba'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature name='skip-l1dfl-vmentry'/>
Nov 14 23:35:45 user nova-compute[75341]:       <pages unit='KiB' size='4'/>
Nov 14 23:35:45 user nova-compute[75341]:       <pages unit='KiB' size='2048'/>
Nov 14 23:35:45 user nova-compute[75341]:     </cpu>
Nov 14 23:35:45 user nova-compute[75341]:     <power_management>
Nov 14 23:35:45 user nova-compute[75341]:       <suspend_mem/>
Nov 14 23:35:45 user nova-compute[75341]:       <suspend_disk/>
Nov 14 23:35:45 user nova-compute[75341]:       <suspend_hybrid/>
Nov 14 23:35:45 user nova-compute[75341]:     </power_management>
Nov 14 23:35:45 user nova-compute[75341]:     <iommu support='no'/>
Nov 14 23:35:45 user nova-compute[75341]:     <migration_features>
Nov 14 23:35:45 user nova-compute[75341]:       <live/>
Nov 14 23:35:45 user nova-compute[75341]:       <uri_transports>
Nov 14 23:35:45 user nova-compute[75341]:         <uri_transport>tcp</uri_transport>
Nov 14 23:35:45 user nova-compute[75341]:         <uri_transport>rdma</uri_transport>
Nov 14 23:35:45 user nova-compute[75341]:       </uri_transports>
Nov 14 23:35:45 user nova-compute[75341]:     </migration_features>
Nov 14 23:35:45 user nova-compute[75341]:     <topology>
Nov 14 23:35:45 user nova-compute[75341]:       <cells num='2'>
Nov 14 23:35:45 user nova-compute[75341]:         <cell id='0'>
Nov 14 23:35:45 user nova-compute[75341]:           <memory unit='KiB'>8189224</memory>
Nov 14 23:35:45 user nova-compute[75341]:           <pages unit='KiB' size='4'>2047306</pages>
Nov 14 23:35:45 user nova-compute[75341]:           <pages unit='KiB' size='2048'>0</pages>
Nov 14 23:35:45 user nova-compute[75341]:           <distances>
Nov 14 23:35:45 user nova-compute[75341]:             <sibling id='0' value='10'/>
Nov 14 23:35:45 user nova-compute[75341]:             <sibling id='1' value='20'/>
Nov 14 23:35:45 user nova-compute[75341]:           </distances>
Nov 14 23:35:45 user nova-compute[75341]:           <cpus num='6'>
Nov 14 23:35:45 user nova-compute[75341]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 14 23:35:45 user nova-compute[75341]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 14 23:35:45 user nova-compute[75341]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 14 23:35:45 user nova-compute[75341]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 14 23:35:45 user nova-compute[75341]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 14 23:35:45 user nova-compute[75341]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 14 23:35:45 user nova-compute[75341]:           </cpus>
Nov 14 23:35:45 user nova-compute[75341]:         </cell>
Nov 14 23:35:45 user nova-compute[75341]:         <cell id='1'>
Nov 14 23:35:45 user nova-compute[75341]:           <memory unit='KiB'>8206460</memory>
Nov 14 23:35:45 user nova-compute[75341]:           <pages unit='KiB' size='4'>2051615</pages>
Nov 14 23:35:45 user nova-compute[75341]:           <pages unit='KiB' size='2048'>0</pages>
Nov 14 23:35:45 user nova-compute[75341]:           <distances>
Nov 14 23:35:45 user nova-compute[75341]:             <sibling id='0' value='20'/>
Nov 14 23:35:45 user nova-compute[75341]:             <sibling id='1' value='10'/>
Nov 14 23:35:45 user nova-compute[75341]:           </distances>
Nov 14 23:35:45 user nova-compute[75341]:           <cpus num='6'>
Nov 14 23:35:45 user nova-compute[75341]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 14 23:35:45 user nova-compute[75341]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 14 23:35:45 user nova-compute[75341]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 14 23:35:45 user nova-compute[75341]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 14 23:35:45 user nova-compute[75341]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 14 23:35:45 user nova-compute[75341]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 14 23:35:45 user nova-compute[75341]:           </cpus>
Nov 14 23:35:45 user nova-compute[75341]:         </cell>
Nov 14 23:35:45 user nova-compute[75341]:       </cells>
Nov 14 23:35:45 user nova-compute[75341]:     </topology>
Nov 14 23:35:45 user nova-compute[75341]:     <cache>
Nov 14 23:35:45 user nova-compute[75341]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 14 23:35:45 user nova-compute[75341]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 14 23:35:45 user nova-compute[75341]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 14 23:35:45 user nova-compute[75341]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 14 23:35:45 user nova-compute[75341]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 14 23:35:45 user nova-compute[75341]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 14 23:35:45 user nova-compute[75341]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 14 23:35:45 user nova-compute[75341]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 14 23:35:45 user nova-compute[75341]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 14 23:35:45 user nova-compute[75341]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 14 23:35:45 user nova-compute[75341]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 14 23:35:45 user nova-compute[75341]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 14 23:35:45 user nova-compute[75341]:     </cache>
Nov 14 23:35:45 user nova-compute[75341]:     <secmodel>
Nov 14 23:35:45 user nova-compute[75341]:       <model>apparmor</model>
Nov 14 23:35:45 user nova-compute[75341]:       <doi>0</doi>
Nov 14 23:35:45 user nova-compute[75341]:     </secmodel>
Nov 14 23:35:45 user nova-compute[75341]:     <secmodel>
Nov 14 23:35:45 user nova-compute[75341]:       <model>dac</model>
Nov 14 23:35:45 user nova-compute[75341]:       <doi>0</doi>
Nov 14 23:35:45 user nova-compute[75341]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 14 23:35:45 user nova-compute[75341]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 14 23:35:45 user nova-compute[75341]:     </secmodel>
Nov 14 23:35:45 user nova-compute[75341]:   </host>
Nov 14 23:35:45 user nova-compute[75341]:   <guest>
Nov 14 23:35:45 user nova-compute[75341]:     <os_type>hvm</os_type>
Nov 14 23:35:45 user nova-compute[75341]:     <arch name='alpha'>
Nov 14 23:35:45 user nova-compute[75341]:       <wordsize>64</wordsize>
Nov 14 23:35:45 user nova-compute[75341]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='4'>clipper</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <domain type='qemu'/>
Nov 14 23:35:45 user nova-compute[75341]:     </arch>
Nov 14 23:35:45 user nova-compute[75341]:     <features>
Nov 14 23:35:45 user nova-compute[75341]:       <cpuselection/>
Nov 14 23:35:45 user nova-compute[75341]:       <deviceboot/>
Nov 14 23:35:45 user nova-compute[75341]:       <disksnapshot default='on' toggle='no'/>
Nov 14 23:35:45 user nova-compute[75341]:     </features>
Nov 14 23:35:45 user nova-compute[75341]:   </guest>
Nov 14 23:35:45 user nova-compute[75341]:   <guest>
Nov 14 23:35:45 user nova-compute[75341]:     <os_type>hvm</os_type>
Nov 14 23:35:45 user nova-compute[75341]:     <arch name='armv6l'>
Nov 14 23:35:45 user nova-compute[75341]:       <wordsize>32</wordsize>
Nov 14 23:35:45 user nova-compute[75341]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>integratorcp</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>borzoi</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>spitz</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2'>nuri</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2'>musca-b1</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>versatileab</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>kzm</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2'>musca-a</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2'>smdkc210</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>sx1</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>z2</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>tosa</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='4'>sabrelite</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>realview-eb</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>n810</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>n800</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>versatilepb</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>terrier</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>mainstone</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='4'>midway</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>musicpal</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>microbit</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>cubieboard</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>verdex</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>netduino2</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='4'>raspi2b</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>cheetah</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='4'>highbank</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>akita</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>connex</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>collie</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>raspi0</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <domain type='qemu'/>
Nov 14 23:35:45 user nova-compute[75341]:     </arch>
Nov 14 23:35:45 user nova-compute[75341]:     <features>
Nov 14 23:35:45 user nova-compute[75341]:       <cpuselection/>
Nov 14 23:35:45 user nova-compute[75341]:       <deviceboot/>
Nov 14 23:35:45 user nova-compute[75341]:       <disksnapshot default='on' toggle='no'/>
Nov 14 23:35:45 user nova-compute[75341]:     </features>
Nov 14 23:35:45 user nova-compute[75341]:   </guest>
Nov 14 23:35:45 user nova-compute[75341]:   <guest>
Nov 14 23:35:45 user nova-compute[75341]:     <os_type>hvm</os_type>
Nov 14 23:35:45 user nova-compute[75341]:     <arch name='armv7l'>
Nov 14 23:35:45 user nova-compute[75341]:       <wordsize>32</wordsize>
Nov 14 23:35:45 user nova-compute[75341]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>integratorcp</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>borzoi</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>spitz</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2'>nuri</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2'>musca-b1</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>versatileab</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>kzm</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2'>musca-a</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2'>smdkc210</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>sx1</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>z2</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>tosa</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='4'>sabrelite</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>realview-eb</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>n810</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>n800</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>versatilepb</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>terrier</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>mainstone</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='4'>midway</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>musicpal</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>microbit</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>cubieboard</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>verdex</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>netduino2</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='4'>raspi2b</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>cheetah</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='4'>highbank</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>akita</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>connex</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>collie</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>raspi0</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <domain type='qemu'/>
Nov 14 23:35:45 user nova-compute[75341]:     </arch>
Nov 14 23:35:45 user nova-compute[75341]:     <features>
Nov 14 23:35:45 user nova-compute[75341]:       <cpuselection/>
Nov 14 23:35:45 user nova-compute[75341]:       <deviceboot/>
Nov 14 23:35:45 user nova-compute[75341]:       <disksnapshot default='on' toggle='no'/>
Nov 14 23:35:45 user nova-compute[75341]:     </features>
Nov 14 23:35:45 user nova-compute[75341]:   </guest>
Nov 14 23:35:45 user nova-compute[75341]:   <guest>
Nov 14 23:35:45 user nova-compute[75341]:     <os_type>hvm</os_type>
Nov 14 23:35:45 user nova-compute[75341]:     <arch name='aarch64'>
Nov 14 23:35:45 user nova-compute[75341]:       <wordsize>64</wordsize>
Nov 14 23:35:45 user nova-compute[75341]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>integratorcp</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>borzoi</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>spitz</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2'>nuri</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2'>musca-b1</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>versatileab</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>kzm</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2'>musca-a</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2'>smdkc210</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>sx1</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>z2</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>tosa</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='4'>sabrelite</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>realview-eb</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>n810</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>n800</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>versatilepb</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>terrier</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>mainstone</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='4'>midway</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>musicpal</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>microbit</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>cubieboard</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>verdex</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>netduino2</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='4'>raspi3b</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='4'>raspi2b</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>cheetah</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='4'>highbank</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>akita</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>connex</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>collie</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>raspi0</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <domain type='qemu'/>
Nov 14 23:35:45 user nova-compute[75341]:     </arch>
Nov 14 23:35:45 user nova-compute[75341]:     <features>
Nov 14 23:35:45 user nova-compute[75341]:       <acpi default='on' toggle='yes'/>
Nov 14 23:35:45 user nova-compute[75341]:       <cpuselection/>
Nov 14 23:35:45 user nova-compute[75341]:       <deviceboot/>
Nov 14 23:35:45 user nova-compute[75341]:       <disksnapshot default='on' toggle='no'/>
Nov 14 23:35:45 user nova-compute[75341]:     </features>
Nov 14 23:35:45 user nova-compute[75341]:   </guest>
Nov 14 23:35:45 user nova-compute[75341]:   <guest>
Nov 14 23:35:45 user nova-compute[75341]:     <os_type>hvm</os_type>
Nov 14 23:35:45 user nova-compute[75341]:     <arch name='cris'>
Nov 14 23:35:45 user nova-compute[75341]:       <wordsize>32</wordsize>
Nov 14 23:35:45 user nova-compute[75341]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <domain type='qemu'/>
Nov 14 23:35:45 user nova-compute[75341]:     </arch>
Nov 14 23:35:45 user nova-compute[75341]:     <features>
Nov 14 23:35:45 user nova-compute[75341]:       <cpuselection/>
Nov 14 23:35:45 user nova-compute[75341]:       <deviceboot/>
Nov 14 23:35:45 user nova-compute[75341]:       <disksnapshot default='on' toggle='no'/>
Nov 14 23:35:45 user nova-compute[75341]:     </features>
Nov 14 23:35:45 user nova-compute[75341]:   </guest>
Nov 14 23:35:45 user nova-compute[75341]:   <guest>
Nov 14 23:35:45 user nova-compute[75341]:     <os_type>hvm</os_type>
Nov 14 23:35:45 user nova-compute[75341]:     <arch name='i686'>
Nov 14 23:35:45 user nova-compute[75341]:       <wordsize>32</wordsize>
Nov 14 23:35:45 user nova-compute[75341]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>x-remote</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>isapc</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>microvm</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <domain type='qemu'/>
Nov 14 23:35:45 user nova-compute[75341]:       <domain type='kvm'/>
Nov 14 23:35:45 user nova-compute[75341]:     </arch>
Nov 14 23:35:45 user nova-compute[75341]:     <features>
Nov 14 23:35:45 user nova-compute[75341]:       <pae/>
Nov 14 23:35:45 user nova-compute[75341]:       <nonpae/>
Nov 14 23:35:45 user nova-compute[75341]:       <acpi default='on' toggle='yes'/>
Nov 14 23:35:45 user nova-compute[75341]:       <apic default='on' toggle='no'/>
Nov 14 23:35:45 user nova-compute[75341]:       <cpuselection/>
Nov 14 23:35:45 user nova-compute[75341]:       <deviceboot/>
Nov 14 23:35:45 user nova-compute[75341]:       <disksnapshot default='on' toggle='no'/>
Nov 14 23:35:45 user nova-compute[75341]:     </features>
Nov 14 23:35:45 user nova-compute[75341]:   </guest>
Nov 14 23:35:45 user nova-compute[75341]:   <guest>
Nov 14 23:35:45 user nova-compute[75341]:     <os_type>hvm</os_type>
Nov 14 23:35:45 user nova-compute[75341]:     <arch name='m68k'>
Nov 14 23:35:45 user nova-compute[75341]:       <wordsize>32</wordsize>
Nov 14 23:35:45 user nova-compute[75341]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>an5206</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>q800</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>next-cube</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <domain type='qemu'/>
Nov 14 23:35:45 user nova-compute[75341]:     </arch>
Nov 14 23:35:45 user nova-compute[75341]:     <features>
Nov 14 23:35:45 user nova-compute[75341]:       <cpuselection/>
Nov 14 23:35:45 user nova-compute[75341]:       <deviceboot/>
Nov 14 23:35:45 user nova-compute[75341]:       <disksnapshot default='on' toggle='no'/>
Nov 14 23:35:45 user nova-compute[75341]:     </features>
Nov 14 23:35:45 user nova-compute[75341]:   </guest>
Nov 14 23:35:45 user nova-compute[75341]:   <guest>
Nov 14 23:35:45 user nova-compute[75341]:     <os_type>hvm</os_type>
Nov 14 23:35:45 user nova-compute[75341]:     <arch name='microblaze'>
Nov 14 23:35:45 user nova-compute[75341]:       <wordsize>32</wordsize>
Nov 14 23:35:45 user nova-compute[75341]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <domain type='qemu'/>
Nov 14 23:35:45 user nova-compute[75341]:     </arch>
Nov 14 23:35:45 user nova-compute[75341]:     <features>
Nov 14 23:35:45 user nova-compute[75341]:       <cpuselection/>
Nov 14 23:35:45 user nova-compute[75341]:       <deviceboot/>
Nov 14 23:35:45 user nova-compute[75341]:       <disksnapshot default='on' toggle='no'/>
Nov 14 23:35:45 user nova-compute[75341]:     </features>
Nov 14 23:35:45 user nova-compute[75341]:   </guest>
Nov 14 23:35:45 user nova-compute[75341]:   <guest>
Nov 14 23:35:45 user nova-compute[75341]:     <os_type>hvm</os_type>
Nov 14 23:35:45 user nova-compute[75341]:     <arch name='microblazeel'>
Nov 14 23:35:45 user nova-compute[75341]:       <wordsize>32</wordsize>
Nov 14 23:35:45 user nova-compute[75341]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <domain type='qemu'/>
Nov 14 23:35:45 user nova-compute[75341]:     </arch>
Nov 14 23:35:45 user nova-compute[75341]:     <features>
Nov 14 23:35:45 user nova-compute[75341]:       <cpuselection/>
Nov 14 23:35:45 user nova-compute[75341]:       <deviceboot/>
Nov 14 23:35:45 user nova-compute[75341]:       <disksnapshot default='on' toggle='no'/>
Nov 14 23:35:45 user nova-compute[75341]:     </features>
Nov 14 23:35:45 user nova-compute[75341]:   </guest>
Nov 14 23:35:45 user nova-compute[75341]:   <guest>
Nov 14 23:35:45 user nova-compute[75341]:     <os_type>hvm</os_type>
Nov 14 23:35:45 user nova-compute[75341]:     <arch name='mips'>
Nov 14 23:35:45 user nova-compute[75341]:       <wordsize>32</wordsize>
Nov 14 23:35:45 user nova-compute[75341]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='16'>malta</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>mipssim</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <domain type='qemu'/>
Nov 14 23:35:45 user nova-compute[75341]:     </arch>
Nov 14 23:35:45 user nova-compute[75341]:     <features>
Nov 14 23:35:45 user nova-compute[75341]:       <cpuselection/>
Nov 14 23:35:45 user nova-compute[75341]:       <deviceboot/>
Nov 14 23:35:45 user nova-compute[75341]:       <disksnapshot default='on' toggle='no'/>
Nov 14 23:35:45 user nova-compute[75341]:     </features>
Nov 14 23:35:45 user nova-compute[75341]:   </guest>
Nov 14 23:35:45 user nova-compute[75341]:   <guest>
Nov 14 23:35:45 user nova-compute[75341]:     <os_type>hvm</os_type>
Nov 14 23:35:45 user nova-compute[75341]:     <arch name='mipsel'>
Nov 14 23:35:45 user nova-compute[75341]:       <wordsize>32</wordsize>
Nov 14 23:35:45 user nova-compute[75341]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='16'>malta</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>mipssim</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <domain type='qemu'/>
Nov 14 23:35:45 user nova-compute[75341]:     </arch>
Nov 14 23:35:45 user nova-compute[75341]:     <features>
Nov 14 23:35:45 user nova-compute[75341]:       <cpuselection/>
Nov 14 23:35:45 user nova-compute[75341]:       <deviceboot/>
Nov 14 23:35:45 user nova-compute[75341]:       <disksnapshot default='on' toggle='no'/>
Nov 14 23:35:45 user nova-compute[75341]:     </features>
Nov 14 23:35:45 user nova-compute[75341]:   </guest>
Nov 14 23:35:45 user nova-compute[75341]:   <guest>
Nov 14 23:35:45 user nova-compute[75341]:     <os_type>hvm</os_type>
Nov 14 23:35:45 user nova-compute[75341]:     <arch name='mips64'>
Nov 14 23:35:45 user nova-compute[75341]:       <wordsize>64</wordsize>
Nov 14 23:35:45 user nova-compute[75341]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='16'>malta</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>mipssim</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>pica61</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>magnum</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <domain type='qemu'/>
Nov 14 23:35:45 user nova-compute[75341]:     </arch>
Nov 14 23:35:45 user nova-compute[75341]:     <features>
Nov 14 23:35:45 user nova-compute[75341]:       <cpuselection/>
Nov 14 23:35:45 user nova-compute[75341]:       <deviceboot/>
Nov 14 23:35:45 user nova-compute[75341]:       <disksnapshot default='on' toggle='no'/>
Nov 14 23:35:45 user nova-compute[75341]:     </features>
Nov 14 23:35:45 user nova-compute[75341]:   </guest>
Nov 14 23:35:45 user nova-compute[75341]:   <guest>
Nov 14 23:35:45 user nova-compute[75341]:     <os_type>hvm</os_type>
Nov 14 23:35:45 user nova-compute[75341]:     <arch name='mips64el'>
Nov 14 23:35:45 user nova-compute[75341]:       <wordsize>64</wordsize>
Nov 14 23:35:45 user nova-compute[75341]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='16'>malta</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>mipssim</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>pica61</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>magnum</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='16'>boston</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <domain type='qemu'/>
Nov 14 23:35:45 user nova-compute[75341]:     </arch>
Nov 14 23:35:45 user nova-compute[75341]:     <features>
Nov 14 23:35:45 user nova-compute[75341]:       <cpuselection/>
Nov 14 23:35:45 user nova-compute[75341]:       <deviceboot/>
Nov 14 23:35:45 user nova-compute[75341]:       <disksnapshot default='on' toggle='no'/>
Nov 14 23:35:45 user nova-compute[75341]:     </features>
Nov 14 23:35:45 user nova-compute[75341]:   </guest>
Nov 14 23:35:45 user nova-compute[75341]:   <guest>
Nov 14 23:35:45 user nova-compute[75341]:     <os_type>hvm</os_type>
Nov 14 23:35:45 user nova-compute[75341]:     <arch name='ppc'>
Nov 14 23:35:45 user nova-compute[75341]:       <wordsize>32</wordsize>
Nov 14 23:35:45 user nova-compute[75341]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>g3beige</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>mac99</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='32'>ppce500</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>pegasos2</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>sam460ex</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>bamboo</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>40p</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>ref405ep</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>taihu</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <domain type='qemu'/>
Nov 14 23:35:45 user nova-compute[75341]:     </arch>
Nov 14 23:35:45 user nova-compute[75341]:     <features>
Nov 14 23:35:45 user nova-compute[75341]:       <cpuselection/>
Nov 14 23:35:45 user nova-compute[75341]:       <deviceboot/>
Nov 14 23:35:45 user nova-compute[75341]:       <disksnapshot default='on' toggle='no'/>
Nov 14 23:35:45 user nova-compute[75341]:     </features>
Nov 14 23:35:45 user nova-compute[75341]:   </guest>
Nov 14 23:35:45 user nova-compute[75341]:   <guest>
Nov 14 23:35:45 user nova-compute[75341]:     <os_type>hvm</os_type>
Nov 14 23:35:45 user nova-compute[75341]:     <arch name='ppc64'>
Nov 14 23:35:45 user nova-compute[75341]:       <wordsize>64</wordsize>
Nov 14 23:35:45 user nova-compute[75341]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2048'>powernv9</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>taihu</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2048'>powernv10</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='32'>ppce500</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>40p</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>pegasos2</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>bamboo</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>g3beige</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>mac99</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>sam460ex</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>ref405ep</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2048'>powernv8</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <domain type='qemu'/>
Nov 14 23:35:45 user nova-compute[75341]:     </arch>
Nov 14 23:35:45 user nova-compute[75341]:     <features>
Nov 14 23:35:45 user nova-compute[75341]:       <cpuselection/>
Nov 14 23:35:45 user nova-compute[75341]:       <deviceboot/>
Nov 14 23:35:45 user nova-compute[75341]:       <disksnapshot default='on' toggle='no'/>
Nov 14 23:35:45 user nova-compute[75341]:     </features>
Nov 14 23:35:45 user nova-compute[75341]:   </guest>
Nov 14 23:35:45 user nova-compute[75341]:   <guest>
Nov 14 23:35:45 user nova-compute[75341]:     <os_type>hvm</os_type>
Nov 14 23:35:45 user nova-compute[75341]:     <arch name='ppc64le'>
Nov 14 23:35:45 user nova-compute[75341]:       <wordsize>64</wordsize>
Nov 14 23:35:45 user nova-compute[75341]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2048'>powernv9</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>taihu</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2048'>powernv10</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='32'>ppce500</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>40p</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>pegasos2</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>bamboo</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>g3beige</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>mac99</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>sam460ex</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>ref405ep</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2048'>powernv8</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <domain type='qemu'/>
Nov 14 23:35:45 user nova-compute[75341]:     </arch>
Nov 14 23:35:45 user nova-compute[75341]:     <features>
Nov 14 23:35:45 user nova-compute[75341]:       <cpuselection/>
Nov 14 23:35:45 user nova-compute[75341]:       <deviceboot/>
Nov 14 23:35:45 user nova-compute[75341]:       <disksnapshot default='on' toggle='no'/>
Nov 14 23:35:45 user nova-compute[75341]:     </features>
Nov 14 23:35:45 user nova-compute[75341]:   </guest>
Nov 14 23:35:45 user nova-compute[75341]:   <guest>
Nov 14 23:35:45 user nova-compute[75341]:     <os_type>hvm</os_type>
Nov 14 23:35:45 user nova-compute[75341]:     <arch name='riscv32'>
Nov 14 23:35:45 user nova-compute[75341]:       <wordsize>32</wordsize>
Nov 14 23:35:45 user nova-compute[75341]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='8'>spike</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>opentitan</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='5'>sifive_u</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>sifive_e</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='8'>virt</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <domain type='qemu'/>
Nov 14 23:35:45 user nova-compute[75341]:     </arch>
Nov 14 23:35:45 user nova-compute[75341]:     <features>
Nov 14 23:35:45 user nova-compute[75341]:       <cpuselection/>
Nov 14 23:35:45 user nova-compute[75341]:       <deviceboot/>
Nov 14 23:35:45 user nova-compute[75341]:       <disksnapshot default='on' toggle='no'/>
Nov 14 23:35:45 user nova-compute[75341]:     </features>
Nov 14 23:35:45 user nova-compute[75341]:   </guest>
Nov 14 23:35:45 user nova-compute[75341]:   <guest>
Nov 14 23:35:45 user nova-compute[75341]:     <os_type>hvm</os_type>
Nov 14 23:35:45 user nova-compute[75341]:     <arch name='riscv64'>
Nov 14 23:35:45 user nova-compute[75341]:       <wordsize>64</wordsize>
Nov 14 23:35:45 user nova-compute[75341]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='8'>spike</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='5'>sifive_u</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>shakti_c</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>sifive_e</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='8'>virt</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <domain type='qemu'/>
Nov 14 23:35:45 user nova-compute[75341]:     </arch>
Nov 14 23:35:45 user nova-compute[75341]:     <features>
Nov 14 23:35:45 user nova-compute[75341]:       <cpuselection/>
Nov 14 23:35:45 user nova-compute[75341]:       <deviceboot/>
Nov 14 23:35:45 user nova-compute[75341]:       <disksnapshot default='on' toggle='no'/>
Nov 14 23:35:45 user nova-compute[75341]:     </features>
Nov 14 23:35:45 user nova-compute[75341]:   </guest>
Nov 14 23:35:45 user nova-compute[75341]:   <guest>
Nov 14 23:35:45 user nova-compute[75341]:     <os_type>hvm</os_type>
Nov 14 23:35:45 user nova-compute[75341]:     <arch name='s390x'>
Nov 14 23:35:45 user nova-compute[75341]:       <wordsize>64</wordsize>
Nov 14 23:35:45 user nova-compute[75341]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <domain type='qemu'/>
Nov 14 23:35:45 user nova-compute[75341]:     </arch>
Nov 14 23:35:45 user nova-compute[75341]:     <features>
Nov 14 23:35:45 user nova-compute[75341]:       <cpuselection/>
Nov 14 23:35:45 user nova-compute[75341]:       <deviceboot/>
Nov 14 23:35:45 user nova-compute[75341]:       <disksnapshot default='on' toggle='no'/>
Nov 14 23:35:45 user nova-compute[75341]:     </features>
Nov 14 23:35:45 user nova-compute[75341]:   </guest>
Nov 14 23:35:45 user nova-compute[75341]:   <guest>
Nov 14 23:35:45 user nova-compute[75341]:     <os_type>hvm</os_type>
Nov 14 23:35:45 user nova-compute[75341]:     <arch name='sh4'>
Nov 14 23:35:45 user nova-compute[75341]:       <wordsize>32</wordsize>
Nov 14 23:35:45 user nova-compute[75341]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>shix</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>r2d</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <domain type='qemu'/>
Nov 14 23:35:45 user nova-compute[75341]:     </arch>
Nov 14 23:35:45 user nova-compute[75341]:     <features>
Nov 14 23:35:45 user nova-compute[75341]:       <cpuselection/>
Nov 14 23:35:45 user nova-compute[75341]:       <deviceboot/>
Nov 14 23:35:45 user nova-compute[75341]:       <disksnapshot default='on' toggle='no'/>
Nov 14 23:35:45 user nova-compute[75341]:     </features>
Nov 14 23:35:45 user nova-compute[75341]:   </guest>
Nov 14 23:35:45 user nova-compute[75341]:   <guest>
Nov 14 23:35:45 user nova-compute[75341]:     <os_type>hvm</os_type>
Nov 14 23:35:45 user nova-compute[75341]:     <arch name='sh4eb'>
Nov 14 23:35:45 user nova-compute[75341]:       <wordsize>64</wordsize>
Nov 14 23:35:45 user nova-compute[75341]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>shix</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>r2d</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <domain type='qemu'/>
Nov 14 23:35:45 user nova-compute[75341]:     </arch>
Nov 14 23:35:45 user nova-compute[75341]:     <features>
Nov 14 23:35:45 user nova-compute[75341]:       <cpuselection/>
Nov 14 23:35:45 user nova-compute[75341]:       <deviceboot/>
Nov 14 23:35:45 user nova-compute[75341]:       <disksnapshot default='on' toggle='no'/>
Nov 14 23:35:45 user nova-compute[75341]:     </features>
Nov 14 23:35:45 user nova-compute[75341]:   </guest>
Nov 14 23:35:45 user nova-compute[75341]:   <guest>
Nov 14 23:35:45 user nova-compute[75341]:     <os_type>hvm</os_type>
Nov 14 23:35:45 user nova-compute[75341]:     <arch name='sparc'>
Nov 14 23:35:45 user nova-compute[75341]:       <wordsize>32</wordsize>
Nov 14 23:35:45 user nova-compute[75341]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>SS-5</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='4'>SS-20</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>LX</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>SS-4</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='4'>SS-10</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>Voyager</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <domain type='qemu'/>
Nov 14 23:35:45 user nova-compute[75341]:     </arch>
Nov 14 23:35:45 user nova-compute[75341]:     <features>
Nov 14 23:35:45 user nova-compute[75341]:       <cpuselection/>
Nov 14 23:35:45 user nova-compute[75341]:       <deviceboot/>
Nov 14 23:35:45 user nova-compute[75341]:       <disksnapshot default='on' toggle='no'/>
Nov 14 23:35:45 user nova-compute[75341]:     </features>
Nov 14 23:35:45 user nova-compute[75341]:   </guest>
Nov 14 23:35:45 user nova-compute[75341]:   <guest>
Nov 14 23:35:45 user nova-compute[75341]:     <os_type>hvm</os_type>
Nov 14 23:35:45 user nova-compute[75341]:     <arch name='sparc64'>
Nov 14 23:35:45 user nova-compute[75341]:       <wordsize>64</wordsize>
Nov 14 23:35:45 user nova-compute[75341]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>sun4u</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>niagara</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>sun4v</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <domain type='qemu'/>
Nov 14 23:35:45 user nova-compute[75341]:     </arch>
Nov 14 23:35:45 user nova-compute[75341]:     <features>
Nov 14 23:35:45 user nova-compute[75341]:       <cpuselection/>
Nov 14 23:35:45 user nova-compute[75341]:       <deviceboot/>
Nov 14 23:35:45 user nova-compute[75341]:       <disksnapshot default='on' toggle='no'/>
Nov 14 23:35:45 user nova-compute[75341]:     </features>
Nov 14 23:35:45 user nova-compute[75341]:   </guest>
Nov 14 23:35:45 user nova-compute[75341]:   <guest>
Nov 14 23:35:45 user nova-compute[75341]:     <os_type>hvm</os_type>
Nov 14 23:35:45 user nova-compute[75341]:     <arch name='x86_64'>
Nov 14 23:35:45 user nova-compute[75341]:       <wordsize>64</wordsize>
Nov 14 23:35:45 user nova-compute[75341]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>x-remote</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='1'>isapc</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>microvm</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <domain type='qemu'/>
Nov 14 23:35:45 user nova-compute[75341]:       <domain type='kvm'/>
Nov 14 23:35:45 user nova-compute[75341]:     </arch>
Nov 14 23:35:45 user nova-compute[75341]:     <features>
Nov 14 23:35:45 user nova-compute[75341]:       <acpi default='on' toggle='yes'/>
Nov 14 23:35:45 user nova-compute[75341]:       <apic default='on' toggle='no'/>
Nov 14 23:35:45 user nova-compute[75341]:       <cpuselection/>
Nov 14 23:35:45 user nova-compute[75341]:       <deviceboot/>
Nov 14 23:35:45 user nova-compute[75341]:       <disksnapshot default='on' toggle='no'/>
Nov 14 23:35:45 user nova-compute[75341]:     </features>
Nov 14 23:35:45 user nova-compute[75341]:   </guest>
Nov 14 23:35:45 user nova-compute[75341]:   <guest>
Nov 14 23:35:45 user nova-compute[75341]:     <os_type>hvm</os_type>
Nov 14 23:35:45 user nova-compute[75341]:     <arch name='xtensa'>
Nov 14 23:35:45 user nova-compute[75341]:       <wordsize>32</wordsize>
Nov 14 23:35:45 user nova-compute[75341]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='4'>sim</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='32'>kc705</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='32'>ml605</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='32'>virt</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='32'>lx200</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='32'>lx60</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <domain type='qemu'/>
Nov 14 23:35:45 user nova-compute[75341]:     </arch>
Nov 14 23:35:45 user nova-compute[75341]:     <features>
Nov 14 23:35:45 user nova-compute[75341]:       <cpuselection/>
Nov 14 23:35:45 user nova-compute[75341]:       <deviceboot/>
Nov 14 23:35:45 user nova-compute[75341]:       <disksnapshot default='on' toggle='no'/>
Nov 14 23:35:45 user nova-compute[75341]:     </features>
Nov 14 23:35:45 user nova-compute[75341]:   </guest>
Nov 14 23:35:45 user nova-compute[75341]:   <guest>
Nov 14 23:35:45 user nova-compute[75341]:     <os_type>hvm</os_type>
Nov 14 23:35:45 user nova-compute[75341]:     <arch name='xtensaeb'>
Nov 14 23:35:45 user nova-compute[75341]:       <wordsize>32</wordsize>
Nov 14 23:35:45 user nova-compute[75341]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='4'>sim</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='32'>kc705</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='32'>ml605</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='32'>virt</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='32'>lx200</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='32'>lx60</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 14 23:35:45 user nova-compute[75341]:       <domain type='qemu'/>
Nov 14 23:35:45 user nova-compute[75341]:     </arch>
Nov 14 23:35:45 user nova-compute[75341]:     <features>
Nov 14 23:35:45 user nova-compute[75341]:       <cpuselection/>
Nov 14 23:35:45 user nova-compute[75341]:       <deviceboot/>
Nov 14 23:35:45 user nova-compute[75341]:       <disksnapshot default='on' toggle='no'/>
Nov 14 23:35:45 user nova-compute[75341]:     </features>
Nov 14 23:35:45 user nova-compute[75341]:   </guest>
Nov 14 23:35:45 user nova-compute[75341]: </capabilities>
Nov 14 23:35:45 user nova-compute[75341]: 
Nov 14 23:35:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75341) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 23:35:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75341) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 23:35:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=75341) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 23:35:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75341) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 23:35:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75341) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 23:35:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75341) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 23:35:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75341) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 23:35:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75341) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 23:35:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75341) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 23:35:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75341) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 23:35:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75341) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 23:35:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'q35', 'pc', 'ubuntu-q35'} {{(pid=75341) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 23:35:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 14 23:35:45 user nova-compute[75341]: <domainCapabilities>
Nov 14 23:35:45 user nova-compute[75341]:   <path>/usr/bin/qemu-system-i386</path>
Nov 14 23:35:45 user nova-compute[75341]:   <domain>kvm</domain>
Nov 14 23:35:45 user nova-compute[75341]:   <machine>pc-i440fx-jammy</machine>
Nov 14 23:35:45 user nova-compute[75341]:   <arch>i686</arch>
Nov 14 23:35:45 user nova-compute[75341]:   <vcpu max='255'/>
Nov 14 23:35:45 user nova-compute[75341]:   <iothreads supported='yes'/>
Nov 14 23:35:45 user nova-compute[75341]:   <os supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:     <enum name='firmware'/>
Nov 14 23:35:45 user nova-compute[75341]:     <loader supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 14 23:35:45 user nova-compute[75341]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 14 23:35:45 user nova-compute[75341]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 14 23:35:45 user nova-compute[75341]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 14 23:35:45 user nova-compute[75341]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='type'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>rom</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>pflash</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='readonly'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>yes</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>no</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='secure'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>no</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </loader>
Nov 14 23:35:45 user nova-compute[75341]:   </os>
Nov 14 23:35:45 user nova-compute[75341]:   <cpu>
Nov 14 23:35:45 user nova-compute[75341]:     <mode name='host-passthrough' supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='hostPassthroughMigratable'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>off</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </mode>
Nov 14 23:35:45 user nova-compute[75341]:     <mode name='maximum' supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='maximumMigratable'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>on</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>off</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </mode>
Nov 14 23:35:45 user nova-compute[75341]:     <mode name='host-model' supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <vendor>Intel</vendor>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='ss'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='vmx'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='pcid'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='hypervisor'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='arat'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='umip'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='md-clear'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='stibp'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='ssbd'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='ibpb'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='ibrs'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='amd-stibp'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='disable' name='erms'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='disable' name='lm'/>
Nov 14 23:35:45 user nova-compute[75341]:     </mode>
Nov 14 23:35:45 user nova-compute[75341]:     <mode name='custom' supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>qemu64</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>qemu32</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>phenom</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>pentium3</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>pentium2</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>pentium</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>n270</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>kvm64</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>kvm32</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>coreduo</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>core2duo</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>athlon</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Westmere-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Westmere</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Snowridge</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Skylake-Server</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Skylake-Client</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>SandyBridge</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Penryn</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Opteron_G5</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Opteron_G4</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Opteron_G3</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Opteron_G2</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Opteron_G1</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Nehalem-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Nehalem</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>IvyBridge</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Icelake-Server</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Haswell</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>EPYC-Rome</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>EPYC-Milan</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>EPYC</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Dhyana</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Cooperlake</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Conroe</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Broadwell</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>486</model>
Nov 14 23:35:45 user nova-compute[75341]:     </mode>
Nov 14 23:35:45 user nova-compute[75341]:   </cpu>
Nov 14 23:35:45 user nova-compute[75341]:   <memoryBacking supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:     <enum name='sourceType'>
Nov 14 23:35:45 user nova-compute[75341]:       <value>file</value>
Nov 14 23:35:45 user nova-compute[75341]:       <value>anonymous</value>
Nov 14 23:35:45 user nova-compute[75341]:       <value>memfd</value>
Nov 14 23:35:45 user nova-compute[75341]:     </enum>
Nov 14 23:35:45 user nova-compute[75341]:   </memoryBacking>
Nov 14 23:35:45 user nova-compute[75341]:   <devices>
Nov 14 23:35:45 user nova-compute[75341]:     <disk supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='diskDevice'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>disk</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>cdrom</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>floppy</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>lun</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='bus'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>ide</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>fdc</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>scsi</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtio</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>usb</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>sata</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='model'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtio</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtio-transitional</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtio-non-transitional</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </disk>
Nov 14 23:35:45 user nova-compute[75341]:     <graphics supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='type'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>sdl</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>vnc</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>spice</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>egl-headless</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </graphics>
Nov 14 23:35:45 user nova-compute[75341]:     <video supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='modelType'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>vga</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>cirrus</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>vmvga</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>qxl</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtio</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>none</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>bochs</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>ramfb</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </video>
Nov 14 23:35:45 user nova-compute[75341]:     <hostdev supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='mode'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>subsystem</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='startupPolicy'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>default</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>mandatory</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>requisite</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>optional</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='subsysType'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>usb</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>pci</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>scsi</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='capsType'/>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='pciBackend'/>
Nov 14 23:35:45 user nova-compute[75341]:     </hostdev>
Nov 14 23:35:45 user nova-compute[75341]:     <rng supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='model'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtio</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtio-transitional</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtio-non-transitional</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='backendModel'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>random</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>egd</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>builtin</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </rng>
Nov 14 23:35:45 user nova-compute[75341]:     <filesystem supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='driverType'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>path</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>handle</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtiofs</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </filesystem>
Nov 14 23:35:45 user nova-compute[75341]:     <tpm supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='model'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>tpm-tis</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>tpm-crb</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='backendModel'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>passthrough</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>emulator</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </tpm>
Nov 14 23:35:45 user nova-compute[75341]:   </devices>
Nov 14 23:35:45 user nova-compute[75341]:   <features>
Nov 14 23:35:45 user nova-compute[75341]:     <gic supported='no'/>
Nov 14 23:35:45 user nova-compute[75341]:     <vmcoreinfo supported='yes'/>
Nov 14 23:35:45 user nova-compute[75341]:     <genid supported='yes'/>
Nov 14 23:35:45 user nova-compute[75341]:     <backingStoreInput supported='yes'/>
Nov 14 23:35:45 user nova-compute[75341]:     <backup supported='yes'/>
Nov 14 23:35:45 user nova-compute[75341]:     <sev supported='no'/>
Nov 14 23:35:45 user nova-compute[75341]:   </features>
Nov 14 23:35:45 user nova-compute[75341]: </domainCapabilities>
Nov 14 23:35:45 user nova-compute[75341]:  {{(pid=75341) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 23:35:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 14 23:35:45 user nova-compute[75341]: <domainCapabilities>
Nov 14 23:35:45 user nova-compute[75341]:   <path>/usr/bin/qemu-system-i386</path>
Nov 14 23:35:45 user nova-compute[75341]:   <domain>kvm</domain>
Nov 14 23:35:45 user nova-compute[75341]:   <machine>pc-q35-6.2</machine>
Nov 14 23:35:45 user nova-compute[75341]:   <arch>i686</arch>
Nov 14 23:35:45 user nova-compute[75341]:   <vcpu max='288'/>
Nov 14 23:35:45 user nova-compute[75341]:   <iothreads supported='yes'/>
Nov 14 23:35:45 user nova-compute[75341]:   <os supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:     <enum name='firmware'/>
Nov 14 23:35:45 user nova-compute[75341]:     <loader supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 14 23:35:45 user nova-compute[75341]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 14 23:35:45 user nova-compute[75341]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 14 23:35:45 user nova-compute[75341]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 14 23:35:45 user nova-compute[75341]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='type'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>rom</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>pflash</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='readonly'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>yes</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>no</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='secure'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>no</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </loader>
Nov 14 23:35:45 user nova-compute[75341]:   </os>
Nov 14 23:35:45 user nova-compute[75341]:   <cpu>
Nov 14 23:35:45 user nova-compute[75341]:     <mode name='host-passthrough' supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='hostPassthroughMigratable'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>off</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </mode>
Nov 14 23:35:45 user nova-compute[75341]:     <mode name='maximum' supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='maximumMigratable'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>on</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>off</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </mode>
Nov 14 23:35:45 user nova-compute[75341]:     <mode name='host-model' supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <vendor>Intel</vendor>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='ss'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='vmx'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='pcid'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='hypervisor'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='arat'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='umip'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='md-clear'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='stibp'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='ssbd'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='ibpb'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='ibrs'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='amd-stibp'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='disable' name='erms'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='disable' name='lm'/>
Nov 14 23:35:45 user nova-compute[75341]:     </mode>
Nov 14 23:35:45 user nova-compute[75341]:     <mode name='custom' supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>qemu64</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>qemu32</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>phenom</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>pentium3</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>pentium2</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>pentium</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>n270</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>kvm64</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>kvm32</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>coreduo</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>core2duo</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>athlon</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Westmere-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Westmere</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Snowridge</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Skylake-Server</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Skylake-Client</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>SandyBridge</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Penryn</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Opteron_G5</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Opteron_G4</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Opteron_G3</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Opteron_G2</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Opteron_G1</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Nehalem-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Nehalem</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>IvyBridge</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Icelake-Server</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Haswell</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>EPYC-Rome</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>EPYC-Milan</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>EPYC</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Dhyana</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Cooperlake</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Conroe</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Broadwell</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>486</model>
Nov 14 23:35:45 user nova-compute[75341]:     </mode>
Nov 14 23:35:45 user nova-compute[75341]:   </cpu>
Nov 14 23:35:45 user nova-compute[75341]:   <memoryBacking supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:     <enum name='sourceType'>
Nov 14 23:35:45 user nova-compute[75341]:       <value>file</value>
Nov 14 23:35:45 user nova-compute[75341]:       <value>anonymous</value>
Nov 14 23:35:45 user nova-compute[75341]:       <value>memfd</value>
Nov 14 23:35:45 user nova-compute[75341]:     </enum>
Nov 14 23:35:45 user nova-compute[75341]:   </memoryBacking>
Nov 14 23:35:45 user nova-compute[75341]:   <devices>
Nov 14 23:35:45 user nova-compute[75341]:     <disk supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='diskDevice'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>disk</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>cdrom</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>floppy</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>lun</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='bus'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>fdc</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>scsi</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtio</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>usb</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>sata</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='model'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtio</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtio-transitional</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtio-non-transitional</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </disk>
Nov 14 23:35:45 user nova-compute[75341]:     <graphics supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='type'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>sdl</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>vnc</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>spice</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>egl-headless</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </graphics>
Nov 14 23:35:45 user nova-compute[75341]:     <video supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='modelType'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>vga</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>cirrus</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>vmvga</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>qxl</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtio</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>none</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>bochs</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>ramfb</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </video>
Nov 14 23:35:45 user nova-compute[75341]:     <hostdev supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='mode'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>subsystem</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='startupPolicy'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>default</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>mandatory</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>requisite</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>optional</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='subsysType'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>usb</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>pci</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>scsi</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='capsType'/>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='pciBackend'/>
Nov 14 23:35:45 user nova-compute[75341]:     </hostdev>
Nov 14 23:35:45 user nova-compute[75341]:     <rng supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='model'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtio</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtio-transitional</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtio-non-transitional</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='backendModel'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>random</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>egd</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>builtin</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </rng>
Nov 14 23:35:45 user nova-compute[75341]:     <filesystem supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='driverType'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>path</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>handle</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtiofs</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </filesystem>
Nov 14 23:35:45 user nova-compute[75341]:     <tpm supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='model'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>tpm-tis</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>tpm-crb</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='backendModel'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>passthrough</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>emulator</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </tpm>
Nov 14 23:35:45 user nova-compute[75341]:   </devices>
Nov 14 23:35:45 user nova-compute[75341]:   <features>
Nov 14 23:35:45 user nova-compute[75341]:     <gic supported='no'/>
Nov 14 23:35:45 user nova-compute[75341]:     <vmcoreinfo supported='yes'/>
Nov 14 23:35:45 user nova-compute[75341]:     <genid supported='yes'/>
Nov 14 23:35:45 user nova-compute[75341]:     <backingStoreInput supported='yes'/>
Nov 14 23:35:45 user nova-compute[75341]:     <backup supported='yes'/>
Nov 14 23:35:45 user nova-compute[75341]:     <sev supported='no'/>
Nov 14 23:35:45 user nova-compute[75341]:   </features>
Nov 14 23:35:45 user nova-compute[75341]: </domainCapabilities>
Nov 14 23:35:45 user nova-compute[75341]:  {{(pid=75341) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 23:35:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 14 23:35:45 user nova-compute[75341]: <domainCapabilities>
Nov 14 23:35:45 user nova-compute[75341]:   <path>/usr/bin/qemu-system-i386</path>
Nov 14 23:35:45 user nova-compute[75341]:   <domain>kvm</domain>
Nov 14 23:35:45 user nova-compute[75341]:   <machine>pc-i440fx-6.2</machine>
Nov 14 23:35:45 user nova-compute[75341]:   <arch>i686</arch>
Nov 14 23:35:45 user nova-compute[75341]:   <vcpu max='255'/>
Nov 14 23:35:45 user nova-compute[75341]:   <iothreads supported='yes'/>
Nov 14 23:35:45 user nova-compute[75341]:   <os supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:     <enum name='firmware'/>
Nov 14 23:35:45 user nova-compute[75341]:     <loader supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 14 23:35:45 user nova-compute[75341]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 14 23:35:45 user nova-compute[75341]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 14 23:35:45 user nova-compute[75341]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 14 23:35:45 user nova-compute[75341]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='type'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>rom</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>pflash</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='readonly'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>yes</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>no</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='secure'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>no</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </loader>
Nov 14 23:35:45 user nova-compute[75341]:   </os>
Nov 14 23:35:45 user nova-compute[75341]:   <cpu>
Nov 14 23:35:45 user nova-compute[75341]:     <mode name='host-passthrough' supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='hostPassthroughMigratable'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>off</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </mode>
Nov 14 23:35:45 user nova-compute[75341]:     <mode name='maximum' supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='maximumMigratable'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>on</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>off</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </mode>
Nov 14 23:35:45 user nova-compute[75341]:     <mode name='host-model' supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <vendor>Intel</vendor>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='ss'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='vmx'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='pcid'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='hypervisor'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='arat'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='umip'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='md-clear'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='stibp'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='ssbd'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='ibpb'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='ibrs'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='amd-stibp'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='disable' name='erms'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='disable' name='lm'/>
Nov 14 23:35:45 user nova-compute[75341]:     </mode>
Nov 14 23:35:45 user nova-compute[75341]:     <mode name='custom' supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>qemu64</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>qemu32</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>phenom</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>pentium3</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>pentium2</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>pentium</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>n270</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>kvm64</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>kvm32</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>coreduo</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>core2duo</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>athlon</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Westmere-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Westmere</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Snowridge</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Skylake-Server</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Skylake-Client</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>SandyBridge</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Penryn</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Opteron_G5</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Opteron_G4</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Opteron_G3</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Opteron_G2</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Opteron_G1</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Nehalem-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Nehalem</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>IvyBridge</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Icelake-Server</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Haswell</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>EPYC-Rome</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>EPYC-Milan</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>EPYC</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Dhyana</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Cooperlake</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Conroe</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Broadwell</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>486</model>
Nov 14 23:35:45 user nova-compute[75341]:     </mode>
Nov 14 23:35:45 user nova-compute[75341]:   </cpu>
Nov 14 23:35:45 user nova-compute[75341]:   <memoryBacking supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:     <enum name='sourceType'>
Nov 14 23:35:45 user nova-compute[75341]:       <value>file</value>
Nov 14 23:35:45 user nova-compute[75341]:       <value>anonymous</value>
Nov 14 23:35:45 user nova-compute[75341]:       <value>memfd</value>
Nov 14 23:35:45 user nova-compute[75341]:     </enum>
Nov 14 23:35:45 user nova-compute[75341]:   </memoryBacking>
Nov 14 23:35:45 user nova-compute[75341]:   <devices>
Nov 14 23:35:45 user nova-compute[75341]:     <disk supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='diskDevice'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>disk</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>cdrom</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>floppy</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>lun</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='bus'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>ide</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>fdc</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>scsi</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtio</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>usb</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>sata</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='model'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtio</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtio-transitional</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtio-non-transitional</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </disk>
Nov 14 23:35:45 user nova-compute[75341]:     <graphics supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='type'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>sdl</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>vnc</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>spice</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>egl-headless</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </graphics>
Nov 14 23:35:45 user nova-compute[75341]:     <video supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='modelType'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>vga</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>cirrus</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>vmvga</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>qxl</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtio</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>none</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>bochs</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>ramfb</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </video>
Nov 14 23:35:45 user nova-compute[75341]:     <hostdev supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='mode'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>subsystem</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='startupPolicy'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>default</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>mandatory</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>requisite</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>optional</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='subsysType'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>usb</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>pci</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>scsi</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='capsType'/>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='pciBackend'/>
Nov 14 23:35:45 user nova-compute[75341]:     </hostdev>
Nov 14 23:35:45 user nova-compute[75341]:     <rng supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='model'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtio</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtio-transitional</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtio-non-transitional</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='backendModel'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>random</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>egd</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>builtin</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </rng>
Nov 14 23:35:45 user nova-compute[75341]:     <filesystem supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='driverType'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>path</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>handle</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtiofs</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </filesystem>
Nov 14 23:35:45 user nova-compute[75341]:     <tpm supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='model'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>tpm-tis</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>tpm-crb</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='backendModel'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>passthrough</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>emulator</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </tpm>
Nov 14 23:35:45 user nova-compute[75341]:   </devices>
Nov 14 23:35:45 user nova-compute[75341]:   <features>
Nov 14 23:35:45 user nova-compute[75341]:     <gic supported='no'/>
Nov 14 23:35:45 user nova-compute[75341]:     <vmcoreinfo supported='yes'/>
Nov 14 23:35:45 user nova-compute[75341]:     <genid supported='yes'/>
Nov 14 23:35:45 user nova-compute[75341]:     <backingStoreInput supported='yes'/>
Nov 14 23:35:45 user nova-compute[75341]:     <backup supported='yes'/>
Nov 14 23:35:45 user nova-compute[75341]:     <sev supported='no'/>
Nov 14 23:35:45 user nova-compute[75341]:   </features>
Nov 14 23:35:45 user nova-compute[75341]: </domainCapabilities>
Nov 14 23:35:45 user nova-compute[75341]:  {{(pid=75341) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 23:35:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 14 23:35:45 user nova-compute[75341]: <domainCapabilities>
Nov 14 23:35:45 user nova-compute[75341]:   <path>/usr/bin/qemu-system-i386</path>
Nov 14 23:35:45 user nova-compute[75341]:   <domain>kvm</domain>
Nov 14 23:35:45 user nova-compute[75341]:   <machine>pc-q35-jammy</machine>
Nov 14 23:35:45 user nova-compute[75341]:   <arch>i686</arch>
Nov 14 23:35:45 user nova-compute[75341]:   <vcpu max='288'/>
Nov 14 23:35:45 user nova-compute[75341]:   <iothreads supported='yes'/>
Nov 14 23:35:45 user nova-compute[75341]:   <os supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:     <enum name='firmware'/>
Nov 14 23:35:45 user nova-compute[75341]:     <loader supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 14 23:35:45 user nova-compute[75341]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 14 23:35:45 user nova-compute[75341]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 14 23:35:45 user nova-compute[75341]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 14 23:35:45 user nova-compute[75341]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='type'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>rom</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>pflash</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='readonly'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>yes</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>no</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='secure'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>no</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </loader>
Nov 14 23:35:45 user nova-compute[75341]:   </os>
Nov 14 23:35:45 user nova-compute[75341]:   <cpu>
Nov 14 23:35:45 user nova-compute[75341]:     <mode name='host-passthrough' supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='hostPassthroughMigratable'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>off</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </mode>
Nov 14 23:35:45 user nova-compute[75341]:     <mode name='maximum' supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='maximumMigratable'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>on</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>off</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </mode>
Nov 14 23:35:45 user nova-compute[75341]:     <mode name='host-model' supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <vendor>Intel</vendor>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='ss'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='vmx'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='pcid'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='hypervisor'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='arat'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='umip'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='md-clear'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='stibp'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='ssbd'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='ibpb'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='ibrs'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='amd-stibp'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='disable' name='erms'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='disable' name='lm'/>
Nov 14 23:35:45 user nova-compute[75341]:     </mode>
Nov 14 23:35:45 user nova-compute[75341]:     <mode name='custom' supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>qemu64</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>qemu32</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>phenom</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>pentium3</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>pentium2</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>pentium</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>n270</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>kvm64</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>kvm32</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>coreduo</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>core2duo</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>athlon</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Westmere-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Westmere</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Snowridge</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Skylake-Server</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Skylake-Client</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>SandyBridge</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Penryn</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Opteron_G5</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Opteron_G4</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Opteron_G3</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Opteron_G2</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Opteron_G1</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Nehalem-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Nehalem</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>IvyBridge</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Icelake-Server</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Haswell</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>EPYC-Rome</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>EPYC-Milan</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>EPYC</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Dhyana</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Cooperlake</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Conroe</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Broadwell</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>486</model>
Nov 14 23:35:45 user nova-compute[75341]:     </mode>
Nov 14 23:35:45 user nova-compute[75341]:   </cpu>
Nov 14 23:35:45 user nova-compute[75341]:   <memoryBacking supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:     <enum name='sourceType'>
Nov 14 23:35:45 user nova-compute[75341]:       <value>file</value>
Nov 14 23:35:45 user nova-compute[75341]:       <value>anonymous</value>
Nov 14 23:35:45 user nova-compute[75341]:       <value>memfd</value>
Nov 14 23:35:45 user nova-compute[75341]:     </enum>
Nov 14 23:35:45 user nova-compute[75341]:   </memoryBacking>
Nov 14 23:35:45 user nova-compute[75341]:   <devices>
Nov 14 23:35:45 user nova-compute[75341]:     <disk supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='diskDevice'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>disk</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>cdrom</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>floppy</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>lun</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='bus'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>fdc</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>scsi</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtio</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>usb</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>sata</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='model'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtio</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtio-transitional</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtio-non-transitional</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </disk>
Nov 14 23:35:45 user nova-compute[75341]:     <graphics supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='type'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>sdl</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>vnc</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>spice</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>egl-headless</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </graphics>
Nov 14 23:35:45 user nova-compute[75341]:     <video supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='modelType'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>vga</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>cirrus</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>vmvga</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>qxl</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtio</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>none</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>bochs</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>ramfb</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </video>
Nov 14 23:35:45 user nova-compute[75341]:     <hostdev supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='mode'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>subsystem</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='startupPolicy'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>default</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>mandatory</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>requisite</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>optional</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='subsysType'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>usb</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>pci</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>scsi</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='capsType'/>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='pciBackend'/>
Nov 14 23:35:45 user nova-compute[75341]:     </hostdev>
Nov 14 23:35:45 user nova-compute[75341]:     <rng supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='model'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtio</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtio-transitional</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtio-non-transitional</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='backendModel'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>random</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>egd</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>builtin</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </rng>
Nov 14 23:35:45 user nova-compute[75341]:     <filesystem supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='driverType'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>path</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>handle</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtiofs</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </filesystem>
Nov 14 23:35:45 user nova-compute[75341]:     <tpm supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='model'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>tpm-tis</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>tpm-crb</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='backendModel'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>passthrough</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>emulator</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </tpm>
Nov 14 23:35:45 user nova-compute[75341]:   </devices>
Nov 14 23:35:45 user nova-compute[75341]:   <features>
Nov 14 23:35:45 user nova-compute[75341]:     <gic supported='no'/>
Nov 14 23:35:45 user nova-compute[75341]:     <vmcoreinfo supported='yes'/>
Nov 14 23:35:45 user nova-compute[75341]:     <genid supported='yes'/>
Nov 14 23:35:45 user nova-compute[75341]:     <backingStoreInput supported='yes'/>
Nov 14 23:35:45 user nova-compute[75341]:     <backup supported='yes'/>
Nov 14 23:35:45 user nova-compute[75341]:     <sev supported='no'/>
Nov 14 23:35:45 user nova-compute[75341]:   </features>
Nov 14 23:35:45 user nova-compute[75341]: </domainCapabilities>
Nov 14 23:35:45 user nova-compute[75341]:  {{(pid=75341) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 23:35:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=75341) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 23:35:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75341) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 23:35:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75341) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 23:35:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75341) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 23:35:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75341) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 23:35:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75341) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 23:35:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75341) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 23:35:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75341) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 23:35:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75341) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 23:35:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75341) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 23:35:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75341) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 23:35:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75341) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 23:35:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75341) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 23:35:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75341) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 23:35:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75341) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 23:35:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75341) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 23:35:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75341) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 23:35:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Getting domain capabilities for ppc64 via machine types: {'powernv', None, 'pseries'} {{(pid=75341) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 23:35:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75341) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 23:35:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75341) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 23:35:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75341) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 23:35:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=75341) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 23:35:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75341) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 23:35:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75341) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 23:35:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75341) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 23:35:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75341) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 23:35:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75341) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 23:35:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75341) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 23:35:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75341) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 23:35:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75341) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 23:35:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75341) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 23:35:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75341) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 23:35:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75341) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 23:35:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75341) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 23:35:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75341) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 23:35:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75341) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 23:35:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75341) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 23:35:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75341) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 23:35:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'q35', 'pc', 'ubuntu-q35'} {{(pid=75341) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 23:35:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 14 23:35:45 user nova-compute[75341]: <domainCapabilities>
Nov 14 23:35:45 user nova-compute[75341]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 14 23:35:45 user nova-compute[75341]:   <domain>kvm</domain>
Nov 14 23:35:45 user nova-compute[75341]:   <machine>pc-i440fx-jammy</machine>
Nov 14 23:35:45 user nova-compute[75341]:   <arch>x86_64</arch>
Nov 14 23:35:45 user nova-compute[75341]:   <vcpu max='255'/>
Nov 14 23:35:45 user nova-compute[75341]:   <iothreads supported='yes'/>
Nov 14 23:35:45 user nova-compute[75341]:   <os supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:     <enum name='firmware'>
Nov 14 23:35:45 user nova-compute[75341]:       <value>efi</value>
Nov 14 23:35:45 user nova-compute[75341]:     </enum>
Nov 14 23:35:45 user nova-compute[75341]:     <loader supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='type'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>rom</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>pflash</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='readonly'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>yes</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>no</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='secure'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>no</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </loader>
Nov 14 23:35:45 user nova-compute[75341]:   </os>
Nov 14 23:35:45 user nova-compute[75341]:   <cpu>
Nov 14 23:35:45 user nova-compute[75341]:     <mode name='host-passthrough' supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='hostPassthroughMigratable'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>on</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>off</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </mode>
Nov 14 23:35:45 user nova-compute[75341]:     <mode name='maximum' supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='maximumMigratable'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>on</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>off</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </mode>
Nov 14 23:35:45 user nova-compute[75341]:     <mode name='host-model' supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <vendor>Intel</vendor>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='ss'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='vmx'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='pcid'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='hypervisor'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='arat'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='umip'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='md-clear'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='stibp'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='ssbd'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='invtsc'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='ibpb'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='ibrs'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='amd-stibp'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='rsba'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='pschange-mc-no'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='disable' name='erms'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 23:35:45 user nova-compute[75341]:     </mode>
Nov 14 23:35:45 user nova-compute[75341]:     <mode name='custom' supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>qemu64</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>qemu32</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>phenom</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>pentium3</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>pentium2</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>pentium</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>n270</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>kvm64</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>kvm32</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>coreduo</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>core2duo</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>athlon</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>Westmere-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>Westmere</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Snowridge</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Skylake-Server</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Skylake-Client</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>SandyBridge</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>Penryn</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Opteron_G5</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Opteron_G4</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Opteron_G3</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Opteron_G2</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>Opteron_G1</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>Nehalem</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>IvyBridge</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Icelake-Server</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Haswell</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>EPYC-Rome</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>EPYC-Milan</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>EPYC</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Dhyana</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Cooperlake</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>Conroe</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Broadwell</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>486</model>
Nov 14 23:35:45 user nova-compute[75341]:     </mode>
Nov 14 23:35:45 user nova-compute[75341]:   </cpu>
Nov 14 23:35:45 user nova-compute[75341]:   <memoryBacking supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:     <enum name='sourceType'>
Nov 14 23:35:45 user nova-compute[75341]:       <value>file</value>
Nov 14 23:35:45 user nova-compute[75341]:       <value>anonymous</value>
Nov 14 23:35:45 user nova-compute[75341]:       <value>memfd</value>
Nov 14 23:35:45 user nova-compute[75341]:     </enum>
Nov 14 23:35:45 user nova-compute[75341]:   </memoryBacking>
Nov 14 23:35:45 user nova-compute[75341]:   <devices>
Nov 14 23:35:45 user nova-compute[75341]:     <disk supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='diskDevice'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>disk</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>cdrom</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>floppy</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>lun</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='bus'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>ide</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>fdc</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>scsi</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtio</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>usb</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>sata</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='model'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtio</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtio-transitional</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtio-non-transitional</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </disk>
Nov 14 23:35:45 user nova-compute[75341]:     <graphics supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='type'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>sdl</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>vnc</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>spice</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>egl-headless</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </graphics>
Nov 14 23:35:45 user nova-compute[75341]:     <video supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='modelType'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>vga</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>cirrus</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>vmvga</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>qxl</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtio</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>none</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>bochs</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>ramfb</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </video>
Nov 14 23:35:45 user nova-compute[75341]:     <hostdev supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='mode'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>subsystem</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='startupPolicy'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>default</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>mandatory</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>requisite</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>optional</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='subsysType'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>usb</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>pci</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>scsi</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='capsType'/>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='pciBackend'/>
Nov 14 23:35:45 user nova-compute[75341]:     </hostdev>
Nov 14 23:35:45 user nova-compute[75341]:     <rng supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='model'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtio</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtio-transitional</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtio-non-transitional</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='backendModel'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>random</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>egd</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>builtin</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </rng>
Nov 14 23:35:45 user nova-compute[75341]:     <filesystem supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='driverType'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>path</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>handle</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtiofs</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </filesystem>
Nov 14 23:35:45 user nova-compute[75341]:     <tpm supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='model'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>tpm-tis</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>tpm-crb</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='backendModel'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>passthrough</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>emulator</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </tpm>
Nov 14 23:35:45 user nova-compute[75341]:   </devices>
Nov 14 23:35:45 user nova-compute[75341]:   <features>
Nov 14 23:35:45 user nova-compute[75341]:     <gic supported='no'/>
Nov 14 23:35:45 user nova-compute[75341]:     <vmcoreinfo supported='yes'/>
Nov 14 23:35:45 user nova-compute[75341]:     <genid supported='yes'/>
Nov 14 23:35:45 user nova-compute[75341]:     <backingStoreInput supported='yes'/>
Nov 14 23:35:45 user nova-compute[75341]:     <backup supported='yes'/>
Nov 14 23:35:45 user nova-compute[75341]:     <sev supported='no'/>
Nov 14 23:35:45 user nova-compute[75341]:   </features>
Nov 14 23:35:45 user nova-compute[75341]: </domainCapabilities>
Nov 14 23:35:45 user nova-compute[75341]:  {{(pid=75341) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 23:35:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 14 23:35:45 user nova-compute[75341]: <domainCapabilities>
Nov 14 23:35:45 user nova-compute[75341]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 14 23:35:45 user nova-compute[75341]:   <domain>kvm</domain>
Nov 14 23:35:45 user nova-compute[75341]:   <machine>pc-q35-6.2</machine>
Nov 14 23:35:45 user nova-compute[75341]:   <arch>x86_64</arch>
Nov 14 23:35:45 user nova-compute[75341]:   <vcpu max='288'/>
Nov 14 23:35:45 user nova-compute[75341]:   <iothreads supported='yes'/>
Nov 14 23:35:45 user nova-compute[75341]:   <os supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:     <enum name='firmware'>
Nov 14 23:35:45 user nova-compute[75341]:       <value>efi</value>
Nov 14 23:35:45 user nova-compute[75341]:     </enum>
Nov 14 23:35:45 user nova-compute[75341]:     <loader supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 14 23:35:45 user nova-compute[75341]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 14 23:35:45 user nova-compute[75341]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='type'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>rom</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>pflash</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='readonly'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>yes</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>no</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='secure'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>yes</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>no</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </loader>
Nov 14 23:35:45 user nova-compute[75341]:   </os>
Nov 14 23:35:45 user nova-compute[75341]:   <cpu>
Nov 14 23:35:45 user nova-compute[75341]:     <mode name='host-passthrough' supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='hostPassthroughMigratable'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>on</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>off</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </mode>
Nov 14 23:35:45 user nova-compute[75341]:     <mode name='maximum' supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='maximumMigratable'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>on</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>off</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </mode>
Nov 14 23:35:45 user nova-compute[75341]:     <mode name='host-model' supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <vendor>Intel</vendor>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='ss'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='vmx'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='pcid'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='hypervisor'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='arat'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='umip'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='md-clear'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='stibp'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='ssbd'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='invtsc'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='ibpb'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='ibrs'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='amd-stibp'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='rsba'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='pschange-mc-no'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='disable' name='erms'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 23:35:45 user nova-compute[75341]:     </mode>
Nov 14 23:35:45 user nova-compute[75341]:     <mode name='custom' supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>qemu64</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>qemu32</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>phenom</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>pentium3</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>pentium2</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>pentium</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>n270</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>kvm64</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>kvm32</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>coreduo</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>core2duo</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>athlon</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>Westmere-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>Westmere</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Snowridge</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Skylake-Server</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Skylake-Client</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>SandyBridge</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>Penryn</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Opteron_G5</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Opteron_G4</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Opteron_G3</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Opteron_G2</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>Opteron_G1</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>Nehalem</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>IvyBridge</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Icelake-Server</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Haswell</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>EPYC-Rome</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>EPYC-Milan</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>EPYC</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Dhyana</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Cooperlake</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>Conroe</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Broadwell</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>486</model>
Nov 14 23:35:45 user nova-compute[75341]:     </mode>
Nov 14 23:35:45 user nova-compute[75341]:   </cpu>
Nov 14 23:35:45 user nova-compute[75341]:   <memoryBacking supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:     <enum name='sourceType'>
Nov 14 23:35:45 user nova-compute[75341]:       <value>file</value>
Nov 14 23:35:45 user nova-compute[75341]:       <value>anonymous</value>
Nov 14 23:35:45 user nova-compute[75341]:       <value>memfd</value>
Nov 14 23:35:45 user nova-compute[75341]:     </enum>
Nov 14 23:35:45 user nova-compute[75341]:   </memoryBacking>
Nov 14 23:35:45 user nova-compute[75341]:   <devices>
Nov 14 23:35:45 user nova-compute[75341]:     <disk supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='diskDevice'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>disk</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>cdrom</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>floppy</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>lun</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='bus'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>fdc</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>scsi</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtio</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>usb</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>sata</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='model'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtio</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtio-transitional</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtio-non-transitional</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </disk>
Nov 14 23:35:45 user nova-compute[75341]:     <graphics supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='type'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>sdl</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>vnc</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>spice</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>egl-headless</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </graphics>
Nov 14 23:35:45 user nova-compute[75341]:     <video supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='modelType'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>vga</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>cirrus</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>vmvga</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>qxl</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtio</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>none</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>bochs</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>ramfb</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </video>
Nov 14 23:35:45 user nova-compute[75341]:     <hostdev supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='mode'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>subsystem</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='startupPolicy'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>default</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>mandatory</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>requisite</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>optional</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='subsysType'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>usb</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>pci</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>scsi</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='capsType'/>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='pciBackend'/>
Nov 14 23:35:45 user nova-compute[75341]:     </hostdev>
Nov 14 23:35:45 user nova-compute[75341]:     <rng supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='model'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtio</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtio-transitional</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtio-non-transitional</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='backendModel'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>random</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>egd</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>builtin</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </rng>
Nov 14 23:35:45 user nova-compute[75341]:     <filesystem supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='driverType'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>path</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>handle</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtiofs</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </filesystem>
Nov 14 23:35:45 user nova-compute[75341]:     <tpm supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='model'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>tpm-tis</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>tpm-crb</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='backendModel'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>passthrough</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>emulator</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </tpm>
Nov 14 23:35:45 user nova-compute[75341]:   </devices>
Nov 14 23:35:45 user nova-compute[75341]:   <features>
Nov 14 23:35:45 user nova-compute[75341]:     <gic supported='no'/>
Nov 14 23:35:45 user nova-compute[75341]:     <vmcoreinfo supported='yes'/>
Nov 14 23:35:45 user nova-compute[75341]:     <genid supported='yes'/>
Nov 14 23:35:45 user nova-compute[75341]:     <backingStoreInput supported='yes'/>
Nov 14 23:35:45 user nova-compute[75341]:     <backup supported='yes'/>
Nov 14 23:35:45 user nova-compute[75341]:     <sev supported='no'/>
Nov 14 23:35:45 user nova-compute[75341]:   </features>
Nov 14 23:35:45 user nova-compute[75341]: </domainCapabilities>
Nov 14 23:35:45 user nova-compute[75341]:  {{(pid=75341) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 23:35:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 14 23:35:45 user nova-compute[75341]: <domainCapabilities>
Nov 14 23:35:45 user nova-compute[75341]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 14 23:35:45 user nova-compute[75341]:   <domain>kvm</domain>
Nov 14 23:35:45 user nova-compute[75341]:   <machine>pc-i440fx-6.2</machine>
Nov 14 23:35:45 user nova-compute[75341]:   <arch>x86_64</arch>
Nov 14 23:35:45 user nova-compute[75341]:   <vcpu max='255'/>
Nov 14 23:35:45 user nova-compute[75341]:   <iothreads supported='yes'/>
Nov 14 23:35:45 user nova-compute[75341]:   <os supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:     <enum name='firmware'>
Nov 14 23:35:45 user nova-compute[75341]:       <value>efi</value>
Nov 14 23:35:45 user nova-compute[75341]:     </enum>
Nov 14 23:35:45 user nova-compute[75341]:     <loader supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='type'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>rom</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>pflash</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='readonly'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>yes</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>no</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='secure'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>no</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </loader>
Nov 14 23:35:45 user nova-compute[75341]:   </os>
Nov 14 23:35:45 user nova-compute[75341]:   <cpu>
Nov 14 23:35:45 user nova-compute[75341]:     <mode name='host-passthrough' supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='hostPassthroughMigratable'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>on</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>off</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </mode>
Nov 14 23:35:45 user nova-compute[75341]:     <mode name='maximum' supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='maximumMigratable'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>on</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>off</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </mode>
Nov 14 23:35:45 user nova-compute[75341]:     <mode name='host-model' supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <vendor>Intel</vendor>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='ss'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='vmx'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='pcid'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='hypervisor'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='arat'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='umip'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='md-clear'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='stibp'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='ssbd'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='invtsc'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='ibpb'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='ibrs'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='amd-stibp'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='rsba'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='pschange-mc-no'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='disable' name='erms'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 23:35:45 user nova-compute[75341]:     </mode>
Nov 14 23:35:45 user nova-compute[75341]:     <mode name='custom' supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>qemu64</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>qemu32</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>phenom</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>pentium3</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>pentium2</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>pentium</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>n270</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>kvm64</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>kvm32</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>coreduo</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>core2duo</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>athlon</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>Westmere-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>Westmere</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Snowridge</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Skylake-Server</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Skylake-Client</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>SandyBridge</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>Penryn</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Opteron_G5</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Opteron_G4</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Opteron_G3</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Opteron_G2</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>Opteron_G1</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>Nehalem</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>IvyBridge</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Icelake-Server</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Haswell</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>EPYC-Rome</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>EPYC-Milan</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>EPYC</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Dhyana</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Cooperlake</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>Conroe</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Broadwell</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>486</model>
Nov 14 23:35:45 user nova-compute[75341]:     </mode>
Nov 14 23:35:45 user nova-compute[75341]:   </cpu>
Nov 14 23:35:45 user nova-compute[75341]:   <memoryBacking supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:     <enum name='sourceType'>
Nov 14 23:35:45 user nova-compute[75341]:       <value>file</value>
Nov 14 23:35:45 user nova-compute[75341]:       <value>anonymous</value>
Nov 14 23:35:45 user nova-compute[75341]:       <value>memfd</value>
Nov 14 23:35:45 user nova-compute[75341]:     </enum>
Nov 14 23:35:45 user nova-compute[75341]:   </memoryBacking>
Nov 14 23:35:45 user nova-compute[75341]:   <devices>
Nov 14 23:35:45 user nova-compute[75341]:     <disk supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='diskDevice'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>disk</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>cdrom</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>floppy</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>lun</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='bus'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>ide</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>fdc</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>scsi</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtio</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>usb</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>sata</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='model'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtio</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtio-transitional</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtio-non-transitional</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </disk>
Nov 14 23:35:45 user nova-compute[75341]:     <graphics supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='type'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>sdl</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>vnc</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>spice</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>egl-headless</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </graphics>
Nov 14 23:35:45 user nova-compute[75341]:     <video supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='modelType'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>vga</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>cirrus</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>vmvga</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>qxl</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtio</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>none</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>bochs</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>ramfb</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </video>
Nov 14 23:35:45 user nova-compute[75341]:     <hostdev supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='mode'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>subsystem</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='startupPolicy'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>default</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>mandatory</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>requisite</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>optional</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='subsysType'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>usb</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>pci</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>scsi</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='capsType'/>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='pciBackend'/>
Nov 14 23:35:45 user nova-compute[75341]:     </hostdev>
Nov 14 23:35:45 user nova-compute[75341]:     <rng supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='model'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtio</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtio-transitional</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtio-non-transitional</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='backendModel'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>random</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>egd</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>builtin</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </rng>
Nov 14 23:35:45 user nova-compute[75341]:     <filesystem supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='driverType'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>path</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>handle</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtiofs</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </filesystem>
Nov 14 23:35:45 user nova-compute[75341]:     <tpm supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='model'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>tpm-tis</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>tpm-crb</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='backendModel'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>passthrough</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>emulator</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </tpm>
Nov 14 23:35:45 user nova-compute[75341]:   </devices>
Nov 14 23:35:45 user nova-compute[75341]:   <features>
Nov 14 23:35:45 user nova-compute[75341]:     <gic supported='no'/>
Nov 14 23:35:45 user nova-compute[75341]:     <vmcoreinfo supported='yes'/>
Nov 14 23:35:45 user nova-compute[75341]:     <genid supported='yes'/>
Nov 14 23:35:45 user nova-compute[75341]:     <backingStoreInput supported='yes'/>
Nov 14 23:35:45 user nova-compute[75341]:     <backup supported='yes'/>
Nov 14 23:35:45 user nova-compute[75341]:     <sev supported='no'/>
Nov 14 23:35:45 user nova-compute[75341]:   </features>
Nov 14 23:35:45 user nova-compute[75341]: </domainCapabilities>
Nov 14 23:35:45 user nova-compute[75341]:  {{(pid=75341) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 23:35:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 14 23:35:45 user nova-compute[75341]: <domainCapabilities>
Nov 14 23:35:45 user nova-compute[75341]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 14 23:35:45 user nova-compute[75341]:   <domain>kvm</domain>
Nov 14 23:35:45 user nova-compute[75341]:   <machine>pc-q35-jammy</machine>
Nov 14 23:35:45 user nova-compute[75341]:   <arch>x86_64</arch>
Nov 14 23:35:45 user nova-compute[75341]:   <vcpu max='288'/>
Nov 14 23:35:45 user nova-compute[75341]:   <iothreads supported='yes'/>
Nov 14 23:35:45 user nova-compute[75341]:   <os supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:     <enum name='firmware'>
Nov 14 23:35:45 user nova-compute[75341]:       <value>efi</value>
Nov 14 23:35:45 user nova-compute[75341]:     </enum>
Nov 14 23:35:45 user nova-compute[75341]:     <loader supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 14 23:35:45 user nova-compute[75341]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 14 23:35:45 user nova-compute[75341]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='type'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>rom</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>pflash</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='readonly'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>yes</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>no</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='secure'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>yes</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>no</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </loader>
Nov 14 23:35:45 user nova-compute[75341]:   </os>
Nov 14 23:35:45 user nova-compute[75341]:   <cpu>
Nov 14 23:35:45 user nova-compute[75341]:     <mode name='host-passthrough' supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='hostPassthroughMigratable'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>on</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>off</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </mode>
Nov 14 23:35:45 user nova-compute[75341]:     <mode name='maximum' supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='maximumMigratable'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>on</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>off</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </mode>
Nov 14 23:35:45 user nova-compute[75341]:     <mode name='host-model' supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <vendor>Intel</vendor>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='ss'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='vmx'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='pcid'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='hypervisor'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='arat'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='umip'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='md-clear'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='stibp'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='ssbd'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='invtsc'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='ibpb'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='ibrs'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='amd-stibp'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='rsba'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='require' name='pschange-mc-no'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='disable' name='erms'/>
Nov 14 23:35:45 user nova-compute[75341]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 23:35:45 user nova-compute[75341]:     </mode>
Nov 14 23:35:45 user nova-compute[75341]:     <mode name='custom' supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>qemu64</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>qemu32</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>phenom</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>pentium3</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>pentium2</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>pentium</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>n270</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>kvm64</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>kvm32</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>coreduo</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>core2duo</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>athlon</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>Westmere-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>Westmere</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Snowridge</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Skylake-Server</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Skylake-Client</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>SandyBridge</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>Penryn</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Opteron_G5</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Opteron_G4</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Opteron_G3</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Opteron_G2</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>Opteron_G1</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>Nehalem</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>IvyBridge</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Icelake-Server</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Haswell</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>EPYC-Rome</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>EPYC-Milan</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>EPYC</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Dhyana</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Cooperlake</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>Conroe</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='no'>Broadwell</model>
Nov 14 23:35:45 user nova-compute[75341]:       <model usable='yes'>486</model>
Nov 14 23:35:45 user nova-compute[75341]:     </mode>
Nov 14 23:35:45 user nova-compute[75341]:   </cpu>
Nov 14 23:35:45 user nova-compute[75341]:   <memoryBacking supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:     <enum name='sourceType'>
Nov 14 23:35:45 user nova-compute[75341]:       <value>file</value>
Nov 14 23:35:45 user nova-compute[75341]:       <value>anonymous</value>
Nov 14 23:35:45 user nova-compute[75341]:       <value>memfd</value>
Nov 14 23:35:45 user nova-compute[75341]:     </enum>
Nov 14 23:35:45 user nova-compute[75341]:   </memoryBacking>
Nov 14 23:35:45 user nova-compute[75341]:   <devices>
Nov 14 23:35:45 user nova-compute[75341]:     <disk supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='diskDevice'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>disk</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>cdrom</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>floppy</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>lun</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='bus'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>fdc</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>scsi</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtio</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>usb</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>sata</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='model'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtio</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtio-transitional</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtio-non-transitional</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </disk>
Nov 14 23:35:45 user nova-compute[75341]:     <graphics supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='type'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>sdl</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>vnc</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>spice</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>egl-headless</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </graphics>
Nov 14 23:35:45 user nova-compute[75341]:     <video supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='modelType'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>vga</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>cirrus</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>vmvga</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>qxl</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtio</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>none</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>bochs</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>ramfb</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </video>
Nov 14 23:35:45 user nova-compute[75341]:     <hostdev supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='mode'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>subsystem</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='startupPolicy'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>default</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>mandatory</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>requisite</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>optional</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='subsysType'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>usb</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>pci</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>scsi</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='capsType'/>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='pciBackend'/>
Nov 14 23:35:45 user nova-compute[75341]:     </hostdev>
Nov 14 23:35:45 user nova-compute[75341]:     <rng supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='model'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtio</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtio-transitional</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtio-non-transitional</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='backendModel'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>random</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>egd</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>builtin</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </rng>
Nov 14 23:35:45 user nova-compute[75341]:     <filesystem supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='driverType'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>path</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>handle</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>virtiofs</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </filesystem>
Nov 14 23:35:45 user nova-compute[75341]:     <tpm supported='yes'>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='model'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>tpm-tis</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>tpm-crb</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:       <enum name='backendModel'>
Nov 14 23:35:45 user nova-compute[75341]:         <value>passthrough</value>
Nov 14 23:35:45 user nova-compute[75341]:         <value>emulator</value>
Nov 14 23:35:45 user nova-compute[75341]:       </enum>
Nov 14 23:35:45 user nova-compute[75341]:     </tpm>
Nov 14 23:35:45 user nova-compute[75341]:   </devices>
Nov 14 23:35:45 user nova-compute[75341]:   <features>
Nov 14 23:35:45 user nova-compute[75341]:     <gic supported='no'/>
Nov 14 23:35:45 user nova-compute[75341]:     <vmcoreinfo supported='yes'/>
Nov 14 23:35:45 user nova-compute[75341]:     <genid supported='yes'/>
Nov 14 23:35:45 user nova-compute[75341]:     <backingStoreInput supported='yes'/>
Nov 14 23:35:45 user nova-compute[75341]:     <backup supported='yes'/>
Nov 14 23:35:45 user nova-compute[75341]:     <sev supported='no'/>
Nov 14 23:35:45 user nova-compute[75341]:   </features>
Nov 14 23:35:45 user nova-compute[75341]: </domainCapabilities>
Nov 14 23:35:45 user nova-compute[75341]:  {{(pid=75341) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 23:35:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75341) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 23:35:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75341) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 23:35:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75341) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 23:35:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75341) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 23:35:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Checking secure boot support for host arch (x86_64) {{(pid=75341) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 14 23:35:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Checking secure boot support for host arch (x86_64) {{(pid=75341) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 14 23:35:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Checking secure boot support for host arch (x86_64) {{(pid=75341) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 14 23:35:45 user nova-compute[75341]: INFO nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Secure Boot support detected
Nov 14 23:35:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] cpu compare xml: <cpu match="exact">
Nov 14 23:35:45 user nova-compute[75341]:   <model>Nehalem</model>
Nov 14 23:35:45 user nova-compute[75341]: </cpu>
Nov 14 23:35:45 user nova-compute[75341]:  {{(pid=75341) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 14 23:35:45 user nova-compute[75341]: INFO nova.virt.node [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Generated node identity 8fa114cc-b541-418f-865c-16c44294e72d
Nov 14 23:35:45 user nova-compute[75341]: INFO nova.virt.node [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Wrote node identity 8fa114cc-b541-418f-865c-16c44294e72d to /opt/stack/data/nova/compute_id
Nov 14 23:35:45 user nova-compute[75341]: WARNING nova.compute.manager [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Compute nodes ['8fa114cc-b541-418f-865c-16c44294e72d'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 14 23:35:45 user nova-compute[75341]: INFO nova.compute.manager [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 14 23:35:46 user nova-compute[75341]: WARNING nova.compute.manager [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 14 23:35:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:35:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:35:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:35:46 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Auditing locally available compute resources for user (node: user) {{(pid=75341) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 23:35:46 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:35:46 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:35:46 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Hypervisor/Node resource view: name=user free_ram=10971MB free_disk=26.34485626220703GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75341) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 23:35:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:35:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:35:46 user nova-compute[75341]: WARNING nova.compute.resource_tracker [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] No compute node record for user:8fa114cc-b541-418f-865c-16c44294e72d: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 8fa114cc-b541-418f-865c-16c44294e72d could not be found.
Nov 14 23:35:46 user nova-compute[75341]: INFO nova.compute.resource_tracker [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Compute node record created for user:user with uuid: 8fa114cc-b541-418f-865c-16c44294e72d
Nov 14 23:35:46 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 23:35:46 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 23:35:46 user nova-compute[75341]: INFO nova.scheduler.client.report [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] [req-c7de3b47-591d-438d-abdb-83bfa2062898] Created resource provider record via placement API for resource provider with UUID 8fa114cc-b541-418f-865c-16c44294e72d and name user.
Nov 14 23:35:46 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75341) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 14 23:35:46 user nova-compute[75341]: INFO nova.virt.libvirt.host [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] kernel doesn't support AMD SEV
Nov 14 23:35:46 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Updating inventory in ProviderTree for provider 8fa114cc-b541-418f-865c-16c44294e72d with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 23:35:46 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 23:35:46 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Libvirt baseline CPU <cpu>
Nov 14 23:35:46 user nova-compute[75341]:   <arch>x86_64</arch>
Nov 14 23:35:46 user nova-compute[75341]:   <model>Nehalem</model>
Nov 14 23:35:46 user nova-compute[75341]:   <vendor>Intel</vendor>
Nov 14 23:35:46 user nova-compute[75341]:   <topology sockets="6" cores="1" threads="1"/>
Nov 14 23:35:46 user nova-compute[75341]: </cpu>
Nov 14 23:35:46 user nova-compute[75341]:  {{(pid=75341) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 14 23:35:46 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Updated inventory for provider 8fa114cc-b541-418f-865c-16c44294e72d with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 14 23:35:46 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Updating resource provider 8fa114cc-b541-418f-865c-16c44294e72d generation from 0 to 1 during operation: update_inventory {{(pid=75341) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 14 23:35:46 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Updating inventory in ProviderTree for provider 8fa114cc-b541-418f-865c-16c44294e72d with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 23:35:46 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Updating resource provider 8fa114cc-b541-418f-865c-16c44294e72d generation from 1 to 2 during operation: update_traits {{(pid=75341) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 14 23:35:46 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Compute_service record updated for user:user {{(pid=75341) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 23:35:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.612s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:35:46 user nova-compute[75341]: DEBUG nova.service [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Creating RPC server for service compute {{(pid=75341) start /opt/stack/nova/nova/service.py:182}}
Nov 14 23:35:46 user nova-compute[75341]: DEBUG nova.service [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] Join ServiceGroup membership for this service compute {{(pid=75341) start /opt/stack/nova/nova/service.py:199}}
Nov 14 23:35:46 user nova-compute[75341]: DEBUG nova.servicegroup.drivers.db [None req-6a547901-89d0-4761-98fd-f6a948e81d8b None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75341) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 14 23:36:10 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:36:10 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:36:37 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:36:37 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:36:37 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Starting heal instance info cache {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 23:36:37 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Rebuilding the list of instances to heal {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 23:36:37 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Didn't find any instances for network info cache update. {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 23:36:37 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:36:37 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:36:37 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:36:37 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:36:37 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:36:37 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:36:37 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75341) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 23:36:37 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:36:37 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:36:37 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:36:37 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:36:37 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75341) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 23:36:38 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:36:38 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:36:38 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Hypervisor/Node resource view: name=user free_ram=10350MB free_disk=26.248699188232422GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75341) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 23:36:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:36:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:36:38 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 23:36:38 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 23:36:38 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:36:38 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:36:38 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Compute_service record updated for user:user {{(pid=75341) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 23:36:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.132s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:37:38 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:37:38 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:37:38 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:37:38 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75341) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 23:37:38 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:37:38 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Starting heal instance info cache {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 23:37:38 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Rebuilding the list of instances to heal {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 23:37:38 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Didn't find any instances for network info cache update. {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 23:37:38 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:37:38 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:37:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:37:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:37:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:37:38 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75341) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 23:37:39 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:37:39 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:37:39 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Hypervisor/Node resource view: name=user free_ram=10325MB free_disk=26.3018798828125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75341) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 23:37:39 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:37:39 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:37:39 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 23:37:39 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 23:37:39 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:37:39 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:37:39 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Compute_service record updated for user:user {{(pid=75341) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 23:37:39 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.145s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:37:40 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:37:40 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:37:40 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:37:40 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:38:38 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:38:39 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:38:39 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Starting heal instance info cache {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 23:38:39 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Rebuilding the list of instances to heal {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 23:38:39 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Didn't find any instances for network info cache update. {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 23:38:39 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:38:39 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:38:39 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75341) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 23:38:39 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:38:39 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:38:39 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:38:39 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:38:39 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75341) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 23:38:40 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:38:40 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:38:40 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Hypervisor/Node resource view: name=user free_ram=10310MB free_disk=26.065414428710938GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75341) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 23:38:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:38:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:38:40 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 23:38:40 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 23:38:40 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:38:40 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:38:40 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Compute_service record updated for user:user {{(pid=75341) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 23:38:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.139s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:38:41 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:38:41 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:38:41 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:38:41 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:39:39 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:39:40 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:39:40 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Starting heal instance info cache {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 23:39:40 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Rebuilding the list of instances to heal {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 23:39:40 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Didn't find any instances for network info cache update. {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 23:39:40 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:39:40 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:39:41 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:39:41 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75341) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 23:39:41 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:39:41 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:39:41 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:39:41 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:39:41 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75341) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 23:39:42 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:39:42 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:39:42 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Hypervisor/Node resource view: name=user free_ram=9575MB free_disk=26.08399200439453GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75341) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 23:39:42 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:39:42 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:39:42 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 23:39:42 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 23:39:42 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:39:42 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:39:42 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Compute_service record updated for user:user {{(pid=75341) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 23:39:42 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.155s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:39:43 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:39:43 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:39:43 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:39:43 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:39:45 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Acquiring lock "881351d7-31f9-44f4-8571-8f540bbec29c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:39:45 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Lock "881351d7-31f9-44f4-8571-8f540bbec29c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:39:45 user nova-compute[75341]: DEBUG nova.compute.manager [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Starting instance... {{(pid=75341) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 23:39:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:39:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.006s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:39:46 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75341) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 23:39:46 user nova-compute[75341]: INFO nova.compute.claims [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Claim successful on node user
Nov 14 23:39:46 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:39:46 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:39:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.633s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:39:46 user nova-compute[75341]: DEBUG nova.compute.manager [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Start building networks asynchronously for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 23:39:46 user nova-compute[75341]: DEBUG nova.compute.manager [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Allocating IP information in the background. {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 23:39:46 user nova-compute[75341]: DEBUG nova.network.neutron [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] allocate_for_instance() {{(pid=75341) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 23:39:46 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 23:39:46 user nova-compute[75341]: DEBUG nova.compute.manager [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Start building block device mappings for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 23:39:47 user nova-compute[75341]: DEBUG nova.compute.manager [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Start spawning the instance on the hypervisor. {{(pid=75341) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 23:39:47 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Creating instance directory {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 23:39:47 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Creating image(s)
Nov 14 23:39:47 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Acquiring lock "/opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:39:47 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Lock "/opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:39:47 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Lock "/opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:39:47 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Acquiring lock "4754efee9a6d73d3647f2add2cfe86c291949740" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:39:47 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:39:47 user nova-compute[75341]: DEBUG nova.policy [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '512d2ce7a01c4ffb924f9476a5c4b946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eff8d64949254c7eb3dd8685ca7447b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75341) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 23:39:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740.part --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:39:47 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Acquiring lock "91603fef-c1cc-4fa1-96b2-e840db651627" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:39:47 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Lock "91603fef-c1cc-4fa1-96b2-e840db651627" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:39:48 user nova-compute[75341]: DEBUG nova.compute.manager [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] Starting instance... {{(pid=75341) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 23:39:48 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:39:48 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:39:48 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75341) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 23:39:48 user nova-compute[75341]: INFO nova.compute.claims [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] Claim successful on node user
Nov 14 23:39:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740.part --force-share --output=json" returned: 0 in 0.181s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:39:48 user nova-compute[75341]: DEBUG nova.virt.images [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] e46abb82-b810-490e-a8a1-ccdc5fa1a796 was qcow2, converting to raw {{(pid=75341) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 23:39:48 user nova-compute[75341]: DEBUG nova.privsep.utils [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75341) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 23:39:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740.part /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740.converted {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:39:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740.part /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740.converted" returned: 0 in 0.510s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:39:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740.converted --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:39:48 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:39:48 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:39:48 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.641s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:39:48 user nova-compute[75341]: DEBUG nova.compute.manager [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] Start building networks asynchronously for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 23:39:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740.converted --force-share --output=json" returned: 0 in 0.186s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:39:48 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.772s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:39:48 user nova-compute[75341]: INFO oslo.privsep.daemon [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpk71otmpj/privsep.sock']
Nov 14 23:39:48 user sudo[84602]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpk71otmpj/privsep.sock
Nov 14 23:39:48 user sudo[84602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 14 23:39:48 user nova-compute[75341]: DEBUG nova.compute.manager [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] Allocating IP information in the background. {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 23:39:48 user nova-compute[75341]: DEBUG nova.network.neutron [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] allocate_for_instance() {{(pid=75341) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 23:39:48 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 23:39:48 user nova-compute[75341]: DEBUG nova.compute.manager [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] Start building block device mappings for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 23:39:49 user nova-compute[75341]: DEBUG nova.policy [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '00343699649c474a989c45344046190d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ea6112e51e4412941ef2e4a68ad1bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75341) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 23:39:49 user nova-compute[75341]: DEBUG nova.compute.manager [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] Start spawning the instance on the hypervisor. {{(pid=75341) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 23:39:49 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] Creating instance directory {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 23:39:49 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] Creating image(s)
Nov 14 23:39:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Acquiring lock "/opt/stack/data/nova/instances/91603fef-c1cc-4fa1-96b2-e840db651627/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:39:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Lock "/opt/stack/data/nova/instances/91603fef-c1cc-4fa1-96b2-e840db651627/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:39:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Lock "/opt/stack/data/nova/instances/91603fef-c1cc-4fa1-96b2-e840db651627/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:39:50 user sudo[84602]: pam_unix(sudo:session): session closed for user root
Nov 14 23:39:50 user nova-compute[75341]: INFO oslo.privsep.daemon [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Spawned new privsep daemon via rootwrap
Nov 14 23:39:50 user nova-compute[75341]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 14 23:39:50 user nova-compute[75341]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 14 23:39:50 user nova-compute[75341]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 14 23:39:50 user nova-compute[75341]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84607
Nov 14 23:39:50 user nova-compute[75341]: WARNING oslo_privsep.priv_context [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] privsep daemon already running
Nov 14 23:39:50 user nova-compute[75341]: DEBUG nova.network.neutron [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] Successfully created port: c53d37cc-db96-4531-9095-053de7f58643 {{(pid=75341) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 23:39:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:39:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:39:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.190s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:39:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Acquiring lock "4754efee9a6d73d3647f2add2cfe86c291949740" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:39:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:39:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:39:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.193s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:39:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Acquiring lock "4754efee9a6d73d3647f2add2cfe86c291949740" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:39:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.176s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:39:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c/disk 1073741824 {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:39:50 user nova-compute[75341]: DEBUG nova.network.neutron [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Successfully created port: dcc0edd5-582a-499a-beaf-6de23ff1537c {{(pid=75341) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 23:39:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c/disk 1073741824" returned: 0 in 0.059s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:39:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:39:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:39:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.233s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:39:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:39:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.175s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:39:51 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Checking if we can resize image /opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c/disk. size=1073741824 {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 23:39:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:39:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.191s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:39:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/91603fef-c1cc-4fa1-96b2-e840db651627/disk 1073741824 {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:39:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/91603fef-c1cc-4fa1-96b2-e840db651627/disk 1073741824" returned: 0 in 0.066s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:39:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:39:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:39:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c/disk --force-share --output=json" returned: 0 in 0.300s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:39:51 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Cannot resize image /opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c/disk to a smaller size. {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 23:39:51 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Created local disks {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 23:39:51 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Ensure instance console log exists: /opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c/console.log {{(pid=75341) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 23:39:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:39:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:39:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:39:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.211s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:39:51 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Checking if we can resize image /opt/stack/data/nova/instances/91603fef-c1cc-4fa1-96b2-e840db651627/disk. size=1073741824 {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 23:39:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91603fef-c1cc-4fa1-96b2-e840db651627/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:39:51 user nova-compute[75341]: DEBUG nova.network.neutron [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] Successfully updated port: c53d37cc-db96-4531-9095-053de7f58643 {{(pid=75341) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 23:39:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Acquiring lock "refresh_cache-91603fef-c1cc-4fa1-96b2-e840db651627" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:39:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Acquired lock "refresh_cache-91603fef-c1cc-4fa1-96b2-e840db651627" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:39:51 user nova-compute[75341]: DEBUG nova.network.neutron [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 23:39:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91603fef-c1cc-4fa1-96b2-e840db651627/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:39:51 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Cannot resize image /opt/stack/data/nova/instances/91603fef-c1cc-4fa1-96b2-e840db651627/disk to a smaller size. {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 23:39:51 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] Created local disks {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 23:39:51 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] Ensure instance console log exists: /opt/stack/data/nova/instances/91603fef-c1cc-4fa1-96b2-e840db651627/console.log {{(pid=75341) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 23:39:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:39:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:39:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:39:51 user nova-compute[75341]: DEBUG nova.network.neutron [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] Instance cache missing network info. {{(pid=75341) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 23:39:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Acquiring lock "a308a35f-c8d7-482c-a93d-5d9eb473d4e1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:39:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "a308a35f-c8d7-482c-a93d-5d9eb473d4e1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:39:51 user nova-compute[75341]: DEBUG nova.compute.manager [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Starting instance... {{(pid=75341) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 23:39:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:39:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:39:51 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75341) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 23:39:51 user nova-compute[75341]: INFO nova.compute.claims [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Claim successful on node user
Nov 14 23:39:51 user nova-compute[75341]: DEBUG nova.compute.manager [req-d4fc22e7-00d1-4f7c-97a4-ce6141c89e40 req-11f92803-ce63-45e6-817e-539d905327b5 service nova] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] Received event network-changed-c53d37cc-db96-4531-9095-053de7f58643 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:39:51 user nova-compute[75341]: DEBUG nova.compute.manager [req-d4fc22e7-00d1-4f7c-97a4-ce6141c89e40 req-11f92803-ce63-45e6-817e-539d905327b5 service nova] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] Refreshing instance network info cache due to event network-changed-c53d37cc-db96-4531-9095-053de7f58643. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:39:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-d4fc22e7-00d1-4f7c-97a4-ce6141c89e40 req-11f92803-ce63-45e6-817e-539d905327b5 service nova] Acquiring lock "refresh_cache-91603fef-c1cc-4fa1-96b2-e840db651627" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:39:52 user nova-compute[75341]: DEBUG nova.network.neutron [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] Updating instance_info_cache with network_info: [{"id": "c53d37cc-db96-4531-9095-053de7f58643", "address": "fa:16:3e:0e:89:c0", "network": {"id": "07acc788-5f14-41b8-8aff-4d5c318cf71e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-470661925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ea6112e51e4412941ef2e4a68ad1bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc53d37cc-db", "ovs_interfaceid": "c53d37cc-db96-4531-9095-053de7f58643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:39:52 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:39:52 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:39:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Releasing lock "refresh_cache-91603fef-c1cc-4fa1-96b2-e840db651627" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:39:52 user nova-compute[75341]: DEBUG nova.compute.manager [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] Instance network_info: |[{"id": "c53d37cc-db96-4531-9095-053de7f58643", "address": "fa:16:3e:0e:89:c0", "network": {"id": "07acc788-5f14-41b8-8aff-4d5c318cf71e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-470661925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ea6112e51e4412941ef2e4a68ad1bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc53d37cc-db", "ovs_interfaceid": "c53d37cc-db96-4531-9095-053de7f58643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 23:39:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-d4fc22e7-00d1-4f7c-97a4-ce6141c89e40 req-11f92803-ce63-45e6-817e-539d905327b5 service nova] Acquired lock "refresh_cache-91603fef-c1cc-4fa1-96b2-e840db651627" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:39:52 user nova-compute[75341]: DEBUG nova.network.neutron [req-d4fc22e7-00d1-4f7c-97a4-ce6141c89e40 req-11f92803-ce63-45e6-817e-539d905327b5 service nova] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] Refreshing network info cache for port c53d37cc-db96-4531-9095-053de7f58643 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:39:52 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] Start _get_guest_xml network_info=[{"id": "c53d37cc-db96-4531-9095-053de7f58643", "address": "fa:16:3e:0e:89:c0", "network": {"id": "07acc788-5f14-41b8-8aff-4d5c318cf71e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-470661925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ea6112e51e4412941ef2e4a68ad1bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc53d37cc-db", "ovs_interfaceid": "c53d37cc-db96-4531-9095-053de7f58643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encrypted': False, 'image_id': 'e46abb82-b810-490e-a8a1-ccdc5fa1a796'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 23:39:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.377s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:39:52 user nova-compute[75341]: DEBUG nova.compute.manager [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Start building networks asynchronously for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 23:39:52 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:39:52 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:39:52 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 23:39:52 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 23:39:52 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 23:39:52 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 23:39:52 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 23:39:52 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 23:39:52 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 23:39:52 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 23:39:52 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 23:39:52 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 23:39:52 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 23:39:52 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 23:39:52 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 23:39:52 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 23:39:52 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 23:39:52 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 23:39:52 user nova-compute[75341]: DEBUG nova.privsep.utils [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75341) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 23:39:52 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:39:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1998907683',display_name='tempest-DeleteServersTestJSON-server-1998907683',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1998907683',id=2,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8ea6112e51e4412941ef2e4a68ad1bb',ramdisk_id='',reservation_id='r-ytcf352t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-177205866',owner_user_name='tempest-DeleteServersTestJSON-177205866-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:39:49Z,user_data=None,user_id='00343699649c474a989c45344046190d',uuid=91603fef-c1cc-4fa1-96b2-e840db651627,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c53d37cc-db96-4531-9095-053de7f58643", "address": "fa:16:3e:0e:89:c0", "network": {"id": "07acc788-5f14-41b8-8aff-4d5c318cf71e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-470661925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ea6112e51e4412941ef2e4a68ad1bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc53d37cc-db", "ovs_interfaceid": "c53d37cc-db96-4531-9095-053de7f58643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:39:52 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Converting VIF {"id": "c53d37cc-db96-4531-9095-053de7f58643", "address": "fa:16:3e:0e:89:c0", "network": {"id": "07acc788-5f14-41b8-8aff-4d5c318cf71e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-470661925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ea6112e51e4412941ef2e4a68ad1bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc53d37cc-db", "ovs_interfaceid": "c53d37cc-db96-4531-9095-053de7f58643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:39:52 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:89:c0,bridge_name='br-int',has_traffic_filtering=True,id=c53d37cc-db96-4531-9095-053de7f58643,network=Network(07acc788-5f14-41b8-8aff-4d5c318cf71e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc53d37cc-db') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:39:52 user nova-compute[75341]: DEBUG nova.objects.instance [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Lazy-loading 'pci_devices' on Instance uuid 91603fef-c1cc-4fa1-96b2-e840db651627 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:39:52 user nova-compute[75341]: DEBUG nova.compute.manager [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Allocating IP information in the background. {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 23:39:52 user nova-compute[75341]: DEBUG nova.network.neutron [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] allocate_for_instance() {{(pid=75341) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 23:39:52 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] End _get_guest_xml xml=<domain type="kvm">
Nov 14 23:39:52 user nova-compute[75341]:   <uuid>91603fef-c1cc-4fa1-96b2-e840db651627</uuid>
Nov 14 23:39:52 user nova-compute[75341]:   <name>instance-00000002</name>
Nov 14 23:39:52 user nova-compute[75341]:   <memory>524288</memory>
Nov 14 23:39:52 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 14 23:39:52 user nova-compute[75341]:   <metadata>
Nov 14 23:39:52 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 23:39:52 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 14 23:39:52 user nova-compute[75341]:       <nova:name>tempest-DeleteServersTestJSON-server-1998907683</nova:name>
Nov 14 23:39:52 user nova-compute[75341]:       <nova:creationTime>2023-11-14 23:39:52</nova:creationTime>
Nov 14 23:39:52 user nova-compute[75341]:       <nova:flavor name="m1.tiny">
Nov 14 23:39:52 user nova-compute[75341]:         <nova:memory>512</nova:memory>
Nov 14 23:39:52 user nova-compute[75341]:         <nova:disk>1</nova:disk>
Nov 14 23:39:52 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 14 23:39:52 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 23:39:52 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 14 23:39:52 user nova-compute[75341]:       </nova:flavor>
Nov 14 23:39:52 user nova-compute[75341]:       <nova:owner>
Nov 14 23:39:52 user nova-compute[75341]:         <nova:user uuid="00343699649c474a989c45344046190d">tempest-DeleteServersTestJSON-177205866-project-member</nova:user>
Nov 14 23:39:52 user nova-compute[75341]:         <nova:project uuid="d8ea6112e51e4412941ef2e4a68ad1bb">tempest-DeleteServersTestJSON-177205866</nova:project>
Nov 14 23:39:52 user nova-compute[75341]:       </nova:owner>
Nov 14 23:39:52 user nova-compute[75341]:       <nova:root type="image" uuid="e46abb82-b810-490e-a8a1-ccdc5fa1a796"/>
Nov 14 23:39:52 user nova-compute[75341]:       <nova:ports>
Nov 14 23:39:52 user nova-compute[75341]:         <nova:port uuid="c53d37cc-db96-4531-9095-053de7f58643">
Nov 14 23:39:52 user nova-compute[75341]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 23:39:52 user nova-compute[75341]:         </nova:port>
Nov 14 23:39:52 user nova-compute[75341]:       </nova:ports>
Nov 14 23:39:52 user nova-compute[75341]:     </nova:instance>
Nov 14 23:39:52 user nova-compute[75341]:   </metadata>
Nov 14 23:39:52 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 14 23:39:52 user nova-compute[75341]:     <system>
Nov 14 23:39:52 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 23:39:52 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 14 23:39:52 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 14 23:39:52 user nova-compute[75341]:       <entry name="serial">91603fef-c1cc-4fa1-96b2-e840db651627</entry>
Nov 14 23:39:52 user nova-compute[75341]:       <entry name="uuid">91603fef-c1cc-4fa1-96b2-e840db651627</entry>
Nov 14 23:39:52 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 14 23:39:52 user nova-compute[75341]:     </system>
Nov 14 23:39:52 user nova-compute[75341]:   </sysinfo>
Nov 14 23:39:52 user nova-compute[75341]:   <os>
Nov 14 23:39:52 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 23:39:52 user nova-compute[75341]:     <boot dev="hd"/>
Nov 14 23:39:52 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 14 23:39:52 user nova-compute[75341]:   </os>
Nov 14 23:39:52 user nova-compute[75341]:   <features>
Nov 14 23:39:52 user nova-compute[75341]:     <acpi/>
Nov 14 23:39:52 user nova-compute[75341]:     <apic/>
Nov 14 23:39:52 user nova-compute[75341]:     <vmcoreinfo/>
Nov 14 23:39:52 user nova-compute[75341]:   </features>
Nov 14 23:39:52 user nova-compute[75341]:   <clock offset="utc">
Nov 14 23:39:52 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 23:39:52 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 23:39:52 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 14 23:39:52 user nova-compute[75341]:   </clock>
Nov 14 23:39:52 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 14 23:39:52 user nova-compute[75341]:     <model>Nehalem</model>
Nov 14 23:39:52 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 23:39:52 user nova-compute[75341]:   </cpu>
Nov 14 23:39:52 user nova-compute[75341]:   <devices>
Nov 14 23:39:52 user nova-compute[75341]:     <disk type="file" device="disk">
Nov 14 23:39:52 user nova-compute[75341]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 23:39:52 user nova-compute[75341]:       <source file="/opt/stack/data/nova/instances/91603fef-c1cc-4fa1-96b2-e840db651627/disk"/>
Nov 14 23:39:52 user nova-compute[75341]:       <target dev="vda" bus="virtio"/>
Nov 14 23:39:52 user nova-compute[75341]:     </disk>
Nov 14 23:39:52 user nova-compute[75341]:     <interface type="ethernet">
Nov 14 23:39:52 user nova-compute[75341]:       <mac address="fa:16:3e:0e:89:c0"/>
Nov 14 23:39:52 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:39:52 user nova-compute[75341]:       <mtu size="1442"/>
Nov 14 23:39:52 user nova-compute[75341]:       <target dev="tapc53d37cc-db"/>
Nov 14 23:39:52 user nova-compute[75341]:     </interface>
Nov 14 23:39:52 user nova-compute[75341]:     <serial type="pty">
Nov 14 23:39:52 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/91603fef-c1cc-4fa1-96b2-e840db651627/console.log" append="off"/>
Nov 14 23:39:52 user nova-compute[75341]:     </serial>
Nov 14 23:39:52 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 23:39:52 user nova-compute[75341]:     <video>
Nov 14 23:39:52 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:39:52 user nova-compute[75341]:     </video>
Nov 14 23:39:52 user nova-compute[75341]:     <rng model="virtio">
Nov 14 23:39:52 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 14 23:39:52 user nova-compute[75341]:     </rng>
Nov 14 23:39:52 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 14 23:39:52 user nova-compute[75341]:     <memballoon model="virtio">
Nov 14 23:39:52 user nova-compute[75341]:       <stats period="10"/>
Nov 14 23:39:52 user nova-compute[75341]:     </memballoon>
Nov 14 23:39:52 user nova-compute[75341]:   </devices>
Nov 14 23:39:52 user nova-compute[75341]: </domain>
Nov 14 23:39:52 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 23:39:52 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:39:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1998907683',display_name='tempest-DeleteServersTestJSON-server-1998907683',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1998907683',id=2,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8ea6112e51e4412941ef2e4a68ad1bb',ramdisk_id='',reservation_id='r-ytcf352t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-177205866',owner_user_name='tempest-DeleteServersTestJSON-177205866-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:39:49Z,user_data=None,user_id='00343699649c474a989c45344046190d',uuid=91603fef-c1cc-4fa1-96b2-e840db651627,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c53d37cc-db96-4531-9095-053de7f58643", "address": "fa:16:3e:0e:89:c0", "network": {"id": "07acc788-5f14-41b8-8aff-4d5c318cf71e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-470661925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ea6112e51e4412941ef2e4a68ad1bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc53d37cc-db", "ovs_interfaceid": "c53d37cc-db96-4531-9095-053de7f58643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 23:39:52 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Converting VIF {"id": "c53d37cc-db96-4531-9095-053de7f58643", "address": "fa:16:3e:0e:89:c0", "network": {"id": "07acc788-5f14-41b8-8aff-4d5c318cf71e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-470661925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ea6112e51e4412941ef2e4a68ad1bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc53d37cc-db", "ovs_interfaceid": "c53d37cc-db96-4531-9095-053de7f58643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:39:52 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:89:c0,bridge_name='br-int',has_traffic_filtering=True,id=c53d37cc-db96-4531-9095-053de7f58643,network=Network(07acc788-5f14-41b8-8aff-4d5c318cf71e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc53d37cc-db') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:39:52 user nova-compute[75341]: DEBUG os_vif [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:89:c0,bridge_name='br-int',has_traffic_filtering=True,id=c53d37cc-db96-4531-9095-053de7f58643,network=Network(07acc788-5f14-41b8-8aff-4d5c318cf71e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc53d37cc-db') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 23:39:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Created schema index Interface.name {{(pid=75341) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 14 23:39:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Created schema index Port.name {{(pid=75341) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 14 23:39:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Created schema index Bridge.name {{(pid=75341) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 14 23:39:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 23:39:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] [POLLOUT] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:39:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 23:39:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:39:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:39:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:39:52 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 23:39:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:39:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:39:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 23:39:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:39:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '80dbe8fe-1066-5807-8044-fc848d231e19', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:39:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:39:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:39:52 user nova-compute[75341]: DEBUG nova.policy [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '38acd33ad6754965a53017185f473f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f27e41f4cc1451291b8aca34544867b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75341) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 23:39:52 user nova-compute[75341]: DEBUG nova.compute.manager [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Start building block device mappings for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 23:39:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:39:52 user nova-compute[75341]: INFO oslo.privsep.daemon [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp0haqgmir/privsep.sock']
Nov 14 23:39:52 user sudo[84678]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp0haqgmir/privsep.sock
Nov 14 23:39:52 user sudo[84678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 14 23:39:52 user nova-compute[75341]: DEBUG nova.compute.manager [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Start spawning the instance on the hypervisor. {{(pid=75341) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 23:39:52 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Creating instance directory {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 23:39:52 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Creating image(s)
Nov 14 23:39:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Acquiring lock "/opt/stack/data/nova/instances/a308a35f-c8d7-482c-a93d-5d9eb473d4e1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:39:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "/opt/stack/data/nova/instances/a308a35f-c8d7-482c-a93d-5d9eb473d4e1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:39:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "/opt/stack/data/nova/instances/a308a35f-c8d7-482c-a93d-5d9eb473d4e1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:39:52 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:39:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.199s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:39:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Acquiring lock "4754efee9a6d73d3647f2add2cfe86c291949740" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:39:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:39:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:39:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.206s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:39:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/a308a35f-c8d7-482c-a93d-5d9eb473d4e1/disk 1073741824 {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:39:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/a308a35f-c8d7-482c-a93d-5d9eb473d4e1/disk 1073741824" returned: 0 in 0.046s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:39:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:39:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:39:53 user nova-compute[75341]: DEBUG nova.network.neutron [req-d4fc22e7-00d1-4f7c-97a4-ce6141c89e40 req-11f92803-ce63-45e6-817e-539d905327b5 service nova] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] Updated VIF entry in instance network info cache for port c53d37cc-db96-4531-9095-053de7f58643. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:39:53 user nova-compute[75341]: DEBUG nova.network.neutron [req-d4fc22e7-00d1-4f7c-97a4-ce6141c89e40 req-11f92803-ce63-45e6-817e-539d905327b5 service nova] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] Updating instance_info_cache with network_info: [{"id": "c53d37cc-db96-4531-9095-053de7f58643", "address": "fa:16:3e:0e:89:c0", "network": {"id": "07acc788-5f14-41b8-8aff-4d5c318cf71e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-470661925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ea6112e51e4412941ef2e4a68ad1bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc53d37cc-db", "ovs_interfaceid": "c53d37cc-db96-4531-9095-053de7f58643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:39:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.188s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:39:53 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a308a35f-c8d7-482c-a93d-5d9eb473d4e1/disk. size=1073741824 {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 23:39:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a308a35f-c8d7-482c-a93d-5d9eb473d4e1/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:39:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-d4fc22e7-00d1-4f7c-97a4-ce6141c89e40 req-11f92803-ce63-45e6-817e-539d905327b5 service nova] Releasing lock "refresh_cache-91603fef-c1cc-4fa1-96b2-e840db651627" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:39:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a308a35f-c8d7-482c-a93d-5d9eb473d4e1/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:39:53 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Cannot resize image /opt/stack/data/nova/instances/a308a35f-c8d7-482c-a93d-5d9eb473d4e1/disk to a smaller size. {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 23:39:53 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Created local disks {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 23:39:53 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Ensure instance console log exists: /opt/stack/data/nova/instances/a308a35f-c8d7-482c-a93d-5d9eb473d4e1/console.log {{(pid=75341) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 23:39:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:39:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:39:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:39:53 user nova-compute[75341]: DEBUG nova.network.neutron [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Successfully updated port: dcc0edd5-582a-499a-beaf-6de23ff1537c {{(pid=75341) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 23:39:53 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:39:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Acquiring lock "refresh_cache-881351d7-31f9-44f4-8571-8f540bbec29c" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:39:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Acquired lock "refresh_cache-881351d7-31f9-44f4-8571-8f540bbec29c" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:39:53 user nova-compute[75341]: DEBUG nova.network.neutron [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 23:39:53 user sudo[84678]: pam_unix(sudo:session): session closed for user root
Nov 14 23:39:53 user nova-compute[75341]: INFO oslo.privsep.daemon [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Spawned new privsep daemon via rootwrap
Nov 14 23:39:53 user nova-compute[75341]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 14 23:39:53 user nova-compute[75341]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 14 23:39:53 user nova-compute[75341]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 14 23:39:53 user nova-compute[75341]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84700
Nov 14 23:39:54 user nova-compute[75341]: DEBUG nova.network.neutron [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Instance cache missing network info. {{(pid=75341) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 23:39:54 user nova-compute[75341]: DEBUG nova.network.neutron [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Successfully created port: 4f1d8292-7392-4939-9303-437dc108b4a4 {{(pid=75341) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 23:39:54 user nova-compute[75341]: DEBUG nova.compute.manager [req-491f8c98-54df-4dc1-8b9e-73ba490cb685 req-59408913-d2af-41f0-8661-cd8218aed5e7 service nova] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Received event network-changed-dcc0edd5-582a-499a-beaf-6de23ff1537c {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:39:54 user nova-compute[75341]: DEBUG nova.compute.manager [req-491f8c98-54df-4dc1-8b9e-73ba490cb685 req-59408913-d2af-41f0-8661-cd8218aed5e7 service nova] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Refreshing instance network info cache due to event network-changed-dcc0edd5-582a-499a-beaf-6de23ff1537c. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:39:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-491f8c98-54df-4dc1-8b9e-73ba490cb685 req-59408913-d2af-41f0-8661-cd8218aed5e7 service nova] Acquiring lock "refresh_cache-881351d7-31f9-44f4-8571-8f540bbec29c" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:39:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:39:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc53d37cc-db, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:39:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc53d37cc-db, col_values=(('qos', UUID('30ffdd28-dbec-47a8-bd07-eabc542d43fd')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:39:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc53d37cc-db, col_values=(('external_ids', {'iface-id': 'c53d37cc-db96-4531-9095-053de7f58643', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:89:c0', 'vm-uuid': '91603fef-c1cc-4fa1-96b2-e840db651627'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:39:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:39:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:39:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:39:54 user nova-compute[75341]: INFO os_vif [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:89:c0,bridge_name='br-int',has_traffic_filtering=True,id=c53d37cc-db96-4531-9095-053de7f58643,network=Network(07acc788-5f14-41b8-8aff-4d5c318cf71e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc53d37cc-db')
Nov 14 23:39:54 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:39:54 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] No VIF found with MAC fa:16:3e:0e:89:c0, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:39:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:39:55 user nova-compute[75341]: DEBUG nova.network.neutron [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Updating instance_info_cache with network_info: [{"id": "dcc0edd5-582a-499a-beaf-6de23ff1537c", "address": "fa:16:3e:83:5b:7a", "network": {"id": "139c86e9-e6ea-4307-9f78-7f41ab7a6d8c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-487359378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eff8d64949254c7eb3dd8685ca7447b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc0edd5-58", "ovs_interfaceid": "dcc0edd5-582a-499a-beaf-6de23ff1537c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:39:55 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Releasing lock "refresh_cache-881351d7-31f9-44f4-8571-8f540bbec29c" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:39:55 user nova-compute[75341]: DEBUG nova.compute.manager [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Instance network_info: |[{"id": "dcc0edd5-582a-499a-beaf-6de23ff1537c", "address": "fa:16:3e:83:5b:7a", "network": {"id": "139c86e9-e6ea-4307-9f78-7f41ab7a6d8c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-487359378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eff8d64949254c7eb3dd8685ca7447b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc0edd5-58", "ovs_interfaceid": "dcc0edd5-582a-499a-beaf-6de23ff1537c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 23:39:55 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-491f8c98-54df-4dc1-8b9e-73ba490cb685 req-59408913-d2af-41f0-8661-cd8218aed5e7 service nova] Acquired lock "refresh_cache-881351d7-31f9-44f4-8571-8f540bbec29c" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:39:55 user nova-compute[75341]: DEBUG nova.network.neutron [req-491f8c98-54df-4dc1-8b9e-73ba490cb685 req-59408913-d2af-41f0-8661-cd8218aed5e7 service nova] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Refreshing network info cache for port dcc0edd5-582a-499a-beaf-6de23ff1537c {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:39:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Start _get_guest_xml network_info=[{"id": "dcc0edd5-582a-499a-beaf-6de23ff1537c", "address": "fa:16:3e:83:5b:7a", "network": {"id": "139c86e9-e6ea-4307-9f78-7f41ab7a6d8c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-487359378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eff8d64949254c7eb3dd8685ca7447b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc0edd5-58", "ovs_interfaceid": "dcc0edd5-582a-499a-beaf-6de23ff1537c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encrypted': False, 'image_id': 'e46abb82-b810-490e-a8a1-ccdc5fa1a796'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 23:39:55 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:39:55 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:39:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 23:39:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 23:39:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 23:39:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 23:39:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 23:39:55 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 23:39:55 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 23:39:55 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 23:39:55 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 23:39:55 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 23:39:55 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 23:39:55 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 23:39:55 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 23:39:55 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 23:39:55 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 23:39:55 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 23:39:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:39:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1731707158',display_name='tempest-ServerActionsTestOtherB-server-1731707158',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1731707158',id=1,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPcpkEsQSTpmH5o8Wvimru34qoMLk4crSEJeEz6XFBwMyGlgEqVH+eZU8RhCkfXTyDuMId//yiBmA84BMG1N70mUPHjpTANep7Y1Hwo1CNlTldBrdW9Ccxs8yCQLXA8Fw==',key_name='tempest-keypair-500318648',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eff8d64949254c7eb3dd8685ca7447b1',ramdisk_id='',reservation_id='r-505keefc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1632747205',owner_user_name='tempest-ServerActionsTestOtherB-1632747205-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:39:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='512d2ce7a01c4ffb924f9476a5c4b946',uuid=881351d7-31f9-44f4-8571-8f540bbec29c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dcc0edd5-582a-499a-beaf-6de23ff1537c", "address": "fa:16:3e:83:5b:7a", "network": {"id": "139c86e9-e6ea-4307-9f78-7f41ab7a6d8c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-487359378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eff8d64949254c7eb3dd8685ca7447b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc0edd5-58", "ovs_interfaceid": "dcc0edd5-582a-499a-beaf-6de23ff1537c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:39:55 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Converting VIF {"id": "dcc0edd5-582a-499a-beaf-6de23ff1537c", "address": "fa:16:3e:83:5b:7a", "network": {"id": "139c86e9-e6ea-4307-9f78-7f41ab7a6d8c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-487359378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eff8d64949254c7eb3dd8685ca7447b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc0edd5-58", "ovs_interfaceid": "dcc0edd5-582a-499a-beaf-6de23ff1537c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:39:55 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:5b:7a,bridge_name='br-int',has_traffic_filtering=True,id=dcc0edd5-582a-499a-beaf-6de23ff1537c,network=Network(139c86e9-e6ea-4307-9f78-7f41ab7a6d8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcc0edd5-58') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:39:55 user nova-compute[75341]: DEBUG nova.objects.instance [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Lazy-loading 'pci_devices' on Instance uuid 881351d7-31f9-44f4-8571-8f540bbec29c {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:39:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] End _get_guest_xml xml=<domain type="kvm">
Nov 14 23:39:55 user nova-compute[75341]:   <uuid>881351d7-31f9-44f4-8571-8f540bbec29c</uuid>
Nov 14 23:39:55 user nova-compute[75341]:   <name>instance-00000001</name>
Nov 14 23:39:55 user nova-compute[75341]:   <memory>524288</memory>
Nov 14 23:39:55 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 14 23:39:55 user nova-compute[75341]:   <metadata>
Nov 14 23:39:55 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 23:39:55 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 14 23:39:55 user nova-compute[75341]:       <nova:name>tempest-ServerActionsTestOtherB-server-1731707158</nova:name>
Nov 14 23:39:55 user nova-compute[75341]:       <nova:creationTime>2023-11-14 23:39:55</nova:creationTime>
Nov 14 23:39:55 user nova-compute[75341]:       <nova:flavor name="m1.tiny">
Nov 14 23:39:55 user nova-compute[75341]:         <nova:memory>512</nova:memory>
Nov 14 23:39:55 user nova-compute[75341]:         <nova:disk>1</nova:disk>
Nov 14 23:39:55 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 14 23:39:55 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 23:39:55 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 14 23:39:55 user nova-compute[75341]:       </nova:flavor>
Nov 14 23:39:55 user nova-compute[75341]:       <nova:owner>
Nov 14 23:39:55 user nova-compute[75341]:         <nova:user uuid="512d2ce7a01c4ffb924f9476a5c4b946">tempest-ServerActionsTestOtherB-1632747205-project-member</nova:user>
Nov 14 23:39:55 user nova-compute[75341]:         <nova:project uuid="eff8d64949254c7eb3dd8685ca7447b1">tempest-ServerActionsTestOtherB-1632747205</nova:project>
Nov 14 23:39:55 user nova-compute[75341]:       </nova:owner>
Nov 14 23:39:55 user nova-compute[75341]:       <nova:root type="image" uuid="e46abb82-b810-490e-a8a1-ccdc5fa1a796"/>
Nov 14 23:39:55 user nova-compute[75341]:       <nova:ports>
Nov 14 23:39:55 user nova-compute[75341]:         <nova:port uuid="dcc0edd5-582a-499a-beaf-6de23ff1537c">
Nov 14 23:39:55 user nova-compute[75341]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 23:39:55 user nova-compute[75341]:         </nova:port>
Nov 14 23:39:55 user nova-compute[75341]:       </nova:ports>
Nov 14 23:39:55 user nova-compute[75341]:     </nova:instance>
Nov 14 23:39:55 user nova-compute[75341]:   </metadata>
Nov 14 23:39:55 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 14 23:39:55 user nova-compute[75341]:     <system>
Nov 14 23:39:55 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 23:39:55 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 14 23:39:55 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 14 23:39:55 user nova-compute[75341]:       <entry name="serial">881351d7-31f9-44f4-8571-8f540bbec29c</entry>
Nov 14 23:39:55 user nova-compute[75341]:       <entry name="uuid">881351d7-31f9-44f4-8571-8f540bbec29c</entry>
Nov 14 23:39:55 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 14 23:39:55 user nova-compute[75341]:     </system>
Nov 14 23:39:55 user nova-compute[75341]:   </sysinfo>
Nov 14 23:39:55 user nova-compute[75341]:   <os>
Nov 14 23:39:55 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 23:39:55 user nova-compute[75341]:     <boot dev="hd"/>
Nov 14 23:39:55 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 14 23:39:55 user nova-compute[75341]:   </os>
Nov 14 23:39:55 user nova-compute[75341]:   <features>
Nov 14 23:39:55 user nova-compute[75341]:     <acpi/>
Nov 14 23:39:55 user nova-compute[75341]:     <apic/>
Nov 14 23:39:55 user nova-compute[75341]:     <vmcoreinfo/>
Nov 14 23:39:55 user nova-compute[75341]:   </features>
Nov 14 23:39:55 user nova-compute[75341]:   <clock offset="utc">
Nov 14 23:39:55 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 23:39:55 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 23:39:55 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 14 23:39:55 user nova-compute[75341]:   </clock>
Nov 14 23:39:55 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 14 23:39:55 user nova-compute[75341]:     <model>Nehalem</model>
Nov 14 23:39:55 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 23:39:55 user nova-compute[75341]:   </cpu>
Nov 14 23:39:55 user nova-compute[75341]:   <devices>
Nov 14 23:39:55 user nova-compute[75341]:     <disk type="file" device="disk">
Nov 14 23:39:55 user nova-compute[75341]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 23:39:55 user nova-compute[75341]:       <source file="/opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c/disk"/>
Nov 14 23:39:55 user nova-compute[75341]:       <target dev="vda" bus="virtio"/>
Nov 14 23:39:55 user nova-compute[75341]:     </disk>
Nov 14 23:39:55 user nova-compute[75341]:     <interface type="ethernet">
Nov 14 23:39:55 user nova-compute[75341]:       <mac address="fa:16:3e:83:5b:7a"/>
Nov 14 23:39:55 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:39:55 user nova-compute[75341]:       <mtu size="1442"/>
Nov 14 23:39:55 user nova-compute[75341]:       <target dev="tapdcc0edd5-58"/>
Nov 14 23:39:55 user nova-compute[75341]:     </interface>
Nov 14 23:39:55 user nova-compute[75341]:     <serial type="pty">
Nov 14 23:39:55 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c/console.log" append="off"/>
Nov 14 23:39:55 user nova-compute[75341]:     </serial>
Nov 14 23:39:55 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 23:39:55 user nova-compute[75341]:     <video>
Nov 14 23:39:55 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:39:55 user nova-compute[75341]:     </video>
Nov 14 23:39:55 user nova-compute[75341]:     <rng model="virtio">
Nov 14 23:39:55 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 14 23:39:55 user nova-compute[75341]:     </rng>
Nov 14 23:39:55 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 14 23:39:55 user nova-compute[75341]:     <memballoon model="virtio">
Nov 14 23:39:55 user nova-compute[75341]:       <stats period="10"/>
Nov 14 23:39:55 user nova-compute[75341]:     </memballoon>
Nov 14 23:39:55 user nova-compute[75341]:   </devices>
Nov 14 23:39:55 user nova-compute[75341]: </domain>
Nov 14 23:39:55 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 23:39:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:39:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1731707158',display_name='tempest-ServerActionsTestOtherB-server-1731707158',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1731707158',id=1,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPcpkEsQSTpmH5o8Wvimru34qoMLk4crSEJeEz6XFBwMyGlgEqVH+eZU8RhCkfXTyDuMId//yiBmA84BMG1N70mUPHjpTANep7Y1Hwo1CNlTldBrdW9Ccxs8yCQLXA8Fw==',key_name='tempest-keypair-500318648',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eff8d64949254c7eb3dd8685ca7447b1',ramdisk_id='',reservation_id='r-505keefc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1632747205',owner_user_name='tempest-ServerActionsTestOtherB-1632747205-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:39:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='512d2ce7a01c4ffb924f9476a5c4b946',uuid=881351d7-31f9-44f4-8571-8f540bbec29c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dcc0edd5-582a-499a-beaf-6de23ff1537c", "address": "fa:16:3e:83:5b:7a", "network": {"id": "139c86e9-e6ea-4307-9f78-7f41ab7a6d8c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-487359378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eff8d64949254c7eb3dd8685ca7447b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc0edd5-58", "ovs_interfaceid": "dcc0edd5-582a-499a-beaf-6de23ff1537c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 23:39:55 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Converting VIF {"id": "dcc0edd5-582a-499a-beaf-6de23ff1537c", "address": "fa:16:3e:83:5b:7a", "network": {"id": "139c86e9-e6ea-4307-9f78-7f41ab7a6d8c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-487359378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eff8d64949254c7eb3dd8685ca7447b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc0edd5-58", "ovs_interfaceid": "dcc0edd5-582a-499a-beaf-6de23ff1537c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:39:55 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:5b:7a,bridge_name='br-int',has_traffic_filtering=True,id=dcc0edd5-582a-499a-beaf-6de23ff1537c,network=Network(139c86e9-e6ea-4307-9f78-7f41ab7a6d8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcc0edd5-58') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:39:55 user nova-compute[75341]: DEBUG os_vif [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:5b:7a,bridge_name='br-int',has_traffic_filtering=True,id=dcc0edd5-582a-499a-beaf-6de23ff1537c,network=Network(139c86e9-e6ea-4307-9f78-7f41ab7a6d8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcc0edd5-58') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 23:39:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:39:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:39:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 23:39:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:39:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '50b635b7-e3cc-5480-a54f-4b5bf0d82bcd', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:39:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:39:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:39:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:39:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdcc0edd5-58, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:39:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdcc0edd5-58, col_values=(('qos', UUID('1230cd6d-9357-44fe-a930-fe18035bf9b3')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:39:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdcc0edd5-58, col_values=(('external_ids', {'iface-id': 'dcc0edd5-582a-499a-beaf-6de23ff1537c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:5b:7a', 'vm-uuid': '881351d7-31f9-44f4-8571-8f540bbec29c'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:39:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:39:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:39:55 user nova-compute[75341]: INFO os_vif [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:5b:7a,bridge_name='br-int',has_traffic_filtering=True,id=dcc0edd5-582a-499a-beaf-6de23ff1537c,network=Network(139c86e9-e6ea-4307-9f78-7f41ab7a6d8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcc0edd5-58')
Nov 14 23:39:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:39:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] No VIF found with MAC fa:16:3e:83:5b:7a, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:39:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:39:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:39:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:39:56 user nova-compute[75341]: DEBUG nova.network.neutron [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Successfully updated port: 4f1d8292-7392-4939-9303-437dc108b4a4 {{(pid=75341) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 23:39:56 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Acquiring lock "refresh_cache-a308a35f-c8d7-482c-a93d-5d9eb473d4e1" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:39:56 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Acquired lock "refresh_cache-a308a35f-c8d7-482c-a93d-5d9eb473d4e1" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:39:56 user nova-compute[75341]: DEBUG nova.network.neutron [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 23:39:56 user nova-compute[75341]: DEBUG nova.compute.manager [req-36b29a34-84d0-479f-89dc-502f2779e5fe req-c35ed432-2702-4a06-9616-73fe77cdb444 service nova] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Received event network-changed-4f1d8292-7392-4939-9303-437dc108b4a4 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:39:56 user nova-compute[75341]: DEBUG nova.compute.manager [req-36b29a34-84d0-479f-89dc-502f2779e5fe req-c35ed432-2702-4a06-9616-73fe77cdb444 service nova] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Refreshing instance network info cache due to event network-changed-4f1d8292-7392-4939-9303-437dc108b4a4. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:39:56 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-36b29a34-84d0-479f-89dc-502f2779e5fe req-c35ed432-2702-4a06-9616-73fe77cdb444 service nova] Acquiring lock "refresh_cache-a308a35f-c8d7-482c-a93d-5d9eb473d4e1" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:39:56 user nova-compute[75341]: DEBUG nova.network.neutron [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Instance cache missing network info. {{(pid=75341) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 23:39:57 user nova-compute[75341]: DEBUG nova.network.neutron [req-491f8c98-54df-4dc1-8b9e-73ba490cb685 req-59408913-d2af-41f0-8661-cd8218aed5e7 service nova] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Updated VIF entry in instance network info cache for port dcc0edd5-582a-499a-beaf-6de23ff1537c. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:39:57 user nova-compute[75341]: DEBUG nova.network.neutron [req-491f8c98-54df-4dc1-8b9e-73ba490cb685 req-59408913-d2af-41f0-8661-cd8218aed5e7 service nova] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Updating instance_info_cache with network_info: [{"id": "dcc0edd5-582a-499a-beaf-6de23ff1537c", "address": "fa:16:3e:83:5b:7a", "network": {"id": "139c86e9-e6ea-4307-9f78-7f41ab7a6d8c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-487359378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eff8d64949254c7eb3dd8685ca7447b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc0edd5-58", "ovs_interfaceid": "dcc0edd5-582a-499a-beaf-6de23ff1537c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:39:57 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-491f8c98-54df-4dc1-8b9e-73ba490cb685 req-59408913-d2af-41f0-8661-cd8218aed5e7 service nova] Releasing lock "refresh_cache-881351d7-31f9-44f4-8571-8f540bbec29c" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:39:57 user nova-compute[75341]: DEBUG nova.network.neutron [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Updating instance_info_cache with network_info: [{"id": "4f1d8292-7392-4939-9303-437dc108b4a4", "address": "fa:16:3e:be:2c:ef", "network": {"id": "e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-64240219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f27e41f4cc1451291b8aca34544867b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f1d8292-73", "ovs_interfaceid": "4f1d8292-7392-4939-9303-437dc108b4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:39:57 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Releasing lock "refresh_cache-a308a35f-c8d7-482c-a93d-5d9eb473d4e1" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:39:57 user nova-compute[75341]: DEBUG nova.compute.manager [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Instance network_info: |[{"id": "4f1d8292-7392-4939-9303-437dc108b4a4", "address": "fa:16:3e:be:2c:ef", "network": {"id": "e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-64240219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f27e41f4cc1451291b8aca34544867b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f1d8292-73", "ovs_interfaceid": "4f1d8292-7392-4939-9303-437dc108b4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 23:39:57 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-36b29a34-84d0-479f-89dc-502f2779e5fe req-c35ed432-2702-4a06-9616-73fe77cdb444 service nova] Acquired lock "refresh_cache-a308a35f-c8d7-482c-a93d-5d9eb473d4e1" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:39:57 user nova-compute[75341]: DEBUG nova.network.neutron [req-36b29a34-84d0-479f-89dc-502f2779e5fe req-c35ed432-2702-4a06-9616-73fe77cdb444 service nova] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Refreshing network info cache for port 4f1d8292-7392-4939-9303-437dc108b4a4 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:39:57 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Start _get_guest_xml network_info=[{"id": "4f1d8292-7392-4939-9303-437dc108b4a4", "address": "fa:16:3e:be:2c:ef", "network": {"id": "e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-64240219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f27e41f4cc1451291b8aca34544867b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f1d8292-73", "ovs_interfaceid": "4f1d8292-7392-4939-9303-437dc108b4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encrypted': False, 'image_id': 'e46abb82-b810-490e-a8a1-ccdc5fa1a796'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 23:39:57 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:39:57 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:39:57 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 23:39:57 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 23:39:57 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 23:39:57 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 23:39:57 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 23:39:57 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 23:39:57 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 23:39:57 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 23:39:57 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 23:39:57 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 23:39:57 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 23:39:57 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 23:39:57 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 23:39:57 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 23:39:57 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 23:39:57 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 23:39:57 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:39:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-173111556',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-173111556',id=3,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0Mg2JrUiYyfg6677+2Zv9Zqfgif2/3/pm4zugiZs2hm3xmaZY7SDs9SySwEI9I4Xie+mX5Zi6rK0j32qh+7Hye8jW21rtlODM9AFIkTLXzgrChX2YVLtprZJUc0cBR9g==',key_name='tempest-keypair-2143336801',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f27e41f4cc1451291b8aca34544867b',ramdisk_id='',reservation_id='r-w2ae1nv0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-946394493',owner_user_name='tempest-AttachVolumeShelveTestJSON-946394493-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:39:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38acd33ad6754965a53017185f473f8a',uuid=a308a35f-c8d7-482c-a93d-5d9eb473d4e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f1d8292-7392-4939-9303-437dc108b4a4", "address": "fa:16:3e:be:2c:ef", "network": {"id": "e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-64240219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f27e41f4cc1451291b8aca34544867b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f1d8292-73", "ovs_interfaceid": "4f1d8292-7392-4939-9303-437dc108b4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:39:57 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Converting VIF {"id": "4f1d8292-7392-4939-9303-437dc108b4a4", "address": "fa:16:3e:be:2c:ef", "network": {"id": "e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-64240219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f27e41f4cc1451291b8aca34544867b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f1d8292-73", "ovs_interfaceid": "4f1d8292-7392-4939-9303-437dc108b4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:39:57 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:2c:ef,bridge_name='br-int',has_traffic_filtering=True,id=4f1d8292-7392-4939-9303-437dc108b4a4,network=Network(e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f1d8292-73') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:39:57 user nova-compute[75341]: DEBUG nova.objects.instance [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lazy-loading 'pci_devices' on Instance uuid a308a35f-c8d7-482c-a93d-5d9eb473d4e1 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:39:57 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] End _get_guest_xml xml=<domain type="kvm">
Nov 14 23:39:57 user nova-compute[75341]:   <uuid>a308a35f-c8d7-482c-a93d-5d9eb473d4e1</uuid>
Nov 14 23:39:57 user nova-compute[75341]:   <name>instance-00000003</name>
Nov 14 23:39:57 user nova-compute[75341]:   <memory>524288</memory>
Nov 14 23:39:57 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 14 23:39:57 user nova-compute[75341]:   <metadata>
Nov 14 23:39:57 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 23:39:57 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 14 23:39:57 user nova-compute[75341]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-173111556</nova:name>
Nov 14 23:39:57 user nova-compute[75341]:       <nova:creationTime>2023-11-14 23:39:57</nova:creationTime>
Nov 14 23:39:57 user nova-compute[75341]:       <nova:flavor name="m1.tiny">
Nov 14 23:39:57 user nova-compute[75341]:         <nova:memory>512</nova:memory>
Nov 14 23:39:57 user nova-compute[75341]:         <nova:disk>1</nova:disk>
Nov 14 23:39:57 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 14 23:39:57 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 23:39:57 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 14 23:39:57 user nova-compute[75341]:       </nova:flavor>
Nov 14 23:39:57 user nova-compute[75341]:       <nova:owner>
Nov 14 23:39:57 user nova-compute[75341]:         <nova:user uuid="38acd33ad6754965a53017185f473f8a">tempest-AttachVolumeShelveTestJSON-946394493-project-member</nova:user>
Nov 14 23:39:57 user nova-compute[75341]:         <nova:project uuid="5f27e41f4cc1451291b8aca34544867b">tempest-AttachVolumeShelveTestJSON-946394493</nova:project>
Nov 14 23:39:57 user nova-compute[75341]:       </nova:owner>
Nov 14 23:39:57 user nova-compute[75341]:       <nova:root type="image" uuid="e46abb82-b810-490e-a8a1-ccdc5fa1a796"/>
Nov 14 23:39:57 user nova-compute[75341]:       <nova:ports>
Nov 14 23:39:57 user nova-compute[75341]:         <nova:port uuid="4f1d8292-7392-4939-9303-437dc108b4a4">
Nov 14 23:39:57 user nova-compute[75341]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 23:39:57 user nova-compute[75341]:         </nova:port>
Nov 14 23:39:57 user nova-compute[75341]:       </nova:ports>
Nov 14 23:39:57 user nova-compute[75341]:     </nova:instance>
Nov 14 23:39:57 user nova-compute[75341]:   </metadata>
Nov 14 23:39:57 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 14 23:39:57 user nova-compute[75341]:     <system>
Nov 14 23:39:57 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 23:39:57 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 14 23:39:57 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 14 23:39:57 user nova-compute[75341]:       <entry name="serial">a308a35f-c8d7-482c-a93d-5d9eb473d4e1</entry>
Nov 14 23:39:57 user nova-compute[75341]:       <entry name="uuid">a308a35f-c8d7-482c-a93d-5d9eb473d4e1</entry>
Nov 14 23:39:57 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 14 23:39:57 user nova-compute[75341]:     </system>
Nov 14 23:39:57 user nova-compute[75341]:   </sysinfo>
Nov 14 23:39:57 user nova-compute[75341]:   <os>
Nov 14 23:39:57 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 23:39:57 user nova-compute[75341]:     <boot dev="hd"/>
Nov 14 23:39:57 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 14 23:39:57 user nova-compute[75341]:   </os>
Nov 14 23:39:57 user nova-compute[75341]:   <features>
Nov 14 23:39:57 user nova-compute[75341]:     <acpi/>
Nov 14 23:39:57 user nova-compute[75341]:     <apic/>
Nov 14 23:39:57 user nova-compute[75341]:     <vmcoreinfo/>
Nov 14 23:39:57 user nova-compute[75341]:   </features>
Nov 14 23:39:57 user nova-compute[75341]:   <clock offset="utc">
Nov 14 23:39:57 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 23:39:57 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 23:39:57 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 14 23:39:57 user nova-compute[75341]:   </clock>
Nov 14 23:39:57 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 14 23:39:57 user nova-compute[75341]:     <model>Nehalem</model>
Nov 14 23:39:57 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 23:39:57 user nova-compute[75341]:   </cpu>
Nov 14 23:39:57 user nova-compute[75341]:   <devices>
Nov 14 23:39:57 user nova-compute[75341]:     <disk type="file" device="disk">
Nov 14 23:39:57 user nova-compute[75341]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 23:39:57 user nova-compute[75341]:       <source file="/opt/stack/data/nova/instances/a308a35f-c8d7-482c-a93d-5d9eb473d4e1/disk"/>
Nov 14 23:39:57 user nova-compute[75341]:       <target dev="vda" bus="virtio"/>
Nov 14 23:39:57 user nova-compute[75341]:     </disk>
Nov 14 23:39:57 user nova-compute[75341]:     <interface type="ethernet">
Nov 14 23:39:57 user nova-compute[75341]:       <mac address="fa:16:3e:be:2c:ef"/>
Nov 14 23:39:57 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:39:57 user nova-compute[75341]:       <mtu size="1442"/>
Nov 14 23:39:57 user nova-compute[75341]:       <target dev="tap4f1d8292-73"/>
Nov 14 23:39:57 user nova-compute[75341]:     </interface>
Nov 14 23:39:57 user nova-compute[75341]:     <serial type="pty">
Nov 14 23:39:57 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/a308a35f-c8d7-482c-a93d-5d9eb473d4e1/console.log" append="off"/>
Nov 14 23:39:57 user nova-compute[75341]:     </serial>
Nov 14 23:39:57 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 23:39:57 user nova-compute[75341]:     <video>
Nov 14 23:39:57 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:39:57 user nova-compute[75341]:     </video>
Nov 14 23:39:57 user nova-compute[75341]:     <rng model="virtio">
Nov 14 23:39:57 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 14 23:39:57 user nova-compute[75341]:     </rng>
Nov 14 23:39:57 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 14 23:39:57 user nova-compute[75341]:     <memballoon model="virtio">
Nov 14 23:39:57 user nova-compute[75341]:       <stats period="10"/>
Nov 14 23:39:57 user nova-compute[75341]:     </memballoon>
Nov 14 23:39:57 user nova-compute[75341]:   </devices>
Nov 14 23:39:57 user nova-compute[75341]: </domain>
Nov 14 23:39:57 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 23:39:57 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:39:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-173111556',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-173111556',id=3,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0Mg2JrUiYyfg6677+2Zv9Zqfgif2/3/pm4zugiZs2hm3xmaZY7SDs9SySwEI9I4Xie+mX5Zi6rK0j32qh+7Hye8jW21rtlODM9AFIkTLXzgrChX2YVLtprZJUc0cBR9g==',key_name='tempest-keypair-2143336801',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f27e41f4cc1451291b8aca34544867b',ramdisk_id='',reservation_id='r-w2ae1nv0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-946394493',owner_user_name='tempest-AttachVolumeShelveTestJSON-946394493-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:39:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38acd33ad6754965a53017185f473f8a',uuid=a308a35f-c8d7-482c-a93d-5d9eb473d4e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f1d8292-7392-4939-9303-437dc108b4a4", "address": "fa:16:3e:be:2c:ef", "network": {"id": "e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-64240219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f27e41f4cc1451291b8aca34544867b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f1d8292-73", "ovs_interfaceid": "4f1d8292-7392-4939-9303-437dc108b4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 23:39:57 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Converting VIF {"id": "4f1d8292-7392-4939-9303-437dc108b4a4", "address": "fa:16:3e:be:2c:ef", "network": {"id": "e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-64240219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f27e41f4cc1451291b8aca34544867b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f1d8292-73", "ovs_interfaceid": "4f1d8292-7392-4939-9303-437dc108b4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:39:57 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:2c:ef,bridge_name='br-int',has_traffic_filtering=True,id=4f1d8292-7392-4939-9303-437dc108b4a4,network=Network(e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f1d8292-73') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:39:57 user nova-compute[75341]: DEBUG os_vif [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:2c:ef,bridge_name='br-int',has_traffic_filtering=True,id=4f1d8292-7392-4939-9303-437dc108b4a4,network=Network(e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f1d8292-73') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 23:39:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:39:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:39:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 23:39:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:39:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '68a4f024-b740-56af-8435-95df2b2dd82d', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:39:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:39:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:39:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:39:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4f1d8292-73, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:39:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4f1d8292-73, col_values=(('qos', UUID('b136ad29-651f-406d-a623-3d8beda3400a')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:39:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4f1d8292-73, col_values=(('external_ids', {'iface-id': '4f1d8292-7392-4939-9303-437dc108b4a4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:2c:ef', 'vm-uuid': 'a308a35f-c8d7-482c-a93d-5d9eb473d4e1'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:39:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:39:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:39:57 user nova-compute[75341]: INFO os_vif [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:2c:ef,bridge_name='br-int',has_traffic_filtering=True,id=4f1d8292-7392-4939-9303-437dc108b4a4,network=Network(e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f1d8292-73')
Nov 14 23:39:57 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:39:57 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] No VIF found with MAC fa:16:3e:be:2c:ef, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:39:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:39:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:39:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:39:58 user nova-compute[75341]: DEBUG nova.network.neutron [req-36b29a34-84d0-479f-89dc-502f2779e5fe req-c35ed432-2702-4a06-9616-73fe77cdb444 service nova] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Updated VIF entry in instance network info cache for port 4f1d8292-7392-4939-9303-437dc108b4a4. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:39:58 user nova-compute[75341]: DEBUG nova.network.neutron [req-36b29a34-84d0-479f-89dc-502f2779e5fe req-c35ed432-2702-4a06-9616-73fe77cdb444 service nova] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Updating instance_info_cache with network_info: [{"id": "4f1d8292-7392-4939-9303-437dc108b4a4", "address": "fa:16:3e:be:2c:ef", "network": {"id": "e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-64240219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f27e41f4cc1451291b8aca34544867b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f1d8292-73", "ovs_interfaceid": "4f1d8292-7392-4939-9303-437dc108b4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:39:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-36b29a34-84d0-479f-89dc-502f2779e5fe req-c35ed432-2702-4a06-9616-73fe77cdb444 service nova] Releasing lock "refresh_cache-a308a35f-c8d7-482c-a93d-5d9eb473d4e1" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:39:59 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:39:59 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:39:59 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:39:59 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:00 user nova-compute[75341]: DEBUG nova.compute.manager [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] Instance event wait completed in 0 seconds for  {{(pid=75341) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 23:40:00 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] Guest created on hypervisor {{(pid=75341) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 23:40:00 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] Instance spawned successfully.
Nov 14 23:40:00 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 23:40:00 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] Found default for hw_cdrom_bus of ide {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:40:00 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] Found default for hw_disk_bus of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:40:00 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] Found default for hw_input_bus of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:40:00 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] Found default for hw_pointer_model of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:40:00 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] Found default for hw_video_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:40:00 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] Found default for hw_vif_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:40:00 user nova-compute[75341]: INFO nova.compute.manager [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] Took 11.49 seconds to spawn the instance on the hypervisor.
Nov 14 23:40:00 user nova-compute[75341]: DEBUG nova.compute.manager [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 23:40:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:00 user nova-compute[75341]: DEBUG nova.compute.manager [req-e55dcabe-da4d-43e3-a0d5-546da829cd9f req-17d6bdca-1bcc-48bc-86e6-acd33d3fb53a service nova] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Received event network-vif-plugged-dcc0edd5-582a-499a-beaf-6de23ff1537c {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:40:00 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-e55dcabe-da4d-43e3-a0d5-546da829cd9f req-17d6bdca-1bcc-48bc-86e6-acd33d3fb53a service nova] Acquiring lock "881351d7-31f9-44f4-8571-8f540bbec29c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:40:00 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-e55dcabe-da4d-43e3-a0d5-546da829cd9f req-17d6bdca-1bcc-48bc-86e6-acd33d3fb53a service nova] Lock "881351d7-31f9-44f4-8571-8f540bbec29c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.017s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:40:00 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-e55dcabe-da4d-43e3-a0d5-546da829cd9f req-17d6bdca-1bcc-48bc-86e6-acd33d3fb53a service nova] Lock "881351d7-31f9-44f4-8571-8f540bbec29c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:40:00 user nova-compute[75341]: DEBUG nova.compute.manager [req-e55dcabe-da4d-43e3-a0d5-546da829cd9f req-17d6bdca-1bcc-48bc-86e6-acd33d3fb53a service nova] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] No waiting events found dispatching network-vif-plugged-dcc0edd5-582a-499a-beaf-6de23ff1537c {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:40:00 user nova-compute[75341]: WARNING nova.compute.manager [req-e55dcabe-da4d-43e3-a0d5-546da829cd9f req-17d6bdca-1bcc-48bc-86e6-acd33d3fb53a service nova] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Received unexpected event network-vif-plugged-dcc0edd5-582a-499a-beaf-6de23ff1537c for instance with vm_state building and task_state spawning.
Nov 14 23:40:00 user nova-compute[75341]: INFO nova.compute.manager [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] Took 12.67 seconds to build instance.
Nov 14 23:40:00 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cfd8db62-0078-4e88-88d1-05afef6cb602 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Lock "91603fef-c1cc-4fa1-96b2-e840db651627" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.814s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:40:00 user nova-compute[75341]: DEBUG nova.compute.manager [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Instance event wait completed in 0 seconds for  {{(pid=75341) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 23:40:00 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Guest created on hypervisor {{(pid=75341) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 23:40:00 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Instance spawned successfully.
Nov 14 23:40:00 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 23:40:00 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Found default for hw_cdrom_bus of ide {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:40:00 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Found default for hw_disk_bus of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:40:00 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Found default for hw_input_bus of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:40:00 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Found default for hw_pointer_model of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:40:00 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Found default for hw_video_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:40:00 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Found default for hw_vif_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:40:01 user nova-compute[75341]: INFO nova.compute.manager [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Took 14.02 seconds to spawn the instance on the hypervisor.
Nov 14 23:40:01 user nova-compute[75341]: DEBUG nova.compute.manager [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 23:40:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:01 user nova-compute[75341]: INFO nova.compute.manager [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Took 15.31 seconds to build instance.
Nov 14 23:40:01 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-27dbd0ba-542a-43c3-9343-f68bb45187b6 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Lock "881351d7-31f9-44f4-8571-8f540bbec29c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.524s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:40:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:01 user nova-compute[75341]: DEBUG nova.compute.manager [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Instance event wait completed in 0 seconds for  {{(pid=75341) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 23:40:01 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Guest created on hypervisor {{(pid=75341) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 23:40:01 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Instance spawned successfully.
Nov 14 23:40:01 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 23:40:01 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Found default for hw_cdrom_bus of ide {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:40:01 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Found default for hw_disk_bus of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:40:01 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Found default for hw_input_bus of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:40:01 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Found default for hw_pointer_model of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:40:01 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Found default for hw_video_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:40:01 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Found default for hw_vif_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:40:02 user nova-compute[75341]: INFO nova.compute.manager [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Took 9.19 seconds to spawn the instance on the hypervisor.
Nov 14 23:40:02 user nova-compute[75341]: DEBUG nova.compute.manager [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 23:40:02 user nova-compute[75341]: INFO nova.compute.manager [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Took 10.41 seconds to build instance.
Nov 14 23:40:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:02 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-10f301a7-ac64-4297-85fd-07d8b4a61449 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "a308a35f-c8d7-482c-a93d-5d9eb473d4e1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.591s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:40:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:02 user nova-compute[75341]: DEBUG nova.compute.manager [req-2290b873-32cb-4217-8d0c-6023e1f1812f req-1d410503-bd16-4422-9427-476b67286aeb service nova] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Received event network-vif-plugged-dcc0edd5-582a-499a-beaf-6de23ff1537c {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:40:02 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-2290b873-32cb-4217-8d0c-6023e1f1812f req-1d410503-bd16-4422-9427-476b67286aeb service nova] Acquiring lock "881351d7-31f9-44f4-8571-8f540bbec29c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:40:02 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-2290b873-32cb-4217-8d0c-6023e1f1812f req-1d410503-bd16-4422-9427-476b67286aeb service nova] Lock "881351d7-31f9-44f4-8571-8f540bbec29c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:40:02 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-2290b873-32cb-4217-8d0c-6023e1f1812f req-1d410503-bd16-4422-9427-476b67286aeb service nova] Lock "881351d7-31f9-44f4-8571-8f540bbec29c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:40:02 user nova-compute[75341]: DEBUG nova.compute.manager [req-2290b873-32cb-4217-8d0c-6023e1f1812f req-1d410503-bd16-4422-9427-476b67286aeb service nova] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] No waiting events found dispatching network-vif-plugged-dcc0edd5-582a-499a-beaf-6de23ff1537c {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:40:02 user nova-compute[75341]: WARNING nova.compute.manager [req-2290b873-32cb-4217-8d0c-6023e1f1812f req-1d410503-bd16-4422-9427-476b67286aeb service nova] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Received unexpected event network-vif-plugged-dcc0edd5-582a-499a-beaf-6de23ff1537c for instance with vm_state active and task_state None.
Nov 14 23:40:03 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:03 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:03 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:03 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:05 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:05 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:05 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:05 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:05 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Acquiring lock "a0cffbac-f552-47bf-bd6c-dabb70e7c867" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:40:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Lock "a0cffbac-f552-47bf-bd6c-dabb70e7c867" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:40:08 user nova-compute[75341]: DEBUG nova.compute.manager [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Starting instance... {{(pid=75341) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 23:40:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:40:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:40:08 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75341) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 23:40:08 user nova-compute[75341]: INFO nova.compute.claims [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Claim successful on node user
Nov 14 23:40:09 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:40:09 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:40:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.593s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:40:09 user nova-compute[75341]: DEBUG nova.compute.manager [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Start building networks asynchronously for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 23:40:09 user nova-compute[75341]: DEBUG nova.compute.manager [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Allocating IP information in the background. {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 23:40:09 user nova-compute[75341]: DEBUG nova.network.neutron [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] allocate_for_instance() {{(pid=75341) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 23:40:09 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 23:40:09 user nova-compute[75341]: DEBUG nova.compute.manager [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Start building block device mappings for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 23:40:09 user nova-compute[75341]: DEBUG nova.policy [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7cc85fb2b1a141578ba9558bc79ccc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c8a897400c74100ad6c115397bc84ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75341) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 23:40:10 user nova-compute[75341]: DEBUG nova.compute.manager [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Start spawning the instance on the hypervisor. {{(pid=75341) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 23:40:10 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Creating instance directory {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 23:40:10 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Creating image(s)
Nov 14 23:40:10 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Acquiring lock "/opt/stack/data/nova/instances/a0cffbac-f552-47bf-bd6c-dabb70e7c867/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:40:10 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Lock "/opt/stack/data/nova/instances/a0cffbac-f552-47bf-bd6c-dabb70e7c867/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:40:10 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Lock "/opt/stack/data/nova/instances/a0cffbac-f552-47bf-bd6c-dabb70e7c867/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:40:10 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:10 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.245s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:10 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Acquiring lock "4754efee9a6d73d3647f2add2cfe86c291949740" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:40:10 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:40:10 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:10 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.261s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:10 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/a0cffbac-f552-47bf-bd6c-dabb70e7c867/disk 1073741824 {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:10 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:10 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/a0cffbac-f552-47bf-bd6c-dabb70e7c867/disk 1073741824" returned: 0 in 0.076s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:10 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.342s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:40:10 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:10 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.232s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:10 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a0cffbac-f552-47bf-bd6c-dabb70e7c867/disk. size=1073741824 {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 23:40:10 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0cffbac-f552-47bf-bd6c-dabb70e7c867/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:10 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Acquiring lock "0e7a53e9-6982-4c93-a830-a49cf0ce76bd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:40:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Lock "0e7a53e9-6982-4c93-a830-a49cf0ce76bd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:40:11 user nova-compute[75341]: DEBUG nova.compute.manager [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Starting instance... {{(pid=75341) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 23:40:11 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0cffbac-f552-47bf-bd6c-dabb70e7c867/disk --force-share --output=json" returned: 0 in 0.288s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:11 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Cannot resize image /opt/stack/data/nova/instances/a0cffbac-f552-47bf-bd6c-dabb70e7c867/disk to a smaller size. {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 23:40:11 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Created local disks {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 23:40:11 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Ensure instance console log exists: /opt/stack/data/nova/instances/a0cffbac-f552-47bf-bd6c-dabb70e7c867/console.log {{(pid=75341) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 23:40:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:40:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:40:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:40:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:40:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:40:11 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75341) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 23:40:11 user nova-compute[75341]: INFO nova.compute.claims [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Claim successful on node user
Nov 14 23:40:11 user nova-compute[75341]: DEBUG nova.network.neutron [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Successfully created port: 8a863ecb-919e-42ac-8507-1c9af9135895 {{(pid=75341) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 23:40:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Acquiring lock "b7d427ed-6ac3-46d9-bebc-d672f465f850" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:40:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Lock "b7d427ed-6ac3-46d9-bebc-d672f465f850" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:40:11 user nova-compute[75341]: DEBUG nova.compute.manager [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] Starting instance... {{(pid=75341) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 23:40:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:40:11 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:40:11 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:40:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.735s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:40:11 user nova-compute[75341]: DEBUG nova.compute.manager [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Start building networks asynchronously for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 23:40:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.256s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:40:11 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75341) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 23:40:11 user nova-compute[75341]: INFO nova.compute.claims [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] Claim successful on node user
Nov 14 23:40:12 user nova-compute[75341]: DEBUG nova.compute.manager [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Allocating IP information in the background. {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 23:40:12 user nova-compute[75341]: DEBUG nova.network.neutron [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] allocate_for_instance() {{(pid=75341) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 23:40:12 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 23:40:12 user nova-compute[75341]: DEBUG nova.compute.manager [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Start building block device mappings for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 23:40:12 user nova-compute[75341]: DEBUG nova.network.neutron [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Successfully updated port: 8a863ecb-919e-42ac-8507-1c9af9135895 {{(pid=75341) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 23:40:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Acquiring lock "refresh_cache-a0cffbac-f552-47bf-bd6c-dabb70e7c867" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:40:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Acquired lock "refresh_cache-a0cffbac-f552-47bf-bd6c-dabb70e7c867" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:40:12 user nova-compute[75341]: DEBUG nova.network.neutron [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 23:40:12 user nova-compute[75341]: DEBUG nova.compute.manager [req-8fb3c6a2-f8ee-40e9-ac19-ea8176168f4d req-1ad60f5a-f355-4e61-b2ab-04f4f755f467 service nova] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Received event network-changed-8a863ecb-919e-42ac-8507-1c9af9135895 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:40:12 user nova-compute[75341]: DEBUG nova.compute.manager [req-8fb3c6a2-f8ee-40e9-ac19-ea8176168f4d req-1ad60f5a-f355-4e61-b2ab-04f4f755f467 service nova] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Refreshing instance network info cache due to event network-changed-8a863ecb-919e-42ac-8507-1c9af9135895. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:40:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-8fb3c6a2-f8ee-40e9-ac19-ea8176168f4d req-1ad60f5a-f355-4e61-b2ab-04f4f755f467 service nova] Acquiring lock "refresh_cache-a0cffbac-f552-47bf-bd6c-dabb70e7c867" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:40:12 user nova-compute[75341]: DEBUG nova.policy [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '666ca2b69b3f487687ba900bd04221d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaee8b9e61234bc68b1da5fceb349cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75341) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 23:40:12 user nova-compute[75341]: DEBUG nova.network.neutron [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Instance cache missing network info. {{(pid=75341) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 23:40:12 user nova-compute[75341]: DEBUG nova.compute.manager [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Start spawning the instance on the hypervisor. {{(pid=75341) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 23:40:12 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Creating instance directory {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 23:40:12 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Creating image(s)
Nov 14 23:40:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Acquiring lock "/opt/stack/data/nova/instances/0e7a53e9-6982-4c93-a830-a49cf0ce76bd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:40:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Lock "/opt/stack/data/nova/instances/0e7a53e9-6982-4c93-a830-a49cf0ce76bd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:40:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Lock "/opt/stack/data/nova/instances/0e7a53e9-6982-4c93-a830-a49cf0ce76bd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:40:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Acquiring lock "163c448b-0183-41bb-b6e0-61917f6ad781" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:40:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Lock "163c448b-0183-41bb-b6e0-61917f6ad781" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:40:12 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:40:12 user nova-compute[75341]: DEBUG nova.compute.manager [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Starting instance... {{(pid=75341) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 23:40:12 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:40:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.664s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:40:12 user nova-compute[75341]: DEBUG nova.compute.manager [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] Start building networks asynchronously for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 23:40:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.319s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Acquiring lock "4754efee9a6d73d3647f2add2cfe86c291949740" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:40:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:40:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:12 user nova-compute[75341]: DEBUG nova.network.neutron [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Updating instance_info_cache with network_info: [{"id": "8a863ecb-919e-42ac-8507-1c9af9135895", "address": "fa:16:3e:0c:75:47", "network": {"id": "a59b651e-81c5-4a68-b694-1e84de25e915", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1023462603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8a897400c74100ad6c115397bc84ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a863ecb-91", "ovs_interfaceid": "8a863ecb-919e-42ac-8507-1c9af9135895", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:40:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:40:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:40:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Releasing lock "refresh_cache-a0cffbac-f552-47bf-bd6c-dabb70e7c867" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:40:12 user nova-compute[75341]: DEBUG nova.compute.manager [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Instance network_info: |[{"id": "8a863ecb-919e-42ac-8507-1c9af9135895", "address": "fa:16:3e:0c:75:47", "network": {"id": "a59b651e-81c5-4a68-b694-1e84de25e915", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1023462603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8a897400c74100ad6c115397bc84ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a863ecb-91", "ovs_interfaceid": "8a863ecb-919e-42ac-8507-1c9af9135895", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 23:40:12 user nova-compute[75341]: DEBUG nova.compute.manager [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] Allocating IP information in the background. {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 23:40:12 user nova-compute[75341]: DEBUG nova.network.neutron [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] allocate_for_instance() {{(pid=75341) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 23:40:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-8fb3c6a2-f8ee-40e9-ac19-ea8176168f4d req-1ad60f5a-f355-4e61-b2ab-04f4f755f467 service nova] Acquired lock "refresh_cache-a0cffbac-f552-47bf-bd6c-dabb70e7c867" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:40:12 user nova-compute[75341]: DEBUG nova.network.neutron [req-8fb3c6a2-f8ee-40e9-ac19-ea8176168f4d req-1ad60f5a-f355-4e61-b2ab-04f4f755f467 service nova] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Refreshing network info cache for port 8a863ecb-919e-42ac-8507-1c9af9135895 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:40:12 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Start _get_guest_xml network_info=[{"id": "8a863ecb-919e-42ac-8507-1c9af9135895", "address": "fa:16:3e:0c:75:47", "network": {"id": "a59b651e-81c5-4a68-b694-1e84de25e915", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1023462603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8a897400c74100ad6c115397bc84ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a863ecb-91", "ovs_interfaceid": "8a863ecb-919e-42ac-8507-1c9af9135895", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encrypted': False, 'image_id': 'e46abb82-b810-490e-a8a1-ccdc5fa1a796'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 23:40:12 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 14 23:40:12 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75341) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 23:40:12 user nova-compute[75341]: INFO nova.compute.claims [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Claim successful on node user
Nov 14 23:40:12 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:40:12 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:40:12 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 23:40:12 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 23:40:12 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 23:40:12 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 23:40:12 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 23:40:12 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 23:40:12 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 23:40:12 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 23:40:12 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 23:40:12 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 23:40:12 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 23:40:12 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 23:40:12 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 23:40:12 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 23:40:12 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 23:40:12 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 23:40:12 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:40:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-807909284',display_name='tempest-VolumesAdminNegativeTest-server-807909284',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-807909284',id=4,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN++rg/5aiXfrPnlzHCWuLQ3r8o7hy8ulHI0qfthn9zAC77asJ8kE9stlg/Vfy7c8tKUC0aAMrWh7glflCSCZBtNolNf3iMY91+pkGd7YugPHHZNXQezIDh4x8HvnEFMkA==',key_name='tempest-keypair-185827126',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c8a897400c74100ad6c115397bc84ff',ramdisk_id='',reservation_id='r-lw53hsch',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2087255478',owner_user_name='tempest-VolumesAdminNegativeTest-2087255478-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:40:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cc85fb2b1a141578ba9558bc79ccc02',uuid=a0cffbac-f552-47bf-bd6c-dabb70e7c867,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a863ecb-919e-42ac-8507-1c9af9135895", "address": "fa:16:3e:0c:75:47", "network": {"id": "a59b651e-81c5-4a68-b694-1e84de25e915", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1023462603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8a897400c74100ad6c115397bc84ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a863ecb-91", "ovs_interfaceid": "8a863ecb-919e-42ac-8507-1c9af9135895", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:40:12 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Converting VIF {"id": "8a863ecb-919e-42ac-8507-1c9af9135895", "address": "fa:16:3e:0c:75:47", "network": {"id": "a59b651e-81c5-4a68-b694-1e84de25e915", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1023462603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8a897400c74100ad6c115397bc84ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a863ecb-91", "ovs_interfaceid": "8a863ecb-919e-42ac-8507-1c9af9135895", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:40:12 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:75:47,bridge_name='br-int',has_traffic_filtering=True,id=8a863ecb-919e-42ac-8507-1c9af9135895,network=Network(a59b651e-81c5-4a68-b694-1e84de25e915),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a863ecb-91') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:40:12 user nova-compute[75341]: DEBUG nova.objects.instance [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Lazy-loading 'pci_devices' on Instance uuid a0cffbac-f552-47bf-bd6c-dabb70e7c867 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:40:12 user nova-compute[75341]: DEBUG nova.compute.manager [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] Start building block device mappings for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 23:40:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.273s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:12 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] End _get_guest_xml xml=<domain type="kvm">
Nov 14 23:40:12 user nova-compute[75341]:   <uuid>a0cffbac-f552-47bf-bd6c-dabb70e7c867</uuid>
Nov 14 23:40:12 user nova-compute[75341]:   <name>instance-00000004</name>
Nov 14 23:40:12 user nova-compute[75341]:   <memory>524288</memory>
Nov 14 23:40:12 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 14 23:40:12 user nova-compute[75341]:   <metadata>
Nov 14 23:40:12 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 23:40:12 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 14 23:40:12 user nova-compute[75341]:       <nova:name>tempest-VolumesAdminNegativeTest-server-807909284</nova:name>
Nov 14 23:40:12 user nova-compute[75341]:       <nova:creationTime>2023-11-14 23:40:12</nova:creationTime>
Nov 14 23:40:12 user nova-compute[75341]:       <nova:flavor name="m1.tiny">
Nov 14 23:40:12 user nova-compute[75341]:         <nova:memory>512</nova:memory>
Nov 14 23:40:12 user nova-compute[75341]:         <nova:disk>1</nova:disk>
Nov 14 23:40:12 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 14 23:40:12 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 23:40:12 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 14 23:40:12 user nova-compute[75341]:       </nova:flavor>
Nov 14 23:40:12 user nova-compute[75341]:       <nova:owner>
Nov 14 23:40:12 user nova-compute[75341]:         <nova:user uuid="7cc85fb2b1a141578ba9558bc79ccc02">tempest-VolumesAdminNegativeTest-2087255478-project-member</nova:user>
Nov 14 23:40:12 user nova-compute[75341]:         <nova:project uuid="7c8a897400c74100ad6c115397bc84ff">tempest-VolumesAdminNegativeTest-2087255478</nova:project>
Nov 14 23:40:12 user nova-compute[75341]:       </nova:owner>
Nov 14 23:40:12 user nova-compute[75341]:       <nova:root type="image" uuid="e46abb82-b810-490e-a8a1-ccdc5fa1a796"/>
Nov 14 23:40:12 user nova-compute[75341]:       <nova:ports>
Nov 14 23:40:12 user nova-compute[75341]:         <nova:port uuid="8a863ecb-919e-42ac-8507-1c9af9135895">
Nov 14 23:40:12 user nova-compute[75341]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 23:40:12 user nova-compute[75341]:         </nova:port>
Nov 14 23:40:12 user nova-compute[75341]:       </nova:ports>
Nov 14 23:40:12 user nova-compute[75341]:     </nova:instance>
Nov 14 23:40:12 user nova-compute[75341]:   </metadata>
Nov 14 23:40:12 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 14 23:40:12 user nova-compute[75341]:     <system>
Nov 14 23:40:12 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 23:40:12 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 14 23:40:12 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 14 23:40:12 user nova-compute[75341]:       <entry name="serial">a0cffbac-f552-47bf-bd6c-dabb70e7c867</entry>
Nov 14 23:40:12 user nova-compute[75341]:       <entry name="uuid">a0cffbac-f552-47bf-bd6c-dabb70e7c867</entry>
Nov 14 23:40:12 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 14 23:40:12 user nova-compute[75341]:     </system>
Nov 14 23:40:12 user nova-compute[75341]:   </sysinfo>
Nov 14 23:40:12 user nova-compute[75341]:   <os>
Nov 14 23:40:12 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 23:40:12 user nova-compute[75341]:     <boot dev="hd"/>
Nov 14 23:40:12 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 14 23:40:12 user nova-compute[75341]:   </os>
Nov 14 23:40:12 user nova-compute[75341]:   <features>
Nov 14 23:40:12 user nova-compute[75341]:     <acpi/>
Nov 14 23:40:12 user nova-compute[75341]:     <apic/>
Nov 14 23:40:12 user nova-compute[75341]:     <vmcoreinfo/>
Nov 14 23:40:12 user nova-compute[75341]:   </features>
Nov 14 23:40:12 user nova-compute[75341]:   <clock offset="utc">
Nov 14 23:40:12 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 23:40:12 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 23:40:12 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 14 23:40:12 user nova-compute[75341]:   </clock>
Nov 14 23:40:12 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 14 23:40:12 user nova-compute[75341]:     <model>Nehalem</model>
Nov 14 23:40:12 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 23:40:12 user nova-compute[75341]:   </cpu>
Nov 14 23:40:12 user nova-compute[75341]:   <devices>
Nov 14 23:40:12 user nova-compute[75341]:     <disk type="file" device="disk">
Nov 14 23:40:12 user nova-compute[75341]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 23:40:12 user nova-compute[75341]:       <source file="/opt/stack/data/nova/instances/a0cffbac-f552-47bf-bd6c-dabb70e7c867/disk"/>
Nov 14 23:40:12 user nova-compute[75341]:       <target dev="vda" bus="virtio"/>
Nov 14 23:40:12 user nova-compute[75341]:     </disk>
Nov 14 23:40:12 user nova-compute[75341]:     <interface type="ethernet">
Nov 14 23:40:12 user nova-compute[75341]:       <mac address="fa:16:3e:0c:75:47"/>
Nov 14 23:40:12 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:40:12 user nova-compute[75341]:       <mtu size="1442"/>
Nov 14 23:40:12 user nova-compute[75341]:       <target dev="tap8a863ecb-91"/>
Nov 14 23:40:12 user nova-compute[75341]:     </interface>
Nov 14 23:40:12 user nova-compute[75341]:     <serial type="pty">
Nov 14 23:40:12 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/a0cffbac-f552-47bf-bd6c-dabb70e7c867/console.log" append="off"/>
Nov 14 23:40:12 user nova-compute[75341]:     </serial>
Nov 14 23:40:12 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 23:40:12 user nova-compute[75341]:     <video>
Nov 14 23:40:12 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:40:12 user nova-compute[75341]:     </video>
Nov 14 23:40:12 user nova-compute[75341]:     <rng model="virtio">
Nov 14 23:40:12 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 14 23:40:12 user nova-compute[75341]:     </rng>
Nov 14 23:40:12 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 14 23:40:12 user nova-compute[75341]:     <memballoon model="virtio">
Nov 14 23:40:12 user nova-compute[75341]:       <stats period="10"/>
Nov 14 23:40:12 user nova-compute[75341]:     </memballoon>
Nov 14 23:40:12 user nova-compute[75341]:   </devices>
Nov 14 23:40:12 user nova-compute[75341]: </domain>
Nov 14 23:40:12 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 23:40:12 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:40:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-807909284',display_name='tempest-VolumesAdminNegativeTest-server-807909284',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-807909284',id=4,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN++rg/5aiXfrPnlzHCWuLQ3r8o7hy8ulHI0qfthn9zAC77asJ8kE9stlg/Vfy7c8tKUC0aAMrWh7glflCSCZBtNolNf3iMY91+pkGd7YugPHHZNXQezIDh4x8HvnEFMkA==',key_name='tempest-keypair-185827126',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c8a897400c74100ad6c115397bc84ff',ramdisk_id='',reservation_id='r-lw53hsch',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2087255478',owner_user_name='tempest-VolumesAdminNegativeTest-2087255478-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:40:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cc85fb2b1a141578ba9558bc79ccc02',uuid=a0cffbac-f552-47bf-bd6c-dabb70e7c867,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a863ecb-919e-42ac-8507-1c9af9135895", "address": "fa:16:3e:0c:75:47", "network": {"id": "a59b651e-81c5-4a68-b694-1e84de25e915", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1023462603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8a897400c74100ad6c115397bc84ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a863ecb-91", "ovs_interfaceid": "8a863ecb-919e-42ac-8507-1c9af9135895", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 23:40:12 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Converting VIF {"id": "8a863ecb-919e-42ac-8507-1c9af9135895", "address": "fa:16:3e:0c:75:47", "network": {"id": "a59b651e-81c5-4a68-b694-1e84de25e915", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1023462603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8a897400c74100ad6c115397bc84ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a863ecb-91", "ovs_interfaceid": "8a863ecb-919e-42ac-8507-1c9af9135895", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:40:12 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:75:47,bridge_name='br-int',has_traffic_filtering=True,id=8a863ecb-919e-42ac-8507-1c9af9135895,network=Network(a59b651e-81c5-4a68-b694-1e84de25e915),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a863ecb-91') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:40:12 user nova-compute[75341]: DEBUG os_vif [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:75:47,bridge_name='br-int',has_traffic_filtering=True,id=8a863ecb-919e-42ac-8507-1c9af9135895,network=Network(a59b651e-81c5-4a68-b694-1e84de25e915),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a863ecb-91') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 23:40:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/0e7a53e9-6982-4c93-a830-a49cf0ce76bd/disk 1073741824 {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:40:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 23:40:12 user nova-compute[75341]: DEBUG nova.policy [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e63bc65c932e4685b00b6b10e4f019a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bc48ec5e944fe7b9bd6d87b32fdad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75341) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 23:40:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '82e80b3b-d07a-5bbb-8498-8a4dde434854', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:40:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/0e7a53e9-6982-4c93-a830-a49cf0ce76bd/disk 1073741824" returned: 0 in 0.080s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.369s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:40:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:40:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a863ecb-91, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:40:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8a863ecb-91, col_values=(('qos', UUID('c6e11717-17b2-4d05-94af-9e1672303f00')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:40:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8a863ecb-91, col_values=(('external_ids', {'iface-id': '8a863ecb-919e-42ac-8507-1c9af9135895', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:75:47', 'vm-uuid': 'a0cffbac-f552-47bf-bd6c-dabb70e7c867'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:40:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:40:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:13 user nova-compute[75341]: INFO os_vif [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:75:47,bridge_name='br-int',has_traffic_filtering=True,id=8a863ecb-919e-42ac-8507-1c9af9135895,network=Network(a59b651e-81c5-4a68-b694-1e84de25e915),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a863ecb-91')
Nov 14 23:40:13 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:40:13 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] No VIF found with MAC fa:16:3e:0c:75:47, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:40:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.204s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:13 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0e7a53e9-6982-4c93-a830-a49cf0ce76bd/disk. size=1073741824 {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 23:40:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e7a53e9-6982-4c93-a830-a49cf0ce76bd/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:13 user nova-compute[75341]: DEBUG nova.compute.manager [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] Start spawning the instance on the hypervisor. {{(pid=75341) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 23:40:13 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] Creating instance directory {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 23:40:13 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] Creating image(s)
Nov 14 23:40:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Acquiring lock "/opt/stack/data/nova/instances/b7d427ed-6ac3-46d9-bebc-d672f465f850/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:40:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Lock "/opt/stack/data/nova/instances/b7d427ed-6ac3-46d9-bebc-d672f465f850/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:40:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Lock "/opt/stack/data/nova/instances/b7d427ed-6ac3-46d9-bebc-d672f465f850/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:40:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Acquiring lock "c71e7f810e936a49bb8ef251c7e0a1c3ee3ef7f8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:40:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Lock "c71e7f810e936a49bb8ef251c7e0a1c3ee3ef7f8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:40:13 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:40:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c71e7f810e936a49bb8ef251c7e0a1c3ee3ef7f8.part --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:14 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:40:14 user nova-compute[75341]: DEBUG nova.network.neutron [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Successfully created port: 6f1be2e1-796a-4b73-a56f-2a5286945ea3 {{(pid=75341) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 23:40:14 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e7a53e9-6982-4c93-a830-a49cf0ce76bd/disk --force-share --output=json" returned: 0 in 0.856s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:14 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Cannot resize image /opt/stack/data/nova/instances/0e7a53e9-6982-4c93-a830-a49cf0ce76bd/disk to a smaller size. {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 23:40:14 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Created local disks {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 23:40:14 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Ensure instance console log exists: /opt/stack/data/nova/instances/0e7a53e9-6982-4c93-a830-a49cf0ce76bd/console.log {{(pid=75341) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 23:40:14 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:40:14 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:40:14 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:40:14 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.376s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:40:14 user nova-compute[75341]: DEBUG nova.compute.manager [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Start building networks asynchronously for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 23:40:14 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c71e7f810e936a49bb8ef251c7e0a1c3ee3ef7f8.part --force-share --output=json" returned: 0 in 0.231s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:14 user nova-compute[75341]: DEBUG nova.virt.images [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] a951ec1b-8017-4b82-9177-9f43ba7742e6 was qcow2, converting to raw {{(pid=75341) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 23:40:14 user nova-compute[75341]: DEBUG nova.privsep.utils [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75341) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 23:40:14 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c71e7f810e936a49bb8ef251c7e0a1c3ee3ef7f8.part /opt/stack/data/nova/instances/_base/c71e7f810e936a49bb8ef251c7e0a1c3ee3ef7f8.converted {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:14 user nova-compute[75341]: DEBUG nova.compute.manager [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Allocating IP information in the background. {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 23:40:14 user nova-compute[75341]: DEBUG nova.network.neutron [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] allocate_for_instance() {{(pid=75341) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 23:40:14 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 23:40:14 user nova-compute[75341]: DEBUG nova.compute.manager [req-7015efbc-5e44-4fd3-a547-91f5bb92da35 req-3f48c6ff-7d0f-4e44-89b6-3d0f182965fc service nova] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] Received event network-vif-plugged-c53d37cc-db96-4531-9095-053de7f58643 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:40:14 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-7015efbc-5e44-4fd3-a547-91f5bb92da35 req-3f48c6ff-7d0f-4e44-89b6-3d0f182965fc service nova] Acquiring lock "91603fef-c1cc-4fa1-96b2-e840db651627-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:40:14 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-7015efbc-5e44-4fd3-a547-91f5bb92da35 req-3f48c6ff-7d0f-4e44-89b6-3d0f182965fc service nova] Lock "91603fef-c1cc-4fa1-96b2-e840db651627-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:40:14 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-7015efbc-5e44-4fd3-a547-91f5bb92da35 req-3f48c6ff-7d0f-4e44-89b6-3d0f182965fc service nova] Lock "91603fef-c1cc-4fa1-96b2-e840db651627-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:40:14 user nova-compute[75341]: DEBUG nova.compute.manager [req-7015efbc-5e44-4fd3-a547-91f5bb92da35 req-3f48c6ff-7d0f-4e44-89b6-3d0f182965fc service nova] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] No waiting events found dispatching network-vif-plugged-c53d37cc-db96-4531-9095-053de7f58643 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:40:14 user nova-compute[75341]: WARNING nova.compute.manager [req-7015efbc-5e44-4fd3-a547-91f5bb92da35 req-3f48c6ff-7d0f-4e44-89b6-3d0f182965fc service nova] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] Received unexpected event network-vif-plugged-c53d37cc-db96-4531-9095-053de7f58643 for instance with vm_state active and task_state None.
Nov 14 23:40:14 user nova-compute[75341]: DEBUG nova.compute.manager [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Start building block device mappings for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 23:40:14 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c71e7f810e936a49bb8ef251c7e0a1c3ee3ef7f8.part /opt/stack/data/nova/instances/_base/c71e7f810e936a49bb8ef251c7e0a1c3ee3ef7f8.converted" returned: 0 in 0.271s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:14 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c71e7f810e936a49bb8ef251c7e0a1c3ee3ef7f8.converted --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:14 user nova-compute[75341]: DEBUG nova.policy [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '48f384876a794dbfa3e7c89e6e20a232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc16bad01d434f7f9a66247f776d6269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75341) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 23:40:14 user nova-compute[75341]: DEBUG nova.compute.manager [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Start spawning the instance on the hypervisor. {{(pid=75341) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 23:40:14 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Creating instance directory {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 23:40:14 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Creating image(s)
Nov 14 23:40:14 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Acquiring lock "/opt/stack/data/nova/instances/163c448b-0183-41bb-b6e0-61917f6ad781/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:40:14 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Lock "/opt/stack/data/nova/instances/163c448b-0183-41bb-b6e0-61917f6ad781/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:40:14 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Lock "/opt/stack/data/nova/instances/163c448b-0183-41bb-b6e0-61917f6ad781/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:40:14 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:14 user nova-compute[75341]: DEBUG nova.network.neutron [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] Successfully created port: a0990271-0de2-47ce-a33e-75cb022ba7c6 {{(pid=75341) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 23:40:14 user nova-compute[75341]: DEBUG nova.network.neutron [req-8fb3c6a2-f8ee-40e9-ac19-ea8176168f4d req-1ad60f5a-f355-4e61-b2ab-04f4f755f467 service nova] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Updated VIF entry in instance network info cache for port 8a863ecb-919e-42ac-8507-1c9af9135895. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:40:14 user nova-compute[75341]: DEBUG nova.network.neutron [req-8fb3c6a2-f8ee-40e9-ac19-ea8176168f4d req-1ad60f5a-f355-4e61-b2ab-04f4f755f467 service nova] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Updating instance_info_cache with network_info: [{"id": "8a863ecb-919e-42ac-8507-1c9af9135895", "address": "fa:16:3e:0c:75:47", "network": {"id": "a59b651e-81c5-4a68-b694-1e84de25e915", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1023462603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8a897400c74100ad6c115397bc84ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a863ecb-91", "ovs_interfaceid": "8a863ecb-919e-42ac-8507-1c9af9135895", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:40:14 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-8fb3c6a2-f8ee-40e9-ac19-ea8176168f4d req-1ad60f5a-f355-4e61-b2ab-04f4f755f467 service nova] Releasing lock "refresh_cache-a0cffbac-f552-47bf-bd6c-dabb70e7c867" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:40:14 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] Acquiring lock "e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:40:14 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] Lock "e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:40:14 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c71e7f810e936a49bb8ef251c7e0a1c3ee3ef7f8.converted --force-share --output=json" returned: 0 in 0.306s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:14 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Lock "c71e7f810e936a49bb8ef251c7e0a1c3ee3ef7f8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.511s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:40:14 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c71e7f810e936a49bb8ef251c7e0a1c3ee3ef7f8 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:14 user nova-compute[75341]: DEBUG nova.compute.manager [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Starting instance... {{(pid=75341) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 23:40:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:14 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.322s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:14 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Acquiring lock "4754efee9a6d73d3647f2add2cfe86c291949740" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:40:14 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:40:14 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:15 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c71e7f810e936a49bb8ef251c7e0a1c3ee3ef7f8 --force-share --output=json" returned: 0 in 0.268s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Acquiring lock "c71e7f810e936a49bb8ef251c7e0a1c3ee3ef7f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:40:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Lock "c71e7f810e936a49bb8ef251c7e0a1c3ee3ef7f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:40:15 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c71e7f810e936a49bb8ef251c7e0a1c3ee3ef7f8 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:15 user nova-compute[75341]: DEBUG nova.network.neutron [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Successfully updated port: 6f1be2e1-796a-4b73-a56f-2a5286945ea3 {{(pid=75341) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 23:40:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:40:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:40:15 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.276s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:15 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/163c448b-0183-41bb-b6e0-61917f6ad781/disk 1073741824 {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Acquiring lock "refresh_cache-0e7a53e9-6982-4c93-a830-a49cf0ce76bd" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:40:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Acquired lock "refresh_cache-0e7a53e9-6982-4c93-a830-a49cf0ce76bd" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:40:15 user nova-compute[75341]: DEBUG nova.network.neutron [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 23:40:15 user nova-compute[75341]: DEBUG nova.compute.manager [req-b53cb446-8159-4cdd-b801-ddeada7079f8 req-553ecc5e-056e-41ce-b498-40c1d5464973 service nova] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Received event network-changed-6f1be2e1-796a-4b73-a56f-2a5286945ea3 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:40:15 user nova-compute[75341]: DEBUG nova.compute.manager [req-b53cb446-8159-4cdd-b801-ddeada7079f8 req-553ecc5e-056e-41ce-b498-40c1d5464973 service nova] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Refreshing instance network info cache due to event network-changed-6f1be2e1-796a-4b73-a56f-2a5286945ea3. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:40:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-b53cb446-8159-4cdd-b801-ddeada7079f8 req-553ecc5e-056e-41ce-b498-40c1d5464973 service nova] Acquiring lock "refresh_cache-0e7a53e9-6982-4c93-a830-a49cf0ce76bd" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:40:15 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75341) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 23:40:15 user nova-compute[75341]: INFO nova.compute.claims [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Claim successful on node user
Nov 14 23:40:15 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/163c448b-0183-41bb-b6e0-61917f6ad781/disk 1073741824" returned: 0 in 0.119s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.408s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:40:15 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:15 user nova-compute[75341]: DEBUG nova.network.neutron [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Instance cache missing network info. {{(pid=75341) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 23:40:15 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c71e7f810e936a49bb8ef251c7e0a1c3ee3ef7f8 --force-share --output=json" returned: 0 in 0.342s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:15 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c71e7f810e936a49bb8ef251c7e0a1c3ee3ef7f8,backing_fmt=raw /opt/stack/data/nova/instances/b7d427ed-6ac3-46d9-bebc-d672f465f850/disk 1073741824 {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:15 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c71e7f810e936a49bb8ef251c7e0a1c3ee3ef7f8,backing_fmt=raw /opt/stack/data/nova/instances/b7d427ed-6ac3-46d9-bebc-d672f465f850/disk 1073741824" returned: 0 in 0.108s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Lock "c71e7f810e936a49bb8ef251c7e0a1c3ee3ef7f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.483s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:40:15 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c71e7f810e936a49bb8ef251c7e0a1c3ee3ef7f8 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:15 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:15 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.399s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:15 user nova-compute[75341]: DEBUG nova.compute.manager [req-cc803089-4549-4d1b-a8ec-94490452a7ff req-a50acf25-ba07-4b78-a890-26b6341bd23a service nova] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Received event network-vif-plugged-8a863ecb-919e-42ac-8507-1c9af9135895 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:40:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-cc803089-4549-4d1b-a8ec-94490452a7ff req-a50acf25-ba07-4b78-a890-26b6341bd23a service nova] Acquiring lock "a0cffbac-f552-47bf-bd6c-dabb70e7c867-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:40:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-cc803089-4549-4d1b-a8ec-94490452a7ff req-a50acf25-ba07-4b78-a890-26b6341bd23a service nova] Lock "a0cffbac-f552-47bf-bd6c-dabb70e7c867-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:40:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-cc803089-4549-4d1b-a8ec-94490452a7ff req-a50acf25-ba07-4b78-a890-26b6341bd23a service nova] Lock "a0cffbac-f552-47bf-bd6c-dabb70e7c867-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:40:15 user nova-compute[75341]: DEBUG nova.compute.manager [req-cc803089-4549-4d1b-a8ec-94490452a7ff req-a50acf25-ba07-4b78-a890-26b6341bd23a service nova] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] No waiting events found dispatching network-vif-plugged-8a863ecb-919e-42ac-8507-1c9af9135895 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:40:15 user nova-compute[75341]: WARNING nova.compute.manager [req-cc803089-4549-4d1b-a8ec-94490452a7ff req-a50acf25-ba07-4b78-a890-26b6341bd23a service nova] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Received unexpected event network-vif-plugged-8a863ecb-919e-42ac-8507-1c9af9135895 for instance with vm_state building and task_state spawning.
Nov 14 23:40:15 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Checking if we can resize image /opt/stack/data/nova/instances/163c448b-0183-41bb-b6e0-61917f6ad781/disk. size=1073741824 {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 23:40:15 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/163c448b-0183-41bb-b6e0-61917f6ad781/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:15 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c71e7f810e936a49bb8ef251c7e0a1c3ee3ef7f8 --force-share --output=json" returned: 0 in 0.228s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:15 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b7d427ed-6ac3-46d9-bebc-d672f465f850/disk. size=1073741824 {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 23:40:15 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d427ed-6ac3-46d9-bebc-d672f465f850/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:15 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:15 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:15 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/163c448b-0183-41bb-b6e0-61917f6ad781/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:15 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Cannot resize image /opt/stack/data/nova/instances/163c448b-0183-41bb-b6e0-61917f6ad781/disk to a smaller size. {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 23:40:15 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Created local disks {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 23:40:15 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Ensure instance console log exists: /opt/stack/data/nova/instances/163c448b-0183-41bb-b6e0-61917f6ad781/console.log {{(pid=75341) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 23:40:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:40:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:40:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG nova.network.neutron [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Successfully created port: 87b091a7-76a0-46e1-b1fd-fd305d1ce55e {{(pid=75341) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG nova.network.neutron [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Updating instance_info_cache with network_info: [{"id": "6f1be2e1-796a-4b73-a56f-2a5286945ea3", "address": "fa:16:3e:a0:1d:39", "network": {"id": "7071106e-e54c-4358-97b0-3c0778da8843", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2081310732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaee8b9e61234bc68b1da5fceb349cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f1be2e1-79", "ovs_interfaceid": "6f1be2e1-796a-4b73-a56f-2a5286945ea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d427ed-6ac3-46d9-bebc-d672f465f850/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Cannot resize image /opt/stack/data/nova/instances/b7d427ed-6ac3-46d9-bebc-d672f465f850/disk to a smaller size. {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] Created local disks {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] Ensure instance console log exists: /opt/stack/data/nova/instances/b7d427ed-6ac3-46d9-bebc-d672f465f850/console.log {{(pid=75341) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Releasing lock "refresh_cache-0e7a53e9-6982-4c93-a830-a49cf0ce76bd" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG nova.compute.manager [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Instance network_info: |[{"id": "6f1be2e1-796a-4b73-a56f-2a5286945ea3", "address": "fa:16:3e:a0:1d:39", "network": {"id": "7071106e-e54c-4358-97b0-3c0778da8843", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2081310732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaee8b9e61234bc68b1da5fceb349cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f1be2e1-79", "ovs_interfaceid": "6f1be2e1-796a-4b73-a56f-2a5286945ea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-b53cb446-8159-4cdd-b801-ddeada7079f8 req-553ecc5e-056e-41ce-b498-40c1d5464973 service nova] Acquired lock "refresh_cache-0e7a53e9-6982-4c93-a830-a49cf0ce76bd" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG nova.network.neutron [req-b53cb446-8159-4cdd-b801-ddeada7079f8 req-553ecc5e-056e-41ce-b498-40c1d5464973 service nova] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Refreshing network info cache for port 6f1be2e1-796a-4b73-a56f-2a5286945ea3 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Start _get_guest_xml network_info=[{"id": "6f1be2e1-796a-4b73-a56f-2a5286945ea3", "address": "fa:16:3e:a0:1d:39", "network": {"id": "7071106e-e54c-4358-97b0-3c0778da8843", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2081310732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaee8b9e61234bc68b1da5fceb349cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f1be2e1-79", "ovs_interfaceid": "6f1be2e1-796a-4b73-a56f-2a5286945ea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encrypted': False, 'image_id': 'e46abb82-b810-490e-a8a1-ccdc5fa1a796'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 23:40:16 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:40:16 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:40:16 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:40:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2055548980',display_name='tempest-TestVolumeSwap-server-2055548980',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2055548980',id=5,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxavwXSG442lyT36C24aCCYnv3KPxzEVSTsX+bLTYR5aG6QoAXbYBEOHyRynDVjR4HdR3O5SO+UFQA6Wd1y9wCyxP5e9Dr7A7aMi0IP7zsHTJxUDMkAXDIgckWNJ7fP6Q==',key_name='tempest-keypair-1225229560',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aaee8b9e61234bc68b1da5fceb349cb6',ramdisk_id='',reservation_id='r-e334ge8g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1447465409',owner_user_name='tempest-TestVolumeSwap-1447465409-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:40:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='666ca2b69b3f487687ba900bd04221d4',uuid=0e7a53e9-6982-4c93-a830-a49cf0ce76bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f1be2e1-796a-4b73-a56f-2a5286945ea3", "address": "fa:16:3e:a0:1d:39", "network": {"id": "7071106e-e54c-4358-97b0-3c0778da8843", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2081310732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaee8b9e61234bc68b1da5fceb349cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f1be2e1-79", "ovs_interfaceid": "6f1be2e1-796a-4b73-a56f-2a5286945ea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Converting VIF {"id": "6f1be2e1-796a-4b73-a56f-2a5286945ea3", "address": "fa:16:3e:a0:1d:39", "network": {"id": "7071106e-e54c-4358-97b0-3c0778da8843", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2081310732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaee8b9e61234bc68b1da5fceb349cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f1be2e1-79", "ovs_interfaceid": "6f1be2e1-796a-4b73-a56f-2a5286945ea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:1d:39,bridge_name='br-int',has_traffic_filtering=True,id=6f1be2e1-796a-4b73-a56f-2a5286945ea3,network=Network(7071106e-e54c-4358-97b0-3c0778da8843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f1be2e1-79') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG nova.objects.instance [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Lazy-loading 'pci_devices' on Instance uuid 0e7a53e9-6982-4c93-a830-a49cf0ce76bd {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] End _get_guest_xml xml=<domain type="kvm">
Nov 14 23:40:16 user nova-compute[75341]:   <uuid>0e7a53e9-6982-4c93-a830-a49cf0ce76bd</uuid>
Nov 14 23:40:16 user nova-compute[75341]:   <name>instance-00000005</name>
Nov 14 23:40:16 user nova-compute[75341]:   <memory>524288</memory>
Nov 14 23:40:16 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 14 23:40:16 user nova-compute[75341]:   <metadata>
Nov 14 23:40:16 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 23:40:16 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 14 23:40:16 user nova-compute[75341]:       <nova:name>tempest-TestVolumeSwap-server-2055548980</nova:name>
Nov 14 23:40:16 user nova-compute[75341]:       <nova:creationTime>2023-11-14 23:40:16</nova:creationTime>
Nov 14 23:40:16 user nova-compute[75341]:       <nova:flavor name="m1.tiny">
Nov 14 23:40:16 user nova-compute[75341]:         <nova:memory>512</nova:memory>
Nov 14 23:40:16 user nova-compute[75341]:         <nova:disk>1</nova:disk>
Nov 14 23:40:16 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 14 23:40:16 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 23:40:16 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 14 23:40:16 user nova-compute[75341]:       </nova:flavor>
Nov 14 23:40:16 user nova-compute[75341]:       <nova:owner>
Nov 14 23:40:16 user nova-compute[75341]:         <nova:user uuid="666ca2b69b3f487687ba900bd04221d4">tempest-TestVolumeSwap-1447465409-project-member</nova:user>
Nov 14 23:40:16 user nova-compute[75341]:         <nova:project uuid="aaee8b9e61234bc68b1da5fceb349cb6">tempest-TestVolumeSwap-1447465409</nova:project>
Nov 14 23:40:16 user nova-compute[75341]:       </nova:owner>
Nov 14 23:40:16 user nova-compute[75341]:       <nova:root type="image" uuid="e46abb82-b810-490e-a8a1-ccdc5fa1a796"/>
Nov 14 23:40:16 user nova-compute[75341]:       <nova:ports>
Nov 14 23:40:16 user nova-compute[75341]:         <nova:port uuid="6f1be2e1-796a-4b73-a56f-2a5286945ea3">
Nov 14 23:40:16 user nova-compute[75341]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 23:40:16 user nova-compute[75341]:         </nova:port>
Nov 14 23:40:16 user nova-compute[75341]:       </nova:ports>
Nov 14 23:40:16 user nova-compute[75341]:     </nova:instance>
Nov 14 23:40:16 user nova-compute[75341]:   </metadata>
Nov 14 23:40:16 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 14 23:40:16 user nova-compute[75341]:     <system>
Nov 14 23:40:16 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 23:40:16 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 14 23:40:16 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 14 23:40:16 user nova-compute[75341]:       <entry name="serial">0e7a53e9-6982-4c93-a830-a49cf0ce76bd</entry>
Nov 14 23:40:16 user nova-compute[75341]:       <entry name="uuid">0e7a53e9-6982-4c93-a830-a49cf0ce76bd</entry>
Nov 14 23:40:16 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 14 23:40:16 user nova-compute[75341]:     </system>
Nov 14 23:40:16 user nova-compute[75341]:   </sysinfo>
Nov 14 23:40:16 user nova-compute[75341]:   <os>
Nov 14 23:40:16 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 23:40:16 user nova-compute[75341]:     <boot dev="hd"/>
Nov 14 23:40:16 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 14 23:40:16 user nova-compute[75341]:   </os>
Nov 14 23:40:16 user nova-compute[75341]:   <features>
Nov 14 23:40:16 user nova-compute[75341]:     <acpi/>
Nov 14 23:40:16 user nova-compute[75341]:     <apic/>
Nov 14 23:40:16 user nova-compute[75341]:     <vmcoreinfo/>
Nov 14 23:40:16 user nova-compute[75341]:   </features>
Nov 14 23:40:16 user nova-compute[75341]:   <clock offset="utc">
Nov 14 23:40:16 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 23:40:16 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 23:40:16 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 14 23:40:16 user nova-compute[75341]:   </clock>
Nov 14 23:40:16 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 14 23:40:16 user nova-compute[75341]:     <model>Nehalem</model>
Nov 14 23:40:16 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 23:40:16 user nova-compute[75341]:   </cpu>
Nov 14 23:40:16 user nova-compute[75341]:   <devices>
Nov 14 23:40:16 user nova-compute[75341]:     <disk type="file" device="disk">
Nov 14 23:40:16 user nova-compute[75341]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 23:40:16 user nova-compute[75341]:       <source file="/opt/stack/data/nova/instances/0e7a53e9-6982-4c93-a830-a49cf0ce76bd/disk"/>
Nov 14 23:40:16 user nova-compute[75341]:       <target dev="vda" bus="virtio"/>
Nov 14 23:40:16 user nova-compute[75341]:     </disk>
Nov 14 23:40:16 user nova-compute[75341]:     <interface type="ethernet">
Nov 14 23:40:16 user nova-compute[75341]:       <mac address="fa:16:3e:a0:1d:39"/>
Nov 14 23:40:16 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:40:16 user nova-compute[75341]:       <mtu size="1442"/>
Nov 14 23:40:16 user nova-compute[75341]:       <target dev="tap6f1be2e1-79"/>
Nov 14 23:40:16 user nova-compute[75341]:     </interface>
Nov 14 23:40:16 user nova-compute[75341]:     <serial type="pty">
Nov 14 23:40:16 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/0e7a53e9-6982-4c93-a830-a49cf0ce76bd/console.log" append="off"/>
Nov 14 23:40:16 user nova-compute[75341]:     </serial>
Nov 14 23:40:16 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 23:40:16 user nova-compute[75341]:     <video>
Nov 14 23:40:16 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:40:16 user nova-compute[75341]:     </video>
Nov 14 23:40:16 user nova-compute[75341]:     <rng model="virtio">
Nov 14 23:40:16 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 14 23:40:16 user nova-compute[75341]:     </rng>
Nov 14 23:40:16 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 14 23:40:16 user nova-compute[75341]:     <memballoon model="virtio">
Nov 14 23:40:16 user nova-compute[75341]:       <stats period="10"/>
Nov 14 23:40:16 user nova-compute[75341]:     </memballoon>
Nov 14 23:40:16 user nova-compute[75341]:   </devices>
Nov 14 23:40:16 user nova-compute[75341]: </domain>
Nov 14 23:40:16 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:40:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2055548980',display_name='tempest-TestVolumeSwap-server-2055548980',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2055548980',id=5,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxavwXSG442lyT36C24aCCYnv3KPxzEVSTsX+bLTYR5aG6QoAXbYBEOHyRynDVjR4HdR3O5SO+UFQA6Wd1y9wCyxP5e9Dr7A7aMi0IP7zsHTJxUDMkAXDIgckWNJ7fP6Q==',key_name='tempest-keypair-1225229560',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aaee8b9e61234bc68b1da5fceb349cb6',ramdisk_id='',reservation_id='r-e334ge8g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1447465409',owner_user_name='tempest-TestVolumeSwap-1447465409-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:40:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='666ca2b69b3f487687ba900bd04221d4',uuid=0e7a53e9-6982-4c93-a830-a49cf0ce76bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f1be2e1-796a-4b73-a56f-2a5286945ea3", "address": "fa:16:3e:a0:1d:39", "network": {"id": "7071106e-e54c-4358-97b0-3c0778da8843", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2081310732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaee8b9e61234bc68b1da5fceb349cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f1be2e1-79", "ovs_interfaceid": "6f1be2e1-796a-4b73-a56f-2a5286945ea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Converting VIF {"id": "6f1be2e1-796a-4b73-a56f-2a5286945ea3", "address": "fa:16:3e:a0:1d:39", "network": {"id": "7071106e-e54c-4358-97b0-3c0778da8843", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2081310732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaee8b9e61234bc68b1da5fceb349cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f1be2e1-79", "ovs_interfaceid": "6f1be2e1-796a-4b73-a56f-2a5286945ea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:1d:39,bridge_name='br-int',has_traffic_filtering=True,id=6f1be2e1-796a-4b73-a56f-2a5286945ea3,network=Network(7071106e-e54c-4358-97b0-3c0778da8843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f1be2e1-79') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG os_vif [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:1d:39,bridge_name='br-int',has_traffic_filtering=True,id=6f1be2e1-796a-4b73-a56f-2a5286945ea3,network=Network(7071106e-e54c-4358-97b0-3c0778da8843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f1be2e1-79') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3ea7863a-02f6-56af-8feb-7b871f506ebf', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6f1be2e1-79, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6f1be2e1-79, col_values=(('qos', UUID('49ff06ba-aef0-4ad5-a044-fb1cf1e3c3dd')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6f1be2e1-79, col_values=(('external_ids', {'iface-id': '6f1be2e1-796a-4b73-a56f-2a5286945ea3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:1d:39', 'vm-uuid': '0e7a53e9-6982-4c93-a830-a49cf0ce76bd'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG nova.network.neutron [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] Successfully updated port: a0990271-0de2-47ce-a33e-75cb022ba7c6 {{(pid=75341) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:16 user nova-compute[75341]: INFO os_vif [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:1d:39,bridge_name='br-int',has_traffic_filtering=True,id=6f1be2e1-796a-4b73-a56f-2a5286945ea3,network=Network(7071106e-e54c-4358-97b0-3c0778da8843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f1be2e1-79')
Nov 14 23:40:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Acquiring lock "refresh_cache-b7d427ed-6ac3-46d9-bebc-d672f465f850" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Acquired lock "refresh_cache-b7d427ed-6ac3-46d9-bebc-d672f465f850" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG nova.network.neutron [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] No VIF found with MAC fa:16:3e:a0:1d:39, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG nova.network.neutron [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] Instance cache missing network info. {{(pid=75341) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.283s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG nova.compute.manager [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Start building networks asynchronously for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG nova.compute.manager [req-9182cdf2-43c8-4e35-a1e2-26dc80b620a7 req-bbfde934-9b24-4142-895f-6ebbc19be275 service nova] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] Received event network-vif-plugged-c53d37cc-db96-4531-9095-053de7f58643 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-9182cdf2-43c8-4e35-a1e2-26dc80b620a7 req-bbfde934-9b24-4142-895f-6ebbc19be275 service nova] Acquiring lock "91603fef-c1cc-4fa1-96b2-e840db651627-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-9182cdf2-43c8-4e35-a1e2-26dc80b620a7 req-bbfde934-9b24-4142-895f-6ebbc19be275 service nova] Lock "91603fef-c1cc-4fa1-96b2-e840db651627-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-9182cdf2-43c8-4e35-a1e2-26dc80b620a7 req-bbfde934-9b24-4142-895f-6ebbc19be275 service nova] Lock "91603fef-c1cc-4fa1-96b2-e840db651627-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG nova.compute.manager [req-9182cdf2-43c8-4e35-a1e2-26dc80b620a7 req-bbfde934-9b24-4142-895f-6ebbc19be275 service nova] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] No waiting events found dispatching network-vif-plugged-c53d37cc-db96-4531-9095-053de7f58643 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:40:16 user nova-compute[75341]: WARNING nova.compute.manager [req-9182cdf2-43c8-4e35-a1e2-26dc80b620a7 req-bbfde934-9b24-4142-895f-6ebbc19be275 service nova] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] Received unexpected event network-vif-plugged-c53d37cc-db96-4531-9095-053de7f58643 for instance with vm_state active and task_state None.
Nov 14 23:40:16 user nova-compute[75341]: DEBUG nova.compute.manager [req-9182cdf2-43c8-4e35-a1e2-26dc80b620a7 req-bbfde934-9b24-4142-895f-6ebbc19be275 service nova] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] Received event network-changed-a0990271-0de2-47ce-a33e-75cb022ba7c6 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG nova.compute.manager [req-9182cdf2-43c8-4e35-a1e2-26dc80b620a7 req-bbfde934-9b24-4142-895f-6ebbc19be275 service nova] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] Refreshing instance network info cache due to event network-changed-a0990271-0de2-47ce-a33e-75cb022ba7c6. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-9182cdf2-43c8-4e35-a1e2-26dc80b620a7 req-bbfde934-9b24-4142-895f-6ebbc19be275 service nova] Acquiring lock "refresh_cache-b7d427ed-6ac3-46d9-bebc-d672f465f850" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG nova.compute.manager [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Allocating IP information in the background. {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG nova.network.neutron [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] allocate_for_instance() {{(pid=75341) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 23:40:16 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 23:40:16 user nova-compute[75341]: DEBUG nova.compute.manager [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Start building block device mappings for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG nova.policy [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2d5ddb1cd696433ebda85b9450ebb836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41edc5e2c0b4dd39fc317727fb22703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75341) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG nova.compute.manager [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Start spawning the instance on the hypervisor. {{(pid=75341) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Creating instance directory {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 23:40:16 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Creating image(s)
Nov 14 23:40:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] Acquiring lock "/opt/stack/data/nova/instances/e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] Lock "/opt/stack/data/nova/instances/e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] Lock "/opt/stack/data/nova/instances/e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG nova.network.neutron [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Successfully updated port: 87b091a7-76a0-46e1-b1fd-fd305d1ce55e {{(pid=75341) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Acquiring lock "refresh_cache-163c448b-0183-41bb-b6e0-61917f6ad781" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Acquired lock "refresh_cache-163c448b-0183-41bb-b6e0-61917f6ad781" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:40:16 user nova-compute[75341]: DEBUG nova.network.neutron [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG nova.network.neutron [req-b53cb446-8159-4cdd-b801-ddeada7079f8 req-553ecc5e-056e-41ce-b498-40c1d5464973 service nova] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Updated VIF entry in instance network info cache for port 6f1be2e1-796a-4b73-a56f-2a5286945ea3. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG nova.network.neutron [req-b53cb446-8159-4cdd-b801-ddeada7079f8 req-553ecc5e-056e-41ce-b498-40c1d5464973 service nova] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Updating instance_info_cache with network_info: [{"id": "6f1be2e1-796a-4b73-a56f-2a5286945ea3", "address": "fa:16:3e:a0:1d:39", "network": {"id": "7071106e-e54c-4358-97b0-3c0778da8843", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2081310732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaee8b9e61234bc68b1da5fceb349cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f1be2e1-79", "ovs_interfaceid": "6f1be2e1-796a-4b73-a56f-2a5286945ea3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-b53cb446-8159-4cdd-b801-ddeada7079f8 req-553ecc5e-056e-41ce-b498-40c1d5464973 service nova] Releasing lock "refresh_cache-0e7a53e9-6982-4c93-a830-a49cf0ce76bd" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG nova.network.neutron [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Instance cache missing network info. {{(pid=75341) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.201s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] Acquiring lock "4754efee9a6d73d3647f2add2cfe86c291949740" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG nova.network.neutron [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] Updating instance_info_cache with network_info: [{"id": "a0990271-0de2-47ce-a33e-75cb022ba7c6", "address": "fa:16:3e:1e:60:6f", "network": {"id": "1bb9b4c1-b9b7-4ba6-8d17-879af734945f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1477588770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bc48ec5e944fe7b9bd6d87b32fdad7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0990271-0d", "ovs_interfaceid": "a0990271-0de2-47ce-a33e-75cb022ba7c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Releasing lock "refresh_cache-b7d427ed-6ac3-46d9-bebc-d672f465f850" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG nova.compute.manager [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] Instance network_info: |[{"id": "a0990271-0de2-47ce-a33e-75cb022ba7c6", "address": "fa:16:3e:1e:60:6f", "network": {"id": "1bb9b4c1-b9b7-4ba6-8d17-879af734945f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1477588770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bc48ec5e944fe7b9bd6d87b32fdad7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0990271-0d", "ovs_interfaceid": "a0990271-0de2-47ce-a33e-75cb022ba7c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-9182cdf2-43c8-4e35-a1e2-26dc80b620a7 req-bbfde934-9b24-4142-895f-6ebbc19be275 service nova] Acquired lock "refresh_cache-b7d427ed-6ac3-46d9-bebc-d672f465f850" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG nova.network.neutron [req-9182cdf2-43c8-4e35-a1e2-26dc80b620a7 req-bbfde934-9b24-4142-895f-6ebbc19be275 service nova] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] Refreshing network info cache for port a0990271-0de2-47ce-a33e-75cb022ba7c6 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] Start _get_guest_xml network_info=[{"id": "a0990271-0de2-47ce-a33e-75cb022ba7c6", "address": "fa:16:3e:1e:60:6f", "network": {"id": "1bb9b4c1-b9b7-4ba6-8d17-879af734945f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1477588770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bc48ec5e944fe7b9bd6d87b32fdad7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0990271-0d", "ovs_interfaceid": "a0990271-0de2-47ce-a33e-75cb022ba7c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:40:03Z,direct_url=<?>,disk_format='qcow2',id=a951ec1b-8017-4b82-9177-9f43ba7742e6,min_disk=0,min_ram=0,name='',owner='bc4eb4acd38f4d21aee5483ba28c0d46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:40:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'disk_bus': 'scsi', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'device_name': '/dev/sda', 'encryption_options': None, 'guest_format': None, 'encrypted': False, 'image_id': 'a951ec1b-8017-4b82-9177-9f43ba7742e6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 23:40:17 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:40:17 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:40:17 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:40:03Z,direct_url=<?>,disk_format='qcow2',id=a951ec1b-8017-4b82-9177-9f43ba7742e6,min_disk=0,min_ram=0,name='',owner='bc4eb4acd38f4d21aee5483ba28c0d46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:40:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T23:40:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1398479448',display_name='tempest-AttachSCSIVolumeTestJSON-server-1398479448',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1398479448',id=6,image_ref='a951ec1b-8017-4b82-9177-9f43ba7742e6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKMj1s2fpdHbB8JRXDfgTyaGC39337y50YVBeGXzIDB6EY1FkoxsWbt2+Zduh2jedtzYhG9cPGluAwUF6mfzm46O/G80KewIMaVLz800PlvGay1c0gNPzCjtmDecT/0TPA==',key_name='tempest-keypair-20970062',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1bc48ec5e944fe7b9bd6d87b32fdad7',ramdisk_id='',reservation_id='r-40d1nhv3',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a951ec1b-8017-4b82-9177-9f43ba7742e6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1408306292',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1408306292-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:40:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e63bc65c932e4685b00b6b10e4f019a7',uuid=b7d427ed-6ac3-46d9-bebc-d672f465f850,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0990271-0de2-47ce-a33e-75cb022ba7c6", "address": "fa:16:3e:1e:60:6f", "network": {"id": "1bb9b4c1-b9b7-4ba6-8d17-879af734945f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1477588770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bc48ec5e944fe7b9bd6d87b32fdad7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0990271-0d", "ovs_interfaceid": "a0990271-0de2-47ce-a33e-75cb022ba7c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Converting VIF {"id": "a0990271-0de2-47ce-a33e-75cb022ba7c6", "address": "fa:16:3e:1e:60:6f", "network": {"id": "1bb9b4c1-b9b7-4ba6-8d17-879af734945f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1477588770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bc48ec5e944fe7b9bd6d87b32fdad7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0990271-0d", "ovs_interfaceid": "a0990271-0de2-47ce-a33e-75cb022ba7c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:60:6f,bridge_name='br-int',has_traffic_filtering=True,id=a0990271-0de2-47ce-a33e-75cb022ba7c6,network=Network(1bb9b4c1-b9b7-4ba6-8d17-879af734945f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0990271-0d') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG nova.objects.instance [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Lazy-loading 'pci_devices' on Instance uuid b7d427ed-6ac3-46d9-bebc-d672f465f850 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] End _get_guest_xml xml=<domain type="kvm">
Nov 14 23:40:17 user nova-compute[75341]:   <uuid>b7d427ed-6ac3-46d9-bebc-d672f465f850</uuid>
Nov 14 23:40:17 user nova-compute[75341]:   <name>instance-00000006</name>
Nov 14 23:40:17 user nova-compute[75341]:   <memory>524288</memory>
Nov 14 23:40:17 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 14 23:40:17 user nova-compute[75341]:   <metadata>
Nov 14 23:40:17 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 23:40:17 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 14 23:40:17 user nova-compute[75341]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1398479448</nova:name>
Nov 14 23:40:17 user nova-compute[75341]:       <nova:creationTime>2023-11-14 23:40:17</nova:creationTime>
Nov 14 23:40:17 user nova-compute[75341]:       <nova:flavor name="m1.tiny">
Nov 14 23:40:17 user nova-compute[75341]:         <nova:memory>512</nova:memory>
Nov 14 23:40:17 user nova-compute[75341]:         <nova:disk>1</nova:disk>
Nov 14 23:40:17 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 14 23:40:17 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 23:40:17 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 14 23:40:17 user nova-compute[75341]:       </nova:flavor>
Nov 14 23:40:17 user nova-compute[75341]:       <nova:owner>
Nov 14 23:40:17 user nova-compute[75341]:         <nova:user uuid="e63bc65c932e4685b00b6b10e4f019a7">tempest-AttachSCSIVolumeTestJSON-1408306292-project-member</nova:user>
Nov 14 23:40:17 user nova-compute[75341]:         <nova:project uuid="f1bc48ec5e944fe7b9bd6d87b32fdad7">tempest-AttachSCSIVolumeTestJSON-1408306292</nova:project>
Nov 14 23:40:17 user nova-compute[75341]:       </nova:owner>
Nov 14 23:40:17 user nova-compute[75341]:       <nova:root type="image" uuid="a951ec1b-8017-4b82-9177-9f43ba7742e6"/>
Nov 14 23:40:17 user nova-compute[75341]:       <nova:ports>
Nov 14 23:40:17 user nova-compute[75341]:         <nova:port uuid="a0990271-0de2-47ce-a33e-75cb022ba7c6">
Nov 14 23:40:17 user nova-compute[75341]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 23:40:17 user nova-compute[75341]:         </nova:port>
Nov 14 23:40:17 user nova-compute[75341]:       </nova:ports>
Nov 14 23:40:17 user nova-compute[75341]:     </nova:instance>
Nov 14 23:40:17 user nova-compute[75341]:   </metadata>
Nov 14 23:40:17 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 14 23:40:17 user nova-compute[75341]:     <system>
Nov 14 23:40:17 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 23:40:17 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 14 23:40:17 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 14 23:40:17 user nova-compute[75341]:       <entry name="serial">b7d427ed-6ac3-46d9-bebc-d672f465f850</entry>
Nov 14 23:40:17 user nova-compute[75341]:       <entry name="uuid">b7d427ed-6ac3-46d9-bebc-d672f465f850</entry>
Nov 14 23:40:17 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 14 23:40:17 user nova-compute[75341]:     </system>
Nov 14 23:40:17 user nova-compute[75341]:   </sysinfo>
Nov 14 23:40:17 user nova-compute[75341]:   <os>
Nov 14 23:40:17 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 23:40:17 user nova-compute[75341]:     <boot dev="hd"/>
Nov 14 23:40:17 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 14 23:40:17 user nova-compute[75341]:   </os>
Nov 14 23:40:17 user nova-compute[75341]:   <features>
Nov 14 23:40:17 user nova-compute[75341]:     <acpi/>
Nov 14 23:40:17 user nova-compute[75341]:     <apic/>
Nov 14 23:40:17 user nova-compute[75341]:     <vmcoreinfo/>
Nov 14 23:40:17 user nova-compute[75341]:   </features>
Nov 14 23:40:17 user nova-compute[75341]:   <clock offset="utc">
Nov 14 23:40:17 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 23:40:17 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 23:40:17 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 14 23:40:17 user nova-compute[75341]:   </clock>
Nov 14 23:40:17 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 14 23:40:17 user nova-compute[75341]:     <model>Nehalem</model>
Nov 14 23:40:17 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 23:40:17 user nova-compute[75341]:   </cpu>
Nov 14 23:40:17 user nova-compute[75341]:   <devices>
Nov 14 23:40:17 user nova-compute[75341]:     <disk type="file" device="disk">
Nov 14 23:40:17 user nova-compute[75341]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 23:40:17 user nova-compute[75341]:       <source file="/opt/stack/data/nova/instances/b7d427ed-6ac3-46d9-bebc-d672f465f850/disk"/>
Nov 14 23:40:17 user nova-compute[75341]:       <target dev="sda" bus="scsi"/>
Nov 14 23:40:17 user nova-compute[75341]:       <address type="drive" controller="0" unit="0"/>
Nov 14 23:40:17 user nova-compute[75341]:     </disk>
Nov 14 23:40:17 user nova-compute[75341]:     <disk type="file" device="cdrom">
Nov 14 23:40:17 user nova-compute[75341]:       <driver name="qemu" type="raw" cache="none"/>
Nov 14 23:40:17 user nova-compute[75341]:       <source file="/opt/stack/data/nova/instances/b7d427ed-6ac3-46d9-bebc-d672f465f850/disk.config"/>
Nov 14 23:40:17 user nova-compute[75341]:       <target dev="sdb" bus="scsi"/>
Nov 14 23:40:17 user nova-compute[75341]:       <address type="drive" controller="0" unit="1"/>
Nov 14 23:40:17 user nova-compute[75341]:     </disk>
Nov 14 23:40:17 user nova-compute[75341]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 14 23:40:17 user nova-compute[75341]:     <interface type="ethernet">
Nov 14 23:40:17 user nova-compute[75341]:       <mac address="fa:16:3e:1e:60:6f"/>
Nov 14 23:40:17 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:40:17 user nova-compute[75341]:       <mtu size="1442"/>
Nov 14 23:40:17 user nova-compute[75341]:       <target dev="tapa0990271-0d"/>
Nov 14 23:40:17 user nova-compute[75341]:     </interface>
Nov 14 23:40:17 user nova-compute[75341]:     <serial type="pty">
Nov 14 23:40:17 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/b7d427ed-6ac3-46d9-bebc-d672f465f850/console.log" append="off"/>
Nov 14 23:40:17 user nova-compute[75341]:     </serial>
Nov 14 23:40:17 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 23:40:17 user nova-compute[75341]:     <video>
Nov 14 23:40:17 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:40:17 user nova-compute[75341]:     </video>
Nov 14 23:40:17 user nova-compute[75341]:     <rng model="virtio">
Nov 14 23:40:17 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 14 23:40:17 user nova-compute[75341]:     </rng>
Nov 14 23:40:17 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 14 23:40:17 user nova-compute[75341]:     <memballoon model="virtio">
Nov 14 23:40:17 user nova-compute[75341]:       <stats period="10"/>
Nov 14 23:40:17 user nova-compute[75341]:     </memballoon>
Nov 14 23:40:17 user nova-compute[75341]:   </devices>
Nov 14 23:40:17 user nova-compute[75341]: </domain>
Nov 14 23:40:17 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T23:40:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1398479448',display_name='tempest-AttachSCSIVolumeTestJSON-server-1398479448',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1398479448',id=6,image_ref='a951ec1b-8017-4b82-9177-9f43ba7742e6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKMj1s2fpdHbB8JRXDfgTyaGC39337y50YVBeGXzIDB6EY1FkoxsWbt2+Zduh2jedtzYhG9cPGluAwUF6mfzm46O/G80KewIMaVLz800PlvGay1c0gNPzCjtmDecT/0TPA==',key_name='tempest-keypair-20970062',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1bc48ec5e944fe7b9bd6d87b32fdad7',ramdisk_id='',reservation_id='r-40d1nhv3',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a951ec1b-8017-4b82-9177-9f43ba7742e6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1408306292',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1408306292-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:40:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e63bc65c932e4685b00b6b10e4f019a7',uuid=b7d427ed-6ac3-46d9-bebc-d672f465f850,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0990271-0de2-47ce-a33e-75cb022ba7c6", "address": "fa:16:3e:1e:60:6f", "network": {"id": "1bb9b4c1-b9b7-4ba6-8d17-879af734945f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1477588770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bc48ec5e944fe7b9bd6d87b32fdad7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0990271-0d", "ovs_interfaceid": "a0990271-0de2-47ce-a33e-75cb022ba7c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Converting VIF {"id": "a0990271-0de2-47ce-a33e-75cb022ba7c6", "address": "fa:16:3e:1e:60:6f", "network": {"id": "1bb9b4c1-b9b7-4ba6-8d17-879af734945f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1477588770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bc48ec5e944fe7b9bd6d87b32fdad7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0990271-0d", "ovs_interfaceid": "a0990271-0de2-47ce-a33e-75cb022ba7c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:60:6f,bridge_name='br-int',has_traffic_filtering=True,id=a0990271-0de2-47ce-a33e-75cb022ba7c6,network=Network(1bb9b4c1-b9b7-4ba6-8d17-879af734945f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0990271-0d') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG os_vif [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:60:6f,bridge_name='br-int',has_traffic_filtering=True,id=a0990271-0de2-47ce-a33e-75cb022ba7c6,network=Network(1bb9b4c1-b9b7-4ba6-8d17-879af734945f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0990271-0d') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3b20eeee-c255-5ccb-a316-d7af5e7b7ee7', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa0990271-0d, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa0990271-0d, col_values=(('qos', UUID('23ef7eb0-d56c-491c-a6c9-31f934e361a3')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa0990271-0d, col_values=(('external_ids', {'iface-id': 'a0990271-0de2-47ce-a33e-75cb022ba7c6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:60:6f', 'vm-uuid': 'b7d427ed-6ac3-46d9-bebc-d672f465f850'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:17 user nova-compute[75341]: INFO os_vif [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:60:6f,bridge_name='br-int',has_traffic_filtering=True,id=a0990271-0de2-47ce-a33e-75cb022ba7c6,network=Network(1bb9b4c1-b9b7-4ba6-8d17-879af734945f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0990271-0d')
Nov 14 23:40:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.257s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd/disk 1073741824 {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd/disk 1073741824" returned: 0 in 0.065s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.327s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] No BDM found with device name sda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] No VIF found with MAC fa:16:3e:1e:60:6f, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:40:17 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] Using config drive
Nov 14 23:40:17 user nova-compute[75341]: DEBUG nova.compute.manager [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Instance event wait completed in 0 seconds for  {{(pid=75341) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Guest created on hypervisor {{(pid=75341) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 23:40:17 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Instance spawned successfully.
Nov 14 23:40:17 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.231s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd/disk. size=1073741824 {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Found default for hw_cdrom_bus of ide {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Found default for hw_disk_bus of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Found default for hw_input_bus of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Found default for hw_pointer_model of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Found default for hw_video_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Found default for hw_vif_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG nova.compute.manager [req-d9528739-cb1e-483e-beb9-baf0020799ea req-cf28f074-1024-46ed-be27-0955ccea0052 service nova] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Received event network-vif-plugged-8a863ecb-919e-42ac-8507-1c9af9135895 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-d9528739-cb1e-483e-beb9-baf0020799ea req-cf28f074-1024-46ed-be27-0955ccea0052 service nova] Acquiring lock "a0cffbac-f552-47bf-bd6c-dabb70e7c867-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-d9528739-cb1e-483e-beb9-baf0020799ea req-cf28f074-1024-46ed-be27-0955ccea0052 service nova] Lock "a0cffbac-f552-47bf-bd6c-dabb70e7c867-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-d9528739-cb1e-483e-beb9-baf0020799ea req-cf28f074-1024-46ed-be27-0955ccea0052 service nova] Lock "a0cffbac-f552-47bf-bd6c-dabb70e7c867-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG nova.compute.manager [req-d9528739-cb1e-483e-beb9-baf0020799ea req-cf28f074-1024-46ed-be27-0955ccea0052 service nova] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] No waiting events found dispatching network-vif-plugged-8a863ecb-919e-42ac-8507-1c9af9135895 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:40:17 user nova-compute[75341]: WARNING nova.compute.manager [req-d9528739-cb1e-483e-beb9-baf0020799ea req-cf28f074-1024-46ed-be27-0955ccea0052 service nova] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Received unexpected event network-vif-plugged-8a863ecb-919e-42ac-8507-1c9af9135895 for instance with vm_state building and task_state spawning.
Nov 14 23:40:17 user nova-compute[75341]: DEBUG nova.compute.manager [req-d9528739-cb1e-483e-beb9-baf0020799ea req-cf28f074-1024-46ed-be27-0955ccea0052 service nova] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Received event network-changed-87b091a7-76a0-46e1-b1fd-fd305d1ce55e {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG nova.compute.manager [req-d9528739-cb1e-483e-beb9-baf0020799ea req-cf28f074-1024-46ed-be27-0955ccea0052 service nova] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Refreshing instance network info cache due to event network-changed-87b091a7-76a0-46e1-b1fd-fd305d1ce55e. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-d9528739-cb1e-483e-beb9-baf0020799ea req-cf28f074-1024-46ed-be27-0955ccea0052 service nova] Acquiring lock "refresh_cache-163c448b-0183-41bb-b6e0-61917f6ad781" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:40:17 user nova-compute[75341]: INFO nova.compute.manager [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Took 7.83 seconds to spawn the instance on the hypervisor.
Nov 14 23:40:17 user nova-compute[75341]: DEBUG nova.compute.manager [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG nova.network.neutron [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Updating instance_info_cache with network_info: [{"id": "87b091a7-76a0-46e1-b1fd-fd305d1ce55e", "address": "fa:16:3e:2f:5b:cc", "network": {"id": "0a21b45e-de67-426a-bc33-c012fb2b5528", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1524380697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc16bad01d434f7f9a66247f776d6269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87b091a7-76", "ovs_interfaceid": "87b091a7-76a0-46e1-b1fd-fd305d1ce55e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Releasing lock "refresh_cache-163c448b-0183-41bb-b6e0-61917f6ad781" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG nova.compute.manager [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Instance network_info: |[{"id": "87b091a7-76a0-46e1-b1fd-fd305d1ce55e", "address": "fa:16:3e:2f:5b:cc", "network": {"id": "0a21b45e-de67-426a-bc33-c012fb2b5528", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1524380697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc16bad01d434f7f9a66247f776d6269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87b091a7-76", "ovs_interfaceid": "87b091a7-76a0-46e1-b1fd-fd305d1ce55e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-d9528739-cb1e-483e-beb9-baf0020799ea req-cf28f074-1024-46ed-be27-0955ccea0052 service nova] Acquired lock "refresh_cache-163c448b-0183-41bb-b6e0-61917f6ad781" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG nova.network.neutron [req-d9528739-cb1e-483e-beb9-baf0020799ea req-cf28f074-1024-46ed-be27-0955ccea0052 service nova] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Refreshing network info cache for port 87b091a7-76a0-46e1-b1fd-fd305d1ce55e {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Start _get_guest_xml network_info=[{"id": "87b091a7-76a0-46e1-b1fd-fd305d1ce55e", "address": "fa:16:3e:2f:5b:cc", "network": {"id": "0a21b45e-de67-426a-bc33-c012fb2b5528", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1524380697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc16bad01d434f7f9a66247f776d6269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87b091a7-76", "ovs_interfaceid": "87b091a7-76a0-46e1-b1fd-fd305d1ce55e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encrypted': False, 'image_id': 'e46abb82-b810-490e-a8a1-ccdc5fa1a796'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] Cannot resize image /opt/stack/data/nova/instances/e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd/disk to a smaller size. {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Created local disks {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Ensure instance console log exists: /opt/stack/data/nova/instances/e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd/console.log {{(pid=75341) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:40:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:17 user nova-compute[75341]: INFO nova.compute.manager [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Took 9.14 seconds to build instance.
Nov 14 23:40:18 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:40:18 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:40:18 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 23:40:18 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 23:40:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1bcfa534-dce1-44b5-a6cf-3f31ffaf403a tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Lock "a0cffbac-f552-47bf-bd6c-dabb70e7c867" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.311s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:40:18 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 23:40:18 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 23:40:18 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 23:40:18 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 23:40:18 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 23:40:18 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 23:40:18 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 23:40:18 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 23:40:18 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 23:40:18 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 23:40:18 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 23:40:18 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 23:40:18 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 23:40:18 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 23:40:18 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T23:40:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1560149904',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1560149904',id=7,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQ3a1x+okDjRVw62hbKhJtP80/zWFyvtGey5wIlVDB0NZ56fG+725fWUXyjh7/+IE35PijjUBR8Wcuw/LlwusTfjzX4MaOP3PLObnIQMoEItEWkt+BvyX7BQ255w2h2Gw==',key_name='tempest-keypair-1289222933',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dc16bad01d434f7f9a66247f776d6269',ramdisk_id='',reservation_id='r-3r4vupg5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1943224082',owner_user_name='tempest-TaggedAttachmentsTest-1943224082-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:40:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48f384876a794dbfa3e7c89e6e20a232',uuid=163c448b-0183-41bb-b6e0-61917f6ad781,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87b091a7-76a0-46e1-b1fd-fd305d1ce55e", "address": "fa:16:3e:2f:5b:cc", "network": {"id": "0a21b45e-de67-426a-bc33-c012fb2b5528", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1524380697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc16bad01d434f7f9a66247f776d6269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87b091a7-76", "ovs_interfaceid": "87b091a7-76a0-46e1-b1fd-fd305d1ce55e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:40:18 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Converting VIF {"id": "87b091a7-76a0-46e1-b1fd-fd305d1ce55e", "address": "fa:16:3e:2f:5b:cc", "network": {"id": "0a21b45e-de67-426a-bc33-c012fb2b5528", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1524380697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc16bad01d434f7f9a66247f776d6269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87b091a7-76", "ovs_interfaceid": "87b091a7-76a0-46e1-b1fd-fd305d1ce55e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:40:18 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:5b:cc,bridge_name='br-int',has_traffic_filtering=True,id=87b091a7-76a0-46e1-b1fd-fd305d1ce55e,network=Network(0a21b45e-de67-426a-bc33-c012fb2b5528),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87b091a7-76') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:40:18 user nova-compute[75341]: DEBUG nova.objects.instance [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Lazy-loading 'pci_devices' on Instance uuid 163c448b-0183-41bb-b6e0-61917f6ad781 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:40:18 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] Creating config drive at /opt/stack/data/nova/instances/b7d427ed-6ac3-46d9-bebc-d672f465f850/disk.config
Nov 14 23:40:18 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b7d427ed-6ac3-46d9-bebc-d672f465f850/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp3le1_lcg {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:18 user nova-compute[75341]: DEBUG nova.network.neutron [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Successfully created port: 295dbc30-38ed-4679-b876-719906e8f9f5 {{(pid=75341) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 23:40:18 user nova-compute[75341]: DEBUG nova.network.neutron [req-9182cdf2-43c8-4e35-a1e2-26dc80b620a7 req-bbfde934-9b24-4142-895f-6ebbc19be275 service nova] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] Updated VIF entry in instance network info cache for port a0990271-0de2-47ce-a33e-75cb022ba7c6. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:40:18 user nova-compute[75341]: DEBUG nova.network.neutron [req-9182cdf2-43c8-4e35-a1e2-26dc80b620a7 req-bbfde934-9b24-4142-895f-6ebbc19be275 service nova] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] Updating instance_info_cache with network_info: [{"id": "a0990271-0de2-47ce-a33e-75cb022ba7c6", "address": "fa:16:3e:1e:60:6f", "network": {"id": "1bb9b4c1-b9b7-4ba6-8d17-879af734945f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1477588770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bc48ec5e944fe7b9bd6d87b32fdad7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0990271-0d", "ovs_interfaceid": "a0990271-0de2-47ce-a33e-75cb022ba7c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:40:18 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] End _get_guest_xml xml=<domain type="kvm">
Nov 14 23:40:18 user nova-compute[75341]:   <uuid>163c448b-0183-41bb-b6e0-61917f6ad781</uuid>
Nov 14 23:40:18 user nova-compute[75341]:   <name>instance-00000007</name>
Nov 14 23:40:18 user nova-compute[75341]:   <memory>524288</memory>
Nov 14 23:40:18 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 14 23:40:18 user nova-compute[75341]:   <metadata>
Nov 14 23:40:18 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 23:40:18 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 14 23:40:18 user nova-compute[75341]:       <nova:name>tempest-device-tagging-server-1560149904</nova:name>
Nov 14 23:40:18 user nova-compute[75341]:       <nova:creationTime>2023-11-14 23:40:18</nova:creationTime>
Nov 14 23:40:18 user nova-compute[75341]:       <nova:flavor name="m1.tiny">
Nov 14 23:40:18 user nova-compute[75341]:         <nova:memory>512</nova:memory>
Nov 14 23:40:18 user nova-compute[75341]:         <nova:disk>1</nova:disk>
Nov 14 23:40:18 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 14 23:40:18 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 23:40:18 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 14 23:40:18 user nova-compute[75341]:       </nova:flavor>
Nov 14 23:40:18 user nova-compute[75341]:       <nova:owner>
Nov 14 23:40:18 user nova-compute[75341]:         <nova:user uuid="48f384876a794dbfa3e7c89e6e20a232">tempest-TaggedAttachmentsTest-1943224082-project-member</nova:user>
Nov 14 23:40:18 user nova-compute[75341]:         <nova:project uuid="dc16bad01d434f7f9a66247f776d6269">tempest-TaggedAttachmentsTest-1943224082</nova:project>
Nov 14 23:40:18 user nova-compute[75341]:       </nova:owner>
Nov 14 23:40:18 user nova-compute[75341]:       <nova:root type="image" uuid="e46abb82-b810-490e-a8a1-ccdc5fa1a796"/>
Nov 14 23:40:18 user nova-compute[75341]:       <nova:ports>
Nov 14 23:40:18 user nova-compute[75341]:         <nova:port uuid="87b091a7-76a0-46e1-b1fd-fd305d1ce55e">
Nov 14 23:40:18 user nova-compute[75341]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 23:40:18 user nova-compute[75341]:         </nova:port>
Nov 14 23:40:18 user nova-compute[75341]:       </nova:ports>
Nov 14 23:40:18 user nova-compute[75341]:     </nova:instance>
Nov 14 23:40:18 user nova-compute[75341]:   </metadata>
Nov 14 23:40:18 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 14 23:40:18 user nova-compute[75341]:     <system>
Nov 14 23:40:18 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 23:40:18 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 14 23:40:18 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 14 23:40:18 user nova-compute[75341]:       <entry name="serial">163c448b-0183-41bb-b6e0-61917f6ad781</entry>
Nov 14 23:40:18 user nova-compute[75341]:       <entry name="uuid">163c448b-0183-41bb-b6e0-61917f6ad781</entry>
Nov 14 23:40:18 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 14 23:40:18 user nova-compute[75341]:     </system>
Nov 14 23:40:18 user nova-compute[75341]:   </sysinfo>
Nov 14 23:40:18 user nova-compute[75341]:   <os>
Nov 14 23:40:18 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 23:40:18 user nova-compute[75341]:     <boot dev="hd"/>
Nov 14 23:40:18 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 14 23:40:18 user nova-compute[75341]:   </os>
Nov 14 23:40:18 user nova-compute[75341]:   <features>
Nov 14 23:40:18 user nova-compute[75341]:     <acpi/>
Nov 14 23:40:18 user nova-compute[75341]:     <apic/>
Nov 14 23:40:18 user nova-compute[75341]:     <vmcoreinfo/>
Nov 14 23:40:18 user nova-compute[75341]:   </features>
Nov 14 23:40:18 user nova-compute[75341]:   <clock offset="utc">
Nov 14 23:40:18 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 23:40:18 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 23:40:18 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 14 23:40:18 user nova-compute[75341]:   </clock>
Nov 14 23:40:18 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 14 23:40:18 user nova-compute[75341]:     <model>Nehalem</model>
Nov 14 23:40:18 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 23:40:18 user nova-compute[75341]:   </cpu>
Nov 14 23:40:18 user nova-compute[75341]:   <devices>
Nov 14 23:40:18 user nova-compute[75341]:     <disk type="file" device="disk">
Nov 14 23:40:18 user nova-compute[75341]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 23:40:18 user nova-compute[75341]:       <source file="/opt/stack/data/nova/instances/163c448b-0183-41bb-b6e0-61917f6ad781/disk"/>
Nov 14 23:40:18 user nova-compute[75341]:       <target dev="vda" bus="virtio"/>
Nov 14 23:40:18 user nova-compute[75341]:     </disk>
Nov 14 23:40:18 user nova-compute[75341]:     <disk type="file" device="cdrom">
Nov 14 23:40:18 user nova-compute[75341]:       <driver name="qemu" type="raw" cache="none"/>
Nov 14 23:40:18 user nova-compute[75341]:       <source file="/opt/stack/data/nova/instances/163c448b-0183-41bb-b6e0-61917f6ad781/disk.config"/>
Nov 14 23:40:18 user nova-compute[75341]:       <target dev="hda" bus="ide"/>
Nov 14 23:40:18 user nova-compute[75341]:     </disk>
Nov 14 23:40:18 user nova-compute[75341]:     <interface type="ethernet">
Nov 14 23:40:18 user nova-compute[75341]:       <mac address="fa:16:3e:2f:5b:cc"/>
Nov 14 23:40:18 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:40:18 user nova-compute[75341]:       <mtu size="1442"/>
Nov 14 23:40:18 user nova-compute[75341]:       <target dev="tap87b091a7-76"/>
Nov 14 23:40:18 user nova-compute[75341]:     </interface>
Nov 14 23:40:18 user nova-compute[75341]:     <serial type="pty">
Nov 14 23:40:18 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/163c448b-0183-41bb-b6e0-61917f6ad781/console.log" append="off"/>
Nov 14 23:40:18 user nova-compute[75341]:     </serial>
Nov 14 23:40:18 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 23:40:18 user nova-compute[75341]:     <video>
Nov 14 23:40:18 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:40:18 user nova-compute[75341]:     </video>
Nov 14 23:40:18 user nova-compute[75341]:     <rng model="virtio">
Nov 14 23:40:18 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 14 23:40:18 user nova-compute[75341]:     </rng>
Nov 14 23:40:18 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 14 23:40:18 user nova-compute[75341]:     <memballoon model="virtio">
Nov 14 23:40:18 user nova-compute[75341]:       <stats period="10"/>
Nov 14 23:40:18 user nova-compute[75341]:     </memballoon>
Nov 14 23:40:18 user nova-compute[75341]:   </devices>
Nov 14 23:40:18 user nova-compute[75341]: </domain>
Nov 14 23:40:18 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 23:40:18 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T23:40:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1560149904',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1560149904',id=7,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQ3a1x+okDjRVw62hbKhJtP80/zWFyvtGey5wIlVDB0NZ56fG+725fWUXyjh7/+IE35PijjUBR8Wcuw/LlwusTfjzX4MaOP3PLObnIQMoEItEWkt+BvyX7BQ255w2h2Gw==',key_name='tempest-keypair-1289222933',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dc16bad01d434f7f9a66247f776d6269',ramdisk_id='',reservation_id='r-3r4vupg5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1943224082',owner_user_name='tempest-TaggedAttachmentsTest-1943224082-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:40:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48f384876a794dbfa3e7c89e6e20a232',uuid=163c448b-0183-41bb-b6e0-61917f6ad781,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87b091a7-76a0-46e1-b1fd-fd305d1ce55e", "address": "fa:16:3e:2f:5b:cc", "network": {"id": "0a21b45e-de67-426a-bc33-c012fb2b5528", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1524380697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc16bad01d434f7f9a66247f776d6269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87b091a7-76", "ovs_interfaceid": "87b091a7-76a0-46e1-b1fd-fd305d1ce55e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 23:40:18 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Converting VIF {"id": "87b091a7-76a0-46e1-b1fd-fd305d1ce55e", "address": "fa:16:3e:2f:5b:cc", "network": {"id": "0a21b45e-de67-426a-bc33-c012fb2b5528", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1524380697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc16bad01d434f7f9a66247f776d6269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87b091a7-76", "ovs_interfaceid": "87b091a7-76a0-46e1-b1fd-fd305d1ce55e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:40:18 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:5b:cc,bridge_name='br-int',has_traffic_filtering=True,id=87b091a7-76a0-46e1-b1fd-fd305d1ce55e,network=Network(0a21b45e-de67-426a-bc33-c012fb2b5528),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87b091a7-76') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:40:18 user nova-compute[75341]: DEBUG os_vif [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:5b:cc,bridge_name='br-int',has_traffic_filtering=True,id=87b091a7-76a0-46e1-b1fd-fd305d1ce55e,network=Network(0a21b45e-de67-426a-bc33-c012fb2b5528),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87b091a7-76') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 23:40:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:40:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 23:40:18 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b7d427ed-6ac3-46d9-bebc-d672f465f850/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp3le1_lcg" returned: 0 in 0.187s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a12bff99-52b7-5a30-a60a-4dff9f18392a', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:40:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:40:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-9182cdf2-43c8-4e35-a1e2-26dc80b620a7 req-bbfde934-9b24-4142-895f-6ebbc19be275 service nova] Releasing lock "refresh_cache-b7d427ed-6ac3-46d9-bebc-d672f465f850" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:40:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap87b091a7-76, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:40:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap87b091a7-76, col_values=(('qos', UUID('4ac4dc7e-96d1-49ef-9c3f-91d7f6dbd6e4')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:40:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap87b091a7-76, col_values=(('external_ids', {'iface-id': '87b091a7-76a0-46e1-b1fd-fd305d1ce55e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:5b:cc', 'vm-uuid': '163c448b-0183-41bb-b6e0-61917f6ad781'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:40:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:40:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:18 user nova-compute[75341]: INFO os_vif [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:5b:cc,bridge_name='br-int',has_traffic_filtering=True,id=87b091a7-76a0-46e1-b1fd-fd305d1ce55e,network=Network(0a21b45e-de67-426a-bc33-c012fb2b5528),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87b091a7-76')
Nov 14 23:40:18 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:40:18 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] No BDM found with device name hda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:40:18 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] No VIF found with MAC fa:16:3e:2f:5b:cc, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:40:18 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Using config drive
Nov 14 23:40:18 user nova-compute[75341]: DEBUG nova.network.neutron [req-d9528739-cb1e-483e-beb9-baf0020799ea req-cf28f074-1024-46ed-be27-0955ccea0052 service nova] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Updated VIF entry in instance network info cache for port 87b091a7-76a0-46e1-b1fd-fd305d1ce55e. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:40:18 user nova-compute[75341]: DEBUG nova.network.neutron [req-d9528739-cb1e-483e-beb9-baf0020799ea req-cf28f074-1024-46ed-be27-0955ccea0052 service nova] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Updating instance_info_cache with network_info: [{"id": "87b091a7-76a0-46e1-b1fd-fd305d1ce55e", "address": "fa:16:3e:2f:5b:cc", "network": {"id": "0a21b45e-de67-426a-bc33-c012fb2b5528", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1524380697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc16bad01d434f7f9a66247f776d6269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87b091a7-76", "ovs_interfaceid": "87b091a7-76a0-46e1-b1fd-fd305d1ce55e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:40:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-d9528739-cb1e-483e-beb9-baf0020799ea req-cf28f074-1024-46ed-be27-0955ccea0052 service nova] Releasing lock "refresh_cache-163c448b-0183-41bb-b6e0-61917f6ad781" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:40:18 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Creating config drive at /opt/stack/data/nova/instances/163c448b-0183-41bb-b6e0-61917f6ad781/disk.config
Nov 14 23:40:18 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/163c448b-0183-41bb-b6e0-61917f6ad781/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpor9ymxif {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:19 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/163c448b-0183-41bb-b6e0-61917f6ad781/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpor9ymxif" returned: 0 in 0.163s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:19 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:19 user nova-compute[75341]: DEBUG nova.compute.manager [req-a617a22c-a4a6-4978-b17c-3537898b9e54 req-f2c90041-0725-45f6-822f-fb74cea9f028 service nova] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Received event network-vif-plugged-4f1d8292-7392-4939-9303-437dc108b4a4 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:40:19 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a617a22c-a4a6-4978-b17c-3537898b9e54 req-f2c90041-0725-45f6-822f-fb74cea9f028 service nova] Acquiring lock "a308a35f-c8d7-482c-a93d-5d9eb473d4e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:40:19 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a617a22c-a4a6-4978-b17c-3537898b9e54 req-f2c90041-0725-45f6-822f-fb74cea9f028 service nova] Lock "a308a35f-c8d7-482c-a93d-5d9eb473d4e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:40:19 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a617a22c-a4a6-4978-b17c-3537898b9e54 req-f2c90041-0725-45f6-822f-fb74cea9f028 service nova] Lock "a308a35f-c8d7-482c-a93d-5d9eb473d4e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:40:19 user nova-compute[75341]: DEBUG nova.compute.manager [req-a617a22c-a4a6-4978-b17c-3537898b9e54 req-f2c90041-0725-45f6-822f-fb74cea9f028 service nova] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] No waiting events found dispatching network-vif-plugged-4f1d8292-7392-4939-9303-437dc108b4a4 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:40:19 user nova-compute[75341]: WARNING nova.compute.manager [req-a617a22c-a4a6-4978-b17c-3537898b9e54 req-f2c90041-0725-45f6-822f-fb74cea9f028 service nova] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Received unexpected event network-vif-plugged-4f1d8292-7392-4939-9303-437dc108b4a4 for instance with vm_state active and task_state None.
Nov 14 23:40:19 user nova-compute[75341]: DEBUG nova.network.neutron [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Successfully updated port: 295dbc30-38ed-4679-b876-719906e8f9f5 {{(pid=75341) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 23:40:19 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] Acquiring lock "refresh_cache-e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:40:19 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] Acquired lock "refresh_cache-e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:40:19 user nova-compute[75341]: DEBUG nova.network.neutron [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 23:40:19 user nova-compute[75341]: DEBUG nova.compute.manager [req-95c1ad23-6bc1-484c-91e1-97465f16a2be req-15083062-6ff1-4f78-8f8b-ffe2fbd9bad8 service nova] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Received event network-changed-295dbc30-38ed-4679-b876-719906e8f9f5 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:40:19 user nova-compute[75341]: DEBUG nova.compute.manager [req-95c1ad23-6bc1-484c-91e1-97465f16a2be req-15083062-6ff1-4f78-8f8b-ffe2fbd9bad8 service nova] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Refreshing instance network info cache due to event network-changed-295dbc30-38ed-4679-b876-719906e8f9f5. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:40:19 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-95c1ad23-6bc1-484c-91e1-97465f16a2be req-15083062-6ff1-4f78-8f8b-ffe2fbd9bad8 service nova] Acquiring lock "refresh_cache-e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:40:19 user nova-compute[75341]: DEBUG nova.network.neutron [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Instance cache missing network info. {{(pid=75341) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 23:40:20 user nova-compute[75341]: DEBUG nova.network.neutron [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Updating instance_info_cache with network_info: [{"id": "295dbc30-38ed-4679-b876-719906e8f9f5", "address": "fa:16:3e:44:65:00", "network": {"id": "63893f57-4617-4e26-9735-6fea458f5b1d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-258967465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d41edc5e2c0b4dd39fc317727fb22703", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap295dbc30-38", "ovs_interfaceid": "295dbc30-38ed-4679-b876-719906e8f9f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:40:20 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] Releasing lock "refresh_cache-e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:40:20 user nova-compute[75341]: DEBUG nova.compute.manager [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Instance network_info: |[{"id": "295dbc30-38ed-4679-b876-719906e8f9f5", "address": "fa:16:3e:44:65:00", "network": {"id": "63893f57-4617-4e26-9735-6fea458f5b1d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-258967465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d41edc5e2c0b4dd39fc317727fb22703", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap295dbc30-38", "ovs_interfaceid": "295dbc30-38ed-4679-b876-719906e8f9f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 23:40:20 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-95c1ad23-6bc1-484c-91e1-97465f16a2be req-15083062-6ff1-4f78-8f8b-ffe2fbd9bad8 service nova] Acquired lock "refresh_cache-e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:40:20 user nova-compute[75341]: DEBUG nova.network.neutron [req-95c1ad23-6bc1-484c-91e1-97465f16a2be req-15083062-6ff1-4f78-8f8b-ffe2fbd9bad8 service nova] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Refreshing network info cache for port 295dbc30-38ed-4679-b876-719906e8f9f5 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:40:20 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Start _get_guest_xml network_info=[{"id": "295dbc30-38ed-4679-b876-719906e8f9f5", "address": "fa:16:3e:44:65:00", "network": {"id": "63893f57-4617-4e26-9735-6fea458f5b1d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-258967465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d41edc5e2c0b4dd39fc317727fb22703", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap295dbc30-38", "ovs_interfaceid": "295dbc30-38ed-4679-b876-719906e8f9f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encrypted': False, 'image_id': 'e46abb82-b810-490e-a8a1-ccdc5fa1a796'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 23:40:20 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:40:20 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:40:20 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 23:40:20 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 23:40:20 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 23:40:20 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 23:40:20 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 23:40:20 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 23:40:20 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 23:40:20 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 23:40:20 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 23:40:20 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 23:40:20 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 23:40:20 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 23:40:20 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 23:40:20 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 23:40:20 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 23:40:20 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 23:40:20 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:40:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1573672987',display_name='tempest-VolumesAssistedSnapshotsTest-server-1573672987',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1573672987',id=8,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN0bK/whtQcGfmPPRHzKnlcdVjJXzM2upZiGMg2fbCCpgADOm7kKv13te8hP3HQp12UZq5dXZyrCd+oJtiS6AET7IPNdikKuZ8PJkRm17fjBrgZomCWtLQu//pZTAjicKw==',key_name='tempest-keypair-27419633',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d41edc5e2c0b4dd39fc317727fb22703',ramdisk_id='',reservation_id='r-6c5mkc5j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1143044886',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1143044886-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:40:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d5ddb1cd696433ebda85b9450ebb836',uuid=e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "295dbc30-38ed-4679-b876-719906e8f9f5", "address": "fa:16:3e:44:65:00", "network": {"id": "63893f57-4617-4e26-9735-6fea458f5b1d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-258967465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d41edc5e2c0b4dd39fc317727fb22703", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap295dbc30-38", "ovs_interfaceid": "295dbc30-38ed-4679-b876-719906e8f9f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:40:20 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] Converting VIF {"id": "295dbc30-38ed-4679-b876-719906e8f9f5", "address": "fa:16:3e:44:65:00", "network": {"id": "63893f57-4617-4e26-9735-6fea458f5b1d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-258967465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d41edc5e2c0b4dd39fc317727fb22703", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap295dbc30-38", "ovs_interfaceid": "295dbc30-38ed-4679-b876-719906e8f9f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:40:20 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:65:00,bridge_name='br-int',has_traffic_filtering=True,id=295dbc30-38ed-4679-b876-719906e8f9f5,network=Network(63893f57-4617-4e26-9735-6fea458f5b1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap295dbc30-38') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:40:20 user nova-compute[75341]: DEBUG nova.objects.instance [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] Lazy-loading 'pci_devices' on Instance uuid e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:40:20 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] End _get_guest_xml xml=<domain type="kvm">
Nov 14 23:40:20 user nova-compute[75341]:   <uuid>e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd</uuid>
Nov 14 23:40:20 user nova-compute[75341]:   <name>instance-00000008</name>
Nov 14 23:40:20 user nova-compute[75341]:   <memory>524288</memory>
Nov 14 23:40:20 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 14 23:40:20 user nova-compute[75341]:   <metadata>
Nov 14 23:40:20 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 23:40:20 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 14 23:40:20 user nova-compute[75341]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1573672987</nova:name>
Nov 14 23:40:20 user nova-compute[75341]:       <nova:creationTime>2023-11-14 23:40:20</nova:creationTime>
Nov 14 23:40:20 user nova-compute[75341]:       <nova:flavor name="m1.tiny">
Nov 14 23:40:20 user nova-compute[75341]:         <nova:memory>512</nova:memory>
Nov 14 23:40:20 user nova-compute[75341]:         <nova:disk>1</nova:disk>
Nov 14 23:40:20 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 14 23:40:20 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 23:40:20 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 14 23:40:20 user nova-compute[75341]:       </nova:flavor>
Nov 14 23:40:20 user nova-compute[75341]:       <nova:owner>
Nov 14 23:40:20 user nova-compute[75341]:         <nova:user uuid="2d5ddb1cd696433ebda85b9450ebb836">tempest-VolumesAssistedSnapshotsTest-1143044886-project-member</nova:user>
Nov 14 23:40:20 user nova-compute[75341]:         <nova:project uuid="d41edc5e2c0b4dd39fc317727fb22703">tempest-VolumesAssistedSnapshotsTest-1143044886</nova:project>
Nov 14 23:40:20 user nova-compute[75341]:       </nova:owner>
Nov 14 23:40:20 user nova-compute[75341]:       <nova:root type="image" uuid="e46abb82-b810-490e-a8a1-ccdc5fa1a796"/>
Nov 14 23:40:20 user nova-compute[75341]:       <nova:ports>
Nov 14 23:40:20 user nova-compute[75341]:         <nova:port uuid="295dbc30-38ed-4679-b876-719906e8f9f5">
Nov 14 23:40:20 user nova-compute[75341]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 23:40:20 user nova-compute[75341]:         </nova:port>
Nov 14 23:40:20 user nova-compute[75341]:       </nova:ports>
Nov 14 23:40:20 user nova-compute[75341]:     </nova:instance>
Nov 14 23:40:20 user nova-compute[75341]:   </metadata>
Nov 14 23:40:20 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 14 23:40:20 user nova-compute[75341]:     <system>
Nov 14 23:40:20 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 23:40:20 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 14 23:40:20 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 14 23:40:20 user nova-compute[75341]:       <entry name="serial">e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd</entry>
Nov 14 23:40:20 user nova-compute[75341]:       <entry name="uuid">e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd</entry>
Nov 14 23:40:20 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 14 23:40:20 user nova-compute[75341]:     </system>
Nov 14 23:40:20 user nova-compute[75341]:   </sysinfo>
Nov 14 23:40:20 user nova-compute[75341]:   <os>
Nov 14 23:40:20 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 23:40:20 user nova-compute[75341]:     <boot dev="hd"/>
Nov 14 23:40:20 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 14 23:40:20 user nova-compute[75341]:   </os>
Nov 14 23:40:20 user nova-compute[75341]:   <features>
Nov 14 23:40:20 user nova-compute[75341]:     <acpi/>
Nov 14 23:40:20 user nova-compute[75341]:     <apic/>
Nov 14 23:40:20 user nova-compute[75341]:     <vmcoreinfo/>
Nov 14 23:40:20 user nova-compute[75341]:   </features>
Nov 14 23:40:20 user nova-compute[75341]:   <clock offset="utc">
Nov 14 23:40:20 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 23:40:20 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 23:40:20 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 14 23:40:20 user nova-compute[75341]:   </clock>
Nov 14 23:40:20 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 14 23:40:20 user nova-compute[75341]:     <model>Nehalem</model>
Nov 14 23:40:20 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 23:40:20 user nova-compute[75341]:   </cpu>
Nov 14 23:40:20 user nova-compute[75341]:   <devices>
Nov 14 23:40:20 user nova-compute[75341]:     <disk type="file" device="disk">
Nov 14 23:40:20 user nova-compute[75341]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 23:40:20 user nova-compute[75341]:       <source file="/opt/stack/data/nova/instances/e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd/disk"/>
Nov 14 23:40:20 user nova-compute[75341]:       <target dev="vda" bus="virtio"/>
Nov 14 23:40:20 user nova-compute[75341]:     </disk>
Nov 14 23:40:20 user nova-compute[75341]:     <interface type="ethernet">
Nov 14 23:40:20 user nova-compute[75341]:       <mac address="fa:16:3e:44:65:00"/>
Nov 14 23:40:20 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:40:20 user nova-compute[75341]:       <mtu size="1442"/>
Nov 14 23:40:20 user nova-compute[75341]:       <target dev="tap295dbc30-38"/>
Nov 14 23:40:20 user nova-compute[75341]:     </interface>
Nov 14 23:40:20 user nova-compute[75341]:     <serial type="pty">
Nov 14 23:40:20 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd/console.log" append="off"/>
Nov 14 23:40:20 user nova-compute[75341]:     </serial>
Nov 14 23:40:20 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 23:40:20 user nova-compute[75341]:     <video>
Nov 14 23:40:20 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:40:20 user nova-compute[75341]:     </video>
Nov 14 23:40:20 user nova-compute[75341]:     <rng model="virtio">
Nov 14 23:40:20 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 14 23:40:20 user nova-compute[75341]:     </rng>
Nov 14 23:40:20 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 14 23:40:20 user nova-compute[75341]:     <memballoon model="virtio">
Nov 14 23:40:20 user nova-compute[75341]:       <stats period="10"/>
Nov 14 23:40:20 user nova-compute[75341]:     </memballoon>
Nov 14 23:40:20 user nova-compute[75341]:   </devices>
Nov 14 23:40:20 user nova-compute[75341]: </domain>
Nov 14 23:40:20 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 23:40:20 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:40:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1573672987',display_name='tempest-VolumesAssistedSnapshotsTest-server-1573672987',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1573672987',id=8,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN0bK/whtQcGfmPPRHzKnlcdVjJXzM2upZiGMg2fbCCpgADOm7kKv13te8hP3HQp12UZq5dXZyrCd+oJtiS6AET7IPNdikKuZ8PJkRm17fjBrgZomCWtLQu//pZTAjicKw==',key_name='tempest-keypair-27419633',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d41edc5e2c0b4dd39fc317727fb22703',ramdisk_id='',reservation_id='r-6c5mkc5j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1143044886',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1143044886-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:40:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d5ddb1cd696433ebda85b9450ebb836',uuid=e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "295dbc30-38ed-4679-b876-719906e8f9f5", "address": "fa:16:3e:44:65:00", "network": {"id": "63893f57-4617-4e26-9735-6fea458f5b1d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-258967465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d41edc5e2c0b4dd39fc317727fb22703", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap295dbc30-38", "ovs_interfaceid": "295dbc30-38ed-4679-b876-719906e8f9f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 23:40:20 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] Converting VIF {"id": "295dbc30-38ed-4679-b876-719906e8f9f5", "address": "fa:16:3e:44:65:00", "network": {"id": "63893f57-4617-4e26-9735-6fea458f5b1d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-258967465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d41edc5e2c0b4dd39fc317727fb22703", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap295dbc30-38", "ovs_interfaceid": "295dbc30-38ed-4679-b876-719906e8f9f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:40:20 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:65:00,bridge_name='br-int',has_traffic_filtering=True,id=295dbc30-38ed-4679-b876-719906e8f9f5,network=Network(63893f57-4617-4e26-9735-6fea458f5b1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap295dbc30-38') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:40:20 user nova-compute[75341]: DEBUG os_vif [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:65:00,bridge_name='br-int',has_traffic_filtering=True,id=295dbc30-38ed-4679-b876-719906e8f9f5,network=Network(63893f57-4617-4e26-9735-6fea458f5b1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap295dbc30-38') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 23:40:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:40:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 23:40:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dde9c3cc-3893-5aa6-9e94-2edc282948d1', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:40:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:40:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap295dbc30-38, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:40:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap295dbc30-38, col_values=(('qos', UUID('baa03cf3-7f35-420b-919d-a4bc461bedd3')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:40:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap295dbc30-38, col_values=(('external_ids', {'iface-id': '295dbc30-38ed-4679-b876-719906e8f9f5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:65:00', 'vm-uuid': 'e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:40:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:40:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:20 user nova-compute[75341]: INFO os_vif [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:65:00,bridge_name='br-int',has_traffic_filtering=True,id=295dbc30-38ed-4679-b876-719906e8f9f5,network=Network(63893f57-4617-4e26-9735-6fea458f5b1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap295dbc30-38')
Nov 14 23:40:20 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:40:20 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] No VIF found with MAC fa:16:3e:44:65:00, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:40:20 user nova-compute[75341]: DEBUG nova.network.neutron [req-95c1ad23-6bc1-484c-91e1-97465f16a2be req-15083062-6ff1-4f78-8f8b-ffe2fbd9bad8 service nova] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Updated VIF entry in instance network info cache for port 295dbc30-38ed-4679-b876-719906e8f9f5. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:40:20 user nova-compute[75341]: DEBUG nova.network.neutron [req-95c1ad23-6bc1-484c-91e1-97465f16a2be req-15083062-6ff1-4f78-8f8b-ffe2fbd9bad8 service nova] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Updating instance_info_cache with network_info: [{"id": "295dbc30-38ed-4679-b876-719906e8f9f5", "address": "fa:16:3e:44:65:00", "network": {"id": "63893f57-4617-4e26-9735-6fea458f5b1d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-258967465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d41edc5e2c0b4dd39fc317727fb22703", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap295dbc30-38", "ovs_interfaceid": "295dbc30-38ed-4679-b876-719906e8f9f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:40:20 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-95c1ad23-6bc1-484c-91e1-97465f16a2be req-15083062-6ff1-4f78-8f8b-ffe2fbd9bad8 service nova] Releasing lock "refresh_cache-e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:40:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:21 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:21 user nova-compute[75341]: DEBUG nova.compute.manager [req-b55e3d63-cc27-4f5b-81d8-9953890ae528 req-fa010e12-2b66-4be3-aaf0-864813a62ce8 service nova] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Received event network-vif-plugged-4f1d8292-7392-4939-9303-437dc108b4a4 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:40:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-b55e3d63-cc27-4f5b-81d8-9953890ae528 req-fa010e12-2b66-4be3-aaf0-864813a62ce8 service nova] Acquiring lock "a308a35f-c8d7-482c-a93d-5d9eb473d4e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:40:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-b55e3d63-cc27-4f5b-81d8-9953890ae528 req-fa010e12-2b66-4be3-aaf0-864813a62ce8 service nova] Lock "a308a35f-c8d7-482c-a93d-5d9eb473d4e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:40:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-b55e3d63-cc27-4f5b-81d8-9953890ae528 req-fa010e12-2b66-4be3-aaf0-864813a62ce8 service nova] Lock "a308a35f-c8d7-482c-a93d-5d9eb473d4e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:40:21 user nova-compute[75341]: DEBUG nova.compute.manager [req-b55e3d63-cc27-4f5b-81d8-9953890ae528 req-fa010e12-2b66-4be3-aaf0-864813a62ce8 service nova] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] No waiting events found dispatching network-vif-plugged-4f1d8292-7392-4939-9303-437dc108b4a4 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:40:21 user nova-compute[75341]: WARNING nova.compute.manager [req-b55e3d63-cc27-4f5b-81d8-9953890ae528 req-fa010e12-2b66-4be3-aaf0-864813a62ce8 service nova] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Received unexpected event network-vif-plugged-4f1d8292-7392-4939-9303-437dc108b4a4 for instance with vm_state active and task_state None.
Nov 14 23:40:21 user nova-compute[75341]: DEBUG nova.compute.manager [req-b55e3d63-cc27-4f5b-81d8-9953890ae528 req-fa010e12-2b66-4be3-aaf0-864813a62ce8 service nova] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Received event network-vif-plugged-6f1be2e1-796a-4b73-a56f-2a5286945ea3 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:40:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-b55e3d63-cc27-4f5b-81d8-9953890ae528 req-fa010e12-2b66-4be3-aaf0-864813a62ce8 service nova] Acquiring lock "0e7a53e9-6982-4c93-a830-a49cf0ce76bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:40:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-b55e3d63-cc27-4f5b-81d8-9953890ae528 req-fa010e12-2b66-4be3-aaf0-864813a62ce8 service nova] Lock "0e7a53e9-6982-4c93-a830-a49cf0ce76bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:40:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-b55e3d63-cc27-4f5b-81d8-9953890ae528 req-fa010e12-2b66-4be3-aaf0-864813a62ce8 service nova] Lock "0e7a53e9-6982-4c93-a830-a49cf0ce76bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:40:21 user nova-compute[75341]: DEBUG nova.compute.manager [req-b55e3d63-cc27-4f5b-81d8-9953890ae528 req-fa010e12-2b66-4be3-aaf0-864813a62ce8 service nova] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] No waiting events found dispatching network-vif-plugged-6f1be2e1-796a-4b73-a56f-2a5286945ea3 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:40:21 user nova-compute[75341]: WARNING nova.compute.manager [req-b55e3d63-cc27-4f5b-81d8-9953890ae528 req-fa010e12-2b66-4be3-aaf0-864813a62ce8 service nova] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Received unexpected event network-vif-plugged-6f1be2e1-796a-4b73-a56f-2a5286945ea3 for instance with vm_state building and task_state spawning.
Nov 14 23:40:21 user nova-compute[75341]: DEBUG nova.compute.manager [req-b55e3d63-cc27-4f5b-81d8-9953890ae528 req-fa010e12-2b66-4be3-aaf0-864813a62ce8 service nova] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Received event network-vif-plugged-6f1be2e1-796a-4b73-a56f-2a5286945ea3 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:40:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-b55e3d63-cc27-4f5b-81d8-9953890ae528 req-fa010e12-2b66-4be3-aaf0-864813a62ce8 service nova] Acquiring lock "0e7a53e9-6982-4c93-a830-a49cf0ce76bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:40:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-b55e3d63-cc27-4f5b-81d8-9953890ae528 req-fa010e12-2b66-4be3-aaf0-864813a62ce8 service nova] Lock "0e7a53e9-6982-4c93-a830-a49cf0ce76bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:40:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-b55e3d63-cc27-4f5b-81d8-9953890ae528 req-fa010e12-2b66-4be3-aaf0-864813a62ce8 service nova] Lock "0e7a53e9-6982-4c93-a830-a49cf0ce76bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:40:21 user nova-compute[75341]: DEBUG nova.compute.manager [req-b55e3d63-cc27-4f5b-81d8-9953890ae528 req-fa010e12-2b66-4be3-aaf0-864813a62ce8 service nova] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] No waiting events found dispatching network-vif-plugged-6f1be2e1-796a-4b73-a56f-2a5286945ea3 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:40:21 user nova-compute[75341]: WARNING nova.compute.manager [req-b55e3d63-cc27-4f5b-81d8-9953890ae528 req-fa010e12-2b66-4be3-aaf0-864813a62ce8 service nova] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Received unexpected event network-vif-plugged-6f1be2e1-796a-4b73-a56f-2a5286945ea3 for instance with vm_state building and task_state spawning.
Nov 14 23:40:21 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:21 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:21 user nova-compute[75341]: DEBUG nova.compute.manager [req-db2837d6-24a6-4d67-805f-ce5a4a7833e5 req-a515f77f-de77-4063-8864-9555f26f852d service nova] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] Received event network-vif-plugged-a0990271-0de2-47ce-a33e-75cb022ba7c6 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:40:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-db2837d6-24a6-4d67-805f-ce5a4a7833e5 req-a515f77f-de77-4063-8864-9555f26f852d service nova] Acquiring lock "b7d427ed-6ac3-46d9-bebc-d672f465f850-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:40:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-db2837d6-24a6-4d67-805f-ce5a4a7833e5 req-a515f77f-de77-4063-8864-9555f26f852d service nova] Lock "b7d427ed-6ac3-46d9-bebc-d672f465f850-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:40:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-db2837d6-24a6-4d67-805f-ce5a4a7833e5 req-a515f77f-de77-4063-8864-9555f26f852d service nova] Lock "b7d427ed-6ac3-46d9-bebc-d672f465f850-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:40:21 user nova-compute[75341]: DEBUG nova.compute.manager [req-db2837d6-24a6-4d67-805f-ce5a4a7833e5 req-a515f77f-de77-4063-8864-9555f26f852d service nova] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] No waiting events found dispatching network-vif-plugged-a0990271-0de2-47ce-a33e-75cb022ba7c6 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:40:21 user nova-compute[75341]: WARNING nova.compute.manager [req-db2837d6-24a6-4d67-805f-ce5a4a7833e5 req-a515f77f-de77-4063-8864-9555f26f852d service nova] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] Received unexpected event network-vif-plugged-a0990271-0de2-47ce-a33e-75cb022ba7c6 for instance with vm_state building and task_state spawning.
Nov 14 23:40:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:22 user nova-compute[75341]: DEBUG nova.compute.manager [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Instance event wait completed in 0 seconds for  {{(pid=75341) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 23:40:22 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Guest created on hypervisor {{(pid=75341) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 23:40:22 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Instance spawned successfully.
Nov 14 23:40:22 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 23:40:22 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Found default for hw_cdrom_bus of ide {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:40:22 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Found default for hw_disk_bus of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:40:22 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Found default for hw_input_bus of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:40:22 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Found default for hw_pointer_model of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:40:22 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Found default for hw_video_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:40:22 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Found default for hw_vif_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:40:22 user nova-compute[75341]: INFO nova.compute.manager [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Took 10.21 seconds to spawn the instance on the hypervisor.
Nov 14 23:40:22 user nova-compute[75341]: DEBUG nova.compute.manager [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 23:40:22 user nova-compute[75341]: INFO nova.compute.manager [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Took 11.49 seconds to build instance.
Nov 14 23:40:22 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d31d3778-f8a0-4795-a15b-523c25452241 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Lock "0e7a53e9-6982-4c93-a830-a49cf0ce76bd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.664s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:40:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:23 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:23 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:23 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:23 user nova-compute[75341]: DEBUG nova.compute.manager [req-eb24ba73-dd33-4263-9e2f-aed9ea6b1507 req-5732599b-591b-4d99-bd0e-15620263aa9f service nova] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Received event network-vif-plugged-295dbc30-38ed-4679-b876-719906e8f9f5 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:40:23 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-eb24ba73-dd33-4263-9e2f-aed9ea6b1507 req-5732599b-591b-4d99-bd0e-15620263aa9f service nova] Acquiring lock "e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:40:23 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-eb24ba73-dd33-4263-9e2f-aed9ea6b1507 req-5732599b-591b-4d99-bd0e-15620263aa9f service nova] Lock "e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:40:23 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-eb24ba73-dd33-4263-9e2f-aed9ea6b1507 req-5732599b-591b-4d99-bd0e-15620263aa9f service nova] Lock "e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:40:23 user nova-compute[75341]: DEBUG nova.compute.manager [req-eb24ba73-dd33-4263-9e2f-aed9ea6b1507 req-5732599b-591b-4d99-bd0e-15620263aa9f service nova] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] No waiting events found dispatching network-vif-plugged-295dbc30-38ed-4679-b876-719906e8f9f5 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:40:23 user nova-compute[75341]: WARNING nova.compute.manager [req-eb24ba73-dd33-4263-9e2f-aed9ea6b1507 req-5732599b-591b-4d99-bd0e-15620263aa9f service nova] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Received unexpected event network-vif-plugged-295dbc30-38ed-4679-b876-719906e8f9f5 for instance with vm_state building and task_state spawning.
Nov 14 23:40:23 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:23 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:23 user nova-compute[75341]: DEBUG nova.compute.manager [req-5bb02847-3f01-4e7b-9404-1fd163d8eb48 req-a76fcd45-6f84-4b8c-9618-855528116555 service nova] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] Received event network-vif-plugged-a0990271-0de2-47ce-a33e-75cb022ba7c6 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:40:23 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-5bb02847-3f01-4e7b-9404-1fd163d8eb48 req-a76fcd45-6f84-4b8c-9618-855528116555 service nova] Acquiring lock "b7d427ed-6ac3-46d9-bebc-d672f465f850-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:40:23 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-5bb02847-3f01-4e7b-9404-1fd163d8eb48 req-a76fcd45-6f84-4b8c-9618-855528116555 service nova] Lock "b7d427ed-6ac3-46d9-bebc-d672f465f850-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:40:23 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-5bb02847-3f01-4e7b-9404-1fd163d8eb48 req-a76fcd45-6f84-4b8c-9618-855528116555 service nova] Lock "b7d427ed-6ac3-46d9-bebc-d672f465f850-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:40:23 user nova-compute[75341]: DEBUG nova.compute.manager [req-5bb02847-3f01-4e7b-9404-1fd163d8eb48 req-a76fcd45-6f84-4b8c-9618-855528116555 service nova] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] No waiting events found dispatching network-vif-plugged-a0990271-0de2-47ce-a33e-75cb022ba7c6 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:40:23 user nova-compute[75341]: WARNING nova.compute.manager [req-5bb02847-3f01-4e7b-9404-1fd163d8eb48 req-a76fcd45-6f84-4b8c-9618-855528116555 service nova] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] Received unexpected event network-vif-plugged-a0990271-0de2-47ce-a33e-75cb022ba7c6 for instance with vm_state building and task_state spawning.
Nov 14 23:40:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:25 user nova-compute[75341]: DEBUG nova.compute.manager [req-3318e598-624c-4dbb-8b4c-3825bb1e810c req-e69af06e-d6a9-456f-95a5-5643d2311722 service nova] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Received event network-vif-plugged-295dbc30-38ed-4679-b876-719906e8f9f5 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:40:25 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-3318e598-624c-4dbb-8b4c-3825bb1e810c req-e69af06e-d6a9-456f-95a5-5643d2311722 service nova] Acquiring lock "e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:40:25 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-3318e598-624c-4dbb-8b4c-3825bb1e810c req-e69af06e-d6a9-456f-95a5-5643d2311722 service nova] Lock "e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:40:25 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-3318e598-624c-4dbb-8b4c-3825bb1e810c req-e69af06e-d6a9-456f-95a5-5643d2311722 service nova] Lock "e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:40:25 user nova-compute[75341]: DEBUG nova.compute.manager [req-3318e598-624c-4dbb-8b4c-3825bb1e810c req-e69af06e-d6a9-456f-95a5-5643d2311722 service nova] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] No waiting events found dispatching network-vif-plugged-295dbc30-38ed-4679-b876-719906e8f9f5 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:40:25 user nova-compute[75341]: WARNING nova.compute.manager [req-3318e598-624c-4dbb-8b4c-3825bb1e810c req-e69af06e-d6a9-456f-95a5-5643d2311722 service nova] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Received unexpected event network-vif-plugged-295dbc30-38ed-4679-b876-719906e8f9f5 for instance with vm_state building and task_state spawning.
Nov 14 23:40:26 user nova-compute[75341]: DEBUG nova.compute.manager [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] Instance event wait completed in 0 seconds for  {{(pid=75341) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 23:40:26 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] Guest created on hypervisor {{(pid=75341) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 23:40:26 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] Instance spawned successfully.
Nov 14 23:40:26 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 23:40:26 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] Found default for hw_input_bus of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:40:26 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] Found default for hw_pointer_model of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:40:26 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] Found default for hw_video_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:40:26 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] Found default for hw_vif_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:40:26 user nova-compute[75341]: INFO nova.compute.manager [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] Took 13.14 seconds to spawn the instance on the hypervisor.
Nov 14 23:40:26 user nova-compute[75341]: DEBUG nova.compute.manager [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 23:40:26 user nova-compute[75341]: INFO nova.compute.manager [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] Took 14.91 seconds to build instance.
Nov 14 23:40:26 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-7d697b7e-5d48-4cc1-93fe-ad3f1b634932 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Lock "b7d427ed-6ac3-46d9-bebc-d672f465f850" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.034s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:40:26 user nova-compute[75341]: DEBUG nova.compute.manager [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Instance event wait completed in 0 seconds for  {{(pid=75341) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 23:40:26 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Guest created on hypervisor {{(pid=75341) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 23:40:26 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Instance spawned successfully.
Nov 14 23:40:26 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 23:40:26 user nova-compute[75341]: DEBUG nova.compute.manager [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Instance event wait completed in 0 seconds for  {{(pid=75341) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 23:40:26 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Guest created on hypervisor {{(pid=75341) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 23:40:26 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Instance spawned successfully.
Nov 14 23:40:26 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 23:40:26 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Found default for hw_cdrom_bus of ide {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:40:26 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Found default for hw_disk_bus of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:40:26 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Found default for hw_input_bus of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:40:26 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Found default for hw_pointer_model of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:40:26 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Found default for hw_video_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:40:26 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Found default for hw_vif_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:40:26 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Found default for hw_cdrom_bus of ide {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:40:26 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Found default for hw_disk_bus of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:40:26 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Found default for hw_input_bus of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:40:26 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Found default for hw_pointer_model of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:40:26 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Found default for hw_video_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:40:26 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Found default for hw_vif_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:40:26 user nova-compute[75341]: INFO nova.compute.manager [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Took 10.07 seconds to spawn the instance on the hypervisor.
Nov 14 23:40:26 user nova-compute[75341]: DEBUG nova.compute.manager [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 23:40:27 user nova-compute[75341]: INFO nova.compute.manager [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Took 12.44 seconds to spawn the instance on the hypervisor.
Nov 14 23:40:27 user nova-compute[75341]: DEBUG nova.compute.manager [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 23:40:27 user nova-compute[75341]: INFO nova.compute.manager [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Took 12.09 seconds to build instance.
Nov 14 23:40:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8673677b-832a-4c9c-b320-0ee8ddb8506b tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] Lock "e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.404s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:40:27 user nova-compute[75341]: INFO nova.compute.manager [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Took 14.59 seconds to build instance.
Nov 14 23:40:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-622f74bd-aea2-4713-89d2-1ff588003a10 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Lock "163c448b-0183-41bb-b6e0-61917f6ad781" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.781s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:40:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:27 user nova-compute[75341]: DEBUG nova.compute.manager [req-4d19422b-03bf-4327-a43d-1ef08c3df27c req-4bfd91a8-b246-4560-93df-f3dffd7669ef service nova] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Received event network-vif-plugged-87b091a7-76a0-46e1-b1fd-fd305d1ce55e {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:40:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4d19422b-03bf-4327-a43d-1ef08c3df27c req-4bfd91a8-b246-4560-93df-f3dffd7669ef service nova] Acquiring lock "163c448b-0183-41bb-b6e0-61917f6ad781-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:40:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4d19422b-03bf-4327-a43d-1ef08c3df27c req-4bfd91a8-b246-4560-93df-f3dffd7669ef service nova] Lock "163c448b-0183-41bb-b6e0-61917f6ad781-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:40:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4d19422b-03bf-4327-a43d-1ef08c3df27c req-4bfd91a8-b246-4560-93df-f3dffd7669ef service nova] Lock "163c448b-0183-41bb-b6e0-61917f6ad781-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:40:27 user nova-compute[75341]: DEBUG nova.compute.manager [req-4d19422b-03bf-4327-a43d-1ef08c3df27c req-4bfd91a8-b246-4560-93df-f3dffd7669ef service nova] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] No waiting events found dispatching network-vif-plugged-87b091a7-76a0-46e1-b1fd-fd305d1ce55e {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:40:27 user nova-compute[75341]: WARNING nova.compute.manager [req-4d19422b-03bf-4327-a43d-1ef08c3df27c req-4bfd91a8-b246-4560-93df-f3dffd7669ef service nova] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Received unexpected event network-vif-plugged-87b091a7-76a0-46e1-b1fd-fd305d1ce55e for instance with vm_state active and task_state None.
Nov 14 23:40:29 user nova-compute[75341]: DEBUG nova.compute.manager [req-8df511f0-8379-4972-9313-063d182bbc8c req-0fccc595-fc8b-4558-beeb-539dccb5b8c0 service nova] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Received event network-vif-plugged-87b091a7-76a0-46e1-b1fd-fd305d1ce55e {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:40:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-8df511f0-8379-4972-9313-063d182bbc8c req-0fccc595-fc8b-4558-beeb-539dccb5b8c0 service nova] Acquiring lock "163c448b-0183-41bb-b6e0-61917f6ad781-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:40:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-8df511f0-8379-4972-9313-063d182bbc8c req-0fccc595-fc8b-4558-beeb-539dccb5b8c0 service nova] Lock "163c448b-0183-41bb-b6e0-61917f6ad781-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:40:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-8df511f0-8379-4972-9313-063d182bbc8c req-0fccc595-fc8b-4558-beeb-539dccb5b8c0 service nova] Lock "163c448b-0183-41bb-b6e0-61917f6ad781-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:40:29 user nova-compute[75341]: DEBUG nova.compute.manager [req-8df511f0-8379-4972-9313-063d182bbc8c req-0fccc595-fc8b-4558-beeb-539dccb5b8c0 service nova] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] No waiting events found dispatching network-vif-plugged-87b091a7-76a0-46e1-b1fd-fd305d1ce55e {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:40:29 user nova-compute[75341]: WARNING nova.compute.manager [req-8df511f0-8379-4972-9313-063d182bbc8c req-0fccc595-fc8b-4558-beeb-539dccb5b8c0 service nova] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Received unexpected event network-vif-plugged-87b091a7-76a0-46e1-b1fd-fd305d1ce55e for instance with vm_state active and task_state None.
Nov 14 23:40:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:35 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:35 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:37 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Acquiring lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:40:37 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:40:37 user nova-compute[75341]: DEBUG nova.compute.manager [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Starting instance... {{(pid=75341) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 23:40:37 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:40:37 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:40:37 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75341) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 23:40:37 user nova-compute[75341]: INFO nova.compute.claims [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Claim successful on node user
Nov 14 23:40:37 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:40:37 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:40:37 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.658s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:40:37 user nova-compute[75341]: DEBUG nova.compute.manager [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Start building networks asynchronously for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 23:40:37 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:40:37 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Cleaning up deleted instances {{(pid=75341) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 23:40:37 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] There are 0 instances to clean {{(pid=75341) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 23:40:37 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:40:37 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75341) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 23:40:37 user nova-compute[75341]: DEBUG nova.compute.manager [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Allocating IP information in the background. {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 23:40:37 user nova-compute[75341]: DEBUG nova.network.neutron [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] allocate_for_instance() {{(pid=75341) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 23:40:37 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:40:38 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 23:40:38 user nova-compute[75341]: DEBUG nova.compute.manager [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Start building block device mappings for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 23:40:38 user nova-compute[75341]: INFO nova.virt.block_device [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Booting with volume a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 at /dev/vda
Nov 14 23:40:38 user nova-compute[75341]: DEBUG os_brick.utils [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:40:38 user nova-compute[75341]: INFO oslo.privsep.daemon [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmph2dxcomz/privsep.sock']
Nov 14 23:40:38 user nova-compute[75341]: DEBUG nova.policy [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3078a91c61fb48a98b7c0e1d98117e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84539186347404ea3cdc32042f70052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75341) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 23:40:38 user sudo[86015]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmph2dxcomz/privsep.sock
Nov 14 23:40:38 user sudo[86015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 14 23:40:39 user nova-compute[75341]: DEBUG nova.network.neutron [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Successfully created port: d0dd84fa-339a-49ec-9042-96715e2230fe {{(pid=75341) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 23:40:39 user nova-compute[75341]: DEBUG nova.network.neutron [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Successfully created port: 886562c6-312d-4a87-a34a-059f2ba3058a {{(pid=75341) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 23:40:40 user sudo[86015]: pam_unix(sudo:session): session closed for user root
Nov 14 23:40:40 user nova-compute[75341]: INFO oslo.privsep.daemon [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Spawned new privsep daemon via rootwrap
Nov 14 23:40:40 user nova-compute[75341]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 14 23:40:40 user nova-compute[75341]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 14 23:40:40 user nova-compute[75341]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 14 23:40:40 user nova-compute[75341]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86063
Nov 14 23:40:40 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f98bce-fb87-4d0a-aa0b-4da54f30ca72]: (2,) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:40:40 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:40 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:40 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:40 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[48298d0e-8b84-4dba-b6e9-2c84271c8686]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6d1cfca09c9\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:40:40 user nova-compute[75341]: WARNING os_brick.initiator.connectors.nvmeof [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 14 23:40:40 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:40 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:40 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[d736ca01-a14e-461d-a364-aa040a1568bd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:40:40 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:40 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:40 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a6197c-1ba9-4b28-98f4-2d851e79ee01]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:40:40 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d8634b-7d49-4e04-9db4-f69f817f45a2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:40:40 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Running cmd (subprocess): nvme version {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:40 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] 'nvme version' failed. Not Retrying. {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:40:40 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.nvmeof [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] nvme not present on system {{(pid=75341) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 23:40:40 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:40 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:40:40 user nova-compute[75341]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 23:40:40 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[b331ee07-2580-43e4-9456-c0bba23d4595]: (4, '') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:40:40 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75341) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 23:40:40 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 23:40:40 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] LIGHTOS: no hostnqn found. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 23:40:40 user nova-compute[75341]: DEBUG os_brick.utils [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] <== get_connector_properties: return (2217ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6d1cfca09c9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:40:40 user nova-compute[75341]: DEBUG nova.virt.block_device [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Updating existing volume attachment record: bbe0925e-b91f-411f-8f7b-e79643868f0c {{(pid=75341) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 23:40:40 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:40 user nova-compute[75341]: DEBUG nova.network.neutron [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Successfully created port: c314df64-6753-4691-a931-1ef8f31a8063 {{(pid=75341) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 23:40:41 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:40:41 user nova-compute[75341]: DEBUG nova.network.neutron [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Successfully created port: 8352810c-25a7-4c4d-b13f-196c82e323ee {{(pid=75341) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 23:40:41 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:40:41 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Starting heal instance info cache {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 23:40:41 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Rebuilding the list of instances to heal {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 23:40:41 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Skipping network cache update for instance because it is Building. {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 14 23:40:42 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "refresh_cache-881351d7-31f9-44f4-8571-8f540bbec29c" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:40:42 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquired lock "refresh_cache-881351d7-31f9-44f4-8571-8f540bbec29c" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:40:42 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Forcefully refreshing network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 23:40:42 user nova-compute[75341]: DEBUG nova.objects.instance [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lazy-loading 'info_cache' on Instance uuid 881351d7-31f9-44f4-8571-8f540bbec29c {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:40:42 user nova-compute[75341]: DEBUG nova.network.neutron [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Successfully created port: e1611672-3415-4fea-adb0-c7fe74ae6049 {{(pid=75341) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 23:40:42 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Updating instance_info_cache with network_info: [{"id": "dcc0edd5-582a-499a-beaf-6de23ff1537c", "address": "fa:16:3e:83:5b:7a", "network": {"id": "139c86e9-e6ea-4307-9f78-7f41ab7a6d8c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-487359378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eff8d64949254c7eb3dd8685ca7447b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc0edd5-58", "ovs_interfaceid": "dcc0edd5-582a-499a-beaf-6de23ff1537c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:40:42 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Releasing lock "refresh_cache-881351d7-31f9-44f4-8571-8f540bbec29c" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:40:42 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Updated the network info_cache for instance {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 23:40:42 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:40:42 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:40:42 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:40:42 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75341) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 23:40:43 user nova-compute[75341]: DEBUG nova.network.neutron [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Successfully updated port: d0dd84fa-339a-49ec-9042-96715e2230fe {{(pid=75341) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 23:40:43 user nova-compute[75341]: DEBUG nova.compute.manager [req-72330e85-03ea-4993-835c-2d76835fce0b req-9293bb64-eee2-45eb-b47a-21ad8899161f service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received event network-changed-d0dd84fa-339a-49ec-9042-96715e2230fe {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:40:43 user nova-compute[75341]: DEBUG nova.compute.manager [req-72330e85-03ea-4993-835c-2d76835fce0b req-9293bb64-eee2-45eb-b47a-21ad8899161f service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Refreshing instance network info cache due to event network-changed-d0dd84fa-339a-49ec-9042-96715e2230fe. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:40:43 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-72330e85-03ea-4993-835c-2d76835fce0b req-9293bb64-eee2-45eb-b47a-21ad8899161f service nova] Acquiring lock "refresh_cache-9d03c7a3-e816-43b0-8616-60dea7a4e81a" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:40:43 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-72330e85-03ea-4993-835c-2d76835fce0b req-9293bb64-eee2-45eb-b47a-21ad8899161f service nova] Acquired lock "refresh_cache-9d03c7a3-e816-43b0-8616-60dea7a4e81a" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:40:43 user nova-compute[75341]: DEBUG nova.network.neutron [req-72330e85-03ea-4993-835c-2d76835fce0b req-9293bb64-eee2-45eb-b47a-21ad8899161f service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Refreshing network info cache for port d0dd84fa-339a-49ec-9042-96715e2230fe {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:40:43 user nova-compute[75341]: DEBUG nova.network.neutron [req-72330e85-03ea-4993-835c-2d76835fce0b req-9293bb64-eee2-45eb-b47a-21ad8899161f service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Instance cache missing network info. {{(pid=75341) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 23:40:43 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:40:43 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:40:43 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:40:43 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:40:44 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:40:44 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:40:44 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75341) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 23:40:44 user nova-compute[75341]: DEBUG nova.network.neutron [req-72330e85-03ea-4993-835c-2d76835fce0b req-9293bb64-eee2-45eb-b47a-21ad8899161f service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:40:44 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-72330e85-03ea-4993-835c-2d76835fce0b req-9293bb64-eee2-45eb-b47a-21ad8899161f service nova] Releasing lock "refresh_cache-9d03c7a3-e816-43b0-8616-60dea7a4e81a" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:40:44 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d427ed-6ac3-46d9-bebc-d672f465f850/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:44 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d427ed-6ac3-46d9-bebc-d672f465f850/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:44 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d427ed-6ac3-46d9-bebc-d672f465f850/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:44 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d427ed-6ac3-46d9-bebc-d672f465f850/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:44 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91603fef-c1cc-4fa1-96b2-e840db651627/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:44 user nova-compute[75341]: DEBUG nova.network.neutron [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Successfully updated port: f55964c8-6b58-4464-a352-e5145cc3c518 {{(pid=75341) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 23:40:44 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91603fef-c1cc-4fa1-96b2-e840db651627/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:44 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91603fef-c1cc-4fa1-96b2-e840db651627/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:45 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91603fef-c1cc-4fa1-96b2-e840db651627/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:45 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/163c448b-0183-41bb-b6e0-61917f6ad781/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:45 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:45 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/163c448b-0183-41bb-b6e0-61917f6ad781/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:45 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/163c448b-0183-41bb-b6e0-61917f6ad781/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:45 user nova-compute[75341]: DEBUG nova.network.neutron [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Successfully updated port: eb488639-e98a-4a85-b148-09dbb505f1c9 {{(pid=75341) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 23:40:45 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/163c448b-0183-41bb-b6e0-61917f6ad781/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:45 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:45 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:45 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:45 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:45 user nova-compute[75341]: DEBUG nova.compute.manager [req-02faef07-9ddc-42cc-8d59-0aec7c630285 req-9ef6844e-c4a1-4060-9759-4f4e214aeb34 service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received event network-changed-f55964c8-6b58-4464-a352-e5145cc3c518 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:40:45 user nova-compute[75341]: DEBUG nova.compute.manager [req-02faef07-9ddc-42cc-8d59-0aec7c630285 req-9ef6844e-c4a1-4060-9759-4f4e214aeb34 service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Refreshing instance network info cache due to event network-changed-f55964c8-6b58-4464-a352-e5145cc3c518. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:40:45 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-02faef07-9ddc-42cc-8d59-0aec7c630285 req-9ef6844e-c4a1-4060-9759-4f4e214aeb34 service nova] Acquiring lock "refresh_cache-9d03c7a3-e816-43b0-8616-60dea7a4e81a" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:40:45 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-02faef07-9ddc-42cc-8d59-0aec7c630285 req-9ef6844e-c4a1-4060-9759-4f4e214aeb34 service nova] Acquired lock "refresh_cache-9d03c7a3-e816-43b0-8616-60dea7a4e81a" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:40:45 user nova-compute[75341]: DEBUG nova.network.neutron [req-02faef07-9ddc-42cc-8d59-0aec7c630285 req-9ef6844e-c4a1-4060-9759-4f4e214aeb34 service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Refreshing network info cache for port f55964c8-6b58-4464-a352-e5145cc3c518 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:40:45 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:45 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0cffbac-f552-47bf-bd6c-dabb70e7c867/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:46 user nova-compute[75341]: DEBUG nova.network.neutron [req-02faef07-9ddc-42cc-8d59-0aec7c630285 req-9ef6844e-c4a1-4060-9759-4f4e214aeb34 service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Instance cache missing network info. {{(pid=75341) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 23:40:46 user nova-compute[75341]: INFO nova.virt.block_device [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Booting with volume 1d39d66b-22ae-4f70-bd8e-1e9df2b517ff at /dev/vdb
Nov 14 23:40:46 user nova-compute[75341]: DEBUG os_brick.utils [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:40:46 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:46 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:46 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[62869347-ba3a-4b0b-982c-452026efdf90]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6d1cfca09c9\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:40:46 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:46 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0cffbac-f552-47bf-bd6c-dabb70e7c867/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:46 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0cffbac-f552-47bf-bd6c-dabb70e7c867/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:46 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:46 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[995108de-1627-4934-b0dd-42f55ad14594]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:40:46 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:46 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:46 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe75089a-a3db-4fab-9814-ae030607ec0c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:40:46 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7a1abf-7f5f-4144-8576-fe4eec2ac4e8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:40:46 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Running cmd (subprocess): nvme version {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:46 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] 'nvme version' failed. Not Retrying. {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:40:46 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.nvmeof [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] nvme not present on system {{(pid=75341) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 23:40:46 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:46 user nova-compute[75341]: DEBUG nova.network.neutron [req-02faef07-9ddc-42cc-8d59-0aec7c630285 req-9ef6844e-c4a1-4060-9759-4f4e214aeb34 service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:40:46 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:40:46 user nova-compute[75341]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 23:40:46 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[62608a7a-b8f0-4d3f-873d-77c22a206bfc]: (4, '') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:40:46 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75341) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 23:40:46 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 23:40:46 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] LIGHTOS: no hostnqn found. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 23:40:46 user nova-compute[75341]: DEBUG os_brick.utils [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6d1cfca09c9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:40:46 user nova-compute[75341]: DEBUG nova.virt.block_device [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Updating existing volume attachment record: 4fa61a92-81ac-43de-9f32-40d6e022ef27 {{(pid=75341) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 23:40:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-02faef07-9ddc-42cc-8d59-0aec7c630285 req-9ef6844e-c4a1-4060-9759-4f4e214aeb34 service nova] Releasing lock "refresh_cache-9d03c7a3-e816-43b0-8616-60dea7a4e81a" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:40:46 user nova-compute[75341]: DEBUG nova.compute.manager [req-02faef07-9ddc-42cc-8d59-0aec7c630285 req-9ef6844e-c4a1-4060-9759-4f4e214aeb34 service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received event network-changed-eb488639-e98a-4a85-b148-09dbb505f1c9 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:40:46 user nova-compute[75341]: DEBUG nova.compute.manager [req-02faef07-9ddc-42cc-8d59-0aec7c630285 req-9ef6844e-c4a1-4060-9759-4f4e214aeb34 service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Refreshing instance network info cache due to event network-changed-eb488639-e98a-4a85-b148-09dbb505f1c9. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:40:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-02faef07-9ddc-42cc-8d59-0aec7c630285 req-9ef6844e-c4a1-4060-9759-4f4e214aeb34 service nova] Acquiring lock "refresh_cache-9d03c7a3-e816-43b0-8616-60dea7a4e81a" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:40:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-02faef07-9ddc-42cc-8d59-0aec7c630285 req-9ef6844e-c4a1-4060-9759-4f4e214aeb34 service nova] Acquired lock "refresh_cache-9d03c7a3-e816-43b0-8616-60dea7a4e81a" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:40:46 user nova-compute[75341]: DEBUG nova.network.neutron [req-02faef07-9ddc-42cc-8d59-0aec7c630285 req-9ef6844e-c4a1-4060-9759-4f4e214aeb34 service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Refreshing network info cache for port eb488639-e98a-4a85-b148-09dbb505f1c9 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:40:46 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0cffbac-f552-47bf-bd6c-dabb70e7c867/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:46 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e7a53e9-6982-4c93-a830-a49cf0ce76bd/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:46 user nova-compute[75341]: DEBUG nova.network.neutron [req-02faef07-9ddc-42cc-8d59-0aec7c630285 req-9ef6844e-c4a1-4060-9759-4f4e214aeb34 service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Instance cache missing network info. {{(pid=75341) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 23:40:46 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:46 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e7a53e9-6982-4c93-a830-a49cf0ce76bd/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:46 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e7a53e9-6982-4c93-a830-a49cf0ce76bd/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:46 user nova-compute[75341]: DEBUG nova.network.neutron [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Successfully updated port: 886562c6-312d-4a87-a34a-059f2ba3058a {{(pid=75341) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 23:40:46 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e7a53e9-6982-4c93-a830-a49cf0ce76bd/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:46 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:46 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:46 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:47 user nova-compute[75341]: DEBUG nova.network.neutron [req-02faef07-9ddc-42cc-8d59-0aec7c630285 req-9ef6844e-c4a1-4060-9759-4f4e214aeb34 service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:40:47 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-02faef07-9ddc-42cc-8d59-0aec7c630285 req-9ef6844e-c4a1-4060-9759-4f4e214aeb34 service nova] Releasing lock "refresh_cache-9d03c7a3-e816-43b0-8616-60dea7a4e81a" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:40:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a308a35f-c8d7-482c-a93d-5d9eb473d4e1/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a308a35f-c8d7-482c-a93d-5d9eb473d4e1/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a308a35f-c8d7-482c-a93d-5d9eb473d4e1/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a308a35f-c8d7-482c-a93d-5d9eb473d4e1/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:48 user nova-compute[75341]: DEBUG nova.network.neutron [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Successfully updated port: c314df64-6753-4691-a931-1ef8f31a8063 {{(pid=75341) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 23:40:48 user nova-compute[75341]: DEBUG nova.compute.manager [req-b6c46969-2ae9-4233-90e1-493bb09d6aee req-7c2ddbae-df58-4634-aa31-fd9436c418f2 service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received event network-changed-886562c6-312d-4a87-a34a-059f2ba3058a {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:40:48 user nova-compute[75341]: DEBUG nova.compute.manager [req-b6c46969-2ae9-4233-90e1-493bb09d6aee req-7c2ddbae-df58-4634-aa31-fd9436c418f2 service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Refreshing instance network info cache due to event network-changed-886562c6-312d-4a87-a34a-059f2ba3058a. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:40:48 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-b6c46969-2ae9-4233-90e1-493bb09d6aee req-7c2ddbae-df58-4634-aa31-fd9436c418f2 service nova] Acquiring lock "refresh_cache-9d03c7a3-e816-43b0-8616-60dea7a4e81a" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:40:48 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-b6c46969-2ae9-4233-90e1-493bb09d6aee req-7c2ddbae-df58-4634-aa31-fd9436c418f2 service nova] Acquired lock "refresh_cache-9d03c7a3-e816-43b0-8616-60dea7a4e81a" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:40:48 user nova-compute[75341]: DEBUG nova.network.neutron [req-b6c46969-2ae9-4233-90e1-493bb09d6aee req-7c2ddbae-df58-4634-aa31-fd9436c418f2 service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Refreshing network info cache for port 886562c6-312d-4a87-a34a-059f2ba3058a {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:40:48 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:40:48 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:40:48 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Hypervisor/Node resource view: name=user free_ram=7330MB free_disk=25.73088836669922GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75341) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 23:40:48 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:40:48 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:40:48 user nova-compute[75341]: DEBUG nova.network.neutron [req-b6c46969-2ae9-4233-90e1-493bb09d6aee req-7c2ddbae-df58-4634-aa31-fd9436c418f2 service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Instance cache missing network info. {{(pid=75341) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 23:40:48 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 881351d7-31f9-44f4-8571-8f540bbec29c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:40:48 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 91603fef-c1cc-4fa1-96b2-e840db651627 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:40:48 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance a308a35f-c8d7-482c-a93d-5d9eb473d4e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:40:48 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance a0cffbac-f552-47bf-bd6c-dabb70e7c867 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:40:48 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 0e7a53e9-6982-4c93-a830-a49cf0ce76bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:40:48 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance b7d427ed-6ac3-46d9-bebc-d672f465f850 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:40:48 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 163c448b-0183-41bb-b6e0-61917f6ad781 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:40:48 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:40:48 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 9d03c7a3-e816-43b0-8616-60dea7a4e81a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:40:48 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 23:40:48 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 23:40:48 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Refreshing inventories for resource provider 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 23:40:48 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Updating ProviderTree inventory for provider 8fa114cc-b541-418f-865c-16c44294e72d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 23:40:48 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Updating inventory in ProviderTree for provider 8fa114cc-b541-418f-865c-16c44294e72d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 23:40:48 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Refreshing aggregate associations for resource provider 8fa114cc-b541-418f-865c-16c44294e72d, aggregates: None {{(pid=75341) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 23:40:48 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Refreshing trait associations for resource provider 8fa114cc-b541-418f-865c-16c44294e72d, traits: COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_MMX,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000E {{(pid=75341) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 23:40:48 user nova-compute[75341]: DEBUG nova.network.neutron [req-b6c46969-2ae9-4233-90e1-493bb09d6aee req-7c2ddbae-df58-4634-aa31-fd9436c418f2 service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:40:48 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-b6c46969-2ae9-4233-90e1-493bb09d6aee req-7c2ddbae-df58-4634-aa31-fd9436c418f2 service nova] Releasing lock "refresh_cache-9d03c7a3-e816-43b0-8616-60dea7a4e81a" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:40:48 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:40:48 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:40:48 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Compute_service record updated for user:user {{(pid=75341) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 23:40:48 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.858s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:40:48 user nova-compute[75341]: DEBUG nova.network.neutron [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Successfully updated port: 8352810c-25a7-4c4d-b13f-196c82e323ee {{(pid=75341) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 23:40:49 user nova-compute[75341]: DEBUG nova.network.neutron [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Successfully updated port: e1611672-3415-4fea-adb0-c7fe74ae6049 {{(pid=75341) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 23:40:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Acquiring lock "refresh_cache-9d03c7a3-e816-43b0-8616-60dea7a4e81a" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:40:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Acquired lock "refresh_cache-9d03c7a3-e816-43b0-8616-60dea7a4e81a" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:40:49 user nova-compute[75341]: DEBUG nova.network.neutron [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 23:40:49 user nova-compute[75341]: DEBUG nova.network.neutron [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Instance cache missing network info. {{(pid=75341) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 23:40:49 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:40:49 user nova-compute[75341]: DEBUG nova.compute.manager [req-de38a3ce-4b8a-43c0-b9fa-7661fce49260 req-31c70791-14c0-4421-b091-f71114431364 service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received event network-changed-c314df64-6753-4691-a931-1ef8f31a8063 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:40:49 user nova-compute[75341]: DEBUG nova.compute.manager [req-de38a3ce-4b8a-43c0-b9fa-7661fce49260 req-31c70791-14c0-4421-b091-f71114431364 service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Refreshing instance network info cache due to event network-changed-c314df64-6753-4691-a931-1ef8f31a8063. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:40:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-de38a3ce-4b8a-43c0-b9fa-7661fce49260 req-31c70791-14c0-4421-b091-f71114431364 service nova] Acquiring lock "refresh_cache-9d03c7a3-e816-43b0-8616-60dea7a4e81a" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:40:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:51 user nova-compute[75341]: INFO nova.virt.block_device [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Booting with volume de5d17dd-51c3-42bc-9950-b815f8d48296 at /dev/vdc
Nov 14 23:40:51 user nova-compute[75341]: DEBUG os_brick.utils [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:40:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:51 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab572b24-2b80-4506-b20d-2099e80fb5c2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6d1cfca09c9\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:40:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:51 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be45a9a-4319-47fe-89e0-6a453e5157ce]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:40:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:51 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[62375e51-d15f-4cf9-8ee4-f35a4a6823da]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:40:51 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dbd3076-6545-44e9-86cc-1544a02f3d54]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:40:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Running cmd (subprocess): nvme version {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] 'nvme version' failed. Not Retrying. {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:40:51 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.nvmeof [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] nvme not present on system {{(pid=75341) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 23:40:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:40:51 user nova-compute[75341]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 23:40:51 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2e6c80-53b4-4d47-8f06-9c07c7344a50]: (4, '') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:40:51 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75341) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 23:40:51 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 23:40:51 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] LIGHTOS: no hostnqn found. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 23:40:51 user nova-compute[75341]: DEBUG os_brick.utils [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6d1cfca09c9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:40:51 user nova-compute[75341]: DEBUG nova.virt.block_device [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Updating existing volume attachment record: b4b5125b-8963-43a2-aeb1-442800c28ac8 {{(pid=75341) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 23:40:51 user nova-compute[75341]: DEBUG nova.network.neutron [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Updating instance_info_cache with network_info: [{"id": "d0dd84fa-339a-49ec-9042-96715e2230fe", "address": "fa:16:3e:b5:06:42", "network": {"id": "b499fa7b-6b9d-49c0-a9cd-42306c00c501", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-385863436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0dd84fa-33", "ovs_interfaceid": "d0dd84fa-339a-49ec-9042-96715e2230fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f55964c8-6b58-4464-a352-e5145cc3c518", "address": "fa:16:3e:1b:36:55", "network": {"id": "c135160d-9db9-4271-a134-0cf75c1e862c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1010953674", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf55964c8-6b", "ovs_interfaceid": "f55964c8-6b58-4464-a352-e5145cc3c518", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "eb488639-e98a-4a85-b148-09dbb505f1c9", "address": "fa:16:3e:36:7e:f8", "network": {"id": "c135160d-9db9-4271-a134-0cf75c1e862c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1010953674", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb488639-e9", "ovs_interfaceid": "eb488639-e98a-4a85-b148-09dbb505f1c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "886562c6-312d-4a87-a34a-059f2ba3058a", "address": "fa:16:3e:28:ad:ae", "network": {"id": "c135160d-9db9-4271-a134-0cf75c1e862c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1010953674", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap886562c6-31", "ovs_interfaceid": "886562c6-312d-4a87-a34a-059f2ba3058a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c314df64-6753-4691-a931-1ef8f31a8063", "address": "fa:16:3e:92:14:79", "network": {"id": "c135160d-9db9-4271-a134-0cf75c1e862c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1010953674", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc314df64-67", "ovs_interfaceid": "c314df64-6753-4691-a931-1ef8f31a8063", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8352810c-25a7-4c4d-b13f-196c82e323ee", "address": "fa:16:3e:6d:e3:2c", "network": {"id": "08285f35-6170-45e2-9aaa-cd8a52bbd6cd", "bridge": "br-int", "label": "tempest-device-tagging-net2-454254441", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8352810c-25", "ovs_interfaceid": "8352810c-25a7-4c4d-b13f-196c82e323ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e1611672-3415-4fea-adb0-c7fe74ae6049", "address": "fa:16:3e:70:02:49", "network": {"id": "08285f35-6170-45e2-9aaa-cd8a52bbd6cd", "bridge": "br-int", "label": "tempest-device-tagging-net2-454254441", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1611672-34", "ovs_interfaceid": "e1611672-3415-4fea-adb0-c7fe74ae6049", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:40:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Releasing lock "refresh_cache-9d03c7a3-e816-43b0-8616-60dea7a4e81a" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:40:51 user nova-compute[75341]: DEBUG nova.compute.manager [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Instance network_info: |[{"id": "d0dd84fa-339a-49ec-9042-96715e2230fe", "address": "fa:16:3e:b5:06:42", "network": {"id": "b499fa7b-6b9d-49c0-a9cd-42306c00c501", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-385863436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0dd84fa-33", "ovs_interfaceid": "d0dd84fa-339a-49ec-9042-96715e2230fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f55964c8-6b58-4464-a352-e5145cc3c518", "address": "fa:16:3e:1b:36:55", "network": {"id": "c135160d-9db9-4271-a134-0cf75c1e862c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1010953674", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf55964c8-6b", "ovs_interfaceid": "f55964c8-6b58-4464-a352-e5145cc3c518", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "eb488639-e98a-4a85-b148-09dbb505f1c9", "address": "fa:16:3e:36:7e:f8", "network": {"id": "c135160d-9db9-4271-a134-0cf75c1e862c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1010953674", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb488639-e9", "ovs_interfaceid": "eb488639-e98a-4a85-b148-09dbb505f1c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "886562c6-312d-4a87-a34a-059f2ba3058a", "address": "fa:16:3e:28:ad:ae", "network": {"id": "c135160d-9db9-4271-a134-0cf75c1e862c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1010953674", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap886562c6-31", "ovs_interfaceid": "886562c6-312d-4a87-a34a-059f2ba3058a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c314df64-6753-4691-a931-1ef8f31a8063", "address": "fa:16:3e:92:14:79", "network": {"id": "c135160d-9db9-4271-a134-0cf75c1e862c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1010953674", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc314df64-67", "ovs_interfaceid": "c314df64-6753-4691-a931-1ef8f31a8063", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8352810c-25a7-4c4d-b13f-196c82e323ee", "address": "fa:16:3e:6d:e3:2c", "network": {"id": "08285f35-6170-45e2-9aaa-cd8a52bbd6cd", "bridge": "br-int", "label": "tempest-device-tagging-net2-454254441", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8352810c-25", "ovs_interfaceid": "8352810c-25a7-4c4d-b13f-196c82e323ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e1611672-3415-4fea-adb0-c7fe74ae6049", "address": "fa:16:3e:70:02:49", "network": {"id": "08285f35-6170-45e2-9aaa-cd8a52bbd6cd", "bridge": "br-int", "label": "tempest-device-tagging-net2-454254441", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1611672-34", "ovs_interfaceid": "e1611672-3415-4fea-adb0-c7fe74ae6049", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 23:40:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-de38a3ce-4b8a-43c0-b9fa-7661fce49260 req-31c70791-14c0-4421-b091-f71114431364 service nova] Acquired lock "refresh_cache-9d03c7a3-e816-43b0-8616-60dea7a4e81a" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:40:51 user nova-compute[75341]: DEBUG nova.network.neutron [req-de38a3ce-4b8a-43c0-b9fa-7661fce49260 req-31c70791-14c0-4421-b091-f71114431364 service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Refreshing network info cache for port c314df64-6753-4691-a931-1ef8f31a8063 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:40:52 user nova-compute[75341]: DEBUG nova.network.neutron [req-de38a3ce-4b8a-43c0-b9fa-7661fce49260 req-31c70791-14c0-4421-b091-f71114431364 service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Updated VIF entry in instance network info cache for port c314df64-6753-4691-a931-1ef8f31a8063. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:40:52 user nova-compute[75341]: DEBUG nova.network.neutron [req-de38a3ce-4b8a-43c0-b9fa-7661fce49260 req-31c70791-14c0-4421-b091-f71114431364 service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Updating instance_info_cache with network_info: [{"id": "d0dd84fa-339a-49ec-9042-96715e2230fe", "address": "fa:16:3e:b5:06:42", "network": {"id": "b499fa7b-6b9d-49c0-a9cd-42306c00c501", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-385863436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0dd84fa-33", "ovs_interfaceid": "d0dd84fa-339a-49ec-9042-96715e2230fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f55964c8-6b58-4464-a352-e5145cc3c518", "address": "fa:16:3e:1b:36:55", "network": {"id": "c135160d-9db9-4271-a134-0cf75c1e862c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1010953674", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf55964c8-6b", "ovs_interfaceid": "f55964c8-6b58-4464-a352-e5145cc3c518", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "eb488639-e98a-4a85-b148-09dbb505f1c9", "address": "fa:16:3e:36:7e:f8", "network": {"id": "c135160d-9db9-4271-a134-0cf75c1e862c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1010953674", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb488639-e9", "ovs_interfaceid": "eb488639-e98a-4a85-b148-09dbb505f1c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "886562c6-312d-4a87-a34a-059f2ba3058a", "address": "fa:16:3e:28:ad:ae", "network": {"id": "c135160d-9db9-4271-a134-0cf75c1e862c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1010953674", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap886562c6-31", "ovs_interfaceid": "886562c6-312d-4a87-a34a-059f2ba3058a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c314df64-6753-4691-a931-1ef8f31a8063", "address": "fa:16:3e:92:14:79", "network": {"id": "c135160d-9db9-4271-a134-0cf75c1e862c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1010953674", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc314df64-67", "ovs_interfaceid": "c314df64-6753-4691-a931-1ef8f31a8063", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8352810c-25a7-4c4d-b13f-196c82e323ee", "address": "fa:16:3e:6d:e3:2c", "network": {"id": "08285f35-6170-45e2-9aaa-cd8a52bbd6cd", "bridge": "br-int", "label": "tempest-device-tagging-net2-454254441", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8352810c-25", "ovs_interfaceid": "8352810c-25a7-4c4d-b13f-196c82e323ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e1611672-3415-4fea-adb0-c7fe74ae6049", "address": "fa:16:3e:70:02:49", "network": {"id": "08285f35-6170-45e2-9aaa-cd8a52bbd6cd", "bridge": "br-int", "label": "tempest-device-tagging-net2-454254441", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1611672-34", "ovs_interfaceid": "e1611672-3415-4fea-adb0-c7fe74ae6049", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:40:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-de38a3ce-4b8a-43c0-b9fa-7661fce49260 req-31c70791-14c0-4421-b091-f71114431364 service nova] Releasing lock "refresh_cache-9d03c7a3-e816-43b0-8616-60dea7a4e81a" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:40:52 user nova-compute[75341]: DEBUG nova.compute.manager [req-de38a3ce-4b8a-43c0-b9fa-7661fce49260 req-31c70791-14c0-4421-b091-f71114431364 service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received event network-changed-8352810c-25a7-4c4d-b13f-196c82e323ee {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:40:52 user nova-compute[75341]: DEBUG nova.compute.manager [req-de38a3ce-4b8a-43c0-b9fa-7661fce49260 req-31c70791-14c0-4421-b091-f71114431364 service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Refreshing instance network info cache due to event network-changed-8352810c-25a7-4c4d-b13f-196c82e323ee. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:40:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-de38a3ce-4b8a-43c0-b9fa-7661fce49260 req-31c70791-14c0-4421-b091-f71114431364 service nova] Acquiring lock "refresh_cache-9d03c7a3-e816-43b0-8616-60dea7a4e81a" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:40:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-de38a3ce-4b8a-43c0-b9fa-7661fce49260 req-31c70791-14c0-4421-b091-f71114431364 service nova] Acquired lock "refresh_cache-9d03c7a3-e816-43b0-8616-60dea7a4e81a" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:40:52 user nova-compute[75341]: DEBUG nova.network.neutron [req-de38a3ce-4b8a-43c0-b9fa-7661fce49260 req-31c70791-14c0-4421-b091-f71114431364 service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Refreshing network info cache for port 8352810c-25a7-4c4d-b13f-196c82e323ee {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:40:53 user nova-compute[75341]: DEBUG nova.network.neutron [req-de38a3ce-4b8a-43c0-b9fa-7661fce49260 req-31c70791-14c0-4421-b091-f71114431364 service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Updated VIF entry in instance network info cache for port 8352810c-25a7-4c4d-b13f-196c82e323ee. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:40:53 user nova-compute[75341]: DEBUG nova.network.neutron [req-de38a3ce-4b8a-43c0-b9fa-7661fce49260 req-31c70791-14c0-4421-b091-f71114431364 service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Updating instance_info_cache with network_info: [{"id": "d0dd84fa-339a-49ec-9042-96715e2230fe", "address": "fa:16:3e:b5:06:42", "network": {"id": "b499fa7b-6b9d-49c0-a9cd-42306c00c501", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-385863436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0dd84fa-33", "ovs_interfaceid": "d0dd84fa-339a-49ec-9042-96715e2230fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f55964c8-6b58-4464-a352-e5145cc3c518", "address": "fa:16:3e:1b:36:55", "network": {"id": "c135160d-9db9-4271-a134-0cf75c1e862c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1010953674", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf55964c8-6b", "ovs_interfaceid": "f55964c8-6b58-4464-a352-e5145cc3c518", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "eb488639-e98a-4a85-b148-09dbb505f1c9", "address": "fa:16:3e:36:7e:f8", "network": {"id": "c135160d-9db9-4271-a134-0cf75c1e862c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1010953674", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb488639-e9", "ovs_interfaceid": "eb488639-e98a-4a85-b148-09dbb505f1c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "886562c6-312d-4a87-a34a-059f2ba3058a", "address": "fa:16:3e:28:ad:ae", "network": {"id": "c135160d-9db9-4271-a134-0cf75c1e862c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1010953674", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap886562c6-31", "ovs_interfaceid": "886562c6-312d-4a87-a34a-059f2ba3058a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c314df64-6753-4691-a931-1ef8f31a8063", "address": "fa:16:3e:92:14:79", "network": {"id": "c135160d-9db9-4271-a134-0cf75c1e862c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1010953674", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc314df64-67", "ovs_interfaceid": "c314df64-6753-4691-a931-1ef8f31a8063", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8352810c-25a7-4c4d-b13f-196c82e323ee", "address": "fa:16:3e:6d:e3:2c", "network": {"id": "08285f35-6170-45e2-9aaa-cd8a52bbd6cd", "bridge": "br-int", "label": "tempest-device-tagging-net2-454254441", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8352810c-25", "ovs_interfaceid": "8352810c-25a7-4c4d-b13f-196c82e323ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e1611672-3415-4fea-adb0-c7fe74ae6049", "address": "fa:16:3e:70:02:49", "network": {"id": "08285f35-6170-45e2-9aaa-cd8a52bbd6cd", "bridge": "br-int", "label": "tempest-device-tagging-net2-454254441", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1611672-34", "ovs_interfaceid": "e1611672-3415-4fea-adb0-c7fe74ae6049", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:40:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-de38a3ce-4b8a-43c0-b9fa-7661fce49260 req-31c70791-14c0-4421-b091-f71114431364 service nova] Releasing lock "refresh_cache-9d03c7a3-e816-43b0-8616-60dea7a4e81a" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:40:53 user nova-compute[75341]: DEBUG nova.compute.manager [req-de38a3ce-4b8a-43c0-b9fa-7661fce49260 req-31c70791-14c0-4421-b091-f71114431364 service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received event network-changed-e1611672-3415-4fea-adb0-c7fe74ae6049 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:40:53 user nova-compute[75341]: DEBUG nova.compute.manager [req-de38a3ce-4b8a-43c0-b9fa-7661fce49260 req-31c70791-14c0-4421-b091-f71114431364 service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Refreshing instance network info cache due to event network-changed-e1611672-3415-4fea-adb0-c7fe74ae6049. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:40:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-de38a3ce-4b8a-43c0-b9fa-7661fce49260 req-31c70791-14c0-4421-b091-f71114431364 service nova] Acquiring lock "refresh_cache-9d03c7a3-e816-43b0-8616-60dea7a4e81a" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:40:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-de38a3ce-4b8a-43c0-b9fa-7661fce49260 req-31c70791-14c0-4421-b091-f71114431364 service nova] Acquired lock "refresh_cache-9d03c7a3-e816-43b0-8616-60dea7a4e81a" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:40:53 user nova-compute[75341]: DEBUG nova.network.neutron [req-de38a3ce-4b8a-43c0-b9fa-7661fce49260 req-31c70791-14c0-4421-b091-f71114431364 service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Refreshing network info cache for port e1611672-3415-4fea-adb0-c7fe74ae6049 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:40:53 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:53 user nova-compute[75341]: DEBUG nova.network.neutron [req-de38a3ce-4b8a-43c0-b9fa-7661fce49260 req-31c70791-14c0-4421-b091-f71114431364 service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Updated VIF entry in instance network info cache for port e1611672-3415-4fea-adb0-c7fe74ae6049. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:40:53 user nova-compute[75341]: DEBUG nova.network.neutron [req-de38a3ce-4b8a-43c0-b9fa-7661fce49260 req-31c70791-14c0-4421-b091-f71114431364 service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Updating instance_info_cache with network_info: [{"id": "d0dd84fa-339a-49ec-9042-96715e2230fe", "address": "fa:16:3e:b5:06:42", "network": {"id": "b499fa7b-6b9d-49c0-a9cd-42306c00c501", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-385863436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0dd84fa-33", "ovs_interfaceid": "d0dd84fa-339a-49ec-9042-96715e2230fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f55964c8-6b58-4464-a352-e5145cc3c518", "address": "fa:16:3e:1b:36:55", "network": {"id": "c135160d-9db9-4271-a134-0cf75c1e862c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1010953674", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf55964c8-6b", "ovs_interfaceid": "f55964c8-6b58-4464-a352-e5145cc3c518", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "eb488639-e98a-4a85-b148-09dbb505f1c9", "address": "fa:16:3e:36:7e:f8", "network": {"id": "c135160d-9db9-4271-a134-0cf75c1e862c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1010953674", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb488639-e9", "ovs_interfaceid": "eb488639-e98a-4a85-b148-09dbb505f1c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "886562c6-312d-4a87-a34a-059f2ba3058a", "address": "fa:16:3e:28:ad:ae", "network": {"id": "c135160d-9db9-4271-a134-0cf75c1e862c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1010953674", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap886562c6-31", "ovs_interfaceid": "886562c6-312d-4a87-a34a-059f2ba3058a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c314df64-6753-4691-a931-1ef8f31a8063", "address": "fa:16:3e:92:14:79", "network": {"id": "c135160d-9db9-4271-a134-0cf75c1e862c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1010953674", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc314df64-67", "ovs_interfaceid": "c314df64-6753-4691-a931-1ef8f31a8063", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8352810c-25a7-4c4d-b13f-196c82e323ee", "address": "fa:16:3e:6d:e3:2c", "network": {"id": "08285f35-6170-45e2-9aaa-cd8a52bbd6cd", "bridge": "br-int", "label": "tempest-device-tagging-net2-454254441", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8352810c-25", "ovs_interfaceid": "8352810c-25a7-4c4d-b13f-196c82e323ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e1611672-3415-4fea-adb0-c7fe74ae6049", "address": "fa:16:3e:70:02:49", "network": {"id": "08285f35-6170-45e2-9aaa-cd8a52bbd6cd", "bridge": "br-int", "label": "tempest-device-tagging-net2-454254441", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1611672-34", "ovs_interfaceid": "e1611672-3415-4fea-adb0-c7fe74ae6049", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:40:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-de38a3ce-4b8a-43c0-b9fa-7661fce49260 req-31c70791-14c0-4421-b091-f71114431364 service nova] Releasing lock "refresh_cache-9d03c7a3-e816-43b0-8616-60dea7a4e81a" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:40:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG nova.compute.manager [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Start spawning the instance on the hypervisor. {{(pid=75341) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Creating instance directory {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 23:40:56 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Creating image(s)
Nov 14 23:40:56 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Did not create local disks {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Ensure instance console log exists: /opt/stack/data/nova/instances/9d03c7a3-e816-43b0-8616-60dea7a4e81a/console.log {{(pid=75341) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Start _get_guest_xml network_info=[{"id": "d0dd84fa-339a-49ec-9042-96715e2230fe", "address": "fa:16:3e:b5:06:42", "network": {"id": "b499fa7b-6b9d-49c0-a9cd-42306c00c501", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-385863436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0dd84fa-33", "ovs_interfaceid": "d0dd84fa-339a-49ec-9042-96715e2230fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f55964c8-6b58-4464-a352-e5145cc3c518", "address": "fa:16:3e:1b:36:55", "network": {"id": "c135160d-9db9-4271-a134-0cf75c1e862c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1010953674", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf55964c8-6b", "ovs_interfaceid": "f55964c8-6b58-4464-a352-e5145cc3c518", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "eb488639-e98a-4a85-b148-09dbb505f1c9", "address": "fa:16:3e:36:7e:f8", "network": {"id": "c135160d-9db9-4271-a134-0cf75c1e862c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1010953674", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb488639-e9", "ovs_interfaceid": "eb488639-e98a-4a85-b148-09dbb505f1c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "886562c6-312d-4a87-a34a-059f2ba3058a", "address": "fa:16:3e:28:ad:ae", "network": {"id": "c135160d-9db9-4271-a134-0cf75c1e862c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1010953674", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap886562c6-31", "ovs_interfaceid": "886562c6-312d-4a87-a34a-059f2ba3058a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c314df64-6753-4691-a931-1ef8f31a8063", "address": "fa:16:3e:92:14:79", "network": {"id": "c135160d-9db9-4271-a134-0cf75c1e862c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1010953674", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc314df64-67", "ovs_interfaceid": "c314df64-6753-4691-a931-1ef8f31a8063", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8352810c-25a7-4c4d-b13f-196c82e323ee", "address": "fa:16:3e:6d:e3:2c", "network": {"id": "08285f35-6170-45e2-9aaa-cd8a52bbd6cd", "bridge": "br-int", "label": "tempest-device-tagging-net2-454254441", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8352810c-25", "ovs_interfaceid": "8352810c-25a7-4c4d-b13f-196c82e323ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e1611672-3415-4fea-adb0-c7fe74ae6049", "address": "fa:16:3e:70:02:49", "network": {"id": "08285f35-6170-45e2-9aaa-cd8a52bbd6cd", "bridge": "br-int", "label": "tempest-device-tagging-net2-454254441", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1611672-34", "ovs_interfaceid": "e1611672-3415-4fea-adb0-c7fe74ae6049", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'bbe0925e-b91f-411f-8f7b-e79643868f0c', 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'glxYfjrN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9d03c7a3-e816-43b0-8616-60dea7a4e81a', 'attached_at': '', 'detached_at': '', 'volume_id': 'a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198', 'serial': 'a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198'}, 'delete_on_termination': False, 'volume_type': None}, {'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 1, 'attachment_id': '4fa61a92-81ac-43de-9f32-40d6e022ef27', 'mount_device': '/dev/vdb', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TQoDFnwl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9d03c7a3-e816-43b0-8616-60dea7a4e81a', 'attached_at': '', 'detached_at': '', 'volume_id': '1d39d66b-22ae-4f70-bd8e-1e9df2b517ff', 'serial': '1d39d66b-22ae-4f70-bd8e-1e9df2b517ff'}, 'delete_on_termination': False, 'volume_type': None}, {'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 2, 'attachment_id': 'b4b5125b-8963-43a2-aeb1-442800c28ac8', 'mount_device': '/dev/vdc', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'szGZitIm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9d03c7a3-e816-43b0-8616-60dea7a4e81a', 'attached_at': '', 'detached_at': '', 'volume_id': 'de5d17dd-51c3-42bc-9950-b815f8d48296', 'serial': 'de5d17dd-51c3-42bc-9950-b815f8d48296'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 23:40:56 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:40:56 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:40:56 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG os_brick.initiator.connector [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Factory for ISCSI on None {{(pid=75341) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Calling os-brick to attach iSCSI Volume {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'glxYfjrN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:40:56 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:40:56 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:40:56 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:40:56 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:40:56 user nova-compute[75341]: INFO os_brick.initiator.connectors.iscsi [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 23:40:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 -p 172.16.0.220:3260 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 -p 172.16.0.220:3260" returned: 21 in 0.015s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[22471978-dafc-4bfc-9470-80c9bda65d00]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 23:40:56 user nova-compute[75341]:  {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 -p 172.16.0.220:3260 --interface default --op new {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f100ec-66ce-4691-9f08-21b070d2cded]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198] added\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198] added
Nov 14 23:40:56 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0b544c-a587-4ebb-956c-645d49debe97]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[6baf92c0-c3e2-44a0-ad99-550e79fc51d3]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v glxYfjrN {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v glxYfjrN" returned: 0 in 0.028s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[370646e3-158f-4bf3-8698-0ef2e5a4fa08]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'glxYfjrN'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.015s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[f90fe952-a33b-4c62-adcd-4c465177cf8b]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[20242fd1-8400-4b09-9d73-d0aa161aaf84]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 23:40:56 user nova-compute[75341]:  {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 23:40:56 user nova-compute[75341]:  {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:40:56 user nova-compute[75341]: WARNING os_brick.initiator.connectors.iscsi [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 23:40:56 user nova-compute[75341]: 
Nov 14 23:40:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 -p 172.16.0.220:3260 --login {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a5c2ab-ac9b-4121-a8c3-7792fe9abac0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198, portal: 172.16.0.220,3260]
Nov 14 23:40:56 user nova-compute[75341]: Login to [iface: default, target: iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198, portal: 172.16.0.220,3260] successful.
Nov 14 23:40:56 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[65067e29-a24f-4bb1-b927-a751bf809845]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df353d6-2f73-43f1-b669-63a1f2b7bada]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)
Nov 14 23:40:56 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)
Nov 14 23:40:56 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Connected to 172.16.0.220:3260 {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75341) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75341) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd40ba8-0020-4bd9-950c-d4fab9f057b3]: (4, ('- - 0', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 23:40:56 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'glxYfjrN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 23:40:57 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Acquiring lock "44080c0d-56eb-4987-aa4b-59f161dcbc0b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:40:57 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Lock "44080c0d-56eb-4987-aa4b-59f161dcbc0b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:40:57 user nova-compute[75341]: DEBUG nova.compute.manager [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Starting instance... {{(pid=75341) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 23:40:57 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:40:57 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:40:57 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75341) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 23:40:57 user nova-compute[75341]: INFO nova.compute.claims [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Claim successful on node user
Nov 14 23:40:57 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:40:57 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:40:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:57 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.425s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:40:57 user nova-compute[75341]: DEBUG nova.compute.manager [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Start building networks asynchronously for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 23:40:57 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:40:57 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23865643839386662', 'path': '/dev/sdb'} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:40:57 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865643839386662', 'path': '/dev/sdb'} {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 23:40:57 user nova-compute[75341]: DEBUG nova.compute.manager [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Allocating IP information in the background. {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 23:40:57 user nova-compute[75341]: DEBUG nova.network.neutron [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] allocate_for_instance() {{(pid=75341) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 23:40:57 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Calling os-brick to attach iSCSI Volume {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 23:40:57 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TQoDFnwl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:40:57 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:40:57 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:40:57 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:40:57 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:40:57 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:40:57 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:40:57 user nova-compute[75341]: INFO os_brick.initiator.connectors.iscsi [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 23:40:57 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 23:40:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff -p 172.16.0.220:3260 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:57 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[904ea933-79af-4022-abbc-b882dc4e1df4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:40:57 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 23:40:57 user nova-compute[75341]:  {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:40:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff -p 172.16.0.220:3260 --interface default --op new {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:57 user nova-compute[75341]: DEBUG nova.compute.manager [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Start building block device mappings for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 23:40:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:57 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[19339365-8673-4ec4-acf8-9ad42ae284e5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff] added\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:40:57 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff] added
Nov 14 23:40:57 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:40:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:57 user nova-compute[75341]: DEBUG nova.policy [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '983c2908d300475db1560f09020eb4fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a263dc99759446c9a226892c0d81a0d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75341) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 23:40:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:57 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7913a6-36ae-4976-ba7f-deb77bb3734e]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:40:57 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:40:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.049s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:58 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[f112c059-978a-4232-99e8-1c02a95c6d0d]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:40:58 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:40:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TQoDFnwl {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:58 user nova-compute[75341]: DEBUG nova.compute.manager [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Start spawning the instance on the hypervisor. {{(pid=75341) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 23:40:58 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Creating instance directory {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 23:40:58 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Creating image(s)
Nov 14 23:40:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Acquiring lock "/opt/stack/data/nova/instances/44080c0d-56eb-4987-aa4b-59f161dcbc0b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:40:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Lock "/opt/stack/data/nova/instances/44080c0d-56eb-4987-aa4b-59f161dcbc0b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:40:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Lock "/opt/stack/data/nova/instances/44080c0d-56eb-4987-aa4b-59f161dcbc0b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:40:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TQoDFnwl" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:58 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ace8a2-1f55-41ed-bfa3-f3b745033411]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:40:58 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TQoDFnwl'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:40:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:58 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ba1605-50cd-4361-b49e-2b991eada0e9]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:40:58 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:40:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:58 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[71aea9e5-35d9-4fb6-b9c1-49cc78b268d7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:40:58 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)
Nov 14 23:40:58 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:40:58 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)
Nov 14 23:40:58 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:40:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff -p 172.16.0.220:3260 --login {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:58 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d66dc5-2b26-4f25-a3da-c80866ad66df]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:40:58 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff, portal: 172.16.0.220,3260]
Nov 14 23:40:58 user nova-compute[75341]: Login to [iface: default, target: iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff, portal: 172.16.0.220,3260] successful.
Nov 14 23:40:58 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:40:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:58 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa8f08d6-fe5a-4cd1-baee-0986a6fb880a]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:40:58 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:40:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.188s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Acquiring lock "4754efee9a6d73d3647f2add2cfe86c291949740" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:40:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:40:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:58 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[f736329f-bc4b-4659-be42-b371f04df424]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:40:58 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)
Nov 14 23:40:58 user nova-compute[75341]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)
Nov 14 23:40:58 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:40:58 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)
Nov 14 23:40:58 user nova-compute[75341]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)
Nov 14 23:40:58 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:40:58 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.389s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:40:58 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Connected to 172.16.0.220:3260 {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 23:40:58 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75341) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 23:40:58 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75341) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 23:40:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:58 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb2600d-575b-4522-900d-70a21f6eaa44]: (4, ('- - 0', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:40:58 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 23:40:58 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TQoDFnwl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 23:40:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.207s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/44080c0d-56eb-4987-aa4b-59f161dcbc0b/disk 1073741824 {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:58 user nova-compute[75341]: DEBUG nova.network.neutron [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Successfully created port: 611fe585-b169-4ec5-97cf-8ebdf5060502 {{(pid=75341) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 23:40:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/44080c0d-56eb-4987-aa4b-59f161dcbc0b/disk 1073741824" returned: 0 in 0.059s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:40:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.192s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:58 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Checking if we can resize image /opt/stack/data/nova/instances/44080c0d-56eb-4987-aa4b-59f161dcbc0b/disk. size=1073741824 {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 23:40:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44080c0d-56eb-4987-aa4b-59f161dcbc0b/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44080c0d-56eb-4987-aa4b-59f161dcbc0b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:58 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Cannot resize image /opt/stack/data/nova/instances/44080c0d-56eb-4987-aa4b-59f161dcbc0b/disk to a smaller size. {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 23:40:58 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Created local disks {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 23:40:58 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Ensure instance console log exists: /opt/stack/data/nova/instances/44080c0d-56eb-4987-aa4b-59f161dcbc0b/console.log {{(pid=75341) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 23:40:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:40:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:40:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG nova.network.neutron [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Successfully updated port: 611fe585-b169-4ec5-97cf-8ebdf5060502 {{(pid=75341) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Acquiring lock "refresh_cache-44080c0d-56eb-4987-aa4b-59f161dcbc0b" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Acquired lock "refresh_cache-44080c0d-56eb-4987-aa4b-59f161dcbc0b" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG nova.network.neutron [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG nova.compute.manager [req-4fe17a27-7060-46b8-ae42-850401bff7ed req-7b86754e-b272-48c7-af7a-816665be47c5 service nova] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Received event network-changed-611fe585-b169-4ec5-97cf-8ebdf5060502 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG nova.compute.manager [req-4fe17a27-7060-46b8-ae42-850401bff7ed req-7b86754e-b272-48c7-af7a-816665be47c5 service nova] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Refreshing instance network info cache due to event network-changed-611fe585-b169-4ec5-97cf-8ebdf5060502. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4fe17a27-7060-46b8-ae42-850401bff7ed req-7b86754e-b272-48c7-af7a-816665be47c5 service nova] Acquiring lock "refresh_cache-44080c0d-56eb-4987-aa4b-59f161dcbc0b" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG nova.network.neutron [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Instance cache missing network info. {{(pid=75341) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.424s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] <== connect_volume: return (1424ms) {'type': 'block', 'scsi_wwn': '23038333765356132', 'path': '/dev/sdc'} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038333765356132', 'path': '/dev/sdc'} {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Calling os-brick to attach iSCSI Volume {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'szGZitIm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:40:59 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:40:59 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:40:59 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:40:59 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:40:59 user nova-compute[75341]: INFO os_brick.initiator.connectors.iscsi [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 23:40:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 -p 172.16.0.220:3260 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[91609b91-e694-4875-8b66-084ab13f0726]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 23:40:59 user nova-compute[75341]:  {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 -p 172.16.0.220:3260 --interface default --op new {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8b92a3-0b17-44ca-a31c-5231d1a21f53]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296] added\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296] added
Nov 14 23:40:59 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG nova.network.neutron [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Updating instance_info_cache with network_info: [{"id": "611fe585-b169-4ec5-97cf-8ebdf5060502", "address": "fa:16:3e:ce:7e:2b", "network": {"id": "4b25a4f0-0f86-4f96-9228-c8e9a60b401d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1630866661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a263dc99759446c9a226892c0d81a0d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap611fe585-b1", "ovs_interfaceid": "611fe585-b169-4ec5-97cf-8ebdf5060502", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e20fe4-157f-4e83-8a26-512ce0c3ce5a]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Releasing lock "refresh_cache-44080c0d-56eb-4987-aa4b-59f161dcbc0b" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG nova.compute.manager [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Instance network_info: |[{"id": "611fe585-b169-4ec5-97cf-8ebdf5060502", "address": "fa:16:3e:ce:7e:2b", "network": {"id": "4b25a4f0-0f86-4f96-9228-c8e9a60b401d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1630866661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a263dc99759446c9a226892c0d81a0d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap611fe585-b1", "ovs_interfaceid": "611fe585-b169-4ec5-97cf-8ebdf5060502", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4fe17a27-7060-46b8-ae42-850401bff7ed req-7b86754e-b272-48c7-af7a-816665be47c5 service nova] Acquired lock "refresh_cache-44080c0d-56eb-4987-aa4b-59f161dcbc0b" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG nova.network.neutron [req-4fe17a27-7060-46b8-ae42-850401bff7ed req-7b86754e-b272-48c7-af7a-816665be47c5 service nova] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Refreshing network info cache for port 611fe585-b169-4ec5-97cf-8ebdf5060502 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Start _get_guest_xml network_info=[{"id": "611fe585-b169-4ec5-97cf-8ebdf5060502", "address": "fa:16:3e:ce:7e:2b", "network": {"id": "4b25a4f0-0f86-4f96-9228-c8e9a60b401d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1630866661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a263dc99759446c9a226892c0d81a0d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap611fe585-b1", "ovs_interfaceid": "611fe585-b169-4ec5-97cf-8ebdf5060502", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encrypted': False, 'image_id': 'e46abb82-b810-490e-a8a1-ccdc5fa1a796'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 23:40:59 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:40:59 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:40:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e11cc3d-f23c-4c8f-a2d2-9c67e6de5101]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v szGZitIm {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:40:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1556249137',display_name='tempest-TestServerVolumeAttachmentScenario-server-1556249137',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1556249137',id=10,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNWifuLHXazlxDoi4AYx90fm7TlMoPQJnyF2x+kn+tGXxVh0bmxBLQKJ+ppXsLB1CnME6rpa/np27IMhonxQ1aAjdvZYcl9oY5YdJSwKjr85od5Te4CRWYL3SMc1ZXrLCw==',key_name='tempest-keypair-1454530888',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a263dc99759446c9a226892c0d81a0d8',ramdisk_id='',reservation_id='r-tq7zbkgh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-394165190',owner_user_name='tempest-TestServerVolumeAttachmentScenario-394165190-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:40:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='983c2908d300475db1560f09020eb4fe',uuid=44080c0d-56eb-4987-aa4b-59f161dcbc0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "611fe585-b169-4ec5-97cf-8ebdf5060502", "address": "fa:16:3e:ce:7e:2b", "network": {"id": "4b25a4f0-0f86-4f96-9228-c8e9a60b401d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1630866661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a263dc99759446c9a226892c0d81a0d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap611fe585-b1", "ovs_interfaceid": "611fe585-b169-4ec5-97cf-8ebdf5060502", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Converting VIF {"id": "611fe585-b169-4ec5-97cf-8ebdf5060502", "address": "fa:16:3e:ce:7e:2b", "network": {"id": "4b25a4f0-0f86-4f96-9228-c8e9a60b401d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1630866661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a263dc99759446c9a226892c0d81a0d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap611fe585-b1", "ovs_interfaceid": "611fe585-b169-4ec5-97cf-8ebdf5060502", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:7e:2b,bridge_name='br-int',has_traffic_filtering=True,id=611fe585-b169-4ec5-97cf-8ebdf5060502,network=Network(4b25a4f0-0f86-4f96-9228-c8e9a60b401d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap611fe585-b1') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG nova.objects.instance [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Lazy-loading 'pci_devices' on Instance uuid 44080c0d-56eb-4987-aa4b-59f161dcbc0b {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v szGZitIm" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b7169f-d48e-47f7-927a-bf85452f45c8]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'szGZitIm'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] End _get_guest_xml xml=<domain type="kvm">
Nov 14 23:40:59 user nova-compute[75341]:   <uuid>44080c0d-56eb-4987-aa4b-59f161dcbc0b</uuid>
Nov 14 23:40:59 user nova-compute[75341]:   <name>instance-0000000a</name>
Nov 14 23:40:59 user nova-compute[75341]:   <memory>524288</memory>
Nov 14 23:40:59 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 14 23:40:59 user nova-compute[75341]:   <metadata>
Nov 14 23:40:59 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 23:40:59 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 14 23:40:59 user nova-compute[75341]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1556249137</nova:name>
Nov 14 23:40:59 user nova-compute[75341]:       <nova:creationTime>2023-11-14 23:40:59</nova:creationTime>
Nov 14 23:40:59 user nova-compute[75341]:       <nova:flavor name="m1.tiny">
Nov 14 23:40:59 user nova-compute[75341]:         <nova:memory>512</nova:memory>
Nov 14 23:40:59 user nova-compute[75341]:         <nova:disk>1</nova:disk>
Nov 14 23:40:59 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 14 23:40:59 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 23:40:59 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 14 23:40:59 user nova-compute[75341]:       </nova:flavor>
Nov 14 23:40:59 user nova-compute[75341]:       <nova:owner>
Nov 14 23:40:59 user nova-compute[75341]:         <nova:user uuid="983c2908d300475db1560f09020eb4fe">tempest-TestServerVolumeAttachmentScenario-394165190-project-member</nova:user>
Nov 14 23:40:59 user nova-compute[75341]:         <nova:project uuid="a263dc99759446c9a226892c0d81a0d8">tempest-TestServerVolumeAttachmentScenario-394165190</nova:project>
Nov 14 23:40:59 user nova-compute[75341]:       </nova:owner>
Nov 14 23:40:59 user nova-compute[75341]:       <nova:root type="image" uuid="e46abb82-b810-490e-a8a1-ccdc5fa1a796"/>
Nov 14 23:40:59 user nova-compute[75341]:       <nova:ports>
Nov 14 23:40:59 user nova-compute[75341]:         <nova:port uuid="611fe585-b169-4ec5-97cf-8ebdf5060502">
Nov 14 23:40:59 user nova-compute[75341]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 23:40:59 user nova-compute[75341]:         </nova:port>
Nov 14 23:40:59 user nova-compute[75341]:       </nova:ports>
Nov 14 23:40:59 user nova-compute[75341]:     </nova:instance>
Nov 14 23:40:59 user nova-compute[75341]:   </metadata>
Nov 14 23:40:59 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 14 23:40:59 user nova-compute[75341]:     <system>
Nov 14 23:40:59 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 23:40:59 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 14 23:40:59 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 14 23:40:59 user nova-compute[75341]:       <entry name="serial">44080c0d-56eb-4987-aa4b-59f161dcbc0b</entry>
Nov 14 23:40:59 user nova-compute[75341]:       <entry name="uuid">44080c0d-56eb-4987-aa4b-59f161dcbc0b</entry>
Nov 14 23:40:59 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 14 23:40:59 user nova-compute[75341]:     </system>
Nov 14 23:40:59 user nova-compute[75341]:   </sysinfo>
Nov 14 23:40:59 user nova-compute[75341]:   <os>
Nov 14 23:40:59 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 23:40:59 user nova-compute[75341]:     <boot dev="hd"/>
Nov 14 23:40:59 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 14 23:40:59 user nova-compute[75341]:   </os>
Nov 14 23:40:59 user nova-compute[75341]:   <features>
Nov 14 23:40:59 user nova-compute[75341]:     <acpi/>
Nov 14 23:40:59 user nova-compute[75341]:     <apic/>
Nov 14 23:40:59 user nova-compute[75341]:     <vmcoreinfo/>
Nov 14 23:40:59 user nova-compute[75341]:   </features>
Nov 14 23:40:59 user nova-compute[75341]:   <clock offset="utc">
Nov 14 23:40:59 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 23:40:59 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 23:40:59 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 14 23:40:59 user nova-compute[75341]:   </clock>
Nov 14 23:40:59 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 14 23:40:59 user nova-compute[75341]:     <model>Nehalem</model>
Nov 14 23:40:59 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 23:40:59 user nova-compute[75341]:   </cpu>
Nov 14 23:40:59 user nova-compute[75341]:   <devices>
Nov 14 23:40:59 user nova-compute[75341]:     <disk type="file" device="disk">
Nov 14 23:40:59 user nova-compute[75341]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 23:40:59 user nova-compute[75341]:       <source file="/opt/stack/data/nova/instances/44080c0d-56eb-4987-aa4b-59f161dcbc0b/disk"/>
Nov 14 23:40:59 user nova-compute[75341]:       <target dev="vda" bus="virtio"/>
Nov 14 23:40:59 user nova-compute[75341]:     </disk>
Nov 14 23:40:59 user nova-compute[75341]:     <interface type="ethernet">
Nov 14 23:40:59 user nova-compute[75341]:       <mac address="fa:16:3e:ce:7e:2b"/>
Nov 14 23:40:59 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:40:59 user nova-compute[75341]:       <mtu size="1442"/>
Nov 14 23:40:59 user nova-compute[75341]:       <target dev="tap611fe585-b1"/>
Nov 14 23:40:59 user nova-compute[75341]:     </interface>
Nov 14 23:40:59 user nova-compute[75341]:     <serial type="pty">
Nov 14 23:40:59 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/44080c0d-56eb-4987-aa4b-59f161dcbc0b/console.log" append="off"/>
Nov 14 23:40:59 user nova-compute[75341]:     </serial>
Nov 14 23:40:59 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 23:40:59 user nova-compute[75341]:     <video>
Nov 14 23:40:59 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:40:59 user nova-compute[75341]:     </video>
Nov 14 23:40:59 user nova-compute[75341]:     <rng model="virtio">
Nov 14 23:40:59 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 14 23:40:59 user nova-compute[75341]:     </rng>
Nov 14 23:40:59 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 14 23:40:59 user nova-compute[75341]:     <memballoon model="virtio">
Nov 14 23:40:59 user nova-compute[75341]:       <stats period="10"/>
Nov 14 23:40:59 user nova-compute[75341]:     </memballoon>
Nov 14 23:40:59 user nova-compute[75341]:   </devices>
Nov 14 23:40:59 user nova-compute[75341]: </domain>
Nov 14 23:40:59 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:40:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1556249137',display_name='tempest-TestServerVolumeAttachmentScenario-server-1556249137',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1556249137',id=10,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNWifuLHXazlxDoi4AYx90fm7TlMoPQJnyF2x+kn+tGXxVh0bmxBLQKJ+ppXsLB1CnME6rpa/np27IMhonxQ1aAjdvZYcl9oY5YdJSwKjr85od5Te4CRWYL3SMc1ZXrLCw==',key_name='tempest-keypair-1454530888',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a263dc99759446c9a226892c0d81a0d8',ramdisk_id='',reservation_id='r-tq7zbkgh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-394165190',owner_user_name='tempest-TestServerVolumeAttachmentScenario-394165190-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:40:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='983c2908d300475db1560f09020eb4fe',uuid=44080c0d-56eb-4987-aa4b-59f161dcbc0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "611fe585-b169-4ec5-97cf-8ebdf5060502", "address": "fa:16:3e:ce:7e:2b", "network": {"id": "4b25a4f0-0f86-4f96-9228-c8e9a60b401d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1630866661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a263dc99759446c9a226892c0d81a0d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap611fe585-b1", "ovs_interfaceid": "611fe585-b169-4ec5-97cf-8ebdf5060502", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Converting VIF {"id": "611fe585-b169-4ec5-97cf-8ebdf5060502", "address": "fa:16:3e:ce:7e:2b", "network": {"id": "4b25a4f0-0f86-4f96-9228-c8e9a60b401d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1630866661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a263dc99759446c9a226892c0d81a0d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap611fe585-b1", "ovs_interfaceid": "611fe585-b169-4ec5-97cf-8ebdf5060502", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:7e:2b,bridge_name='br-int',has_traffic_filtering=True,id=611fe585-b169-4ec5-97cf-8ebdf5060502,network=Network(4b25a4f0-0f86-4f96-9228-c8e9a60b401d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap611fe585-b1') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG os_vif [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:7e:2b,bridge_name='br-int',has_traffic_filtering=True,id=611fe585-b169-4ec5-97cf-8ebdf5060502,network=Network(4b25a4f0-0f86-4f96-9228-c8e9a60b401d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap611fe585-b1') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a82a8b8e-b233-5e29-8a95-fc521f8b4f70', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap611fe585-b1, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap611fe585-b1, col_values=(('qos', UUID('00bbc16a-a7a8-489d-a544-ffa3a00346d7')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap611fe585-b1, col_values=(('external_ids', {'iface-id': '611fe585-b169-4ec5-97cf-8ebdf5060502', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:7e:2b', 'vm-uuid': '44080c0d-56eb-4987-aa4b-59f161dcbc0b'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[3519965a-238b-4c15-b2de-247f156c6d6e]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:40:59 user nova-compute[75341]: INFO os_vif [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:7e:2b,bridge_name='br-int',has_traffic_filtering=True,id=611fe585-b169-4ec5-97cf-8ebdf5060502,network=Network(4b25a4f0-0f86-4f96-9228-c8e9a60b401d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap611fe585-b1')
Nov 14 23:40:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[c825351e-9024-4794-8191-abd613167cb6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)
Nov 14 23:40:59 user nova-compute[75341]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)
Nov 14 23:40:59 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)
Nov 14 23:40:59 user nova-compute[75341]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)
Nov 14 23:40:59 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 -p 172.16.0.220:3260 --login {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] No VIF found with MAC fa:16:3e:ce:7e:2b, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa8d12f-d471-469a-b0eb-f0649a2fc004]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296, portal: 172.16.0.220,3260]
Nov 14 23:40:59 user nova-compute[75341]: Login to [iface: default, target: iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296, portal: 172.16.0.220,3260] successful.
Nov 14 23:40:59 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2de0e26-8126-4a9e-96c5-a5cd607dd78d]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b995ee-df60-4133-9fd7-cde0ad2a8327]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)
Nov 14 23:40:59 user nova-compute[75341]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)
Nov 14 23:40:59 user nova-compute[75341]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)
Nov 14 23:40:59 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)
Nov 14 23:40:59 user nova-compute[75341]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)
Nov 14 23:40:59 user nova-compute[75341]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)
Nov 14 23:40:59 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Connected to 172.16.0.220:3260 {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=75341) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75341) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[486abc2c-2e87-4c24-bd5e-e4973ef49e91]: (4, ('- - 0', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'szGZitIm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG nova.network.neutron [req-4fe17a27-7060-46b8-ae42-850401bff7ed req-7b86754e-b272-48c7-af7a-816665be47c5 service nova] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Updated VIF entry in instance network info cache for port 611fe585-b169-4ec5-97cf-8ebdf5060502. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG nova.network.neutron [req-4fe17a27-7060-46b8-ae42-850401bff7ed req-7b86754e-b272-48c7-af7a-816665be47c5 service nova] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Updating instance_info_cache with network_info: [{"id": "611fe585-b169-4ec5-97cf-8ebdf5060502", "address": "fa:16:3e:ce:7e:2b", "network": {"id": "4b25a4f0-0f86-4f96-9228-c8e9a60b401d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1630866661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a263dc99759446c9a226892c0d81a0d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap611fe585-b1", "ovs_interfaceid": "611fe585-b169-4ec5-97cf-8ebdf5060502", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:40:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4fe17a27-7060-46b8-ae42-850401bff7ed req-7b86754e-b272-48c7-af7a-816665be47c5 service nova] Releasing lock "refresh_cache-44080c0d-56eb-4987-aa4b-59f161dcbc0b" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '23030663130613239', 'path': '/dev/sdd'} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030663130613239', 'path': '/dev/sdd'} {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T23:40:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-993143391',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-993143391',id=9,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiUPPSlFnRUQvBR9O/mDOOgi/KDCGIsTUS9ts2D2JCf7UKa4oJ0is321+3mkZZFGv5oTtL1SS4r0kUkIb28JdNKZeJZCDUMNnN/nhj+h3UTsN88WEzZbLjhSZCfzMNo2w==',key_name='tempest-keypair-931450966',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b84539186347404ea3cdc32042f70052',ramdisk_id='',reservation_id='r-flwl45cc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-491908434',owner_user_name='tempest-TaggedBootDevicesTest-491908434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:40:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3078a91c61fb48a98b7c0e1d98117e8f',uuid=9d03c7a3-e816-43b0-8616-60dea7a4e81a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0dd84fa-339a-49ec-9042-96715e2230fe", "address": "fa:16:3e:b5:06:42", "network": {"id": "b499fa7b-6b9d-49c0-a9cd-42306c00c501", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-385863436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0dd84fa-33", "ovs_interfaceid": "d0dd84fa-339a-49ec-9042-96715e2230fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Converting VIF {"id": "d0dd84fa-339a-49ec-9042-96715e2230fe", "address": "fa:16:3e:b5:06:42", "network": {"id": "b499fa7b-6b9d-49c0-a9cd-42306c00c501", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-385863436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0dd84fa-33", "ovs_interfaceid": "d0dd84fa-339a-49ec-9042-96715e2230fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:06:42,bridge_name='br-int',has_traffic_filtering=True,id=d0dd84fa-339a-49ec-9042-96715e2230fe,network=Network(b499fa7b-6b9d-49c0-a9cd-42306c00c501),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0dd84fa-33') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T23:40:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-993143391',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-993143391',id=9,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiUPPSlFnRUQvBR9O/mDOOgi/KDCGIsTUS9ts2D2JCf7UKa4oJ0is321+3mkZZFGv5oTtL1SS4r0kUkIb28JdNKZeJZCDUMNnN/nhj+h3UTsN88WEzZbLjhSZCfzMNo2w==',key_name='tempest-keypair-931450966',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b84539186347404ea3cdc32042f70052',ramdisk_id='',reservation_id='r-flwl45cc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-491908434',owner_user_name='tempest-TaggedBootDevicesTest-491908434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:40:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3078a91c61fb48a98b7c0e1d98117e8f',uuid=9d03c7a3-e816-43b0-8616-60dea7a4e81a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f55964c8-6b58-4464-a352-e5145cc3c518", "address": "fa:16:3e:1b:36:55", "network": {"id": "c135160d-9db9-4271-a134-0cf75c1e862c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1010953674", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf55964c8-6b", "ovs_interfaceid": "f55964c8-6b58-4464-a352-e5145cc3c518", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Converting VIF {"id": "f55964c8-6b58-4464-a352-e5145cc3c518", "address": "fa:16:3e:1b:36:55", "network": {"id": "c135160d-9db9-4271-a134-0cf75c1e862c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1010953674", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf55964c8-6b", "ovs_interfaceid": "f55964c8-6b58-4464-a352-e5145cc3c518", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:36:55,bridge_name='br-int',has_traffic_filtering=True,id=f55964c8-6b58-4464-a352-e5145cc3c518,network=Network(c135160d-9db9-4271-a134-0cf75c1e862c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf55964c8-6b') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T23:40:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-993143391',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-993143391',id=9,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiUPPSlFnRUQvBR9O/mDOOgi/KDCGIsTUS9ts2D2JCf7UKa4oJ0is321+3mkZZFGv5oTtL1SS4r0kUkIb28JdNKZeJZCDUMNnN/nhj+h3UTsN88WEzZbLjhSZCfzMNo2w==',key_name='tempest-keypair-931450966',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b84539186347404ea3cdc32042f70052',ramdisk_id='',reservation_id='r-flwl45cc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-491908434',owner_user_name='tempest-TaggedBootDevicesTest-491908434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:40:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3078a91c61fb48a98b7c0e1d98117e8f',uuid=9d03c7a3-e816-43b0-8616-60dea7a4e81a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb488639-e98a-4a85-b148-09dbb505f1c9", "address": "fa:16:3e:36:7e:f8", "network": {"id": "c135160d-9db9-4271-a134-0cf75c1e862c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1010953674", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb488639-e9", "ovs_interfaceid": "eb488639-e98a-4a85-b148-09dbb505f1c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Converting VIF {"id": "eb488639-e98a-4a85-b148-09dbb505f1c9", "address": "fa:16:3e:36:7e:f8", "network": {"id": "c135160d-9db9-4271-a134-0cf75c1e862c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1010953674", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb488639-e9", "ovs_interfaceid": "eb488639-e98a-4a85-b148-09dbb505f1c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:7e:f8,bridge_name='br-int',has_traffic_filtering=True,id=eb488639-e98a-4a85-b148-09dbb505f1c9,network=Network(c135160d-9db9-4271-a134-0cf75c1e862c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapeb488639-e9') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T23:40:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-993143391',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-993143391',id=9,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiUPPSlFnRUQvBR9O/mDOOgi/KDCGIsTUS9ts2D2JCf7UKa4oJ0is321+3mkZZFGv5oTtL1SS4r0kUkIb28JdNKZeJZCDUMNnN/nhj+h3UTsN88WEzZbLjhSZCfzMNo2w==',key_name='tempest-keypair-931450966',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b84539186347404ea3cdc32042f70052',ramdisk_id='',reservation_id='r-flwl45cc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-491908434',owner_user_name='tempest-TaggedBootDevicesTest-491908434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:40:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3078a91c61fb48a98b7c0e1d98117e8f',uuid=9d03c7a3-e816-43b0-8616-60dea7a4e81a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "886562c6-312d-4a87-a34a-059f2ba3058a", "address": "fa:16:3e:28:ad:ae", "network": {"id": "c135160d-9db9-4271-a134-0cf75c1e862c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1010953674", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap886562c6-31", "ovs_interfaceid": "886562c6-312d-4a87-a34a-059f2ba3058a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Converting VIF {"id": "886562c6-312d-4a87-a34a-059f2ba3058a", "address": "fa:16:3e:28:ad:ae", "network": {"id": "c135160d-9db9-4271-a134-0cf75c1e862c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1010953674", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap886562c6-31", "ovs_interfaceid": "886562c6-312d-4a87-a34a-059f2ba3058a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:ad:ae,bridge_name='br-int',has_traffic_filtering=True,id=886562c6-312d-4a87-a34a-059f2ba3058a,network=Network(c135160d-9db9-4271-a134-0cf75c1e862c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap886562c6-31') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T23:40:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-993143391',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-993143391',id=9,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiUPPSlFnRUQvBR9O/mDOOgi/KDCGIsTUS9ts2D2JCf7UKa4oJ0is321+3mkZZFGv5oTtL1SS4r0kUkIb28JdNKZeJZCDUMNnN/nhj+h3UTsN88WEzZbLjhSZCfzMNo2w==',key_name='tempest-keypair-931450966',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b84539186347404ea3cdc32042f70052',ramdisk_id='',reservation_id='r-flwl45cc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-491908434',owner_user_name='tempest-TaggedBootDevicesTest-491908434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:40:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3078a91c61fb48a98b7c0e1d98117e8f',uuid=9d03c7a3-e816-43b0-8616-60dea7a4e81a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c314df64-6753-4691-a931-1ef8f31a8063", "address": "fa:16:3e:92:14:79", "network": {"id": "c135160d-9db9-4271-a134-0cf75c1e862c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1010953674", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc314df64-67", "ovs_interfaceid": "c314df64-6753-4691-a931-1ef8f31a8063", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Converting VIF {"id": "c314df64-6753-4691-a931-1ef8f31a8063", "address": "fa:16:3e:92:14:79", "network": {"id": "c135160d-9db9-4271-a134-0cf75c1e862c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1010953674", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc314df64-67", "ovs_interfaceid": "c314df64-6753-4691-a931-1ef8f31a8063", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:14:79,bridge_name='br-int',has_traffic_filtering=True,id=c314df64-6753-4691-a931-1ef8f31a8063,network=Network(c135160d-9db9-4271-a134-0cf75c1e862c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc314df64-67') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T23:40:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-993143391',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-993143391',id=9,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiUPPSlFnRUQvBR9O/mDOOgi/KDCGIsTUS9ts2D2JCf7UKa4oJ0is321+3mkZZFGv5oTtL1SS4r0kUkIb28JdNKZeJZCDUMNnN/nhj+h3UTsN88WEzZbLjhSZCfzMNo2w==',key_name='tempest-keypair-931450966',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b84539186347404ea3cdc32042f70052',ramdisk_id='',reservation_id='r-flwl45cc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-491908434',owner_user_name='tempest-TaggedBootDevicesTest-491908434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:40:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3078a91c61fb48a98b7c0e1d98117e8f',uuid=9d03c7a3-e816-43b0-8616-60dea7a4e81a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8352810c-25a7-4c4d-b13f-196c82e323ee", "address": "fa:16:3e:6d:e3:2c", "network": {"id": "08285f35-6170-45e2-9aaa-cd8a52bbd6cd", "bridge": "br-int", "label": "tempest-device-tagging-net2-454254441", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8352810c-25", "ovs_interfaceid": "8352810c-25a7-4c4d-b13f-196c82e323ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Converting VIF {"id": "8352810c-25a7-4c4d-b13f-196c82e323ee", "address": "fa:16:3e:6d:e3:2c", "network": {"id": "08285f35-6170-45e2-9aaa-cd8a52bbd6cd", "bridge": "br-int", "label": "tempest-device-tagging-net2-454254441", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8352810c-25", "ovs_interfaceid": "8352810c-25a7-4c4d-b13f-196c82e323ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:e3:2c,bridge_name='br-int',has_traffic_filtering=True,id=8352810c-25a7-4c4d-b13f-196c82e323ee,network=Network(08285f35-6170-45e2-9aaa-cd8a52bbd6cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8352810c-25') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T23:40:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-993143391',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-993143391',id=9,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiUPPSlFnRUQvBR9O/mDOOgi/KDCGIsTUS9ts2D2JCf7UKa4oJ0is321+3mkZZFGv5oTtL1SS4r0kUkIb28JdNKZeJZCDUMNnN/nhj+h3UTsN88WEzZbLjhSZCfzMNo2w==',key_name='tempest-keypair-931450966',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b84539186347404ea3cdc32042f70052',ramdisk_id='',reservation_id='r-flwl45cc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-491908434',owner_user_name='tempest-TaggedBootDevicesTest-491908434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:40:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3078a91c61fb48a98b7c0e1d98117e8f',uuid=9d03c7a3-e816-43b0-8616-60dea7a4e81a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1611672-3415-4fea-adb0-c7fe74ae6049", "address": "fa:16:3e:70:02:49", "network": {"id": "08285f35-6170-45e2-9aaa-cd8a52bbd6cd", "bridge": "br-int", "label": "tempest-device-tagging-net2-454254441", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1611672-34", "ovs_interfaceid": "e1611672-3415-4fea-adb0-c7fe74ae6049", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Converting VIF {"id": "e1611672-3415-4fea-adb0-c7fe74ae6049", "address": "fa:16:3e:70:02:49", "network": {"id": "08285f35-6170-45e2-9aaa-cd8a52bbd6cd", "bridge": "br-int", "label": "tempest-device-tagging-net2-454254441", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1611672-34", "ovs_interfaceid": "e1611672-3415-4fea-adb0-c7fe74ae6049", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:02:49,bridge_name='br-int',has_traffic_filtering=True,id=e1611672-3415-4fea-adb0-c7fe74ae6049,network=Network(08285f35-6170-45e2-9aaa-cd8a52bbd6cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1611672-34') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG nova.objects.instance [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Lazy-loading 'pci_devices' on Instance uuid 9d03c7a3-e816-43b0-8616-60dea7a4e81a {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] End _get_guest_xml xml=<domain type="kvm">
Nov 14 23:41:00 user nova-compute[75341]:   <uuid>9d03c7a3-e816-43b0-8616-60dea7a4e81a</uuid>
Nov 14 23:41:00 user nova-compute[75341]:   <name>instance-00000009</name>
Nov 14 23:41:00 user nova-compute[75341]:   <memory>524288</memory>
Nov 14 23:41:00 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 14 23:41:00 user nova-compute[75341]:   <metadata>
Nov 14 23:41:00 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 23:41:00 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 14 23:41:00 user nova-compute[75341]:       <nova:name>tempest-device-tagging-server-993143391</nova:name>
Nov 14 23:41:00 user nova-compute[75341]:       <nova:creationTime>2023-11-14 23:40:56</nova:creationTime>
Nov 14 23:41:00 user nova-compute[75341]:       <nova:flavor name="m1.tiny">
Nov 14 23:41:00 user nova-compute[75341]:         <nova:memory>512</nova:memory>
Nov 14 23:41:00 user nova-compute[75341]:         <nova:disk>1</nova:disk>
Nov 14 23:41:00 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 14 23:41:00 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 23:41:00 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 14 23:41:00 user nova-compute[75341]:       </nova:flavor>
Nov 14 23:41:00 user nova-compute[75341]:       <nova:owner>
Nov 14 23:41:00 user nova-compute[75341]:         <nova:user uuid="3078a91c61fb48a98b7c0e1d98117e8f">tempest-TaggedBootDevicesTest-491908434-project-member</nova:user>
Nov 14 23:41:00 user nova-compute[75341]:         <nova:project uuid="b84539186347404ea3cdc32042f70052">tempest-TaggedBootDevicesTest-491908434</nova:project>
Nov 14 23:41:00 user nova-compute[75341]:       </nova:owner>
Nov 14 23:41:00 user nova-compute[75341]:       <nova:root type="image" uuid="e46abb82-b810-490e-a8a1-ccdc5fa1a796"/>
Nov 14 23:41:00 user nova-compute[75341]:       <nova:ports>
Nov 14 23:41:00 user nova-compute[75341]:         <nova:port uuid="d0dd84fa-339a-49ec-9042-96715e2230fe">
Nov 14 23:41:00 user nova-compute[75341]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 23:41:00 user nova-compute[75341]:         </nova:port>
Nov 14 23:41:00 user nova-compute[75341]:         <nova:port uuid="f55964c8-6b58-4464-a352-e5145cc3c518">
Nov 14 23:41:00 user nova-compute[75341]:           <nova:ip type="fixed" address="10.1.1.138" ipVersion="4"/>
Nov 14 23:41:00 user nova-compute[75341]:         </nova:port>
Nov 14 23:41:00 user nova-compute[75341]:         <nova:port uuid="eb488639-e98a-4a85-b148-09dbb505f1c9">
Nov 14 23:41:00 user nova-compute[75341]:           <nova:ip type="fixed" address="10.1.1.168" ipVersion="4"/>
Nov 14 23:41:00 user nova-compute[75341]:         </nova:port>
Nov 14 23:41:00 user nova-compute[75341]:         <nova:port uuid="886562c6-312d-4a87-a34a-059f2ba3058a">
Nov 14 23:41:00 user nova-compute[75341]:           <nova:ip type="fixed" address="10.1.1.173" ipVersion="4"/>
Nov 14 23:41:00 user nova-compute[75341]:         </nova:port>
Nov 14 23:41:00 user nova-compute[75341]:         <nova:port uuid="c314df64-6753-4691-a931-1ef8f31a8063">
Nov 14 23:41:00 user nova-compute[75341]:           <nova:ip type="fixed" address="10.1.1.149" ipVersion="4"/>
Nov 14 23:41:00 user nova-compute[75341]:         </nova:port>
Nov 14 23:41:00 user nova-compute[75341]:         <nova:port uuid="8352810c-25a7-4c4d-b13f-196c82e323ee">
Nov 14 23:41:00 user nova-compute[75341]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 14 23:41:00 user nova-compute[75341]:         </nova:port>
Nov 14 23:41:00 user nova-compute[75341]:         <nova:port uuid="e1611672-3415-4fea-adb0-c7fe74ae6049">
Nov 14 23:41:00 user nova-compute[75341]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 14 23:41:00 user nova-compute[75341]:         </nova:port>
Nov 14 23:41:00 user nova-compute[75341]:       </nova:ports>
Nov 14 23:41:00 user nova-compute[75341]:     </nova:instance>
Nov 14 23:41:00 user nova-compute[75341]:   </metadata>
Nov 14 23:41:00 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 14 23:41:00 user nova-compute[75341]:     <system>
Nov 14 23:41:00 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 23:41:00 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 14 23:41:00 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 14 23:41:00 user nova-compute[75341]:       <entry name="serial">9d03c7a3-e816-43b0-8616-60dea7a4e81a</entry>
Nov 14 23:41:00 user nova-compute[75341]:       <entry name="uuid">9d03c7a3-e816-43b0-8616-60dea7a4e81a</entry>
Nov 14 23:41:00 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 14 23:41:00 user nova-compute[75341]:     </system>
Nov 14 23:41:00 user nova-compute[75341]:   </sysinfo>
Nov 14 23:41:00 user nova-compute[75341]:   <os>
Nov 14 23:41:00 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 23:41:00 user nova-compute[75341]:     <boot dev="hd"/>
Nov 14 23:41:00 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 14 23:41:00 user nova-compute[75341]:   </os>
Nov 14 23:41:00 user nova-compute[75341]:   <features>
Nov 14 23:41:00 user nova-compute[75341]:     <acpi/>
Nov 14 23:41:00 user nova-compute[75341]:     <apic/>
Nov 14 23:41:00 user nova-compute[75341]:     <vmcoreinfo/>
Nov 14 23:41:00 user nova-compute[75341]:   </features>
Nov 14 23:41:00 user nova-compute[75341]:   <clock offset="utc">
Nov 14 23:41:00 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 23:41:00 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 23:41:00 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 14 23:41:00 user nova-compute[75341]:   </clock>
Nov 14 23:41:00 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 14 23:41:00 user nova-compute[75341]:     <model>Nehalem</model>
Nov 14 23:41:00 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 23:41:00 user nova-compute[75341]:   </cpu>
Nov 14 23:41:00 user nova-compute[75341]:   <devices>
Nov 14 23:41:00 user nova-compute[75341]:     <disk type="file" device="cdrom">
Nov 14 23:41:00 user nova-compute[75341]:       <driver name="qemu" type="raw" cache="none"/>
Nov 14 23:41:00 user nova-compute[75341]:       <source file="/opt/stack/data/nova/instances/9d03c7a3-e816-43b0-8616-60dea7a4e81a/disk.config"/>
Nov 14 23:41:00 user nova-compute[75341]:       <target dev="hda" bus="ide"/>
Nov 14 23:41:00 user nova-compute[75341]:     </disk>
Nov 14 23:41:00 user nova-compute[75341]:     <disk type="block" device="disk">
Nov 14 23:41:00 user nova-compute[75341]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:41:00 user nova-compute[75341]:       <source dev="/dev/sdb"/>
Nov 14 23:41:00 user nova-compute[75341]:       <target dev="vda" bus="virtio"/>
Nov 14 23:41:00 user nova-compute[75341]:       <serial>a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198</serial>
Nov 14 23:41:00 user nova-compute[75341]:     </disk>
Nov 14 23:41:00 user nova-compute[75341]:     <disk type="block" device="disk">
Nov 14 23:41:00 user nova-compute[75341]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:41:00 user nova-compute[75341]:       <source dev="/dev/sdc"/>
Nov 14 23:41:00 user nova-compute[75341]:       <target dev="vdb" bus="virtio"/>
Nov 14 23:41:00 user nova-compute[75341]:       <serial>1d39d66b-22ae-4f70-bd8e-1e9df2b517ff</serial>
Nov 14 23:41:00 user nova-compute[75341]:     </disk>
Nov 14 23:41:00 user nova-compute[75341]:     <disk type="block" device="disk">
Nov 14 23:41:00 user nova-compute[75341]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:41:00 user nova-compute[75341]:       <source dev="/dev/sdd"/>
Nov 14 23:41:00 user nova-compute[75341]:       <target dev="vdc" bus="virtio"/>
Nov 14 23:41:00 user nova-compute[75341]:       <serial>de5d17dd-51c3-42bc-9950-b815f8d48296</serial>
Nov 14 23:41:00 user nova-compute[75341]:     </disk>
Nov 14 23:41:00 user nova-compute[75341]:     <interface type="ethernet">
Nov 14 23:41:00 user nova-compute[75341]:       <mac address="fa:16:3e:b5:06:42"/>
Nov 14 23:41:00 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:41:00 user nova-compute[75341]:       <mtu size="1442"/>
Nov 14 23:41:00 user nova-compute[75341]:       <target dev="tapd0dd84fa-33"/>
Nov 14 23:41:00 user nova-compute[75341]:     </interface>
Nov 14 23:41:00 user nova-compute[75341]:     <interface type="ethernet">
Nov 14 23:41:00 user nova-compute[75341]:       <mac address="fa:16:3e:1b:36:55"/>
Nov 14 23:41:00 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:41:00 user nova-compute[75341]:       <mtu size="1442"/>
Nov 14 23:41:00 user nova-compute[75341]:       <target dev="tapf55964c8-6b"/>
Nov 14 23:41:00 user nova-compute[75341]:     </interface>
Nov 14 23:41:00 user nova-compute[75341]:     <interface type="ethernet">
Nov 14 23:41:00 user nova-compute[75341]:       <mac address="fa:16:3e:36:7e:f8"/>
Nov 14 23:41:00 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:41:00 user nova-compute[75341]:       <mtu size="1442"/>
Nov 14 23:41:00 user nova-compute[75341]:       <target dev="tapeb488639-e9"/>
Nov 14 23:41:00 user nova-compute[75341]:     </interface>
Nov 14 23:41:00 user nova-compute[75341]:     <interface type="ethernet">
Nov 14 23:41:00 user nova-compute[75341]:       <mac address="fa:16:3e:28:ad:ae"/>
Nov 14 23:41:00 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:41:00 user nova-compute[75341]:       <mtu size="1442"/>
Nov 14 23:41:00 user nova-compute[75341]:       <target dev="tap886562c6-31"/>
Nov 14 23:41:00 user nova-compute[75341]:     </interface>
Nov 14 23:41:00 user nova-compute[75341]:     <interface type="ethernet">
Nov 14 23:41:00 user nova-compute[75341]:       <mac address="fa:16:3e:92:14:79"/>
Nov 14 23:41:00 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:41:00 user nova-compute[75341]:       <mtu size="1442"/>
Nov 14 23:41:00 user nova-compute[75341]:       <target dev="tapc314df64-67"/>
Nov 14 23:41:00 user nova-compute[75341]:     </interface>
Nov 14 23:41:00 user nova-compute[75341]:     <interface type="ethernet">
Nov 14 23:41:00 user nova-compute[75341]:       <mac address="fa:16:3e:6d:e3:2c"/>
Nov 14 23:41:00 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:41:00 user nova-compute[75341]:       <mtu size="1442"/>
Nov 14 23:41:00 user nova-compute[75341]:       <target dev="tap8352810c-25"/>
Nov 14 23:41:00 user nova-compute[75341]:     </interface>
Nov 14 23:41:00 user nova-compute[75341]:     <interface type="ethernet">
Nov 14 23:41:00 user nova-compute[75341]:       <mac address="fa:16:3e:70:02:49"/>
Nov 14 23:41:00 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:41:00 user nova-compute[75341]:       <mtu size="1442"/>
Nov 14 23:41:00 user nova-compute[75341]:       <target dev="tape1611672-34"/>
Nov 14 23:41:00 user nova-compute[75341]:     </interface>
Nov 14 23:41:00 user nova-compute[75341]:     <serial type="pty">
Nov 14 23:41:00 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/9d03c7a3-e816-43b0-8616-60dea7a4e81a/console.log" append="off"/>
Nov 14 23:41:00 user nova-compute[75341]:     </serial>
Nov 14 23:41:00 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 23:41:00 user nova-compute[75341]:     <video>
Nov 14 23:41:00 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:41:00 user nova-compute[75341]:     </video>
Nov 14 23:41:00 user nova-compute[75341]:     <rng model="virtio">
Nov 14 23:41:00 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 14 23:41:00 user nova-compute[75341]:     </rng>
Nov 14 23:41:00 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 14 23:41:00 user nova-compute[75341]:     <memballoon model="virtio">
Nov 14 23:41:00 user nova-compute[75341]:       <stats period="10"/>
Nov 14 23:41:00 user nova-compute[75341]:     </memballoon>
Nov 14 23:41:00 user nova-compute[75341]:   </devices>
Nov 14 23:41:00 user nova-compute[75341]: </domain>
Nov 14 23:41:00 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T23:40:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-993143391',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-993143391',id=9,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiUPPSlFnRUQvBR9O/mDOOgi/KDCGIsTUS9ts2D2JCf7UKa4oJ0is321+3mkZZFGv5oTtL1SS4r0kUkIb28JdNKZeJZCDUMNnN/nhj+h3UTsN88WEzZbLjhSZCfzMNo2w==',key_name='tempest-keypair-931450966',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b84539186347404ea3cdc32042f70052',ramdisk_id='',reservation_id='r-flwl45cc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-491908434',owner_user_name='tempest-TaggedBootDevicesTest-491908434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:40:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3078a91c61fb48a98b7c0e1d98117e8f',uuid=9d03c7a3-e816-43b0-8616-60dea7a4e81a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0dd84fa-339a-49ec-9042-96715e2230fe", "address": "fa:16:3e:b5:06:42", "network": {"id": "b499fa7b-6b9d-49c0-a9cd-42306c00c501", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-385863436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0dd84fa-33", "ovs_interfaceid": "d0dd84fa-339a-49ec-9042-96715e2230fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Converting VIF {"id": "d0dd84fa-339a-49ec-9042-96715e2230fe", "address": "fa:16:3e:b5:06:42", "network": {"id": "b499fa7b-6b9d-49c0-a9cd-42306c00c501", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-385863436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0dd84fa-33", "ovs_interfaceid": "d0dd84fa-339a-49ec-9042-96715e2230fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:06:42,bridge_name='br-int',has_traffic_filtering=True,id=d0dd84fa-339a-49ec-9042-96715e2230fe,network=Network(b499fa7b-6b9d-49c0-a9cd-42306c00c501),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0dd84fa-33') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG os_vif [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:06:42,bridge_name='br-int',has_traffic_filtering=True,id=d0dd84fa-339a-49ec-9042-96715e2230fe,network=Network(b499fa7b-6b9d-49c0-a9cd-42306c00c501),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0dd84fa-33') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4a64b0cb-3da8-5412-acf9-f1dcf7e171e4', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd0dd84fa-33, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd0dd84fa-33, col_values=(('qos', UUID('059846df-7d36-47b6-afd8-ea07387edfaa')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd0dd84fa-33, col_values=(('external_ids', {'iface-id': 'd0dd84fa-339a-49ec-9042-96715e2230fe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:06:42', 'vm-uuid': '9d03c7a3-e816-43b0-8616-60dea7a4e81a'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:00 user nova-compute[75341]: INFO os_vif [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:06:42,bridge_name='br-int',has_traffic_filtering=True,id=d0dd84fa-339a-49ec-9042-96715e2230fe,network=Network(b499fa7b-6b9d-49c0-a9cd-42306c00c501),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0dd84fa-33')
Nov 14 23:41:00 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T23:40:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-993143391',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-993143391',id=9,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiUPPSlFnRUQvBR9O/mDOOgi/KDCGIsTUS9ts2D2JCf7UKa4oJ0is321+3mkZZFGv5oTtL1SS4r0kUkIb28JdNKZeJZCDUMNnN/nhj+h3UTsN88WEzZbLjhSZCfzMNo2w==',key_name='tempest-keypair-931450966',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b84539186347404ea3cdc32042f70052',ramdisk_id='',reservation_id='r-flwl45cc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-491908434',owner_user_name='tempest-TaggedBootDevicesTest-491908434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:40:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3078a91c61fb48a98b7c0e1d98117e8f',uuid=9d03c7a3-e816-43b0-8616-60dea7a4e81a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f55964c8-6b58-4464-a352-e5145cc3c518", "address": "fa:16:3e:1b:36:55", "network": {"id": "c135160d-9db9-4271-a134-0cf75c1e862c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1010953674", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf55964c8-6b", "ovs_interfaceid": "f55964c8-6b58-4464-a352-e5145cc3c518", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Converting VIF {"id": "f55964c8-6b58-4464-a352-e5145cc3c518", "address": "fa:16:3e:1b:36:55", "network": {"id": "c135160d-9db9-4271-a134-0cf75c1e862c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1010953674", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf55964c8-6b", "ovs_interfaceid": "f55964c8-6b58-4464-a352-e5145cc3c518", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:36:55,bridge_name='br-int',has_traffic_filtering=True,id=f55964c8-6b58-4464-a352-e5145cc3c518,network=Network(c135160d-9db9-4271-a134-0cf75c1e862c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf55964c8-6b') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG os_vif [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:36:55,bridge_name='br-int',has_traffic_filtering=True,id=f55964c8-6b58-4464-a352-e5145cc3c518,network=Network(c135160d-9db9-4271-a134-0cf75c1e862c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf55964c8-6b') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '20593207-8c65-52e6-a226-83c407b1ef94', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf55964c8-6b, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf55964c8-6b, col_values=(('qos', UUID('65db1ba1-bd1f-4a44-bc4e-2bd12b024619')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf55964c8-6b, col_values=(('external_ids', {'iface-id': 'f55964c8-6b58-4464-a352-e5145cc3c518', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:36:55', 'vm-uuid': '9d03c7a3-e816-43b0-8616-60dea7a4e81a'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:00 user nova-compute[75341]: INFO os_vif [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:36:55,bridge_name='br-int',has_traffic_filtering=True,id=f55964c8-6b58-4464-a352-e5145cc3c518,network=Network(c135160d-9db9-4271-a134-0cf75c1e862c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf55964c8-6b')
Nov 14 23:41:00 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T23:40:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-993143391',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-993143391',id=9,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiUPPSlFnRUQvBR9O/mDOOgi/KDCGIsTUS9ts2D2JCf7UKa4oJ0is321+3mkZZFGv5oTtL1SS4r0kUkIb28JdNKZeJZCDUMNnN/nhj+h3UTsN88WEzZbLjhSZCfzMNo2w==',key_name='tempest-keypair-931450966',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b84539186347404ea3cdc32042f70052',ramdisk_id='',reservation_id='r-flwl45cc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-491908434',owner_user_name='tempest-TaggedBootDevicesTest-491908434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:40:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3078a91c61fb48a98b7c0e1d98117e8f',uuid=9d03c7a3-e816-43b0-8616-60dea7a4e81a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb488639-e98a-4a85-b148-09dbb505f1c9", "address": "fa:16:3e:36:7e:f8", "network": {"id": "c135160d-9db9-4271-a134-0cf75c1e862c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1010953674", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb488639-e9", "ovs_interfaceid": "eb488639-e98a-4a85-b148-09dbb505f1c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Converting VIF {"id": "eb488639-e98a-4a85-b148-09dbb505f1c9", "address": "fa:16:3e:36:7e:f8", "network": {"id": "c135160d-9db9-4271-a134-0cf75c1e862c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1010953674", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb488639-e9", "ovs_interfaceid": "eb488639-e98a-4a85-b148-09dbb505f1c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:7e:f8,bridge_name='br-int',has_traffic_filtering=True,id=eb488639-e98a-4a85-b148-09dbb505f1c9,network=Network(c135160d-9db9-4271-a134-0cf75c1e862c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapeb488639-e9') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG os_vif [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:7e:f8,bridge_name='br-int',has_traffic_filtering=True,id=eb488639-e98a-4a85-b148-09dbb505f1c9,network=Network(c135160d-9db9-4271-a134-0cf75c1e862c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapeb488639-e9') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aa3d89a2-a695-5eee-a5eb-c07e9c0426d6', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeb488639-e9, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeb488639-e9, col_values=(('qos', UUID('38c6b356-4e9e-4451-8b3a-9e642e67905b')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeb488639-e9, col_values=(('external_ids', {'iface-id': 'eb488639-e98a-4a85-b148-09dbb505f1c9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:7e:f8', 'vm-uuid': '9d03c7a3-e816-43b0-8616-60dea7a4e81a'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:01 user nova-compute[75341]: INFO os_vif [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:7e:f8,bridge_name='br-int',has_traffic_filtering=True,id=eb488639-e98a-4a85-b148-09dbb505f1c9,network=Network(c135160d-9db9-4271-a134-0cf75c1e862c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapeb488639-e9')
Nov 14 23:41:01 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T23:40:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-993143391',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-993143391',id=9,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiUPPSlFnRUQvBR9O/mDOOgi/KDCGIsTUS9ts2D2JCf7UKa4oJ0is321+3mkZZFGv5oTtL1SS4r0kUkIb28JdNKZeJZCDUMNnN/nhj+h3UTsN88WEzZbLjhSZCfzMNo2w==',key_name='tempest-keypair-931450966',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b84539186347404ea3cdc32042f70052',ramdisk_id='',reservation_id='r-flwl45cc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-491908434',owner_user_name='tempest-TaggedBootDevicesTest-491908434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:40:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3078a91c61fb48a98b7c0e1d98117e8f',uuid=9d03c7a3-e816-43b0-8616-60dea7a4e81a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "886562c6-312d-4a87-a34a-059f2ba3058a", "address": "fa:16:3e:28:ad:ae", "network": {"id": "c135160d-9db9-4271-a134-0cf75c1e862c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1010953674", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap886562c6-31", "ovs_interfaceid": "886562c6-312d-4a87-a34a-059f2ba3058a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Converting VIF {"id": "886562c6-312d-4a87-a34a-059f2ba3058a", "address": "fa:16:3e:28:ad:ae", "network": {"id": "c135160d-9db9-4271-a134-0cf75c1e862c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1010953674", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap886562c6-31", "ovs_interfaceid": "886562c6-312d-4a87-a34a-059f2ba3058a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:ad:ae,bridge_name='br-int',has_traffic_filtering=True,id=886562c6-312d-4a87-a34a-059f2ba3058a,network=Network(c135160d-9db9-4271-a134-0cf75c1e862c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap886562c6-31') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG os_vif [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:ad:ae,bridge_name='br-int',has_traffic_filtering=True,id=886562c6-312d-4a87-a34a-059f2ba3058a,network=Network(c135160d-9db9-4271-a134-0cf75c1e862c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap886562c6-31') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c7a0ba45-c3c4-58c4-bd04-77487ade571d', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap886562c6-31, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap886562c6-31, col_values=(('qos', UUID('63a02334-ecc8-4451-b086-9717b080ac58')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap886562c6-31, col_values=(('external_ids', {'iface-id': '886562c6-312d-4a87-a34a-059f2ba3058a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:ad:ae', 'vm-uuid': '9d03c7a3-e816-43b0-8616-60dea7a4e81a'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:01 user nova-compute[75341]: INFO os_vif [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:ad:ae,bridge_name='br-int',has_traffic_filtering=True,id=886562c6-312d-4a87-a34a-059f2ba3058a,network=Network(c135160d-9db9-4271-a134-0cf75c1e862c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap886562c6-31')
Nov 14 23:41:01 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T23:40:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-993143391',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-993143391',id=9,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiUPPSlFnRUQvBR9O/mDOOgi/KDCGIsTUS9ts2D2JCf7UKa4oJ0is321+3mkZZFGv5oTtL1SS4r0kUkIb28JdNKZeJZCDUMNnN/nhj+h3UTsN88WEzZbLjhSZCfzMNo2w==',key_name='tempest-keypair-931450966',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b84539186347404ea3cdc32042f70052',ramdisk_id='',reservation_id='r-flwl45cc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-491908434',owner_user_name='tempest-TaggedBootDevicesTest-491908434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:40:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3078a91c61fb48a98b7c0e1d98117e8f',uuid=9d03c7a3-e816-43b0-8616-60dea7a4e81a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c314df64-6753-4691-a931-1ef8f31a8063", "address": "fa:16:3e:92:14:79", "network": {"id": "c135160d-9db9-4271-a134-0cf75c1e862c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1010953674", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc314df64-67", "ovs_interfaceid": "c314df64-6753-4691-a931-1ef8f31a8063", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Converting VIF {"id": "c314df64-6753-4691-a931-1ef8f31a8063", "address": "fa:16:3e:92:14:79", "network": {"id": "c135160d-9db9-4271-a134-0cf75c1e862c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1010953674", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc314df64-67", "ovs_interfaceid": "c314df64-6753-4691-a931-1ef8f31a8063", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:14:79,bridge_name='br-int',has_traffic_filtering=True,id=c314df64-6753-4691-a931-1ef8f31a8063,network=Network(c135160d-9db9-4271-a134-0cf75c1e862c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc314df64-67') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG os_vif [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:14:79,bridge_name='br-int',has_traffic_filtering=True,id=c314df64-6753-4691-a931-1ef8f31a8063,network=Network(c135160d-9db9-4271-a134-0cf75c1e862c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc314df64-67') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6e4a176c-3c93-5b89-8482-3a0a6b026970', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc314df64-67, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc314df64-67, col_values=(('qos', UUID('9d09a7f2-e1f8-4b5b-8f3b-c05df45978ab')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc314df64-67, col_values=(('external_ids', {'iface-id': 'c314df64-6753-4691-a931-1ef8f31a8063', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:14:79', 'vm-uuid': '9d03c7a3-e816-43b0-8616-60dea7a4e81a'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:01 user nova-compute[75341]: INFO os_vif [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:14:79,bridge_name='br-int',has_traffic_filtering=True,id=c314df64-6753-4691-a931-1ef8f31a8063,network=Network(c135160d-9db9-4271-a134-0cf75c1e862c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc314df64-67')
Nov 14 23:41:01 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T23:40:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-993143391',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-993143391',id=9,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiUPPSlFnRUQvBR9O/mDOOgi/KDCGIsTUS9ts2D2JCf7UKa4oJ0is321+3mkZZFGv5oTtL1SS4r0kUkIb28JdNKZeJZCDUMNnN/nhj+h3UTsN88WEzZbLjhSZCfzMNo2w==',key_name='tempest-keypair-931450966',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b84539186347404ea3cdc32042f70052',ramdisk_id='',reservation_id='r-flwl45cc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-491908434',owner_user_name='tempest-TaggedBootDevicesTest-491908434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:40:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3078a91c61fb48a98b7c0e1d98117e8f',uuid=9d03c7a3-e816-43b0-8616-60dea7a4e81a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8352810c-25a7-4c4d-b13f-196c82e323ee", "address": "fa:16:3e:6d:e3:2c", "network": {"id": "08285f35-6170-45e2-9aaa-cd8a52bbd6cd", "bridge": "br-int", "label": "tempest-device-tagging-net2-454254441", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8352810c-25", "ovs_interfaceid": "8352810c-25a7-4c4d-b13f-196c82e323ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Converting VIF {"id": "8352810c-25a7-4c4d-b13f-196c82e323ee", "address": "fa:16:3e:6d:e3:2c", "network": {"id": "08285f35-6170-45e2-9aaa-cd8a52bbd6cd", "bridge": "br-int", "label": "tempest-device-tagging-net2-454254441", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8352810c-25", "ovs_interfaceid": "8352810c-25a7-4c4d-b13f-196c82e323ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:e3:2c,bridge_name='br-int',has_traffic_filtering=True,id=8352810c-25a7-4c4d-b13f-196c82e323ee,network=Network(08285f35-6170-45e2-9aaa-cd8a52bbd6cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8352810c-25') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG os_vif [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:e3:2c,bridge_name='br-int',has_traffic_filtering=True,id=8352810c-25a7-4c4d-b13f-196c82e323ee,network=Network(08285f35-6170-45e2-9aaa-cd8a52bbd6cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8352810c-25') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '192d218b-85a8-5824-81fc-9750336d32e2', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8352810c-25, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8352810c-25, col_values=(('qos', UUID('09448534-820c-4354-ad31-cc4aacd26cc1')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8352810c-25, col_values=(('external_ids', {'iface-id': '8352810c-25a7-4c4d-b13f-196c82e323ee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:e3:2c', 'vm-uuid': '9d03c7a3-e816-43b0-8616-60dea7a4e81a'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG nova.compute.manager [req-4691d4a7-9b8e-44af-b33a-e2681cba6764 req-d848cbe1-0365-4952-8ebd-6c8dcd035d9b service nova] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Received event network-vif-plugged-611fe585-b169-4ec5-97cf-8ebdf5060502 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4691d4a7-9b8e-44af-b33a-e2681cba6764 req-d848cbe1-0365-4952-8ebd-6c8dcd035d9b service nova] Acquiring lock "44080c0d-56eb-4987-aa4b-59f161dcbc0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4691d4a7-9b8e-44af-b33a-e2681cba6764 req-d848cbe1-0365-4952-8ebd-6c8dcd035d9b service nova] Lock "44080c0d-56eb-4987-aa4b-59f161dcbc0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4691d4a7-9b8e-44af-b33a-e2681cba6764 req-d848cbe1-0365-4952-8ebd-6c8dcd035d9b service nova] Lock "44080c0d-56eb-4987-aa4b-59f161dcbc0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG nova.compute.manager [req-4691d4a7-9b8e-44af-b33a-e2681cba6764 req-d848cbe1-0365-4952-8ebd-6c8dcd035d9b service nova] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] No waiting events found dispatching network-vif-plugged-611fe585-b169-4ec5-97cf-8ebdf5060502 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:41:01 user nova-compute[75341]: WARNING nova.compute.manager [req-4691d4a7-9b8e-44af-b33a-e2681cba6764 req-d848cbe1-0365-4952-8ebd-6c8dcd035d9b service nova] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Received unexpected event network-vif-plugged-611fe585-b169-4ec5-97cf-8ebdf5060502 for instance with vm_state building and task_state spawning.
Nov 14 23:41:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:01 user nova-compute[75341]: INFO os_vif [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:e3:2c,bridge_name='br-int',has_traffic_filtering=True,id=8352810c-25a7-4c4d-b13f-196c82e323ee,network=Network(08285f35-6170-45e2-9aaa-cd8a52bbd6cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8352810c-25')
Nov 14 23:41:01 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T23:40:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-993143391',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-993143391',id=9,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiUPPSlFnRUQvBR9O/mDOOgi/KDCGIsTUS9ts2D2JCf7UKa4oJ0is321+3mkZZFGv5oTtL1SS4r0kUkIb28JdNKZeJZCDUMNnN/nhj+h3UTsN88WEzZbLjhSZCfzMNo2w==',key_name='tempest-keypair-931450966',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b84539186347404ea3cdc32042f70052',ramdisk_id='',reservation_id='r-flwl45cc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-491908434',owner_user_name='tempest-TaggedBootDevicesTest-491908434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:40:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3078a91c61fb48a98b7c0e1d98117e8f',uuid=9d03c7a3-e816-43b0-8616-60dea7a4e81a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1611672-3415-4fea-adb0-c7fe74ae6049", "address": "fa:16:3e:70:02:49", "network": {"id": "08285f35-6170-45e2-9aaa-cd8a52bbd6cd", "bridge": "br-int", "label": "tempest-device-tagging-net2-454254441", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1611672-34", "ovs_interfaceid": "e1611672-3415-4fea-adb0-c7fe74ae6049", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Converting VIF {"id": "e1611672-3415-4fea-adb0-c7fe74ae6049", "address": "fa:16:3e:70:02:49", "network": {"id": "08285f35-6170-45e2-9aaa-cd8a52bbd6cd", "bridge": "br-int", "label": "tempest-device-tagging-net2-454254441", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1611672-34", "ovs_interfaceid": "e1611672-3415-4fea-adb0-c7fe74ae6049", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:02:49,bridge_name='br-int',has_traffic_filtering=True,id=e1611672-3415-4fea-adb0-c7fe74ae6049,network=Network(08285f35-6170-45e2-9aaa-cd8a52bbd6cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1611672-34') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG os_vif [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:02:49,bridge_name='br-int',has_traffic_filtering=True,id=e1611672-3415-4fea-adb0-c7fe74ae6049,network=Network(08285f35-6170-45e2-9aaa-cd8a52bbd6cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1611672-34') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b0784187-54d8-5329-84bb-68ad3d4c3d5a', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape1611672-34, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape1611672-34, col_values=(('qos', UUID('f7304662-59cf-4175-83fa-0a50f2982477')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape1611672-34, col_values=(('external_ids', {'iface-id': 'e1611672-3415-4fea-adb0-c7fe74ae6049', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:02:49', 'vm-uuid': '9d03c7a3-e816-43b0-8616-60dea7a4e81a'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:01 user nova-compute[75341]: INFO os_vif [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:02:49,bridge_name='br-int',has_traffic_filtering=True,id=e1611672-3415-4fea-adb0-c7fe74ae6049,network=Network(08285f35-6170-45e2-9aaa-cd8a52bbd6cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1611672-34')
Nov 14 23:41:01 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] No BDM found with device name hda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] No VIF found with MAC fa:16:3e:b5:06:42, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:41:01 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] No VIF found with MAC fa:16:3e:92:14:79, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:41:01 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Using config drive
Nov 14 23:41:02 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Creating config drive at /opt/stack/data/nova/instances/9d03c7a3-e816-43b0-8616-60dea7a4e81a/disk.config
Nov 14 23:41:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9d03c7a3-e816-43b0-8616-60dea7a4e81a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp8uchjkbb {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9d03c7a3-e816-43b0-8616-60dea7a4e81a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp8uchjkbb" returned: 0 in 0.058s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:41:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:03 user nova-compute[75341]: DEBUG nova.compute.manager [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Instance event wait completed in 0 seconds for  {{(pid=75341) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 23:41:03 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Guest created on hypervisor {{(pid=75341) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 23:41:03 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Instance spawned successfully.
Nov 14 23:41:03 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 23:41:03 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Found default for hw_cdrom_bus of ide {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:41:03 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Found default for hw_disk_bus of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:41:03 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Found default for hw_input_bus of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:41:03 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Found default for hw_pointer_model of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:41:03 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Found default for hw_video_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:41:03 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Found default for hw_vif_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:41:03 user nova-compute[75341]: INFO nova.compute.manager [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Took 5.26 seconds to spawn the instance on the hypervisor.
Nov 14 23:41:03 user nova-compute[75341]: DEBUG nova.compute.manager [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 23:41:03 user nova-compute[75341]: INFO nova.compute.manager [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Took 6.02 seconds to build instance.
Nov 14 23:41:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e5f8e955-32e1-44d4-b0fd-6054842ff6e6 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Lock "44080c0d-56eb-4987-aa4b-59f161dcbc0b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.128s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:41:03 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:03 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:03 user nova-compute[75341]: DEBUG nova.compute.manager [req-ecb8170e-4dc3-4f5d-9047-6a63f888334d req-014b642f-fa59-41ba-b9c4-023a5a83dacf service nova] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Received event network-vif-plugged-611fe585-b169-4ec5-97cf-8ebdf5060502 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:41:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ecb8170e-4dc3-4f5d-9047-6a63f888334d req-014b642f-fa59-41ba-b9c4-023a5a83dacf service nova] Acquiring lock "44080c0d-56eb-4987-aa4b-59f161dcbc0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:41:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ecb8170e-4dc3-4f5d-9047-6a63f888334d req-014b642f-fa59-41ba-b9c4-023a5a83dacf service nova] Lock "44080c0d-56eb-4987-aa4b-59f161dcbc0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:41:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ecb8170e-4dc3-4f5d-9047-6a63f888334d req-014b642f-fa59-41ba-b9c4-023a5a83dacf service nova] Lock "44080c0d-56eb-4987-aa4b-59f161dcbc0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:41:03 user nova-compute[75341]: DEBUG nova.compute.manager [req-ecb8170e-4dc3-4f5d-9047-6a63f888334d req-014b642f-fa59-41ba-b9c4-023a5a83dacf service nova] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] No waiting events found dispatching network-vif-plugged-611fe585-b169-4ec5-97cf-8ebdf5060502 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:41:03 user nova-compute[75341]: WARNING nova.compute.manager [req-ecb8170e-4dc3-4f5d-9047-6a63f888334d req-014b642f-fa59-41ba-b9c4-023a5a83dacf service nova] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Received unexpected event network-vif-plugged-611fe585-b169-4ec5-97cf-8ebdf5060502 for instance with vm_state active and task_state None.
Nov 14 23:41:03 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:03 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:03 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:03 user nova-compute[75341]: DEBUG nova.compute.manager [req-ae072540-e5ce-48a4-9cdb-9363255ac5bb req-714b7448-639d-47c4-8081-e8e89b4037ac service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received event network-vif-plugged-d0dd84fa-339a-49ec-9042-96715e2230fe {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:41:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ae072540-e5ce-48a4-9cdb-9363255ac5bb req-714b7448-639d-47c4-8081-e8e89b4037ac service nova] Acquiring lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:41:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ae072540-e5ce-48a4-9cdb-9363255ac5bb req-714b7448-639d-47c4-8081-e8e89b4037ac service nova] Lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:41:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ae072540-e5ce-48a4-9cdb-9363255ac5bb req-714b7448-639d-47c4-8081-e8e89b4037ac service nova] Lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:41:03 user nova-compute[75341]: DEBUG nova.compute.manager [req-ae072540-e5ce-48a4-9cdb-9363255ac5bb req-714b7448-639d-47c4-8081-e8e89b4037ac service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] No waiting events found dispatching network-vif-plugged-d0dd84fa-339a-49ec-9042-96715e2230fe {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:41:03 user nova-compute[75341]: WARNING nova.compute.manager [req-ae072540-e5ce-48a4-9cdb-9363255ac5bb req-714b7448-639d-47c4-8081-e8e89b4037ac service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received unexpected event network-vif-plugged-d0dd84fa-339a-49ec-9042-96715e2230fe for instance with vm_state building and task_state spawning.
Nov 14 23:41:03 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:05 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:05 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:05 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:05 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:05 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:05 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:05 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:05 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:05 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:05 user nova-compute[75341]: DEBUG nova.compute.manager [req-966238e3-ab67-4d77-bc94-ad84f4c967ce req-a88abb2d-96b5-4696-97bc-37c16ea232d0 service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received event network-vif-plugged-eb488639-e98a-4a85-b148-09dbb505f1c9 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:41:05 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-966238e3-ab67-4d77-bc94-ad84f4c967ce req-a88abb2d-96b5-4696-97bc-37c16ea232d0 service nova] Acquiring lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:41:05 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-966238e3-ab67-4d77-bc94-ad84f4c967ce req-a88abb2d-96b5-4696-97bc-37c16ea232d0 service nova] Lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:41:05 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-966238e3-ab67-4d77-bc94-ad84f4c967ce req-a88abb2d-96b5-4696-97bc-37c16ea232d0 service nova] Lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:41:05 user nova-compute[75341]: DEBUG nova.compute.manager [req-966238e3-ab67-4d77-bc94-ad84f4c967ce req-a88abb2d-96b5-4696-97bc-37c16ea232d0 service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] No waiting events found dispatching network-vif-plugged-eb488639-e98a-4a85-b148-09dbb505f1c9 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:41:05 user nova-compute[75341]: WARNING nova.compute.manager [req-966238e3-ab67-4d77-bc94-ad84f4c967ce req-a88abb2d-96b5-4696-97bc-37c16ea232d0 service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received unexpected event network-vif-plugged-eb488639-e98a-4a85-b148-09dbb505f1c9 for instance with vm_state building and task_state spawning.
Nov 14 23:41:05 user nova-compute[75341]: DEBUG nova.compute.manager [req-966238e3-ab67-4d77-bc94-ad84f4c967ce req-a88abb2d-96b5-4696-97bc-37c16ea232d0 service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received event network-vif-plugged-eb488639-e98a-4a85-b148-09dbb505f1c9 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:41:05 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-966238e3-ab67-4d77-bc94-ad84f4c967ce req-a88abb2d-96b5-4696-97bc-37c16ea232d0 service nova] Acquiring lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:41:05 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-966238e3-ab67-4d77-bc94-ad84f4c967ce req-a88abb2d-96b5-4696-97bc-37c16ea232d0 service nova] Lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:41:05 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-966238e3-ab67-4d77-bc94-ad84f4c967ce req-a88abb2d-96b5-4696-97bc-37c16ea232d0 service nova] Lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:41:05 user nova-compute[75341]: DEBUG nova.compute.manager [req-966238e3-ab67-4d77-bc94-ad84f4c967ce req-a88abb2d-96b5-4696-97bc-37c16ea232d0 service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] No waiting events found dispatching network-vif-plugged-eb488639-e98a-4a85-b148-09dbb505f1c9 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:41:05 user nova-compute[75341]: WARNING nova.compute.manager [req-966238e3-ab67-4d77-bc94-ad84f4c967ce req-a88abb2d-96b5-4696-97bc-37c16ea232d0 service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received unexpected event network-vif-plugged-eb488639-e98a-4a85-b148-09dbb505f1c9 for instance with vm_state building and task_state spawning.
Nov 14 23:41:05 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:05 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:06 user nova-compute[75341]: DEBUG nova.compute.manager [req-5c59a787-b4fd-40a6-91f6-0e95ad04eb27 req-7b752302-5953-421f-ba7b-ec2ddbe29005 service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received event network-vif-plugged-d0dd84fa-339a-49ec-9042-96715e2230fe {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:41:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-5c59a787-b4fd-40a6-91f6-0e95ad04eb27 req-7b752302-5953-421f-ba7b-ec2ddbe29005 service nova] Acquiring lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:41:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-5c59a787-b4fd-40a6-91f6-0e95ad04eb27 req-7b752302-5953-421f-ba7b-ec2ddbe29005 service nova] Lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:41:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-5c59a787-b4fd-40a6-91f6-0e95ad04eb27 req-7b752302-5953-421f-ba7b-ec2ddbe29005 service nova] Lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:41:06 user nova-compute[75341]: DEBUG nova.compute.manager [req-5c59a787-b4fd-40a6-91f6-0e95ad04eb27 req-7b752302-5953-421f-ba7b-ec2ddbe29005 service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] No waiting events found dispatching network-vif-plugged-d0dd84fa-339a-49ec-9042-96715e2230fe {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:41:06 user nova-compute[75341]: WARNING nova.compute.manager [req-5c59a787-b4fd-40a6-91f6-0e95ad04eb27 req-7b752302-5953-421f-ba7b-ec2ddbe29005 service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received unexpected event network-vif-plugged-d0dd84fa-339a-49ec-9042-96715e2230fe for instance with vm_state building and task_state spawning.
Nov 14 23:41:06 user nova-compute[75341]: DEBUG nova.compute.manager [req-5c59a787-b4fd-40a6-91f6-0e95ad04eb27 req-7b752302-5953-421f-ba7b-ec2ddbe29005 service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received event network-vif-plugged-8352810c-25a7-4c4d-b13f-196c82e323ee {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:41:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-5c59a787-b4fd-40a6-91f6-0e95ad04eb27 req-7b752302-5953-421f-ba7b-ec2ddbe29005 service nova] Acquiring lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:41:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-5c59a787-b4fd-40a6-91f6-0e95ad04eb27 req-7b752302-5953-421f-ba7b-ec2ddbe29005 service nova] Lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:41:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-5c59a787-b4fd-40a6-91f6-0e95ad04eb27 req-7b752302-5953-421f-ba7b-ec2ddbe29005 service nova] Lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:41:06 user nova-compute[75341]: DEBUG nova.compute.manager [req-5c59a787-b4fd-40a6-91f6-0e95ad04eb27 req-7b752302-5953-421f-ba7b-ec2ddbe29005 service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] No waiting events found dispatching network-vif-plugged-8352810c-25a7-4c4d-b13f-196c82e323ee {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:41:06 user nova-compute[75341]: WARNING nova.compute.manager [req-5c59a787-b4fd-40a6-91f6-0e95ad04eb27 req-7b752302-5953-421f-ba7b-ec2ddbe29005 service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received unexpected event network-vif-plugged-8352810c-25a7-4c4d-b13f-196c82e323ee for instance with vm_state building and task_state spawning.
Nov 14 23:41:06 user nova-compute[75341]: DEBUG nova.compute.manager [req-5c59a787-b4fd-40a6-91f6-0e95ad04eb27 req-7b752302-5953-421f-ba7b-ec2ddbe29005 service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received event network-vif-plugged-8352810c-25a7-4c4d-b13f-196c82e323ee {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:41:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-5c59a787-b4fd-40a6-91f6-0e95ad04eb27 req-7b752302-5953-421f-ba7b-ec2ddbe29005 service nova] Acquiring lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:41:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-5c59a787-b4fd-40a6-91f6-0e95ad04eb27 req-7b752302-5953-421f-ba7b-ec2ddbe29005 service nova] Lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:41:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-5c59a787-b4fd-40a6-91f6-0e95ad04eb27 req-7b752302-5953-421f-ba7b-ec2ddbe29005 service nova] Lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:41:06 user nova-compute[75341]: DEBUG nova.compute.manager [req-5c59a787-b4fd-40a6-91f6-0e95ad04eb27 req-7b752302-5953-421f-ba7b-ec2ddbe29005 service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] No waiting events found dispatching network-vif-plugged-8352810c-25a7-4c4d-b13f-196c82e323ee {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:41:06 user nova-compute[75341]: WARNING nova.compute.manager [req-5c59a787-b4fd-40a6-91f6-0e95ad04eb27 req-7b752302-5953-421f-ba7b-ec2ddbe29005 service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received unexpected event network-vif-plugged-8352810c-25a7-4c4d-b13f-196c82e323ee for instance with vm_state building and task_state spawning.
Nov 14 23:41:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:06 user nova-compute[75341]: DEBUG nova.compute.manager [req-b189d462-be0b-450b-ad17-21f2adb40c75 req-bcda3ffc-a81a-444b-aaa7-a2495566bce7 service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received event network-vif-plugged-f55964c8-6b58-4464-a352-e5145cc3c518 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:41:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-b189d462-be0b-450b-ad17-21f2adb40c75 req-bcda3ffc-a81a-444b-aaa7-a2495566bce7 service nova] Acquiring lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:41:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-b189d462-be0b-450b-ad17-21f2adb40c75 req-bcda3ffc-a81a-444b-aaa7-a2495566bce7 service nova] Lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:41:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-b189d462-be0b-450b-ad17-21f2adb40c75 req-bcda3ffc-a81a-444b-aaa7-a2495566bce7 service nova] Lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:41:06 user nova-compute[75341]: DEBUG nova.compute.manager [req-b189d462-be0b-450b-ad17-21f2adb40c75 req-bcda3ffc-a81a-444b-aaa7-a2495566bce7 service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] No waiting events found dispatching network-vif-plugged-f55964c8-6b58-4464-a352-e5145cc3c518 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:41:06 user nova-compute[75341]: WARNING nova.compute.manager [req-b189d462-be0b-450b-ad17-21f2adb40c75 req-bcda3ffc-a81a-444b-aaa7-a2495566bce7 service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received unexpected event network-vif-plugged-f55964c8-6b58-4464-a352-e5145cc3c518 for instance with vm_state building and task_state spawning.
Nov 14 23:41:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:07 user nova-compute[75341]: DEBUG nova.compute.manager [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Instance event wait completed in 0 seconds for  {{(pid=75341) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 23:41:07 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Guest created on hypervisor {{(pid=75341) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 23:41:07 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Instance spawned successfully.
Nov 14 23:41:07 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 23:41:07 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Found default for hw_cdrom_bus of ide {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:41:07 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Found default for hw_disk_bus of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:41:07 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Found default for hw_input_bus of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:41:07 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Found default for hw_pointer_model of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:41:07 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Found default for hw_video_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:41:07 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Found default for hw_vif_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:41:08 user nova-compute[75341]: INFO nova.compute.manager [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Took 11.53 seconds to spawn the instance on the hypervisor.
Nov 14 23:41:08 user nova-compute[75341]: DEBUG nova.compute.manager [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 23:41:08 user nova-compute[75341]: INFO nova.compute.manager [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Took 30.97 seconds to build instance.
Nov 14 23:41:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-18eb347e-26e3-4ddf-abd0-eb3bfd90e212 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 31.130s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:41:09 user nova-compute[75341]: DEBUG nova.compute.manager [req-a8d9f125-daa0-4a25-9213-09cc324b96ea req-78da498e-d194-4013-a245-017fd56bd90f service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received event network-vif-plugged-f55964c8-6b58-4464-a352-e5145cc3c518 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:41:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a8d9f125-daa0-4a25-9213-09cc324b96ea req-78da498e-d194-4013-a245-017fd56bd90f service nova] Acquiring lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:41:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a8d9f125-daa0-4a25-9213-09cc324b96ea req-78da498e-d194-4013-a245-017fd56bd90f service nova] Lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:41:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a8d9f125-daa0-4a25-9213-09cc324b96ea req-78da498e-d194-4013-a245-017fd56bd90f service nova] Lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:41:09 user nova-compute[75341]: DEBUG nova.compute.manager [req-a8d9f125-daa0-4a25-9213-09cc324b96ea req-78da498e-d194-4013-a245-017fd56bd90f service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] No waiting events found dispatching network-vif-plugged-f55964c8-6b58-4464-a352-e5145cc3c518 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:41:09 user nova-compute[75341]: WARNING nova.compute.manager [req-a8d9f125-daa0-4a25-9213-09cc324b96ea req-78da498e-d194-4013-a245-017fd56bd90f service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received unexpected event network-vif-plugged-f55964c8-6b58-4464-a352-e5145cc3c518 for instance with vm_state active and task_state None.
Nov 14 23:41:09 user nova-compute[75341]: DEBUG nova.compute.manager [req-a8d9f125-daa0-4a25-9213-09cc324b96ea req-78da498e-d194-4013-a245-017fd56bd90f service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received event network-vif-plugged-886562c6-312d-4a87-a34a-059f2ba3058a {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:41:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a8d9f125-daa0-4a25-9213-09cc324b96ea req-78da498e-d194-4013-a245-017fd56bd90f service nova] Acquiring lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:41:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a8d9f125-daa0-4a25-9213-09cc324b96ea req-78da498e-d194-4013-a245-017fd56bd90f service nova] Lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:41:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a8d9f125-daa0-4a25-9213-09cc324b96ea req-78da498e-d194-4013-a245-017fd56bd90f service nova] Lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:41:09 user nova-compute[75341]: DEBUG nova.compute.manager [req-a8d9f125-daa0-4a25-9213-09cc324b96ea req-78da498e-d194-4013-a245-017fd56bd90f service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] No waiting events found dispatching network-vif-plugged-886562c6-312d-4a87-a34a-059f2ba3058a {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:41:09 user nova-compute[75341]: WARNING nova.compute.manager [req-a8d9f125-daa0-4a25-9213-09cc324b96ea req-78da498e-d194-4013-a245-017fd56bd90f service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received unexpected event network-vif-plugged-886562c6-312d-4a87-a34a-059f2ba3058a for instance with vm_state active and task_state None.
Nov 14 23:41:09 user nova-compute[75341]: DEBUG nova.compute.manager [req-a8d9f125-daa0-4a25-9213-09cc324b96ea req-78da498e-d194-4013-a245-017fd56bd90f service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received event network-vif-plugged-886562c6-312d-4a87-a34a-059f2ba3058a {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:41:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a8d9f125-daa0-4a25-9213-09cc324b96ea req-78da498e-d194-4013-a245-017fd56bd90f service nova] Acquiring lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:41:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a8d9f125-daa0-4a25-9213-09cc324b96ea req-78da498e-d194-4013-a245-017fd56bd90f service nova] Lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:41:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a8d9f125-daa0-4a25-9213-09cc324b96ea req-78da498e-d194-4013-a245-017fd56bd90f service nova] Lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:41:09 user nova-compute[75341]: DEBUG nova.compute.manager [req-a8d9f125-daa0-4a25-9213-09cc324b96ea req-78da498e-d194-4013-a245-017fd56bd90f service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] No waiting events found dispatching network-vif-plugged-886562c6-312d-4a87-a34a-059f2ba3058a {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:41:09 user nova-compute[75341]: WARNING nova.compute.manager [req-a8d9f125-daa0-4a25-9213-09cc324b96ea req-78da498e-d194-4013-a245-017fd56bd90f service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received unexpected event network-vif-plugged-886562c6-312d-4a87-a34a-059f2ba3058a for instance with vm_state active and task_state None.
Nov 14 23:41:09 user nova-compute[75341]: DEBUG nova.compute.manager [req-a8d9f125-daa0-4a25-9213-09cc324b96ea req-78da498e-d194-4013-a245-017fd56bd90f service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received event network-vif-plugged-c314df64-6753-4691-a931-1ef8f31a8063 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:41:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a8d9f125-daa0-4a25-9213-09cc324b96ea req-78da498e-d194-4013-a245-017fd56bd90f service nova] Acquiring lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:41:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a8d9f125-daa0-4a25-9213-09cc324b96ea req-78da498e-d194-4013-a245-017fd56bd90f service nova] Lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:41:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a8d9f125-daa0-4a25-9213-09cc324b96ea req-78da498e-d194-4013-a245-017fd56bd90f service nova] Lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:41:09 user nova-compute[75341]: DEBUG nova.compute.manager [req-a8d9f125-daa0-4a25-9213-09cc324b96ea req-78da498e-d194-4013-a245-017fd56bd90f service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] No waiting events found dispatching network-vif-plugged-c314df64-6753-4691-a931-1ef8f31a8063 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:41:09 user nova-compute[75341]: WARNING nova.compute.manager [req-a8d9f125-daa0-4a25-9213-09cc324b96ea req-78da498e-d194-4013-a245-017fd56bd90f service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received unexpected event network-vif-plugged-c314df64-6753-4691-a931-1ef8f31a8063 for instance with vm_state active and task_state None.
Nov 14 23:41:09 user nova-compute[75341]: DEBUG nova.compute.manager [req-a8d9f125-daa0-4a25-9213-09cc324b96ea req-78da498e-d194-4013-a245-017fd56bd90f service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received event network-vif-plugged-c314df64-6753-4691-a931-1ef8f31a8063 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:41:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a8d9f125-daa0-4a25-9213-09cc324b96ea req-78da498e-d194-4013-a245-017fd56bd90f service nova] Acquiring lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:41:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a8d9f125-daa0-4a25-9213-09cc324b96ea req-78da498e-d194-4013-a245-017fd56bd90f service nova] Lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:41:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a8d9f125-daa0-4a25-9213-09cc324b96ea req-78da498e-d194-4013-a245-017fd56bd90f service nova] Lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:41:09 user nova-compute[75341]: DEBUG nova.compute.manager [req-a8d9f125-daa0-4a25-9213-09cc324b96ea req-78da498e-d194-4013-a245-017fd56bd90f service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] No waiting events found dispatching network-vif-plugged-c314df64-6753-4691-a931-1ef8f31a8063 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:41:09 user nova-compute[75341]: WARNING nova.compute.manager [req-a8d9f125-daa0-4a25-9213-09cc324b96ea req-78da498e-d194-4013-a245-017fd56bd90f service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received unexpected event network-vif-plugged-c314df64-6753-4691-a931-1ef8f31a8063 for instance with vm_state active and task_state None.
Nov 14 23:41:09 user nova-compute[75341]: DEBUG nova.compute.manager [req-a8d9f125-daa0-4a25-9213-09cc324b96ea req-78da498e-d194-4013-a245-017fd56bd90f service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received event network-vif-plugged-e1611672-3415-4fea-adb0-c7fe74ae6049 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:41:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a8d9f125-daa0-4a25-9213-09cc324b96ea req-78da498e-d194-4013-a245-017fd56bd90f service nova] Acquiring lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:41:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a8d9f125-daa0-4a25-9213-09cc324b96ea req-78da498e-d194-4013-a245-017fd56bd90f service nova] Lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:41:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a8d9f125-daa0-4a25-9213-09cc324b96ea req-78da498e-d194-4013-a245-017fd56bd90f service nova] Lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:41:09 user nova-compute[75341]: DEBUG nova.compute.manager [req-a8d9f125-daa0-4a25-9213-09cc324b96ea req-78da498e-d194-4013-a245-017fd56bd90f service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] No waiting events found dispatching network-vif-plugged-e1611672-3415-4fea-adb0-c7fe74ae6049 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:41:09 user nova-compute[75341]: WARNING nova.compute.manager [req-a8d9f125-daa0-4a25-9213-09cc324b96ea req-78da498e-d194-4013-a245-017fd56bd90f service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received unexpected event network-vif-plugged-e1611672-3415-4fea-adb0-c7fe74ae6049 for instance with vm_state active and task_state None.
Nov 14 23:41:09 user nova-compute[75341]: DEBUG nova.compute.manager [req-a8d9f125-daa0-4a25-9213-09cc324b96ea req-78da498e-d194-4013-a245-017fd56bd90f service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received event network-vif-plugged-e1611672-3415-4fea-adb0-c7fe74ae6049 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:41:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a8d9f125-daa0-4a25-9213-09cc324b96ea req-78da498e-d194-4013-a245-017fd56bd90f service nova] Acquiring lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:41:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a8d9f125-daa0-4a25-9213-09cc324b96ea req-78da498e-d194-4013-a245-017fd56bd90f service nova] Lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:41:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a8d9f125-daa0-4a25-9213-09cc324b96ea req-78da498e-d194-4013-a245-017fd56bd90f service nova] Lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:41:09 user nova-compute[75341]: DEBUG nova.compute.manager [req-a8d9f125-daa0-4a25-9213-09cc324b96ea req-78da498e-d194-4013-a245-017fd56bd90f service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] No waiting events found dispatching network-vif-plugged-e1611672-3415-4fea-adb0-c7fe74ae6049 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:41:09 user nova-compute[75341]: WARNING nova.compute.manager [req-a8d9f125-daa0-4a25-9213-09cc324b96ea req-78da498e-d194-4013-a245-017fd56bd90f service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received unexpected event network-vif-plugged-e1611672-3415-4fea-adb0-c7fe74ae6049 for instance with vm_state active and task_state None.
Nov 14 23:41:10 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:10 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:11 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:14 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Acquiring lock "0223a98e-e08f-4a0f-a707-3770c7a99b00" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:41:14 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Lock "0223a98e-e08f-4a0f-a707-3770c7a99b00" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:41:14 user nova-compute[75341]: DEBUG nova.compute.manager [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Starting instance... {{(pid=75341) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 23:41:14 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:41:14 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:41:14 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75341) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 23:41:14 user nova-compute[75341]: INFO nova.compute.claims [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Claim successful on node user
Nov 14 23:41:14 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:41:14 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:41:14 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.443s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:41:14 user nova-compute[75341]: DEBUG nova.compute.manager [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Start building networks asynchronously for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 23:41:14 user nova-compute[75341]: DEBUG nova.compute.manager [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Allocating IP information in the background. {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 23:41:14 user nova-compute[75341]: DEBUG nova.network.neutron [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] allocate_for_instance() {{(pid=75341) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 23:41:14 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 23:41:14 user nova-compute[75341]: DEBUG nova.compute.manager [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Start building block device mappings for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 23:41:14 user nova-compute[75341]: DEBUG nova.policy [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ee1ed14495f14c7e8bddfde73dbb3a29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9beb6cd1f92a46f4a37459b75b7ff1d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75341) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 23:41:14 user nova-compute[75341]: INFO nova.virt.block_device [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Booting with volume 3d4927ae-8df9-41e3-97e6-2eef950500f7 at /dev/vda
Nov 14 23:41:14 user nova-compute[75341]: DEBUG os_brick.utils [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:41:14 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:14 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:41:14 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0ed356-ceb6-4196-8e24-56c83ef68ff6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6d1cfca09c9\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:41:14 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:15 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:41:15 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[568cff4d-c85b-4e19-9172-ace063582f65]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:41:15 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:15 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:41:15 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc7389b3-8f64-4f4a-b6ef-af369fb0eeb9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:41:15 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[df79c16f-e628-4887-ab57-975092e6e3a4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:41:15 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Running cmd (subprocess): nvme version {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:15 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] 'nvme version' failed. Not Retrying. {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:41:15 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] nvme not present on system {{(pid=75341) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 23:41:15 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:15 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:41:15 user nova-compute[75341]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 23:41:15 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd626a1-8bc2-4428-afb6-0ae1631a5ed9]: (4, '') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:41:15 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75341) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 23:41:15 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 23:41:15 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] LIGHTOS: no hostnqn found. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 23:41:15 user nova-compute[75341]: DEBUG os_brick.utils [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6d1cfca09c9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:41:15 user nova-compute[75341]: DEBUG nova.virt.block_device [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Updating existing volume attachment record: f0b42fbb-5309-4779-bbd3-cd00b992bd43 {{(pid=75341) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 23:41:15 user nova-compute[75341]: DEBUG nova.network.neutron [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Successfully created port: dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e {{(pid=75341) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 23:41:15 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Acquiring lock "d8d3b42b-11b5-477a-afb1-80a1786b693b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:41:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Lock "d8d3b42b-11b5-477a-afb1-80a1786b693b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:41:16 user nova-compute[75341]: DEBUG nova.network.neutron [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Successfully updated port: dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e {{(pid=75341) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 23:41:16 user nova-compute[75341]: DEBUG nova.compute.manager [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Starting instance... {{(pid=75341) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 23:41:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Acquiring lock "refresh_cache-0223a98e-e08f-4a0f-a707-3770c7a99b00" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:41:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Acquired lock "refresh_cache-0223a98e-e08f-4a0f-a707-3770c7a99b00" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:41:16 user nova-compute[75341]: DEBUG nova.network.neutron [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 23:41:16 user nova-compute[75341]: DEBUG nova.network.neutron [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Instance cache missing network info. {{(pid=75341) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 23:41:16 user nova-compute[75341]: DEBUG nova.compute.manager [req-27c454b1-7884-4795-ace8-1065783355e4 req-1e2513f3-14a0-4fc8-9484-06cd777a4cf7 service nova] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Received event network-changed-dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:41:16 user nova-compute[75341]: DEBUG nova.compute.manager [req-27c454b1-7884-4795-ace8-1065783355e4 req-1e2513f3-14a0-4fc8-9484-06cd777a4cf7 service nova] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Refreshing instance network info cache due to event network-changed-dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:41:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-27c454b1-7884-4795-ace8-1065783355e4 req-1e2513f3-14a0-4fc8-9484-06cd777a4cf7 service nova] Acquiring lock "refresh_cache-0223a98e-e08f-4a0f-a707-3770c7a99b00" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:41:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:41:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:41:16 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75341) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 23:41:16 user nova-compute[75341]: INFO nova.compute.claims [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Claim successful on node user
Nov 14 23:41:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:16 user nova-compute[75341]: DEBUG nova.network.neutron [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Updating instance_info_cache with network_info: [{"id": "dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e", "address": "fa:16:3e:19:cd:2f", "network": {"id": "eb5b5fbb-4747-49e9-a830-c9ab1c4d4af7", "bridge": "br-int", "label": "tempest-TestShelveInstance-261763164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9beb6cd1f92a46f4a37459b75b7ff1d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbe5cbca-08", "ovs_interfaceid": "dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:41:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Releasing lock "refresh_cache-0223a98e-e08f-4a0f-a707-3770c7a99b00" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:41:16 user nova-compute[75341]: DEBUG nova.compute.manager [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Instance network_info: |[{"id": "dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e", "address": "fa:16:3e:19:cd:2f", "network": {"id": "eb5b5fbb-4747-49e9-a830-c9ab1c4d4af7", "bridge": "br-int", "label": "tempest-TestShelveInstance-261763164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9beb6cd1f92a46f4a37459b75b7ff1d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbe5cbca-08", "ovs_interfaceid": "dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 23:41:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-27c454b1-7884-4795-ace8-1065783355e4 req-1e2513f3-14a0-4fc8-9484-06cd777a4cf7 service nova] Acquired lock "refresh_cache-0223a98e-e08f-4a0f-a707-3770c7a99b00" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:41:16 user nova-compute[75341]: DEBUG nova.network.neutron [req-27c454b1-7884-4795-ace8-1065783355e4 req-1e2513f3-14a0-4fc8-9484-06cd777a4cf7 service nova] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Refreshing network info cache for port dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:41:17 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:41:17 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:41:17 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.538s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:41:17 user nova-compute[75341]: DEBUG nova.compute.manager [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Start building networks asynchronously for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 23:41:17 user nova-compute[75341]: DEBUG nova.compute.manager [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Allocating IP information in the background. {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 23:41:17 user nova-compute[75341]: DEBUG nova.network.neutron [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] allocate_for_instance() {{(pid=75341) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 23:41:17 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 23:41:17 user nova-compute[75341]: DEBUG nova.compute.manager [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Start building block device mappings for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 23:41:17 user nova-compute[75341]: DEBUG nova.network.neutron [req-27c454b1-7884-4795-ace8-1065783355e4 req-1e2513f3-14a0-4fc8-9484-06cd777a4cf7 service nova] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Updated VIF entry in instance network info cache for port dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:41:17 user nova-compute[75341]: DEBUG nova.network.neutron [req-27c454b1-7884-4795-ace8-1065783355e4 req-1e2513f3-14a0-4fc8-9484-06cd777a4cf7 service nova] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Updating instance_info_cache with network_info: [{"id": "dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e", "address": "fa:16:3e:19:cd:2f", "network": {"id": "eb5b5fbb-4747-49e9-a830-c9ab1c4d4af7", "bridge": "br-int", "label": "tempest-TestShelveInstance-261763164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9beb6cd1f92a46f4a37459b75b7ff1d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbe5cbca-08", "ovs_interfaceid": "dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:41:17 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-27c454b1-7884-4795-ace8-1065783355e4 req-1e2513f3-14a0-4fc8-9484-06cd777a4cf7 service nova] Releasing lock "refresh_cache-0223a98e-e08f-4a0f-a707-3770c7a99b00" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:41:17 user nova-compute[75341]: DEBUG nova.policy [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '092cd31b946d422995dc1afedf49ba51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bff46be1f8b45bc95a7924ef327bf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75341) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 23:41:17 user nova-compute[75341]: DEBUG nova.compute.manager [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Start spawning the instance on the hypervisor. {{(pid=75341) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 23:41:17 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Creating instance directory {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 23:41:17 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Creating image(s)
Nov 14 23:41:17 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Acquiring lock "/opt/stack/data/nova/instances/d8d3b42b-11b5-477a-afb1-80a1786b693b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:41:17 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Lock "/opt/stack/data/nova/instances/d8d3b42b-11b5-477a-afb1-80a1786b693b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:41:17 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Lock "/opt/stack/data/nova/instances/d8d3b42b-11b5-477a-afb1-80a1786b693b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:41:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.173s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:41:17 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Acquiring lock "4754efee9a6d73d3647f2add2cfe86c291949740" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:41:17 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:41:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.189s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:41:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/d8d3b42b-11b5-477a-afb1-80a1786b693b/disk 1073741824 {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/d8d3b42b-11b5-477a-afb1-80a1786b693b/disk 1073741824" returned: 0 in 0.050s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:41:17 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:41:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:17 user nova-compute[75341]: DEBUG nova.network.neutron [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Successfully created port: 9032b49d-13a3-4049-bada-48eb30ea932a {{(pid=75341) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 23:41:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.184s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:41:17 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d8d3b42b-11b5-477a-afb1-80a1786b693b/disk. size=1073741824 {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 23:41:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8d3b42b-11b5-477a-afb1-80a1786b693b/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:18 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8d3b42b-11b5-477a-afb1-80a1786b693b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:41:18 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Cannot resize image /opt/stack/data/nova/instances/d8d3b42b-11b5-477a-afb1-80a1786b693b/disk to a smaller size. {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 23:41:18 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Created local disks {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 23:41:18 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Ensure instance console log exists: /opt/stack/data/nova/instances/d8d3b42b-11b5-477a-afb1-80a1786b693b/console.log {{(pid=75341) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 23:41:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:41:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:41:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:41:18 user nova-compute[75341]: DEBUG nova.network.neutron [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Successfully updated port: 9032b49d-13a3-4049-bada-48eb30ea932a {{(pid=75341) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 23:41:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Acquiring lock "refresh_cache-d8d3b42b-11b5-477a-afb1-80a1786b693b" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:41:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Acquired lock "refresh_cache-d8d3b42b-11b5-477a-afb1-80a1786b693b" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:41:18 user nova-compute[75341]: DEBUG nova.network.neutron [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 23:41:18 user nova-compute[75341]: DEBUG nova.compute.manager [req-267c6eb0-cf2e-4442-98ae-fa1f106f0575 req-4180b125-6ae2-4cf8-a9a6-4ec3d1fb3a45 service nova] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Received event network-changed-9032b49d-13a3-4049-bada-48eb30ea932a {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:41:18 user nova-compute[75341]: DEBUG nova.compute.manager [req-267c6eb0-cf2e-4442-98ae-fa1f106f0575 req-4180b125-6ae2-4cf8-a9a6-4ec3d1fb3a45 service nova] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Refreshing instance network info cache due to event network-changed-9032b49d-13a3-4049-bada-48eb30ea932a. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:41:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-267c6eb0-cf2e-4442-98ae-fa1f106f0575 req-4180b125-6ae2-4cf8-a9a6-4ec3d1fb3a45 service nova] Acquiring lock "refresh_cache-d8d3b42b-11b5-477a-afb1-80a1786b693b" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:41:18 user nova-compute[75341]: DEBUG nova.network.neutron [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Instance cache missing network info. {{(pid=75341) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 23:41:18 user nova-compute[75341]: DEBUG nova.network.neutron [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Updating instance_info_cache with network_info: [{"id": "9032b49d-13a3-4049-bada-48eb30ea932a", "address": "fa:16:3e:12:b9:0d", "network": {"id": "3a83bb9c-6349-46b4-a0ee-a1bd8530b4df", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-310072341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bff46be1f8b45bc95a7924ef327bf46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9032b49d-13", "ovs_interfaceid": "9032b49d-13a3-4049-bada-48eb30ea932a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:41:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Releasing lock "refresh_cache-d8d3b42b-11b5-477a-afb1-80a1786b693b" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:41:18 user nova-compute[75341]: DEBUG nova.compute.manager [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Instance network_info: |[{"id": "9032b49d-13a3-4049-bada-48eb30ea932a", "address": "fa:16:3e:12:b9:0d", "network": {"id": "3a83bb9c-6349-46b4-a0ee-a1bd8530b4df", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-310072341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bff46be1f8b45bc95a7924ef327bf46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9032b49d-13", "ovs_interfaceid": "9032b49d-13a3-4049-bada-48eb30ea932a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 23:41:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-267c6eb0-cf2e-4442-98ae-fa1f106f0575 req-4180b125-6ae2-4cf8-a9a6-4ec3d1fb3a45 service nova] Acquired lock "refresh_cache-d8d3b42b-11b5-477a-afb1-80a1786b693b" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:41:18 user nova-compute[75341]: DEBUG nova.network.neutron [req-267c6eb0-cf2e-4442-98ae-fa1f106f0575 req-4180b125-6ae2-4cf8-a9a6-4ec3d1fb3a45 service nova] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Refreshing network info cache for port 9032b49d-13a3-4049-bada-48eb30ea932a {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:41:18 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Start _get_guest_xml network_info=[{"id": "9032b49d-13a3-4049-bada-48eb30ea932a", "address": "fa:16:3e:12:b9:0d", "network": {"id": "3a83bb9c-6349-46b4-a0ee-a1bd8530b4df", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-310072341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bff46be1f8b45bc95a7924ef327bf46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9032b49d-13", "ovs_interfaceid": "9032b49d-13a3-4049-bada-48eb30ea932a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encrypted': False, 'image_id': 'e46abb82-b810-490e-a8a1-ccdc5fa1a796'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 23:41:18 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:41:18 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:41:18 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 23:41:18 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 23:41:18 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 23:41:18 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 23:41:18 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 23:41:18 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 23:41:18 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 23:41:18 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 23:41:18 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 23:41:18 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 23:41:18 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 23:41:18 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 23:41:18 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 23:41:18 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 23:41:18 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 23:41:18 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 23:41:18 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:41:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1435042738',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1435042738',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1435042',id=12,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB1F00Ytu5Y0L/OJ1o5i4l+4O3ClnPU6hzM4C8RcLmSekHy346t23JOvPGwNdgnmAmapvF7xbChAIvUz9DgqpjY8vcPLOmqgIm/ZfhZQUqpU1q0BxQy58cVXtE+EysBAiQ==',key_name='tempest-keypair-45478595',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bff46be1f8b45bc95a7924ef327bf46',ramdisk_id='',reservation_id='r-b96bltmj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1020299484',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:41:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='092cd31b946d422995dc1afedf49ba51',uuid=d8d3b42b-11b5-477a-afb1-80a1786b693b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9032b49d-13a3-4049-bada-48eb30ea932a", "address": "fa:16:3e:12:b9:0d", "network": {"id": "3a83bb9c-6349-46b4-a0ee-a1bd8530b4df", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-310072341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bff46be1f8b45bc95a7924ef327bf46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9032b49d-13", "ovs_interfaceid": "9032b49d-13a3-4049-bada-48eb30ea932a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:41:18 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Converting VIF {"id": "9032b49d-13a3-4049-bada-48eb30ea932a", "address": "fa:16:3e:12:b9:0d", "network": {"id": "3a83bb9c-6349-46b4-a0ee-a1bd8530b4df", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-310072341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bff46be1f8b45bc95a7924ef327bf46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9032b49d-13", "ovs_interfaceid": "9032b49d-13a3-4049-bada-48eb30ea932a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:41:18 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:b9:0d,bridge_name='br-int',has_traffic_filtering=True,id=9032b49d-13a3-4049-bada-48eb30ea932a,network=Network(3a83bb9c-6349-46b4-a0ee-a1bd8530b4df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9032b49d-13') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:41:18 user nova-compute[75341]: DEBUG nova.objects.instance [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Lazy-loading 'pci_devices' on Instance uuid d8d3b42b-11b5-477a-afb1-80a1786b693b {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:41:18 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] End _get_guest_xml xml=<domain type="kvm">
Nov 14 23:41:18 user nova-compute[75341]:   <uuid>d8d3b42b-11b5-477a-afb1-80a1786b693b</uuid>
Nov 14 23:41:18 user nova-compute[75341]:   <name>instance-0000000c</name>
Nov 14 23:41:18 user nova-compute[75341]:   <memory>524288</memory>
Nov 14 23:41:18 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 14 23:41:18 user nova-compute[75341]:   <metadata>
Nov 14 23:41:18 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 23:41:18 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 14 23:41:18 user nova-compute[75341]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1435042738</nova:name>
Nov 14 23:41:18 user nova-compute[75341]:       <nova:creationTime>2023-11-14 23:41:18</nova:creationTime>
Nov 14 23:41:18 user nova-compute[75341]:       <nova:flavor name="m1.tiny">
Nov 14 23:41:18 user nova-compute[75341]:         <nova:memory>512</nova:memory>
Nov 14 23:41:18 user nova-compute[75341]:         <nova:disk>1</nova:disk>
Nov 14 23:41:18 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 14 23:41:18 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 23:41:18 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 14 23:41:18 user nova-compute[75341]:       </nova:flavor>
Nov 14 23:41:18 user nova-compute[75341]:       <nova:owner>
Nov 14 23:41:18 user nova-compute[75341]:         <nova:user uuid="092cd31b946d422995dc1afedf49ba51">tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member</nova:user>
Nov 14 23:41:18 user nova-compute[75341]:         <nova:project uuid="6bff46be1f8b45bc95a7924ef327bf46">tempest-TestServerVolumeAttachScenarioOldVersion-1020299484</nova:project>
Nov 14 23:41:18 user nova-compute[75341]:       </nova:owner>
Nov 14 23:41:18 user nova-compute[75341]:       <nova:root type="image" uuid="e46abb82-b810-490e-a8a1-ccdc5fa1a796"/>
Nov 14 23:41:18 user nova-compute[75341]:       <nova:ports>
Nov 14 23:41:18 user nova-compute[75341]:         <nova:port uuid="9032b49d-13a3-4049-bada-48eb30ea932a">
Nov 14 23:41:18 user nova-compute[75341]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 23:41:18 user nova-compute[75341]:         </nova:port>
Nov 14 23:41:18 user nova-compute[75341]:       </nova:ports>
Nov 14 23:41:18 user nova-compute[75341]:     </nova:instance>
Nov 14 23:41:18 user nova-compute[75341]:   </metadata>
Nov 14 23:41:18 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 14 23:41:18 user nova-compute[75341]:     <system>
Nov 14 23:41:18 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 23:41:18 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 14 23:41:18 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 14 23:41:18 user nova-compute[75341]:       <entry name="serial">d8d3b42b-11b5-477a-afb1-80a1786b693b</entry>
Nov 14 23:41:18 user nova-compute[75341]:       <entry name="uuid">d8d3b42b-11b5-477a-afb1-80a1786b693b</entry>
Nov 14 23:41:18 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 14 23:41:18 user nova-compute[75341]:     </system>
Nov 14 23:41:18 user nova-compute[75341]:   </sysinfo>
Nov 14 23:41:18 user nova-compute[75341]:   <os>
Nov 14 23:41:18 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 23:41:18 user nova-compute[75341]:     <boot dev="hd"/>
Nov 14 23:41:18 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 14 23:41:18 user nova-compute[75341]:   </os>
Nov 14 23:41:18 user nova-compute[75341]:   <features>
Nov 14 23:41:18 user nova-compute[75341]:     <acpi/>
Nov 14 23:41:18 user nova-compute[75341]:     <apic/>
Nov 14 23:41:18 user nova-compute[75341]:     <vmcoreinfo/>
Nov 14 23:41:18 user nova-compute[75341]:   </features>
Nov 14 23:41:18 user nova-compute[75341]:   <clock offset="utc">
Nov 14 23:41:18 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 23:41:18 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 23:41:18 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 14 23:41:18 user nova-compute[75341]:   </clock>
Nov 14 23:41:18 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 14 23:41:18 user nova-compute[75341]:     <model>Nehalem</model>
Nov 14 23:41:18 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 23:41:18 user nova-compute[75341]:   </cpu>
Nov 14 23:41:18 user nova-compute[75341]:   <devices>
Nov 14 23:41:18 user nova-compute[75341]:     <disk type="file" device="disk">
Nov 14 23:41:18 user nova-compute[75341]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 23:41:18 user nova-compute[75341]:       <source file="/opt/stack/data/nova/instances/d8d3b42b-11b5-477a-afb1-80a1786b693b/disk"/>
Nov 14 23:41:18 user nova-compute[75341]:       <target dev="vda" bus="virtio"/>
Nov 14 23:41:18 user nova-compute[75341]:     </disk>
Nov 14 23:41:18 user nova-compute[75341]:     <interface type="ethernet">
Nov 14 23:41:18 user nova-compute[75341]:       <mac address="fa:16:3e:12:b9:0d"/>
Nov 14 23:41:18 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:41:18 user nova-compute[75341]:       <mtu size="1442"/>
Nov 14 23:41:18 user nova-compute[75341]:       <target dev="tap9032b49d-13"/>
Nov 14 23:41:18 user nova-compute[75341]:     </interface>
Nov 14 23:41:18 user nova-compute[75341]:     <serial type="pty">
Nov 14 23:41:18 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/d8d3b42b-11b5-477a-afb1-80a1786b693b/console.log" append="off"/>
Nov 14 23:41:18 user nova-compute[75341]:     </serial>
Nov 14 23:41:18 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 23:41:18 user nova-compute[75341]:     <video>
Nov 14 23:41:18 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:41:18 user nova-compute[75341]:     </video>
Nov 14 23:41:18 user nova-compute[75341]:     <rng model="virtio">
Nov 14 23:41:18 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 14 23:41:18 user nova-compute[75341]:     </rng>
Nov 14 23:41:18 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 14 23:41:18 user nova-compute[75341]:     <memballoon model="virtio">
Nov 14 23:41:18 user nova-compute[75341]:       <stats period="10"/>
Nov 14 23:41:18 user nova-compute[75341]:     </memballoon>
Nov 14 23:41:18 user nova-compute[75341]:   </devices>
Nov 14 23:41:18 user nova-compute[75341]: </domain>
Nov 14 23:41:18 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 23:41:18 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:41:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1435042738',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1435042738',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1435042',id=12,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB1F00Ytu5Y0L/OJ1o5i4l+4O3ClnPU6hzM4C8RcLmSekHy346t23JOvPGwNdgnmAmapvF7xbChAIvUz9DgqpjY8vcPLOmqgIm/ZfhZQUqpU1q0BxQy58cVXtE+EysBAiQ==',key_name='tempest-keypair-45478595',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bff46be1f8b45bc95a7924ef327bf46',ramdisk_id='',reservation_id='r-b96bltmj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1020299484',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:41:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='092cd31b946d422995dc1afedf49ba51',uuid=d8d3b42b-11b5-477a-afb1-80a1786b693b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9032b49d-13a3-4049-bada-48eb30ea932a", "address": "fa:16:3e:12:b9:0d", "network": {"id": "3a83bb9c-6349-46b4-a0ee-a1bd8530b4df", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-310072341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bff46be1f8b45bc95a7924ef327bf46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9032b49d-13", "ovs_interfaceid": "9032b49d-13a3-4049-bada-48eb30ea932a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 23:41:18 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Converting VIF {"id": "9032b49d-13a3-4049-bada-48eb30ea932a", "address": "fa:16:3e:12:b9:0d", "network": {"id": "3a83bb9c-6349-46b4-a0ee-a1bd8530b4df", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-310072341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bff46be1f8b45bc95a7924ef327bf46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9032b49d-13", "ovs_interfaceid": "9032b49d-13a3-4049-bada-48eb30ea932a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:41:18 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:b9:0d,bridge_name='br-int',has_traffic_filtering=True,id=9032b49d-13a3-4049-bada-48eb30ea932a,network=Network(3a83bb9c-6349-46b4-a0ee-a1bd8530b4df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9032b49d-13') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:41:18 user nova-compute[75341]: DEBUG os_vif [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:b9:0d,bridge_name='br-int',has_traffic_filtering=True,id=9032b49d-13a3-4049-bada-48eb30ea932a,network=Network(3a83bb9c-6349-46b4-a0ee-a1bd8530b4df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9032b49d-13') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 23:41:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:41:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 23:41:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7c410ac6-0146-5691-8239-0ae25d8288df', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:41:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:41:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9032b49d-13, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:41:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9032b49d-13, col_values=(('qos', UUID('523bbb0e-2c88-4427-8afb-0a96ee4cc11b')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:41:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9032b49d-13, col_values=(('external_ids', {'iface-id': '9032b49d-13a3-4049-bada-48eb30ea932a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:b9:0d', 'vm-uuid': 'd8d3b42b-11b5-477a-afb1-80a1786b693b'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:41:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:41:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:18 user nova-compute[75341]: INFO os_vif [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:b9:0d,bridge_name='br-int',has_traffic_filtering=True,id=9032b49d-13a3-4049-bada-48eb30ea932a,network=Network(3a83bb9c-6349-46b4-a0ee-a1bd8530b4df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9032b49d-13')
Nov 14 23:41:19 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:41:19 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] No VIF found with MAC fa:16:3e:12:b9:0d, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:41:19 user nova-compute[75341]: DEBUG nova.network.neutron [req-267c6eb0-cf2e-4442-98ae-fa1f106f0575 req-4180b125-6ae2-4cf8-a9a6-4ec3d1fb3a45 service nova] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Updated VIF entry in instance network info cache for port 9032b49d-13a3-4049-bada-48eb30ea932a. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:41:19 user nova-compute[75341]: DEBUG nova.network.neutron [req-267c6eb0-cf2e-4442-98ae-fa1f106f0575 req-4180b125-6ae2-4cf8-a9a6-4ec3d1fb3a45 service nova] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Updating instance_info_cache with network_info: [{"id": "9032b49d-13a3-4049-bada-48eb30ea932a", "address": "fa:16:3e:12:b9:0d", "network": {"id": "3a83bb9c-6349-46b4-a0ee-a1bd8530b4df", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-310072341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bff46be1f8b45bc95a7924ef327bf46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9032b49d-13", "ovs_interfaceid": "9032b49d-13a3-4049-bada-48eb30ea932a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:41:19 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-267c6eb0-cf2e-4442-98ae-fa1f106f0575 req-4180b125-6ae2-4cf8-a9a6-4ec3d1fb3a45 service nova] Releasing lock "refresh_cache-d8d3b42b-11b5-477a-afb1-80a1786b693b" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:41:19 user nova-compute[75341]: DEBUG nova.compute.manager [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Start spawning the instance on the hypervisor. {{(pid=75341) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 23:41:19 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Creating instance directory {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 23:41:19 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Creating image(s)
Nov 14 23:41:19 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Did not create local disks {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 23:41:19 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Ensure instance console log exists: /opt/stack/data/nova/instances/0223a98e-e08f-4a0f-a707-3770c7a99b00/console.log {{(pid=75341) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 23:41:19 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:41:19 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:41:19 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:41:19 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Start _get_guest_xml network_info=[{"id": "dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e", "address": "fa:16:3e:19:cd:2f", "network": {"id": "eb5b5fbb-4747-49e9-a830-c9ab1c4d4af7", "bridge": "br-int", "label": "tempest-TestShelveInstance-261763164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9beb6cd1f92a46f4a37459b75b7ff1d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbe5cbca-08", "ovs_interfaceid": "dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'f0b42fbb-5309-4779-bbd3-cd00b992bd43', 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fjgHolcY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0223a98e-e08f-4a0f-a707-3770c7a99b00', 'attached_at': '', 'detached_at': '', 'volume_id': '3d4927ae-8df9-41e3-97e6-2eef950500f7', 'serial': '3d4927ae-8df9-41e3-97e6-2eef950500f7'}, 'delete_on_termination': True, 'volume_type': None} {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 23:41:19 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:41:19 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:41:19 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 23:41:19 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 23:41:19 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 23:41:19 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 23:41:19 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 23:41:19 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 23:41:19 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 23:41:19 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 23:41:19 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 23:41:19 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 23:41:19 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 23:41:19 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 23:41:19 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 23:41:19 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 23:41:19 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 23:41:19 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 23:41:20 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Calling os-brick to attach iSCSI Volume {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 23:41:20 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fjgHolcY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:41:20 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:41:20 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:41:20 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:41:20 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:41:20 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:41:20 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:41:20 user nova-compute[75341]: INFO os_brick.initiator.connectors.iscsi [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 23:41:20 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 -p 172.16.0.220:3260 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:20 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:41:20 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47c7d65-9b50-480d-b4cb-c97c287426e6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:41:20 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 23:41:20 user nova-compute[75341]:  {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:41:20 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:20 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:41:20 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[57fa8e20-d2f3-48df-b6f5-bbae4b12be05]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7] added\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:41:20 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7] added
Nov 14 23:41:20 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:41:20 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:20 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:41:20 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd90b1c-6bec-46cf-aefb-829dada49f07]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:41:20 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:41:20 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:20 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:41:20 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[96cf5c28-3a8b-46c9-adba-326c354b4343]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:41:20 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:41:20 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fjgHolcY {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:20 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fjgHolcY" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:41:20 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe804c2a-fbdb-4b70-a4f0-bf8c2605cdd3]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:41:20 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fjgHolcY'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:41:20 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:20 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:41:20 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3ec1bb-7e0e-481c-915f-d87257e7a59d]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:41:20 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:41:20 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:20 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:41:20 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef9a167-bd4e-44a0-b59d-5ee55df5a194]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:41:20 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)
Nov 14 23:41:20 user nova-compute[75341]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)
Nov 14 23:41:20 user nova-compute[75341]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)
Nov 14 23:41:20 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:41:20 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)
Nov 14 23:41:20 user nova-compute[75341]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)
Nov 14 23:41:20 user nova-compute[75341]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)
Nov 14 23:41:20 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:41:20 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 -p 172.16.0.220:3260 --login {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:20 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:41:20 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2330605-72d3-4e37-916b-9f19fc4acb13]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:41:20 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7, portal: 172.16.0.220,3260]
Nov 14 23:41:20 user nova-compute[75341]: Login to [iface: default, target: iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7, portal: 172.16.0.220,3260] successful.
Nov 14 23:41:20 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:41:20 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:20 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:41:20 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2c3586-43b7-4956-8164-7c8f39e1ca5b]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:41:20 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:41:20 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:20 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:41:20 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78da941-90fc-4ae7-947f-a6263a5a2ea3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:41:20 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)
Nov 14 23:41:20 user nova-compute[75341]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)
Nov 14 23:41:20 user nova-compute[75341]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)
Nov 14 23:41:20 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:41:20 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:41:20 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)
Nov 14 23:41:20 user nova-compute[75341]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)
Nov 14 23:41:20 user nova-compute[75341]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)
Nov 14 23:41:20 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:41:20 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:41:20 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:41:20 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Connected to 172.16.0.220:3260 {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 23:41:20 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=75341) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 23:41:20 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75341) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 23:41:20 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:20 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:41:20 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec301b0c-1f09-4303-962d-b1cd48200bf5]: (4, ('- - 0', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:41:20 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 23:41:20 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fjgHolcY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 23:41:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:20 user nova-compute[75341]: DEBUG nova.compute.manager [req-40bb6890-2529-4d14-b646-da171440dab6 req-36960f6e-c361-4eff-9051-614c059e3554 service nova] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Received event network-vif-plugged-9032b49d-13a3-4049-bada-48eb30ea932a {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:41:20 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-40bb6890-2529-4d14-b646-da171440dab6 req-36960f6e-c361-4eff-9051-614c059e3554 service nova] Acquiring lock "d8d3b42b-11b5-477a-afb1-80a1786b693b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:41:20 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-40bb6890-2529-4d14-b646-da171440dab6 req-36960f6e-c361-4eff-9051-614c059e3554 service nova] Lock "d8d3b42b-11b5-477a-afb1-80a1786b693b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:41:20 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-40bb6890-2529-4d14-b646-da171440dab6 req-36960f6e-c361-4eff-9051-614c059e3554 service nova] Lock "d8d3b42b-11b5-477a-afb1-80a1786b693b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:41:20 user nova-compute[75341]: DEBUG nova.compute.manager [req-40bb6890-2529-4d14-b646-da171440dab6 req-36960f6e-c361-4eff-9051-614c059e3554 service nova] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] No waiting events found dispatching network-vif-plugged-9032b49d-13a3-4049-bada-48eb30ea932a {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:41:20 user nova-compute[75341]: WARNING nova.compute.manager [req-40bb6890-2529-4d14-b646-da171440dab6 req-36960f6e-c361-4eff-9051-614c059e3554 service nova] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Received unexpected event network-vif-plugged-9032b49d-13a3-4049-bada-48eb30ea932a for instance with vm_state building and task_state spawning.
Nov 14 23:41:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:21 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:21 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:21 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:21 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:41:21 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23661616137303062', 'path': '/dev/sde'} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:41:21 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661616137303062', 'path': '/dev/sde'} {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 23:41:21 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:41:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-745577741',display_name='tempest-TestShelveInstance-server-745577741',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-745577741',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCC/fpuT6kOHQaV9HZ2f/yPGx85iWhp/2ZbngnYaFTTZ0up9RjcbLjQe5XMoVflV9AQ+bAmt83ts1O90HoYfCtqnb8fvFlLRjy7CrBRwtOEIR115LUYMUcjq8rDRKo0GlA==',key_name='tempest-TestShelveInstance-272108759',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9beb6cd1f92a46f4a37459b75b7ff1d4',ramdisk_id='',reservation_id='r-w770xi1a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1537108126',owner_user_name='tempest-TestShelveInstance-1537108126-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:41:15Z,user_data=None,user_id='ee1ed14495f14c7e8bddfde73dbb3a29',uuid=0223a98e-e08f-4a0f-a707-3770c7a99b00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e", "address": "fa:16:3e:19:cd:2f", "network": {"id": "eb5b5fbb-4747-49e9-a830-c9ab1c4d4af7", "bridge": "br-int", "label": "tempest-TestShelveInstance-261763164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9beb6cd1f92a46f4a37459b75b7ff1d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbe5cbca-08", "ovs_interfaceid": "dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:41:21 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Converting VIF {"id": "dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e", "address": "fa:16:3e:19:cd:2f", "network": {"id": "eb5b5fbb-4747-49e9-a830-c9ab1c4d4af7", "bridge": "br-int", "label": "tempest-TestShelveInstance-261763164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9beb6cd1f92a46f4a37459b75b7ff1d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbe5cbca-08", "ovs_interfaceid": "dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:41:21 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:cd:2f,bridge_name='br-int',has_traffic_filtering=True,id=dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e,network=Network(eb5b5fbb-4747-49e9-a830-c9ab1c4d4af7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbe5cbca-08') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:41:21 user nova-compute[75341]: DEBUG nova.objects.instance [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Lazy-loading 'pci_devices' on Instance uuid 0223a98e-e08f-4a0f-a707-3770c7a99b00 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:41:21 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] End _get_guest_xml xml=<domain type="kvm">
Nov 14 23:41:21 user nova-compute[75341]:   <uuid>0223a98e-e08f-4a0f-a707-3770c7a99b00</uuid>
Nov 14 23:41:21 user nova-compute[75341]:   <name>instance-0000000b</name>
Nov 14 23:41:21 user nova-compute[75341]:   <memory>524288</memory>
Nov 14 23:41:21 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 14 23:41:21 user nova-compute[75341]:   <metadata>
Nov 14 23:41:21 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 23:41:21 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 14 23:41:21 user nova-compute[75341]:       <nova:name>tempest-TestShelveInstance-server-745577741</nova:name>
Nov 14 23:41:21 user nova-compute[75341]:       <nova:creationTime>2023-11-14 23:41:19</nova:creationTime>
Nov 14 23:41:21 user nova-compute[75341]:       <nova:flavor name="m1.tiny">
Nov 14 23:41:21 user nova-compute[75341]:         <nova:memory>512</nova:memory>
Nov 14 23:41:21 user nova-compute[75341]:         <nova:disk>1</nova:disk>
Nov 14 23:41:21 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 14 23:41:21 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 23:41:21 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 14 23:41:21 user nova-compute[75341]:       </nova:flavor>
Nov 14 23:41:21 user nova-compute[75341]:       <nova:owner>
Nov 14 23:41:21 user nova-compute[75341]:         <nova:user uuid="ee1ed14495f14c7e8bddfde73dbb3a29">tempest-TestShelveInstance-1537108126-project-member</nova:user>
Nov 14 23:41:21 user nova-compute[75341]:         <nova:project uuid="9beb6cd1f92a46f4a37459b75b7ff1d4">tempest-TestShelveInstance-1537108126</nova:project>
Nov 14 23:41:21 user nova-compute[75341]:       </nova:owner>
Nov 14 23:41:21 user nova-compute[75341]:       <nova:ports>
Nov 14 23:41:21 user nova-compute[75341]:         <nova:port uuid="dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e">
Nov 14 23:41:21 user nova-compute[75341]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 23:41:21 user nova-compute[75341]:         </nova:port>
Nov 14 23:41:21 user nova-compute[75341]:       </nova:ports>
Nov 14 23:41:21 user nova-compute[75341]:     </nova:instance>
Nov 14 23:41:21 user nova-compute[75341]:   </metadata>
Nov 14 23:41:21 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 14 23:41:21 user nova-compute[75341]:     <system>
Nov 14 23:41:21 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 23:41:21 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 14 23:41:21 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 14 23:41:21 user nova-compute[75341]:       <entry name="serial">0223a98e-e08f-4a0f-a707-3770c7a99b00</entry>
Nov 14 23:41:21 user nova-compute[75341]:       <entry name="uuid">0223a98e-e08f-4a0f-a707-3770c7a99b00</entry>
Nov 14 23:41:21 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 14 23:41:21 user nova-compute[75341]:     </system>
Nov 14 23:41:21 user nova-compute[75341]:   </sysinfo>
Nov 14 23:41:21 user nova-compute[75341]:   <os>
Nov 14 23:41:21 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 23:41:21 user nova-compute[75341]:     <boot dev="hd"/>
Nov 14 23:41:21 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 14 23:41:21 user nova-compute[75341]:   </os>
Nov 14 23:41:21 user nova-compute[75341]:   <features>
Nov 14 23:41:21 user nova-compute[75341]:     <acpi/>
Nov 14 23:41:21 user nova-compute[75341]:     <apic/>
Nov 14 23:41:21 user nova-compute[75341]:     <vmcoreinfo/>
Nov 14 23:41:21 user nova-compute[75341]:   </features>
Nov 14 23:41:21 user nova-compute[75341]:   <clock offset="utc">
Nov 14 23:41:21 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 23:41:21 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 23:41:21 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 14 23:41:21 user nova-compute[75341]:   </clock>
Nov 14 23:41:21 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 14 23:41:21 user nova-compute[75341]:     <model>Nehalem</model>
Nov 14 23:41:21 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 23:41:21 user nova-compute[75341]:   </cpu>
Nov 14 23:41:21 user nova-compute[75341]:   <devices>
Nov 14 23:41:21 user nova-compute[75341]:     <disk type="block" device="disk">
Nov 14 23:41:21 user nova-compute[75341]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:41:21 user nova-compute[75341]:       <source dev="/dev/sde"/>
Nov 14 23:41:21 user nova-compute[75341]:       <target dev="vda" bus="virtio"/>
Nov 14 23:41:21 user nova-compute[75341]:       <serial>3d4927ae-8df9-41e3-97e6-2eef950500f7</serial>
Nov 14 23:41:21 user nova-compute[75341]:     </disk>
Nov 14 23:41:21 user nova-compute[75341]:     <interface type="ethernet">
Nov 14 23:41:21 user nova-compute[75341]:       <mac address="fa:16:3e:19:cd:2f"/>
Nov 14 23:41:21 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:41:21 user nova-compute[75341]:       <mtu size="1442"/>
Nov 14 23:41:21 user nova-compute[75341]:       <target dev="tapdbe5cbca-08"/>
Nov 14 23:41:21 user nova-compute[75341]:     </interface>
Nov 14 23:41:21 user nova-compute[75341]:     <serial type="pty">
Nov 14 23:41:21 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/0223a98e-e08f-4a0f-a707-3770c7a99b00/console.log" append="off"/>
Nov 14 23:41:21 user nova-compute[75341]:     </serial>
Nov 14 23:41:21 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 23:41:21 user nova-compute[75341]:     <video>
Nov 14 23:41:21 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:41:21 user nova-compute[75341]:     </video>
Nov 14 23:41:21 user nova-compute[75341]:     <rng model="virtio">
Nov 14 23:41:21 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 14 23:41:21 user nova-compute[75341]:     </rng>
Nov 14 23:41:21 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 14 23:41:21 user nova-compute[75341]:     <memballoon model="virtio">
Nov 14 23:41:21 user nova-compute[75341]:       <stats period="10"/>
Nov 14 23:41:21 user nova-compute[75341]:     </memballoon>
Nov 14 23:41:21 user nova-compute[75341]:   </devices>
Nov 14 23:41:21 user nova-compute[75341]: </domain>
Nov 14 23:41:21 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 23:41:21 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:41:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-745577741',display_name='tempest-TestShelveInstance-server-745577741',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-745577741',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCC/fpuT6kOHQaV9HZ2f/yPGx85iWhp/2ZbngnYaFTTZ0up9RjcbLjQe5XMoVflV9AQ+bAmt83ts1O90HoYfCtqnb8fvFlLRjy7CrBRwtOEIR115LUYMUcjq8rDRKo0GlA==',key_name='tempest-TestShelveInstance-272108759',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9beb6cd1f92a46f4a37459b75b7ff1d4',ramdisk_id='',reservation_id='r-w770xi1a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1537108126',owner_user_name='tempest-TestShelveInstance-1537108126-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:41:15Z,user_data=None,user_id='ee1ed14495f14c7e8bddfde73dbb3a29',uuid=0223a98e-e08f-4a0f-a707-3770c7a99b00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e", "address": "fa:16:3e:19:cd:2f", "network": {"id": "eb5b5fbb-4747-49e9-a830-c9ab1c4d4af7", "bridge": "br-int", "label": "tempest-TestShelveInstance-261763164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9beb6cd1f92a46f4a37459b75b7ff1d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbe5cbca-08", "ovs_interfaceid": "dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 23:41:21 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Converting VIF {"id": "dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e", "address": "fa:16:3e:19:cd:2f", "network": {"id": "eb5b5fbb-4747-49e9-a830-c9ab1c4d4af7", "bridge": "br-int", "label": "tempest-TestShelveInstance-261763164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9beb6cd1f92a46f4a37459b75b7ff1d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbe5cbca-08", "ovs_interfaceid": "dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:41:21 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:cd:2f,bridge_name='br-int',has_traffic_filtering=True,id=dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e,network=Network(eb5b5fbb-4747-49e9-a830-c9ab1c4d4af7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbe5cbca-08') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:41:21 user nova-compute[75341]: DEBUG os_vif [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:cd:2f,bridge_name='br-int',has_traffic_filtering=True,id=dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e,network=Network(eb5b5fbb-4747-49e9-a830-c9ab1c4d4af7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbe5cbca-08') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 23:41:21 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:21 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:41:21 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 23:41:21 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:21 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fab8edeb-7128-56a1-bfd5-8fe6a05e1f0d', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:41:21 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:21 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:21 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:21 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdbe5cbca-08, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:41:21 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdbe5cbca-08, col_values=(('qos', UUID('8d0e34ee-7827-46a3-9e47-3567643526d3')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:41:21 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdbe5cbca-08, col_values=(('external_ids', {'iface-id': 'dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:cd:2f', 'vm-uuid': '0223a98e-e08f-4a0f-a707-3770c7a99b00'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:41:21 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:21 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:41:21 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:21 user nova-compute[75341]: INFO os_vif [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:cd:2f,bridge_name='br-int',has_traffic_filtering=True,id=dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e,network=Network(eb5b5fbb-4747-49e9-a830-c9ab1c4d4af7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbe5cbca-08')
Nov 14 23:41:21 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:41:21 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] No VIF found with MAC fa:16:3e:19:cd:2f, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:41:22 user nova-compute[75341]: DEBUG nova.compute.manager [req-5ac6d019-bfae-4e2d-9476-9b62bbf79532 req-8cab2715-b04e-44ff-85ee-071ec2880360 service nova] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Received event network-vif-plugged-9032b49d-13a3-4049-bada-48eb30ea932a {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:41:22 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-5ac6d019-bfae-4e2d-9476-9b62bbf79532 req-8cab2715-b04e-44ff-85ee-071ec2880360 service nova] Acquiring lock "d8d3b42b-11b5-477a-afb1-80a1786b693b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:41:22 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-5ac6d019-bfae-4e2d-9476-9b62bbf79532 req-8cab2715-b04e-44ff-85ee-071ec2880360 service nova] Lock "d8d3b42b-11b5-477a-afb1-80a1786b693b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:41:22 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-5ac6d019-bfae-4e2d-9476-9b62bbf79532 req-8cab2715-b04e-44ff-85ee-071ec2880360 service nova] Lock "d8d3b42b-11b5-477a-afb1-80a1786b693b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:41:22 user nova-compute[75341]: DEBUG nova.compute.manager [req-5ac6d019-bfae-4e2d-9476-9b62bbf79532 req-8cab2715-b04e-44ff-85ee-071ec2880360 service nova] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] No waiting events found dispatching network-vif-plugged-9032b49d-13a3-4049-bada-48eb30ea932a {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:41:22 user nova-compute[75341]: WARNING nova.compute.manager [req-5ac6d019-bfae-4e2d-9476-9b62bbf79532 req-8cab2715-b04e-44ff-85ee-071ec2880360 service nova] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Received unexpected event network-vif-plugged-9032b49d-13a3-4049-bada-48eb30ea932a for instance with vm_state building and task_state spawning.
Nov 14 23:41:22 user nova-compute[75341]: DEBUG nova.compute.manager [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Instance event wait completed in 0 seconds for  {{(pid=75341) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 23:41:22 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Guest created on hypervisor {{(pid=75341) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 23:41:22 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Instance spawned successfully.
Nov 14 23:41:22 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 23:41:22 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Found default for hw_cdrom_bus of ide {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:41:22 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Found default for hw_disk_bus of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:41:22 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Found default for hw_input_bus of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:41:22 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Found default for hw_pointer_model of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:41:22 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Found default for hw_video_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:41:22 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Found default for hw_vif_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:41:22 user nova-compute[75341]: INFO nova.compute.manager [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Took 5.43 seconds to spawn the instance on the hypervisor.
Nov 14 23:41:22 user nova-compute[75341]: DEBUG nova.compute.manager [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 23:41:22 user nova-compute[75341]: INFO nova.compute.manager [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Took 6.33 seconds to build instance.
Nov 14 23:41:22 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-621004d6-338b-42be-b0c0-d4892d09fcce tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Lock "d8d3b42b-11b5-477a-afb1-80a1786b693b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.762s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:41:23 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:23 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:23 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:23 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:23 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:23 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:23 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:24 user nova-compute[75341]: DEBUG nova.compute.manager [req-27b806a9-4776-4a70-878f-20f6c4db25c6 req-615fb934-ce73-4e1f-9561-1358fe5bb3bd service nova] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Received event network-vif-plugged-dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:41:24 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-27b806a9-4776-4a70-878f-20f6c4db25c6 req-615fb934-ce73-4e1f-9561-1358fe5bb3bd service nova] Acquiring lock "0223a98e-e08f-4a0f-a707-3770c7a99b00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:41:24 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-27b806a9-4776-4a70-878f-20f6c4db25c6 req-615fb934-ce73-4e1f-9561-1358fe5bb3bd service nova] Lock "0223a98e-e08f-4a0f-a707-3770c7a99b00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:41:24 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-27b806a9-4776-4a70-878f-20f6c4db25c6 req-615fb934-ce73-4e1f-9561-1358fe5bb3bd service nova] Lock "0223a98e-e08f-4a0f-a707-3770c7a99b00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:41:24 user nova-compute[75341]: DEBUG nova.compute.manager [req-27b806a9-4776-4a70-878f-20f6c4db25c6 req-615fb934-ce73-4e1f-9561-1358fe5bb3bd service nova] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] No waiting events found dispatching network-vif-plugged-dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:41:24 user nova-compute[75341]: WARNING nova.compute.manager [req-27b806a9-4776-4a70-878f-20f6c4db25c6 req-615fb934-ce73-4e1f-9561-1358fe5bb3bd service nova] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Received unexpected event network-vif-plugged-dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e for instance with vm_state building and task_state spawning.
Nov 14 23:41:24 user nova-compute[75341]: DEBUG nova.compute.manager [req-27b806a9-4776-4a70-878f-20f6c4db25c6 req-615fb934-ce73-4e1f-9561-1358fe5bb3bd service nova] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Received event network-vif-plugged-dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:41:24 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-27b806a9-4776-4a70-878f-20f6c4db25c6 req-615fb934-ce73-4e1f-9561-1358fe5bb3bd service nova] Acquiring lock "0223a98e-e08f-4a0f-a707-3770c7a99b00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:41:24 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-27b806a9-4776-4a70-878f-20f6c4db25c6 req-615fb934-ce73-4e1f-9561-1358fe5bb3bd service nova] Lock "0223a98e-e08f-4a0f-a707-3770c7a99b00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:41:24 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-27b806a9-4776-4a70-878f-20f6c4db25c6 req-615fb934-ce73-4e1f-9561-1358fe5bb3bd service nova] Lock "0223a98e-e08f-4a0f-a707-3770c7a99b00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:41:24 user nova-compute[75341]: DEBUG nova.compute.manager [req-27b806a9-4776-4a70-878f-20f6c4db25c6 req-615fb934-ce73-4e1f-9561-1358fe5bb3bd service nova] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] No waiting events found dispatching network-vif-plugged-dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:41:24 user nova-compute[75341]: WARNING nova.compute.manager [req-27b806a9-4776-4a70-878f-20f6c4db25c6 req-615fb934-ce73-4e1f-9561-1358fe5bb3bd service nova] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Received unexpected event network-vif-plugged-dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e for instance with vm_state building and task_state spawning.
Nov 14 23:41:25 user nova-compute[75341]: DEBUG nova.compute.manager [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Instance event wait completed in 0 seconds for  {{(pid=75341) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 23:41:25 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Guest created on hypervisor {{(pid=75341) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 23:41:25 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Instance spawned successfully.
Nov 14 23:41:25 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 23:41:25 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Found default for hw_cdrom_bus of ide {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:41:25 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Found default for hw_disk_bus of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:41:25 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Found default for hw_input_bus of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:41:25 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Found default for hw_pointer_model of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:41:25 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Found default for hw_video_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:41:25 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Found default for hw_vif_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:41:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:25 user nova-compute[75341]: INFO nova.compute.manager [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Took 5.70 seconds to spawn the instance on the hypervisor.
Nov 14 23:41:25 user nova-compute[75341]: DEBUG nova.compute.manager [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 23:41:25 user nova-compute[75341]: INFO nova.compute.manager [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Took 11.52 seconds to build instance.
Nov 14 23:41:25 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f25410e2-c0c8-4537-b34b-5dc68d9845aa tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Lock "0223a98e-e08f-4a0f-a707-3770c7a99b00" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.641s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:41:26 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:35 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:36 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:37 user nova-compute[75341]: DEBUG nova.compute.manager [req-eafda76e-9c82-4ef8-84d4-9fe9957658fc req-a0c9f015-baae-4f2c-b7d2-6cd8772ce44e service nova] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Received event network-changed-dcc0edd5-582a-499a-beaf-6de23ff1537c {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:41:37 user nova-compute[75341]: DEBUG nova.compute.manager [req-eafda76e-9c82-4ef8-84d4-9fe9957658fc req-a0c9f015-baae-4f2c-b7d2-6cd8772ce44e service nova] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Refreshing instance network info cache due to event network-changed-dcc0edd5-582a-499a-beaf-6de23ff1537c. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:41:37 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-eafda76e-9c82-4ef8-84d4-9fe9957658fc req-a0c9f015-baae-4f2c-b7d2-6cd8772ce44e service nova] Acquiring lock "refresh_cache-881351d7-31f9-44f4-8571-8f540bbec29c" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:41:37 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-eafda76e-9c82-4ef8-84d4-9fe9957658fc req-a0c9f015-baae-4f2c-b7d2-6cd8772ce44e service nova] Acquired lock "refresh_cache-881351d7-31f9-44f4-8571-8f540bbec29c" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:41:37 user nova-compute[75341]: DEBUG nova.network.neutron [req-eafda76e-9c82-4ef8-84d4-9fe9957658fc req-a0c9f015-baae-4f2c-b7d2-6cd8772ce44e service nova] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Refreshing network info cache for port dcc0edd5-582a-499a-beaf-6de23ff1537c {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:41:38 user nova-compute[75341]: DEBUG nova.network.neutron [req-eafda76e-9c82-4ef8-84d4-9fe9957658fc req-a0c9f015-baae-4f2c-b7d2-6cd8772ce44e service nova] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Updated VIF entry in instance network info cache for port dcc0edd5-582a-499a-beaf-6de23ff1537c. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:41:38 user nova-compute[75341]: DEBUG nova.network.neutron [req-eafda76e-9c82-4ef8-84d4-9fe9957658fc req-a0c9f015-baae-4f2c-b7d2-6cd8772ce44e service nova] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Updating instance_info_cache with network_info: [{"id": "dcc0edd5-582a-499a-beaf-6de23ff1537c", "address": "fa:16:3e:83:5b:7a", "network": {"id": "139c86e9-e6ea-4307-9f78-7f41ab7a6d8c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-487359378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eff8d64949254c7eb3dd8685ca7447b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc0edd5-58", "ovs_interfaceid": "dcc0edd5-582a-499a-beaf-6de23ff1537c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:41:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-eafda76e-9c82-4ef8-84d4-9fe9957658fc req-a0c9f015-baae-4f2c-b7d2-6cd8772ce44e service nova] Releasing lock "refresh_cache-881351d7-31f9-44f4-8571-8f540bbec29c" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:41:39 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-92b52e15-cd88-4945-b481-dab2163e9015 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Acquiring lock "91603fef-c1cc-4fa1-96b2-e840db651627" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:41:39 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-92b52e15-cd88-4945-b481-dab2163e9015 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Lock "91603fef-c1cc-4fa1-96b2-e840db651627" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:41:39 user nova-compute[75341]: DEBUG nova.objects.instance [None req-92b52e15-cd88-4945-b481-dab2163e9015 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Lazy-loading 'flavor' on Instance uuid 91603fef-c1cc-4fa1-96b2-e840db651627 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:41:39 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-92b52e15-cd88-4945-b481-dab2163e9015 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Lock "91603fef-c1cc-4fa1-96b2-e840db651627" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:41:39 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-92b52e15-cd88-4945-b481-dab2163e9015 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Acquiring lock "91603fef-c1cc-4fa1-96b2-e840db651627" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:41:39 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-92b52e15-cd88-4945-b481-dab2163e9015 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Lock "91603fef-c1cc-4fa1-96b2-e840db651627" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:41:39 user nova-compute[75341]: INFO nova.compute.manager [None req-92b52e15-cd88-4945-b481-dab2163e9015 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] Attaching volume 1019ea18-2a5e-45ac-a40d-0e868befd139 to /dev/vdb
Nov 14 23:41:39 user nova-compute[75341]: DEBUG os_brick.utils [None req-92b52e15-cd88-4945-b481-dab2163e9015 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:41:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:41:39 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e9e973-f085-4a06-a039-9b6763f6ea6d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6d1cfca09c9\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:41:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.026s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:41:39 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[4943b39c-2da0-463f-b2c2-0349f7da7cbe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:41:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:41:39 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[92237417-cd9c-49d9-8de2-bb83b0b7a442]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:41:39 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea978dd0-6b58-42d7-a601-94fa2d567d7a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:41:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-92b52e15-cd88-4945-b481-dab2163e9015 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Running cmd (subprocess): nvme version {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-92b52e15-cd88-4945-b481-dab2163e9015 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] 'nvme version' failed. Not Retrying. {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:41:39 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.nvmeof [None req-92b52e15-cd88-4945-b481-dab2163e9015 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] nvme not present on system {{(pid=75341) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 23:41:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:41:39 user nova-compute[75341]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 23:41:39 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16dec64-ef45-4187-b09f-7d64a7b3a6bc]: (4, '') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:41:39 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-92b52e15-cd88-4945-b481-dab2163e9015 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75341) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 23:41:39 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-92b52e15-cd88-4945-b481-dab2163e9015 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 23:41:39 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-92b52e15-cd88-4945-b481-dab2163e9015 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] LIGHTOS: no hostnqn found. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 23:41:39 user nova-compute[75341]: DEBUG os_brick.utils [None req-92b52e15-cd88-4945-b481-dab2163e9015 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6d1cfca09c9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:41:39 user nova-compute[75341]: DEBUG nova.virt.block_device [None req-92b52e15-cd88-4945-b481-dab2163e9015 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] Updating existing volume attachment record: b318107e-1bf7-4226-952a-b45134835d22 {{(pid=75341) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 23:41:40 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:41 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:41:42 user nova-compute[75341]: DEBUG nova.compute.manager [req-d66d20f7-f493-4bef-a18a-652783a52b51 req-515692cf-e1cf-429f-bdc6-3ac19ed79c9f service nova] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Received event network-changed-4f1d8292-7392-4939-9303-437dc108b4a4 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:41:42 user nova-compute[75341]: DEBUG nova.compute.manager [req-d66d20f7-f493-4bef-a18a-652783a52b51 req-515692cf-e1cf-429f-bdc6-3ac19ed79c9f service nova] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Refreshing instance network info cache due to event network-changed-4f1d8292-7392-4939-9303-437dc108b4a4. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:41:42 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-d66d20f7-f493-4bef-a18a-652783a52b51 req-515692cf-e1cf-429f-bdc6-3ac19ed79c9f service nova] Acquiring lock "refresh_cache-a308a35f-c8d7-482c-a93d-5d9eb473d4e1" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:41:42 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-d66d20f7-f493-4bef-a18a-652783a52b51 req-515692cf-e1cf-429f-bdc6-3ac19ed79c9f service nova] Acquired lock "refresh_cache-a308a35f-c8d7-482c-a93d-5d9eb473d4e1" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:41:42 user nova-compute[75341]: DEBUG nova.network.neutron [req-d66d20f7-f493-4bef-a18a-652783a52b51 req-515692cf-e1cf-429f-bdc6-3ac19ed79c9f service nova] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Refreshing network info cache for port 4f1d8292-7392-4939-9303-437dc108b4a4 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:41:42 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:41:42 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Starting heal instance info cache {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 23:41:43 user nova-compute[75341]: DEBUG nova.network.neutron [req-d66d20f7-f493-4bef-a18a-652783a52b51 req-515692cf-e1cf-429f-bdc6-3ac19ed79c9f service nova] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Updated VIF entry in instance network info cache for port 4f1d8292-7392-4939-9303-437dc108b4a4. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:41:43 user nova-compute[75341]: DEBUG nova.network.neutron [req-d66d20f7-f493-4bef-a18a-652783a52b51 req-515692cf-e1cf-429f-bdc6-3ac19ed79c9f service nova] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Updating instance_info_cache with network_info: [{"id": "4f1d8292-7392-4939-9303-437dc108b4a4", "address": "fa:16:3e:be:2c:ef", "network": {"id": "e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-64240219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f27e41f4cc1451291b8aca34544867b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f1d8292-73", "ovs_interfaceid": "4f1d8292-7392-4939-9303-437dc108b4a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:41:43 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-d66d20f7-f493-4bef-a18a-652783a52b51 req-515692cf-e1cf-429f-bdc6-3ac19ed79c9f service nova] Releasing lock "refresh_cache-a308a35f-c8d7-482c-a93d-5d9eb473d4e1" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:41:43 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "refresh_cache-91603fef-c1cc-4fa1-96b2-e840db651627" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:41:43 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquired lock "refresh_cache-91603fef-c1cc-4fa1-96b2-e840db651627" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:41:43 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] Forcefully refreshing network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 23:41:43 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] Updating instance_info_cache with network_info: [{"id": "c53d37cc-db96-4531-9095-053de7f58643", "address": "fa:16:3e:0e:89:c0", "network": {"id": "07acc788-5f14-41b8-8aff-4d5c318cf71e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-470661925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ea6112e51e4412941ef2e4a68ad1bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc53d37cc-db", "ovs_interfaceid": "c53d37cc-db96-4531-9095-053de7f58643", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:41:43 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Releasing lock "refresh_cache-91603fef-c1cc-4fa1-96b2-e840db651627" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:41:43 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] Updated the network info_cache for instance {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 23:41:43 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:41:43 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:41:43 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:41:43 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75341) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 23:41:43 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:41:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92b52e15-cd88-4945-b481-dab2163e9015 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] Calling os-brick to attach iSCSI Volume {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 23:41:45 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b52e15-cd88-4945-b481-dab2163e9015 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1019ea18-2a5e-45ac-a40d-0e868befd139', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NWiavjKZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:41:45 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-92b52e15-cd88-4945-b481-dab2163e9015 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:41:45 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-92b52e15-cd88-4945-b481-dab2163e9015 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:41:45 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-92b52e15-cd88-4945-b481-dab2163e9015 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:41:45 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-92b52e15-cd88-4945-b481-dab2163e9015 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:41:45 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-92b52e15-cd88-4945-b481-dab2163e9015 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1019ea18-2a5e-45ac-a40d-0e868befd139" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:41:45 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-92b52e15-cd88-4945-b481-dab2163e9015 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1019ea18-2a5e-45ac-a40d-0e868befd139" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:41:45 user nova-compute[75341]: INFO os_brick.initiator.connectors.iscsi [None req-92b52e15-cd88-4945-b481-dab2163e9015 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 23:41:45 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1019ea18-2a5e-45ac-a40d-0e868befd139 -p 172.16.0.220:3260 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:45 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1019ea18-2a5e-45ac-a40d-0e868befd139 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:41:45 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5999e7b-eb8d-4838-acd4-49cc5189250a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:41:45 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b52e15-cd88-4945-b481-dab2163e9015 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 23:41:45 user nova-compute[75341]:  {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:41:45 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1019ea18-2a5e-45ac-a40d-0e868befd139 -p 172.16.0.220:3260 --interface default --op new {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:45 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1019ea18-2a5e-45ac-a40d-0e868befd139 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:41:45 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[087d508b-aa64-41df-8ae0-1eabd169bcd7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1019ea18-2a5e-45ac-a40d-0e868befd139] added\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:41:45 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b52e15-cd88-4945-b481-dab2163e9015 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1019ea18-2a5e-45ac-a40d-0e868befd139] added
Nov 14 23:41:45 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:41:45 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1019ea18-2a5e-45ac-a40d-0e868befd139 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:45 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1019ea18-2a5e-45ac-a40d-0e868befd139 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:41:45 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2221d69-5de1-445f-8740-6e0e5f3856b4]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:41:45 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b52e15-cd88-4945-b481-dab2163e9015 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:41:45 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1019ea18-2a5e-45ac-a40d-0e868befd139 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:45 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1019ea18-2a5e-45ac-a40d-0e868befd139 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:41:45 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7604f10-99b3-49f8-a3d7-4b50dd1f059e]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:41:45 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b52e15-cd88-4945-b481-dab2163e9015 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:41:45 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1019ea18-2a5e-45ac-a40d-0e868befd139 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NWiavjKZ {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:45 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1019ea18-2a5e-45ac-a40d-0e868befd139 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NWiavjKZ" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:41:45 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aab7f08-4736-45d0-af22-9a9fc3b060b2]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:41:45 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b52e15-cd88-4945-b481-dab2163e9015 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NWiavjKZ'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:41:45 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1019ea18-2a5e-45ac-a40d-0e868befd139 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:45 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1019ea18-2a5e-45ac-a40d-0e868befd139 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:41:45 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[d502c1ff-ecb0-45a0-a6b2-e2f7eecae271]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:41:45 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b52e15-cd88-4945-b481-dab2163e9015 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:41:45 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:45 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:41:45 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[51dd3c88-8664-4a21-91e1-6662fec1bd73]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:41:45 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b52e15-cd88-4945-b481-dab2163e9015 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)
Nov 14 23:41:45 user nova-compute[75341]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)
Nov 14 23:41:45 user nova-compute[75341]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)
Nov 14 23:41:45 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:41:45 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:41:45 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b52e15-cd88-4945-b481-dab2163e9015 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)
Nov 14 23:41:45 user nova-compute[75341]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)
Nov 14 23:41:45 user nova-compute[75341]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)
Nov 14 23:41:45 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:41:45 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:41:45 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1019ea18-2a5e-45ac-a40d-0e868befd139 -p 172.16.0.220:3260 --login {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:45 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1019ea18-2a5e-45ac-a40d-0e868befd139 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:41:45 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32776be-94c3-45aa-9535-9d73268dbc13]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1019ea18-2a5e-45ac-a40d-0e868befd139, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1019ea18-2a5e-45ac-a40d-0e868befd139, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:41:45 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b52e15-cd88-4945-b481-dab2163e9015 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1019ea18-2a5e-45ac-a40d-0e868befd139, portal: 172.16.0.220,3260]
Nov 14 23:41:45 user nova-compute[75341]: Login to [iface: default, target: iqn.2010-10.org.openstack:1019ea18-2a5e-45ac-a40d-0e868befd139, portal: 172.16.0.220,3260] successful.
Nov 14 23:41:45 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:41:45 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1019ea18-2a5e-45ac-a40d-0e868befd139 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:45 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1019ea18-2a5e-45ac-a40d-0e868befd139 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:41:45 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc46f21c-4fb7-4955-959c-f072a28764f3]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:41:45 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b52e15-cd88-4945-b481-dab2163e9015 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:41:45 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:45 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:41:45 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[63328c69-c14a-40f4-9344-41369a08c329]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1019ea18-2a5e-45ac-a40d-0e868befd139 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:41:45 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b52e15-cd88-4945-b481-dab2163e9015 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)
Nov 14 23:41:45 user nova-compute[75341]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)
Nov 14 23:41:45 user nova-compute[75341]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)
Nov 14 23:41:45 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:41:45 user nova-compute[75341]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1019ea18-2a5e-45ac-a40d-0e868befd139 (non-flash)
Nov 14 23:41:45 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:41:45 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b52e15-cd88-4945-b481-dab2163e9015 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)
Nov 14 23:41:45 user nova-compute[75341]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)
Nov 14 23:41:45 user nova-compute[75341]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)
Nov 14 23:41:45 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:41:45 user nova-compute[75341]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1019ea18-2a5e-45ac-a40d-0e868befd139 (non-flash)
Nov 14 23:41:45 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:41:45 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-92b52e15-cd88-4945-b481-dab2163e9015 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1019ea18-2a5e-45ac-a40d-0e868befd139" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:41:45 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b52e15-cd88-4945-b481-dab2163e9015 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Connected to 172.16.0.220:3260 {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 23:41:45 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-92b52e15-cd88-4945-b481-dab2163e9015 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=75341) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 23:41:45 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-92b52e15-cd88-4945-b481-dab2163e9015 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75341) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 23:41:45 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:45 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.024s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:41:45 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[53aad346-8b4c-4f0e-b54d-b26aad387707]: (4, ('- - 0', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:41:45 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-92b52e15-cd88-4945-b481-dab2163e9015 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 23:41:45 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b52e15-cd88-4945-b481-dab2163e9015 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:1019ea18-2a5e-45ac-a40d-0e868befd139', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NWiavjKZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 23:41:45 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:45 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:41:45 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:41:45 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:41:45 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:41:45 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:41:45 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75341) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 23:41:46 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d427ed-6ac3-46d9-bebc-d672f465f850/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-14b75462-9d10-4d71-8a5a-85d6610a10be tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Acquiring lock "a308a35f-c8d7-482c-a93d-5d9eb473d4e1" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:41:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-14b75462-9d10-4d71-8a5a-85d6610a10be tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "a308a35f-c8d7-482c-a93d-5d9eb473d4e1" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:41:46 user nova-compute[75341]: INFO nova.compute.manager [None req-14b75462-9d10-4d71-8a5a-85d6610a10be tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Shelving
Nov 14 23:41:46 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:46 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:46 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d427ed-6ac3-46d9-bebc-d672f465f850/disk --force-share --output=json" returned: 0 in 0.302s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:41:46 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d427ed-6ac3-46d9-bebc-d672f465f850/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:46 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:46 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:46 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:46 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-92b52e15-cd88-4945-b481-dab2163e9015 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:41:46 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b52e15-cd88-4945-b481-dab2163e9015 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23336303863356331', 'path': '/dev/sdf'} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:41:46 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92b52e15-cd88-4945-b481-dab2163e9015 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336303863356331', 'path': '/dev/sdf'} {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 23:41:46 user nova-compute[75341]: DEBUG nova.objects.instance [None req-92b52e15-cd88-4945-b481-dab2163e9015 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Lazy-loading 'flavor' on Instance uuid 91603fef-c1cc-4fa1-96b2-e840db651627 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:41:46 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-92b52e15-cd88-4945-b481-dab2163e9015 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 23:41:46 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:41:46 user nova-compute[75341]:   <source dev="/dev/sdf"/>
Nov 14 23:41:46 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:41:46 user nova-compute[75341]:   <serial>1019ea18-2a5e-45ac-a40d-0e868befd139</serial>
Nov 14 23:41:46 user nova-compute[75341]: </disk>
Nov 14 23:41:46 user nova-compute[75341]:  {{(pid=75341) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 23:41:46 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d427ed-6ac3-46d9-bebc-d672f465f850/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:41:46 user nova-compute[75341]: DEBUG nova.compute.manager [req-fe07f41c-2f63-4b10-9116-a0300bd7b96c req-603ef5aa-1c35-4d1f-9537-235499e8768f service nova] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Received event network-vif-unplugged-4f1d8292-7392-4939-9303-437dc108b4a4 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:41:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-fe07f41c-2f63-4b10-9116-a0300bd7b96c req-603ef5aa-1c35-4d1f-9537-235499e8768f service nova] Acquiring lock "a308a35f-c8d7-482c-a93d-5d9eb473d4e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:41:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-fe07f41c-2f63-4b10-9116-a0300bd7b96c req-603ef5aa-1c35-4d1f-9537-235499e8768f service nova] Lock "a308a35f-c8d7-482c-a93d-5d9eb473d4e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:41:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-fe07f41c-2f63-4b10-9116-a0300bd7b96c req-603ef5aa-1c35-4d1f-9537-235499e8768f service nova] Lock "a308a35f-c8d7-482c-a93d-5d9eb473d4e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:41:46 user nova-compute[75341]: DEBUG nova.compute.manager [req-fe07f41c-2f63-4b10-9116-a0300bd7b96c req-603ef5aa-1c35-4d1f-9537-235499e8768f service nova] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] No waiting events found dispatching network-vif-unplugged-4f1d8292-7392-4939-9303-437dc108b4a4 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:41:46 user nova-compute[75341]: WARNING nova.compute.manager [req-fe07f41c-2f63-4b10-9116-a0300bd7b96c req-603ef5aa-1c35-4d1f-9537-235499e8768f service nova] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Received unexpected event network-vif-unplugged-4f1d8292-7392-4939-9303-437dc108b4a4 for instance with vm_state active and task_state shelving.
Nov 14 23:41:46 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91603fef-c1cc-4fa1-96b2-e840db651627/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:47 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Instance destroyed successfully.
Nov 14 23:41:47 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-92b52e15-cd88-4945-b481-dab2163e9015 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:41:47 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-92b52e15-cd88-4945-b481-dab2163e9015 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:41:47 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-92b52e15-cd88-4945-b481-dab2163e9015 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] No VIF found with MAC fa:16:3e:0e:89:c0, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:41:47 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-14b75462-9d10-4d71-8a5a-85d6610a10be tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Beginning cold snapshot process
Nov 14 23:41:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91603fef-c1cc-4fa1-96b2-e840db651627/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:41:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91603fef-c1cc-4fa1-96b2-e840db651627/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:47 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-92b52e15-cd88-4945-b481-dab2163e9015 tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Lock "91603fef-c1cc-4fa1-96b2-e840db651627" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.065s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:41:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91603fef-c1cc-4fa1-96b2-e840db651627/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:41:47 user nova-compute[75341]: DEBUG nova.privsep.utils [None req-14b75462-9d10-4d71-8a5a-85d6610a10be tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75341) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 23:41:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-14b75462-9d10-4d71-8a5a-85d6610a10be tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/a308a35f-c8d7-482c-a93d-5d9eb473d4e1/disk /opt/stack/data/nova/instances/snapshots/tmpjizyjw29/c7948dc4c75a4b6cbd63a487ef45f3c0 {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/163c448b-0183-41bb-b6e0-61917f6ad781/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/163c448b-0183-41bb-b6e0-61917f6ad781/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:41:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/163c448b-0183-41bb-b6e0-61917f6ad781/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/163c448b-0183-41bb-b6e0-61917f6ad781/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:41:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:41:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:48 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b68cb032-5e0c-4eb4-94a3-f1fee18b97ef tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Acquiring lock "91603fef-c1cc-4fa1-96b2-e840db651627" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:41:48 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b68cb032-5e0c-4eb4-94a3-f1fee18b97ef tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Lock "91603fef-c1cc-4fa1-96b2-e840db651627" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:41:48 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b68cb032-5e0c-4eb4-94a3-f1fee18b97ef tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Acquiring lock "91603fef-c1cc-4fa1-96b2-e840db651627-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:41:48 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b68cb032-5e0c-4eb4-94a3-f1fee18b97ef tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Lock "91603fef-c1cc-4fa1-96b2-e840db651627-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:41:48 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b68cb032-5e0c-4eb4-94a3-f1fee18b97ef tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Lock "91603fef-c1cc-4fa1-96b2-e840db651627-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:41:48 user nova-compute[75341]: INFO nova.compute.manager [None req-b68cb032-5e0c-4eb4-94a3-f1fee18b97ef tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] Terminating instance
Nov 14 23:41:48 user nova-compute[75341]: DEBUG nova.compute.manager [None req-b68cb032-5e0c-4eb4-94a3-f1fee18b97ef tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] Start destroying the instance on the hypervisor. {{(pid=75341) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 23:41:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-14b75462-9d10-4d71-8a5a-85d6610a10be tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/a308a35f-c8d7-482c-a93d-5d9eb473d4e1/disk /opt/stack/data/nova/instances/snapshots/tmpjizyjw29/c7948dc4c75a4b6cbd63a487ef45f3c0" returned: 0 in 0.721s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:41:48 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-14b75462-9d10-4d71-8a5a-85d6610a10be tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Snapshot extracted, beginning image upload
Nov 14 23:41:48 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:41:48 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0cffbac-f552-47bf-bd6c-dabb70e7c867/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:48 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:48 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:48 user nova-compute[75341]: DEBUG nova.compute.manager [req-b94c3a58-18aa-498d-b9d3-4ddd8141e195 req-d1a86c77-4977-40af-9616-a3530a6b5d88 service nova] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] Received event network-vif-unplugged-c53d37cc-db96-4531-9095-053de7f58643 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:41:48 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-b94c3a58-18aa-498d-b9d3-4ddd8141e195 req-d1a86c77-4977-40af-9616-a3530a6b5d88 service nova] Acquiring lock "91603fef-c1cc-4fa1-96b2-e840db651627-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:41:48 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-b94c3a58-18aa-498d-b9d3-4ddd8141e195 req-d1a86c77-4977-40af-9616-a3530a6b5d88 service nova] Lock "91603fef-c1cc-4fa1-96b2-e840db651627-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:41:48 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-b94c3a58-18aa-498d-b9d3-4ddd8141e195 req-d1a86c77-4977-40af-9616-a3530a6b5d88 service nova] Lock "91603fef-c1cc-4fa1-96b2-e840db651627-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:41:48 user nova-compute[75341]: DEBUG nova.compute.manager [req-b94c3a58-18aa-498d-b9d3-4ddd8141e195 req-d1a86c77-4977-40af-9616-a3530a6b5d88 service nova] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] No waiting events found dispatching network-vif-unplugged-c53d37cc-db96-4531-9095-053de7f58643 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:41:48 user nova-compute[75341]: DEBUG nova.compute.manager [req-b94c3a58-18aa-498d-b9d3-4ddd8141e195 req-d1a86c77-4977-40af-9616-a3530a6b5d88 service nova] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] Received event network-vif-unplugged-c53d37cc-db96-4531-9095-053de7f58643 for instance with task_state deleting. {{(pid=75341) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 23:41:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0cffbac-f552-47bf-bd6c-dabb70e7c867/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:41:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0cffbac-f552-47bf-bd6c-dabb70e7c867/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:48 user nova-compute[75341]: DEBUG nova.compute.manager [req-c9c862f8-e2d8-4cb3-8be5-74f13b7367d8 req-1085477c-ac08-442b-91ed-b56426565447 service nova] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Received event network-vif-plugged-4f1d8292-7392-4939-9303-437dc108b4a4 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:41:48 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-c9c862f8-e2d8-4cb3-8be5-74f13b7367d8 req-1085477c-ac08-442b-91ed-b56426565447 service nova] Acquiring lock "a308a35f-c8d7-482c-a93d-5d9eb473d4e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:41:48 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-c9c862f8-e2d8-4cb3-8be5-74f13b7367d8 req-1085477c-ac08-442b-91ed-b56426565447 service nova] Lock "a308a35f-c8d7-482c-a93d-5d9eb473d4e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:41:48 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-c9c862f8-e2d8-4cb3-8be5-74f13b7367d8 req-1085477c-ac08-442b-91ed-b56426565447 service nova] Lock "a308a35f-c8d7-482c-a93d-5d9eb473d4e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:41:48 user nova-compute[75341]: DEBUG nova.compute.manager [req-c9c862f8-e2d8-4cb3-8be5-74f13b7367d8 req-1085477c-ac08-442b-91ed-b56426565447 service nova] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] No waiting events found dispatching network-vif-plugged-4f1d8292-7392-4939-9303-437dc108b4a4 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:41:48 user nova-compute[75341]: WARNING nova.compute.manager [req-c9c862f8-e2d8-4cb3-8be5-74f13b7367d8 req-1085477c-ac08-442b-91ed-b56426565447 service nova] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Received unexpected event network-vif-plugged-4f1d8292-7392-4939-9303-437dc108b4a4 for instance with vm_state active and task_state shelving_image_uploading.
Nov 14 23:41:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0cffbac-f552-47bf-bd6c-dabb70e7c867/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:41:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44080c0d-56eb-4987-aa4b-59f161dcbc0b/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44080c0d-56eb-4987-aa4b-59f161dcbc0b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44080c0d-56eb-4987-aa4b-59f161dcbc0b/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:49 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] Instance destroyed successfully.
Nov 14 23:41:49 user nova-compute[75341]: DEBUG nova.objects.instance [None req-b68cb032-5e0c-4eb4-94a3-f1fee18b97ef tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Lazy-loading 'resources' on Instance uuid 91603fef-c1cc-4fa1-96b2-e840db651627 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-b68cb032-5e0c-4eb4-94a3-f1fee18b97ef tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:39:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1998907683',display_name='tempest-DeleteServersTestJSON-server-1998907683',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1998907683',id=2,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:40:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d8ea6112e51e4412941ef2e4a68ad1bb',ramdisk_id='',reservation_id='r-ytcf352t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-177205866',owner_user_name='tempest-DeleteServersTestJSON-177205866-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:40:01Z,user_data=None,user_id='00343699649c474a989c45344046190d',uuid=91603fef-c1cc-4fa1-96b2-e840db651627,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c53d37cc-db96-4531-9095-053de7f58643", "address": "fa:16:3e:0e:89:c0", "network": {"id": "07acc788-5f14-41b8-8aff-4d5c318cf71e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-470661925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ea6112e51e4412941ef2e4a68ad1bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc53d37cc-db", "ovs_interfaceid": "c53d37cc-db96-4531-9095-053de7f58643", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-b68cb032-5e0c-4eb4-94a3-f1fee18b97ef tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Converting VIF {"id": "c53d37cc-db96-4531-9095-053de7f58643", "address": "fa:16:3e:0e:89:c0", "network": {"id": "07acc788-5f14-41b8-8aff-4d5c318cf71e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-470661925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ea6112e51e4412941ef2e4a68ad1bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc53d37cc-db", "ovs_interfaceid": "c53d37cc-db96-4531-9095-053de7f58643", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-b68cb032-5e0c-4eb4-94a3-f1fee18b97ef tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0e:89:c0,bridge_name='br-int',has_traffic_filtering=True,id=c53d37cc-db96-4531-9095-053de7f58643,network=Network(07acc788-5f14-41b8-8aff-4d5c318cf71e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc53d37cc-db') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG os_vif [None req-b68cb032-5e0c-4eb4-94a3-f1fee18b97ef tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:89:c0,bridge_name='br-int',has_traffic_filtering=True,id=c53d37cc-db96-4531-9095-053de7f58643,network=Network(07acc788-5f14-41b8-8aff-4d5c318cf71e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc53d37cc-db') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc53d37cc-db, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=30ffdd28-dbec-47a8-bd07-eabc542d43fd) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:49 user nova-compute[75341]: INFO os_vif [None req-b68cb032-5e0c-4eb4-94a3-f1fee18b97ef tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:89:c0,bridge_name='br-int',has_traffic_filtering=True,id=c53d37cc-db96-4531-9095-053de7f58643,network=Network(07acc788-5f14-41b8-8aff-4d5c318cf71e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc53d37cc-db')
Nov 14 23:41:49 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b68cb032-5e0c-4eb4-94a3-f1fee18b97ef tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] calling os-brick to detach iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b68cb032-5e0c-4eb4-94a3-f1fee18b97ef tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, {'target_iqn': 'iqn.2010-10.org.openstack:1019ea18-2a5e-45ac-a40d-0e868befd139', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NWiavjKZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:41:49 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-b68cb032-5e0c-4eb4-94a3-f1fee18b97ef tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:41:49 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-b68cb032-5e0c-4eb4-94a3-f1fee18b97ef tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-b68cb032-5e0c-4eb4-94a3-f1fee18b97ef tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52fc217-e789-41fe-9635-9680f3e83a24]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1019ea18-2a5e-45ac-a40d-0e868befd139\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b68cb032-5e0c-4eb4-94a3-f1fee18b97ef tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 23:41:49 user nova-compute[75341]: No targets found.
Nov 14 23:41:49 user nova-compute[75341]: iSNS:
Nov 14 23:41:49 user nova-compute[75341]: No targets found.
Nov 14 23:41:49 user nova-compute[75341]: STATIC:
Nov 14 23:41:49 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff
Nov 14 23:41:49 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:41:49 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:41:49 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198
Nov 14 23:41:49 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:41:49 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:41:49 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7
Nov 14 23:41:49 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:41:49 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:41:49 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296
Nov 14 23:41:49 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:41:49 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:41:49 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:1019ea18-2a5e-45ac-a40d-0e868befd139
Nov 14 23:41:49 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:41:49 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:41:49 user nova-compute[75341]: FIRMWARE:
Nov 14 23:41:49 user nova-compute[75341]: No targets found.
Nov 14 23:41:49 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b68cb032-5e0c-4eb4-94a3-f1fee18b97ef tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 23:41:49 user nova-compute[75341]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 23:41:49 user nova-compute[75341]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75341) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b68cb032-5e0c-4eb4-94a3-f1fee18b97ef tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1019ea18-2a5e-45ac-a40d-0e868befd139', 0)] {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7159a35-4d8a-4373-84cc-22f450f651ac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1019ea18-2a5e-45ac-a40d-0e868befd139\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44080c0d-56eb-4987-aa4b-59f161dcbc0b/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e7a53e9-6982-4c93-a830-a49cf0ce76bd/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[638dda4d-a0a0-4165-9cfd-4eb83be7ad4b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1019ea18-2a5e-45ac-a40d-0e868befd139 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b68cb032-5e0c-4eb4-94a3-f1fee18b97ef tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)
Nov 14 23:41:49 user nova-compute[75341]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)
Nov 14 23:41:49 user nova-compute[75341]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)
Nov 14 23:41:49 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:41:49 user nova-compute[75341]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1019ea18-2a5e-45ac-a40d-0e868befd139 (non-flash)
Nov 14 23:41:49 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b68cb032-5e0c-4eb4-94a3-f1fee18b97ef tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)
Nov 14 23:41:49 user nova-compute[75341]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)
Nov 14 23:41:49 user nova-compute[75341]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)
Nov 14 23:41:49 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:41:49 user nova-compute[75341]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1019ea18-2a5e-45ac-a40d-0e868befd139 (non-flash)
Nov 14 23:41:49 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b68cb032-5e0c-4eb4-94a3-f1fee18b97ef tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18706b7760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1019ea18-2a5e-45ac-a40d-0e868befd139'): ({'sdf'}, set())}) {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-b68cb032-5e0c-4eb4-94a3-f1fee18b97ef tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Removing single pathed devices sdf {{(pid=75341) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff3255f-e8a2-4b29-a2b5-f6bacbfa6eae]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd997f36-668a-43af-9ca0-4fc784c2a689]: (4, ('ok\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-b68cb032-5e0c-4eb4-94a3-f1fee18b97ef tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Flushing IO for device /dev/sdf {{(pid=75341) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.011s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ef6d7e-f584-4e21-b4a1-44d49aa1e11a]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-b68cb032-5e0c-4eb4-94a3-f1fee18b97ef tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75341) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.042s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a79172-d86e-4d65-aa0e-aef266621bd8]: (4, ('1', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-b68cb032-5e0c-4eb4-94a3-f1fee18b97ef tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-b68cb032-5e0c-4eb4-94a3-f1fee18b97ef tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] SCSI volumes sdf have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b68cb032-5e0c-4eb4-94a3-f1fee18b97ef tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1019ea18-2a5e-45ac-a40d-0e868befd139')] {{(pid=75341) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1019ea18-2a5e-45ac-a40d-0e868befd139 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1019ea18-2a5e-45ac-a40d-0e868befd139 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[842f846e-bf1b-4988-9c4e-9e35ca141a9a]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b68cb032-5e0c-4eb4-94a3-f1fee18b97ef tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1019ea18-2a5e-45ac-a40d-0e868befd139 -p 172.16.0.220:3260 --logout {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e7a53e9-6982-4c93-a830-a49cf0ce76bd/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e7a53e9-6982-4c93-a830-a49cf0ce76bd/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1019ea18-2a5e-45ac-a40d-0e868befd139 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[33176a8e-59e0-4bbc-bd9c-069e9eb5c2ad]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:1019ea18-2a5e-45ac-a40d-0e868befd139, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:1019ea18-2a5e-45ac-a40d-0e868befd139, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b68cb032-5e0c-4eb4-94a3-f1fee18b97ef tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:1019ea18-2a5e-45ac-a40d-0e868befd139, portal: 172.16.0.220,3260]
Nov 14 23:41:49 user nova-compute[75341]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:1019ea18-2a5e-45ac-a40d-0e868befd139, portal: 172.16.0.220,3260] successful.
Nov 14 23:41:49 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1019ea18-2a5e-45ac-a40d-0e868befd139 -p 172.16.0.220:3260 --op delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1019ea18-2a5e-45ac-a40d-0e868befd139 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd476779-b745-4315-b497-feabaa95e005]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b68cb032-5e0c-4eb4-94a3-f1fee18b97ef tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-b68cb032-5e0c-4eb4-94a3-f1fee18b97ef tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b68cb032-5e0c-4eb4-94a3-f1fee18b97ef tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] <== disconnect_volume: return (359ms) None {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b68cb032-5e0c-4eb4-94a3-f1fee18b97ef tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] Disconnected iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 23:41:49 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-b68cb032-5e0c-4eb4-94a3-f1fee18b97ef tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] Deleting instance files /opt/stack/data/nova/instances/91603fef-c1cc-4fa1-96b2-e840db651627_del
Nov 14 23:41:49 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-b68cb032-5e0c-4eb4-94a3-f1fee18b97ef tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] Deletion of /opt/stack/data/nova/instances/91603fef-c1cc-4fa1-96b2-e840db651627_del complete
Nov 14 23:41:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e7a53e9-6982-4c93-a830-a49cf0ce76bd/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-b68cb032-5e0c-4eb4-94a3-f1fee18b97ef tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75341) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 14 23:41:49 user nova-compute[75341]: INFO nova.virt.libvirt.host [None req-b68cb032-5e0c-4eb4-94a3-f1fee18b97ef tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] UEFI support detected
Nov 14 23:41:49 user nova-compute[75341]: INFO nova.compute.manager [None req-b68cb032-5e0c-4eb4-94a3-f1fee18b97ef tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] Took 1.37 seconds to destroy the instance on the hypervisor.
Nov 14 23:41:49 user nova-compute[75341]: DEBUG oslo.service.loopingcall [None req-b68cb032-5e0c-4eb4-94a3-f1fee18b97ef tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75341) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG nova.compute.manager [-] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] Deallocating network for instance {{(pid=75341) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] deallocate_for_instance() {{(pid=75341) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:41:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:41:50 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 23:41:50 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 23:41:50 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 23:41:50 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 23:41:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a308a35f-c8d7-482c-a93d-5d9eb473d4e1/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:50 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:41:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a308a35f-c8d7-482c-a93d-5d9eb473d4e1/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:41:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a308a35f-c8d7-482c-a93d-5d9eb473d4e1/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:50 user nova-compute[75341]: INFO nova.compute.manager [-] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] Took 0.60 seconds to deallocate network for instance.
Nov 14 23:41:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a308a35f-c8d7-482c-a93d-5d9eb473d4e1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:41:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8d3b42b-11b5-477a-afb1-80a1786b693b/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8d3b42b-11b5-477a-afb1-80a1786b693b/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:41:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8d3b42b-11b5-477a-afb1-80a1786b693b/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:41:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:50 user nova-compute[75341]: DEBUG nova.compute.manager [req-19e1f0e9-b4c7-438e-a9b7-78920db2a9bf req-4ecebd46-c7b0-4396-851c-99997d570ece service nova] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] Received event network-vif-plugged-c53d37cc-db96-4531-9095-053de7f58643 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:41:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-19e1f0e9-b4c7-438e-a9b7-78920db2a9bf req-4ecebd46-c7b0-4396-851c-99997d570ece service nova] Acquiring lock "91603fef-c1cc-4fa1-96b2-e840db651627-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:41:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-19e1f0e9-b4c7-438e-a9b7-78920db2a9bf req-4ecebd46-c7b0-4396-851c-99997d570ece service nova] Lock "91603fef-c1cc-4fa1-96b2-e840db651627-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:41:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-19e1f0e9-b4c7-438e-a9b7-78920db2a9bf req-4ecebd46-c7b0-4396-851c-99997d570ece service nova] Lock "91603fef-c1cc-4fa1-96b2-e840db651627-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:41:50 user nova-compute[75341]: DEBUG nova.compute.manager [req-19e1f0e9-b4c7-438e-a9b7-78920db2a9bf req-4ecebd46-c7b0-4396-851c-99997d570ece service nova] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] No waiting events found dispatching network-vif-plugged-c53d37cc-db96-4531-9095-053de7f58643 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:41:50 user nova-compute[75341]: WARNING nova.compute.manager [req-19e1f0e9-b4c7-438e-a9b7-78920db2a9bf req-4ecebd46-c7b0-4396-851c-99997d570ece service nova] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] Received unexpected event network-vif-plugged-c53d37cc-db96-4531-9095-053de7f58643 for instance with vm_state active and task_state deleting.
Nov 14 23:41:50 user nova-compute[75341]: DEBUG nova.compute.manager [req-19e1f0e9-b4c7-438e-a9b7-78920db2a9bf req-4ecebd46-c7b0-4396-851c-99997d570ece service nova] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] Received event network-vif-deleted-c53d37cc-db96-4531-9095-053de7f58643 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:41:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8d3b42b-11b5-477a-afb1-80a1786b693b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:41:51 user nova-compute[75341]: INFO nova.compute.manager [None req-b68cb032-5e0c-4eb4-94a3-f1fee18b97ef tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] [instance: 91603fef-c1cc-4fa1-96b2-e840db651627] Took 1.01 seconds to detach 1 volumes for instance.
Nov 14 23:41:51 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:41:51 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:41:51 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Hypervisor/Node resource view: name=user free_ram=6609MB free_disk=25.64202117919922GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75341) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 23:41:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:41:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:41:51 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-14b75462-9d10-4d71-8a5a-85d6610a10be tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Snapshot image upload complete
Nov 14 23:41:51 user nova-compute[75341]: DEBUG nova.compute.manager [None req-14b75462-9d10-4d71-8a5a-85d6610a10be tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 23:41:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b68cb032-5e0c-4eb4-94a3-f1fee18b97ef tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:41:51 user nova-compute[75341]: INFO nova.compute.manager [None req-14b75462-9d10-4d71-8a5a-85d6610a10be tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Shelve offloading
Nov 14 23:41:51 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Instance destroyed successfully.
Nov 14 23:41:51 user nova-compute[75341]: DEBUG nova.compute.manager [None req-14b75462-9d10-4d71-8a5a-85d6610a10be tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 23:41:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-14b75462-9d10-4d71-8a5a-85d6610a10be tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Acquiring lock "refresh_cache-a308a35f-c8d7-482c-a93d-5d9eb473d4e1" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:41:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-14b75462-9d10-4d71-8a5a-85d6610a10be tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Acquired lock "refresh_cache-a308a35f-c8d7-482c-a93d-5d9eb473d4e1" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:41:51 user nova-compute[75341]: DEBUG nova.network.neutron [None req-14b75462-9d10-4d71-8a5a-85d6610a10be tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 23:41:51 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 881351d7-31f9-44f4-8571-8f540bbec29c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:41:51 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 91603fef-c1cc-4fa1-96b2-e840db651627 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:41:51 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance a308a35f-c8d7-482c-a93d-5d9eb473d4e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:41:51 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance a0cffbac-f552-47bf-bd6c-dabb70e7c867 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:41:51 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 0e7a53e9-6982-4c93-a830-a49cf0ce76bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:41:51 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance b7d427ed-6ac3-46d9-bebc-d672f465f850 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:41:51 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 163c448b-0183-41bb-b6e0-61917f6ad781 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:41:51 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:41:51 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 9d03c7a3-e816-43b0-8616-60dea7a4e81a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:41:51 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 44080c0d-56eb-4987-aa4b-59f161dcbc0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:41:51 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 0223a98e-e08f-4a0f-a707-3770c7a99b00 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:41:51 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance d8d3b42b-11b5-477a-afb1-80a1786b693b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:41:51 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 23:41:51 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 23:41:52 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:41:52 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:41:52 user nova-compute[75341]: DEBUG nova.network.neutron [None req-14b75462-9d10-4d71-8a5a-85d6610a10be tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Updating instance_info_cache with network_info: [{"id": "4f1d8292-7392-4939-9303-437dc108b4a4", "address": "fa:16:3e:be:2c:ef", "network": {"id": "e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-64240219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f27e41f4cc1451291b8aca34544867b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f1d8292-73", "ovs_interfaceid": "4f1d8292-7392-4939-9303-437dc108b4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:41:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-14b75462-9d10-4d71-8a5a-85d6610a10be tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Releasing lock "refresh_cache-a308a35f-c8d7-482c-a93d-5d9eb473d4e1" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:41:52 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Compute_service record updated for user:user {{(pid=75341) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 23:41:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.874s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:41:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b68cb032-5e0c-4eb4-94a3-f1fee18b97ef tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.831s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:41:52 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-b68cb032-5e0c-4eb4-94a3-f1fee18b97ef tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:41:52 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-b68cb032-5e0c-4eb4-94a3-f1fee18b97ef tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:41:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b68cb032-5e0c-4eb4-94a3-f1fee18b97ef tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.360s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:41:52 user nova-compute[75341]: INFO nova.scheduler.client.report [None req-b68cb032-5e0c-4eb4-94a3-f1fee18b97ef tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Deleted allocations for instance 91603fef-c1cc-4fa1-96b2-e840db651627
Nov 14 23:41:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b68cb032-5e0c-4eb4-94a3-f1fee18b97ef tempest-DeleteServersTestJSON-177205866 tempest-DeleteServersTestJSON-177205866-project-member] Lock "91603fef-c1cc-4fa1-96b2-e840db651627" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.390s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:41:52 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Instance destroyed successfully.
Nov 14 23:41:52 user nova-compute[75341]: DEBUG nova.objects.instance [None req-14b75462-9d10-4d71-8a5a-85d6610a10be tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lazy-loading 'resources' on Instance uuid a308a35f-c8d7-482c-a93d-5d9eb473d4e1 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:41:52 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-14b75462-9d10-4d71-8a5a-85d6610a10be tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:39:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-173111556',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-173111556',id=3,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0Mg2JrUiYyfg6677+2Zv9Zqfgif2/3/pm4zugiZs2hm3xmaZY7SDs9SySwEI9I4Xie+mX5Zi6rK0j32qh+7Hye8jW21rtlODM9AFIkTLXzgrChX2YVLtprZJUc0cBR9g==',key_name='tempest-keypair-2143336801',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:40:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5f27e41f4cc1451291b8aca34544867b',ramdisk_id='',reservation_id='r-w2ae1nv0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-946394493',owner_user_name='tempest-AttachVolumeShelveTestJSON-946394493-project-member',shelved_at='2023-11-14T23:41:51.391628',shelved_host='user',shelved_image_id='f171a069-dd12-4efd-bfcb-aa2e28fcb5ee'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:41:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38acd33ad6754965a53017185f473f8a',uuid=a308a35f-c8d7-482c-a93d-5d9eb473d4e1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "4f1d8292-7392-4939-9303-437dc108b4a4", "address": "fa:16:3e:be:2c:ef", "network": {"id": "e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-64240219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f27e41f4cc1451291b8aca34544867b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f1d8292-73", "ovs_interfaceid": "4f1d8292-7392-4939-9303-437dc108b4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 23:41:52 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-14b75462-9d10-4d71-8a5a-85d6610a10be tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Converting VIF {"id": "4f1d8292-7392-4939-9303-437dc108b4a4", "address": "fa:16:3e:be:2c:ef", "network": {"id": "e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-64240219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f27e41f4cc1451291b8aca34544867b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f1d8292-73", "ovs_interfaceid": "4f1d8292-7392-4939-9303-437dc108b4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:41:52 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-14b75462-9d10-4d71-8a5a-85d6610a10be tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:2c:ef,bridge_name='br-int',has_traffic_filtering=True,id=4f1d8292-7392-4939-9303-437dc108b4a4,network=Network(e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f1d8292-73') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:41:52 user nova-compute[75341]: DEBUG os_vif [None req-14b75462-9d10-4d71-8a5a-85d6610a10be tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:2c:ef,bridge_name='br-int',has_traffic_filtering=True,id=4f1d8292-7392-4939-9303-437dc108b4a4,network=Network(e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f1d8292-73') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 23:41:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4f1d8292-73, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:41:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:52 user nova-compute[75341]: DEBUG nova.compute.manager [req-1ac30c5e-19db-43c4-babf-e331dcd15ff2 req-287267b9-e6a5-4924-867c-1bd4c8af6e54 service nova] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Received event network-changed-4f1d8292-7392-4939-9303-437dc108b4a4 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:41:52 user nova-compute[75341]: DEBUG nova.compute.manager [req-1ac30c5e-19db-43c4-babf-e331dcd15ff2 req-287267b9-e6a5-4924-867c-1bd4c8af6e54 service nova] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Refreshing instance network info cache due to event network-changed-4f1d8292-7392-4939-9303-437dc108b4a4. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:41:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-1ac30c5e-19db-43c4-babf-e331dcd15ff2 req-287267b9-e6a5-4924-867c-1bd4c8af6e54 service nova] Acquiring lock "refresh_cache-a308a35f-c8d7-482c-a93d-5d9eb473d4e1" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:41:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-1ac30c5e-19db-43c4-babf-e331dcd15ff2 req-287267b9-e6a5-4924-867c-1bd4c8af6e54 service nova] Acquired lock "refresh_cache-a308a35f-c8d7-482c-a93d-5d9eb473d4e1" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:41:52 user nova-compute[75341]: DEBUG nova.network.neutron [req-1ac30c5e-19db-43c4-babf-e331dcd15ff2 req-287267b9-e6a5-4924-867c-1bd4c8af6e54 service nova] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Refreshing network info cache for port 4f1d8292-7392-4939-9303-437dc108b4a4 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:41:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:41:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b136ad29-651f-406d-a623-3d8beda3400a) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:41:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:41:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:52 user nova-compute[75341]: INFO os_vif [None req-14b75462-9d10-4d71-8a5a-85d6610a10be tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:2c:ef,bridge_name='br-int',has_traffic_filtering=True,id=4f1d8292-7392-4939-9303-437dc108b4a4,network=Network(e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f1d8292-73')
Nov 14 23:41:52 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-14b75462-9d10-4d71-8a5a-85d6610a10be tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Deleting instance files /opt/stack/data/nova/instances/a308a35f-c8d7-482c-a93d-5d9eb473d4e1_del
Nov 14 23:41:52 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-14b75462-9d10-4d71-8a5a-85d6610a10be tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Deletion of /opt/stack/data/nova/instances/a308a35f-c8d7-482c-a93d-5d9eb473d4e1_del complete
Nov 14 23:41:53 user nova-compute[75341]: INFO nova.scheduler.client.report [None req-14b75462-9d10-4d71-8a5a-85d6610a10be tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Deleted allocations for instance a308a35f-c8d7-482c-a93d-5d9eb473d4e1
Nov 14 23:41:53 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:41:53 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:41:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-14b75462-9d10-4d71-8a5a-85d6610a10be tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:41:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-14b75462-9d10-4d71-8a5a-85d6610a10be tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:41:53 user nova-compute[75341]: DEBUG nova.objects.instance [None req-14b75462-9d10-4d71-8a5a-85d6610a10be tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lazy-loading 'numa_topology' on Instance uuid a308a35f-c8d7-482c-a93d-5d9eb473d4e1 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:41:53 user nova-compute[75341]: DEBUG nova.objects.base [None req-14b75462-9d10-4d71-8a5a-85d6610a10be tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Object Instance<a308a35f-c8d7-482c-a93d-5d9eb473d4e1> lazy-loaded attributes: resources,numa_topology {{(pid=75341) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 23:41:53 user nova-compute[75341]: DEBUG nova.network.neutron [req-1ac30c5e-19db-43c4-babf-e331dcd15ff2 req-287267b9-e6a5-4924-867c-1bd4c8af6e54 service nova] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Updated VIF entry in instance network info cache for port 4f1d8292-7392-4939-9303-437dc108b4a4. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:41:53 user nova-compute[75341]: DEBUG nova.network.neutron [req-1ac30c5e-19db-43c4-babf-e331dcd15ff2 req-287267b9-e6a5-4924-867c-1bd4c8af6e54 service nova] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Updating instance_info_cache with network_info: [{"id": "4f1d8292-7392-4939-9303-437dc108b4a4", "address": "fa:16:3e:be:2c:ef", "network": {"id": "e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-64240219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f27e41f4cc1451291b8aca34544867b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap4f1d8292-73", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:41:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-1ac30c5e-19db-43c4-babf-e331dcd15ff2 req-287267b9-e6a5-4924-867c-1bd4c8af6e54 service nova] Releasing lock "refresh_cache-a308a35f-c8d7-482c-a93d-5d9eb473d4e1" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:41:53 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-14b75462-9d10-4d71-8a5a-85d6610a10be tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:41:53 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-14b75462-9d10-4d71-8a5a-85d6610a10be tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:41:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-14b75462-9d10-4d71-8a5a-85d6610a10be tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.349s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:41:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-14b75462-9d10-4d71-8a5a-85d6610a10be tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "a308a35f-c8d7-482c-a93d-5d9eb473d4e1" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.343s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:41:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:41:59 user nova-compute[75341]: DEBUG nova.compute.manager [req-591d75ce-9ebe-4a74-9f61-6c58d4d82624 req-50752171-0d34-4a13-80bd-487c23dc9163 service nova] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Received event network-changed-8a863ecb-919e-42ac-8507-1c9af9135895 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:41:59 user nova-compute[75341]: DEBUG nova.compute.manager [req-591d75ce-9ebe-4a74-9f61-6c58d4d82624 req-50752171-0d34-4a13-80bd-487c23dc9163 service nova] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Refreshing instance network info cache due to event network-changed-8a863ecb-919e-42ac-8507-1c9af9135895. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:41:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-591d75ce-9ebe-4a74-9f61-6c58d4d82624 req-50752171-0d34-4a13-80bd-487c23dc9163 service nova] Acquiring lock "refresh_cache-a0cffbac-f552-47bf-bd6c-dabb70e7c867" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:41:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-591d75ce-9ebe-4a74-9f61-6c58d4d82624 req-50752171-0d34-4a13-80bd-487c23dc9163 service nova] Acquired lock "refresh_cache-a0cffbac-f552-47bf-bd6c-dabb70e7c867" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:41:59 user nova-compute[75341]: DEBUG nova.network.neutron [req-591d75ce-9ebe-4a74-9f61-6c58d4d82624 req-50752171-0d34-4a13-80bd-487c23dc9163 service nova] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Refreshing network info cache for port 8a863ecb-919e-42ac-8507-1c9af9135895 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:42:00 user nova-compute[75341]: DEBUG nova.network.neutron [req-591d75ce-9ebe-4a74-9f61-6c58d4d82624 req-50752171-0d34-4a13-80bd-487c23dc9163 service nova] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Updated VIF entry in instance network info cache for port 8a863ecb-919e-42ac-8507-1c9af9135895. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:42:00 user nova-compute[75341]: DEBUG nova.network.neutron [req-591d75ce-9ebe-4a74-9f61-6c58d4d82624 req-50752171-0d34-4a13-80bd-487c23dc9163 service nova] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Updating instance_info_cache with network_info: [{"id": "8a863ecb-919e-42ac-8507-1c9af9135895", "address": "fa:16:3e:0c:75:47", "network": {"id": "a59b651e-81c5-4a68-b694-1e84de25e915", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1023462603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8a897400c74100ad6c115397bc84ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a863ecb-91", "ovs_interfaceid": "8a863ecb-919e-42ac-8507-1c9af9135895", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:42:00 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-591d75ce-9ebe-4a74-9f61-6c58d4d82624 req-50752171-0d34-4a13-80bd-487c23dc9163 service nova] Releasing lock "refresh_cache-a0cffbac-f552-47bf-bd6c-dabb70e7c867" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:42:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:01 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6ecb054f-d471-4eb3-94b4-aac3816abd3c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Acquiring lock "a0cffbac-f552-47bf-bd6c-dabb70e7c867" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:42:01 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6ecb054f-d471-4eb3-94b4-aac3816abd3c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Lock "a0cffbac-f552-47bf-bd6c-dabb70e7c867" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:42:01 user nova-compute[75341]: DEBUG nova.objects.instance [None req-6ecb054f-d471-4eb3-94b4-aac3816abd3c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Lazy-loading 'flavor' on Instance uuid a0cffbac-f552-47bf-bd6c-dabb70e7c867 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:42:01 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6ecb054f-d471-4eb3-94b4-aac3816abd3c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Lock "a0cffbac-f552-47bf-bd6c-dabb70e7c867" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.098s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:42:01 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6ecb054f-d471-4eb3-94b4-aac3816abd3c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Acquiring lock "a0cffbac-f552-47bf-bd6c-dabb70e7c867" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:42:01 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6ecb054f-d471-4eb3-94b4-aac3816abd3c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Lock "a0cffbac-f552-47bf-bd6c-dabb70e7c867" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:42:01 user nova-compute[75341]: INFO nova.compute.manager [None req-6ecb054f-d471-4eb3-94b4-aac3816abd3c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Attaching volume 6f2c6115-2b76-4800-bb46-0d69bed0ec02 to /dev/vdb
Nov 14 23:42:01 user nova-compute[75341]: DEBUG nova.compute.manager [req-5e655d6f-2dfa-498d-9477-3c32f24a7b44 req-4c7836de-2ae1-49d5-8df1-65351bb6fdd7 service nova] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Received event network-changed-6f1be2e1-796a-4b73-a56f-2a5286945ea3 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:42:01 user nova-compute[75341]: DEBUG nova.compute.manager [req-5e655d6f-2dfa-498d-9477-3c32f24a7b44 req-4c7836de-2ae1-49d5-8df1-65351bb6fdd7 service nova] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Refreshing instance network info cache due to event network-changed-6f1be2e1-796a-4b73-a56f-2a5286945ea3. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:42:01 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-5e655d6f-2dfa-498d-9477-3c32f24a7b44 req-4c7836de-2ae1-49d5-8df1-65351bb6fdd7 service nova] Acquiring lock "refresh_cache-0e7a53e9-6982-4c93-a830-a49cf0ce76bd" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:42:01 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-5e655d6f-2dfa-498d-9477-3c32f24a7b44 req-4c7836de-2ae1-49d5-8df1-65351bb6fdd7 service nova] Acquired lock "refresh_cache-0e7a53e9-6982-4c93-a830-a49cf0ce76bd" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:42:01 user nova-compute[75341]: DEBUG nova.network.neutron [req-5e655d6f-2dfa-498d-9477-3c32f24a7b44 req-4c7836de-2ae1-49d5-8df1-65351bb6fdd7 service nova] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Refreshing network info cache for port 6f1be2e1-796a-4b73-a56f-2a5286945ea3 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:42:01 user nova-compute[75341]: DEBUG os_brick.utils [None req-6ecb054f-d471-4eb3-94b4-aac3816abd3c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:42:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:01 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[adca4765-4d07-4ead-9c7b-674a34168bcf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6d1cfca09c9\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:01 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4aca444-7c2d-4ab8-96b3-fa50a089c93d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:01 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1012d6d-6cdc-463f-adc9-c69b283595c4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:01 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c1e2d6-f09b-4c35-be0b-6e1c92a9dade]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-6ecb054f-d471-4eb3-94b4-aac3816abd3c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Running cmd (subprocess): nvme version {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-6ecb054f-d471-4eb3-94b4-aac3816abd3c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] 'nvme version' failed. Not Retrying. {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:42:01 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6ecb054f-d471-4eb3-94b4-aac3816abd3c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] nvme not present on system {{(pid=75341) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 23:42:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:42:01 user nova-compute[75341]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 23:42:01 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ddaec0-d6f8-4cdc-a1d7-bba7014a9e6e]: (4, '') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:01 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-6ecb054f-d471-4eb3-94b4-aac3816abd3c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75341) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 23:42:01 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-6ecb054f-d471-4eb3-94b4-aac3816abd3c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 23:42:01 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-6ecb054f-d471-4eb3-94b4-aac3816abd3c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] LIGHTOS: no hostnqn found. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 23:42:01 user nova-compute[75341]: DEBUG os_brick.utils [None req-6ecb054f-d471-4eb3-94b4-aac3816abd3c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6d1cfca09c9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:42:01 user nova-compute[75341]: DEBUG nova.virt.block_device [None req-6ecb054f-d471-4eb3-94b4-aac3816abd3c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Updating existing volume attachment record: a27385d3-286e-4704-9402-739b38f0f2f9 {{(pid=75341) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 23:42:01 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8edb877f-f6aa-4bba-b5a6-5f181bdc06b7 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Acquiring lock "0e7a53e9-6982-4c93-a830-a49cf0ce76bd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:42:01 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8edb877f-f6aa-4bba-b5a6-5f181bdc06b7 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Lock "0e7a53e9-6982-4c93-a830-a49cf0ce76bd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:42:01 user nova-compute[75341]: DEBUG nova.objects.instance [None req-8edb877f-f6aa-4bba-b5a6-5f181bdc06b7 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Lazy-loading 'flavor' on Instance uuid 0e7a53e9-6982-4c93-a830-a49cf0ce76bd {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:42:01 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8edb877f-f6aa-4bba-b5a6-5f181bdc06b7 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Lock "0e7a53e9-6982-4c93-a830-a49cf0ce76bd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:42:02 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8edb877f-f6aa-4bba-b5a6-5f181bdc06b7 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Acquiring lock "0e7a53e9-6982-4c93-a830-a49cf0ce76bd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:42:02 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8edb877f-f6aa-4bba-b5a6-5f181bdc06b7 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Lock "0e7a53e9-6982-4c93-a830-a49cf0ce76bd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:42:02 user nova-compute[75341]: INFO nova.compute.manager [None req-8edb877f-f6aa-4bba-b5a6-5f181bdc06b7 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Attaching volume 0df8b689-2583-4be4-8499-cc2e54889ac2 to /dev/vdb
Nov 14 23:42:02 user nova-compute[75341]: DEBUG nova.network.neutron [req-5e655d6f-2dfa-498d-9477-3c32f24a7b44 req-4c7836de-2ae1-49d5-8df1-65351bb6fdd7 service nova] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Updated VIF entry in instance network info cache for port 6f1be2e1-796a-4b73-a56f-2a5286945ea3. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:42:02 user nova-compute[75341]: DEBUG nova.network.neutron [req-5e655d6f-2dfa-498d-9477-3c32f24a7b44 req-4c7836de-2ae1-49d5-8df1-65351bb6fdd7 service nova] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Updating instance_info_cache with network_info: [{"id": "6f1be2e1-796a-4b73-a56f-2a5286945ea3", "address": "fa:16:3e:a0:1d:39", "network": {"id": "7071106e-e54c-4358-97b0-3c0778da8843", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2081310732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaee8b9e61234bc68b1da5fceb349cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f1be2e1-79", "ovs_interfaceid": "6f1be2e1-796a-4b73-a56f-2a5286945ea3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:42:02 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-5e655d6f-2dfa-498d-9477-3c32f24a7b44 req-4c7836de-2ae1-49d5-8df1-65351bb6fdd7 service nova] Releasing lock "refresh_cache-0e7a53e9-6982-4c93-a830-a49cf0ce76bd" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:42:02 user nova-compute[75341]: DEBUG os_brick.utils [None req-8edb877f-f6aa-4bba-b5a6-5f181bdc06b7 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:42:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:02 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb41a7d8-2c1d-47c8-97b4-3673dcf21cb6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6d1cfca09c9\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:02 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2ed0f3-8266-459c-ac40-2be7e3a4df9a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:02 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb32195-3dc3-48d1-98c8-1b5b45d280c8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:02 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dee55ee-7803-4e8e-ae6b-d2c334cf2941]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-8edb877f-f6aa-4bba-b5a6-5f181bdc06b7 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Running cmd (subprocess): nvme version {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-8edb877f-f6aa-4bba-b5a6-5f181bdc06b7 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] 'nvme version' failed. Not Retrying. {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:42:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8edb877f-f6aa-4bba-b5a6-5f181bdc06b7 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] nvme not present on system {{(pid=75341) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 23:42:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:42:02 user nova-compute[75341]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 23:42:02 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b2810a2-3c0d-42ea-9224-362c2551ad50]: (4, '') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-8edb877f-f6aa-4bba-b5a6-5f181bdc06b7 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75341) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 23:42:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-8edb877f-f6aa-4bba-b5a6-5f181bdc06b7 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 23:42:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-8edb877f-f6aa-4bba-b5a6-5f181bdc06b7 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] LIGHTOS: no hostnqn found. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 23:42:02 user nova-compute[75341]: DEBUG os_brick.utils [None req-8edb877f-f6aa-4bba-b5a6-5f181bdc06b7 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6d1cfca09c9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:42:02 user nova-compute[75341]: DEBUG nova.virt.block_device [None req-8edb877f-f6aa-4bba-b5a6-5f181bdc06b7 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Updating existing volume attachment record: 74f29499-5424-4b14-9f59-5a5749fd16db {{(pid=75341) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 23:42:02 user nova-compute[75341]: DEBUG nova.compute.manager [req-f17b2834-3293-486d-8685-64291e7ee6de req-14bbf99f-ae1f-48b7-9516-d38c5dd1db5b service nova] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] Received event network-changed-a0990271-0de2-47ce-a33e-75cb022ba7c6 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:42:02 user nova-compute[75341]: DEBUG nova.compute.manager [req-f17b2834-3293-486d-8685-64291e7ee6de req-14bbf99f-ae1f-48b7-9516-d38c5dd1db5b service nova] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] Refreshing instance network info cache due to event network-changed-a0990271-0de2-47ce-a33e-75cb022ba7c6. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:42:02 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-f17b2834-3293-486d-8685-64291e7ee6de req-14bbf99f-ae1f-48b7-9516-d38c5dd1db5b service nova] Acquiring lock "refresh_cache-b7d427ed-6ac3-46d9-bebc-d672f465f850" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:42:02 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-f17b2834-3293-486d-8685-64291e7ee6de req-14bbf99f-ae1f-48b7-9516-d38c5dd1db5b service nova] Acquired lock "refresh_cache-b7d427ed-6ac3-46d9-bebc-d672f465f850" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:42:02 user nova-compute[75341]: DEBUG nova.network.neutron [req-f17b2834-3293-486d-8685-64291e7ee6de req-14bbf99f-ae1f-48b7-9516-d38c5dd1db5b service nova] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] Refreshing network info cache for port a0990271-0de2-47ce-a33e-75cb022ba7c6 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:42:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:02 user nova-compute[75341]: DEBUG nova.network.neutron [req-f17b2834-3293-486d-8685-64291e7ee6de req-14bbf99f-ae1f-48b7-9516-d38c5dd1db5b service nova] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] Updated VIF entry in instance network info cache for port a0990271-0de2-47ce-a33e-75cb022ba7c6. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:42:02 user nova-compute[75341]: DEBUG nova.network.neutron [req-f17b2834-3293-486d-8685-64291e7ee6de req-14bbf99f-ae1f-48b7-9516-d38c5dd1db5b service nova] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] Updating instance_info_cache with network_info: [{"id": "a0990271-0de2-47ce-a33e-75cb022ba7c6", "address": "fa:16:3e:1e:60:6f", "network": {"id": "1bb9b4c1-b9b7-4ba6-8d17-879af734945f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1477588770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bc48ec5e944fe7b9bd6d87b32fdad7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0990271-0d", "ovs_interfaceid": "a0990271-0de2-47ce-a33e-75cb022ba7c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:42:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-f17b2834-3293-486d-8685-64291e7ee6de req-14bbf99f-ae1f-48b7-9516-d38c5dd1db5b service nova] Releasing lock "refresh_cache-b7d427ed-6ac3-46d9-bebc-d672f465f850" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:42:04 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-75330891-5bdc-4a0e-88c4-f7178ff76771 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Acquiring lock "interface-163c448b-0183-41bb-b6e0-61917f6ad781-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:42:04 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-75330891-5bdc-4a0e-88c4-f7178ff76771 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Lock "interface-163c448b-0183-41bb-b6e0-61917f6ad781-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:42:04 user nova-compute[75341]: DEBUG nova.objects.instance [None req-75330891-5bdc-4a0e-88c4-f7178ff76771 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Lazy-loading 'flavor' on Instance uuid 163c448b-0183-41bb-b6e0-61917f6ad781 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:42:04 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-036ba073-5506-4b3e-94af-17e6cc858dfc tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Acquiring lock "b7d427ed-6ac3-46d9-bebc-d672f465f850" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:42:04 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-036ba073-5506-4b3e-94af-17e6cc858dfc tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Lock "b7d427ed-6ac3-46d9-bebc-d672f465f850" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:42:04 user nova-compute[75341]: DEBUG nova.objects.instance [None req-036ba073-5506-4b3e-94af-17e6cc858dfc tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Lazy-loading 'flavor' on Instance uuid b7d427ed-6ac3-46d9-bebc-d672f465f850 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:42:04 user nova-compute[75341]: DEBUG nova.objects.instance [None req-75330891-5bdc-4a0e-88c4-f7178ff76771 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Lazy-loading 'pci_requests' on Instance uuid 163c448b-0183-41bb-b6e0-61917f6ad781 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:42:04 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-036ba073-5506-4b3e-94af-17e6cc858dfc tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Lock "b7d427ed-6ac3-46d9-bebc-d672f465f850" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.087s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:42:04 user nova-compute[75341]: DEBUG nova.objects.base [None req-75330891-5bdc-4a0e-88c4-f7178ff76771 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Object Instance<163c448b-0183-41bb-b6e0-61917f6ad781> lazy-loaded attributes: flavor,pci_requests {{(pid=75341) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 23:42:04 user nova-compute[75341]: DEBUG nova.network.neutron [None req-75330891-5bdc-4a0e-88c4-f7178ff76771 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] allocate_for_instance() {{(pid=75341) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 23:42:04 user nova-compute[75341]: DEBUG nova.policy [None req-75330891-5bdc-4a0e-88c4-f7178ff76771 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '48f384876a794dbfa3e7c89e6e20a232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc16bad01d434f7f9a66247f776d6269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75341) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 23:42:04 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-036ba073-5506-4b3e-94af-17e6cc858dfc tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Acquiring lock "b7d427ed-6ac3-46d9-bebc-d672f465f850" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:42:04 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-036ba073-5506-4b3e-94af-17e6cc858dfc tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Lock "b7d427ed-6ac3-46d9-bebc-d672f465f850" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:42:04 user nova-compute[75341]: INFO nova.compute.manager [None req-036ba073-5506-4b3e-94af-17e6cc858dfc tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] Attaching volume bd8fcacd-78e7-46eb-a630-a974fff87da3 to /dev/sdc
Nov 14 23:42:04 user nova-compute[75341]: DEBUG os_brick.utils [None req-036ba073-5506-4b3e-94af-17e6cc858dfc tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:42:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:04 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a9c461-2c8a-4dd9-bfd8-9ba702e0df97]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6d1cfca09c9\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:04 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e91fe5f-9a78-4c89-9172-a93f3d14b0a0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:04 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb65b49-328d-4a7b-98c0-4a8ea8392315]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:04 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[670f53d6-59ba-44ab-8cf3-7ad8e1fa78fd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-036ba073-5506-4b3e-94af-17e6cc858dfc tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Running cmd (subprocess): nvme version {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-036ba073-5506-4b3e-94af-17e6cc858dfc tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] 'nvme version' failed. Not Retrying. {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:42:04 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.nvmeof [None req-036ba073-5506-4b3e-94af-17e6cc858dfc tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] nvme not present on system {{(pid=75341) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 23:42:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:04 user nova-compute[75341]: DEBUG nova.compute.manager [req-e6045392-5689-41e4-88f7-eb06e5323ce7 req-8f6f48b6-6c54-40c8-92bf-46d0c4bba775 service nova] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Received event network-changed-87b091a7-76a0-46e1-b1fd-fd305d1ce55e {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:42:04 user nova-compute[75341]: DEBUG nova.compute.manager [req-e6045392-5689-41e4-88f7-eb06e5323ce7 req-8f6f48b6-6c54-40c8-92bf-46d0c4bba775 service nova] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Refreshing instance network info cache due to event network-changed-87b091a7-76a0-46e1-b1fd-fd305d1ce55e. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:42:04 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-e6045392-5689-41e4-88f7-eb06e5323ce7 req-8f6f48b6-6c54-40c8-92bf-46d0c4bba775 service nova] Acquiring lock "refresh_cache-163c448b-0183-41bb-b6e0-61917f6ad781" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:42:04 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-e6045392-5689-41e4-88f7-eb06e5323ce7 req-8f6f48b6-6c54-40c8-92bf-46d0c4bba775 service nova] Acquired lock "refresh_cache-163c448b-0183-41bb-b6e0-61917f6ad781" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:42:04 user nova-compute[75341]: DEBUG nova.network.neutron [req-e6045392-5689-41e4-88f7-eb06e5323ce7 req-8f6f48b6-6c54-40c8-92bf-46d0c4bba775 service nova] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Refreshing network info cache for port 87b091a7-76a0-46e1-b1fd-fd305d1ce55e {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:42:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:42:04 user nova-compute[75341]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 23:42:04 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4fd8ea-ff4a-4659-9130-9991b91a17f5]: (4, '') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:04 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-036ba073-5506-4b3e-94af-17e6cc858dfc tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75341) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 23:42:04 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-036ba073-5506-4b3e-94af-17e6cc858dfc tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 23:42:04 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-036ba073-5506-4b3e-94af-17e6cc858dfc tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] LIGHTOS: no hostnqn found. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 23:42:04 user nova-compute[75341]: DEBUG os_brick.utils [None req-036ba073-5506-4b3e-94af-17e6cc858dfc tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6d1cfca09c9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:42:04 user nova-compute[75341]: DEBUG nova.virt.block_device [None req-036ba073-5506-4b3e-94af-17e6cc858dfc tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] Updating existing volume attachment record: 0a2403cf-fd23-4024-a13b-27f842e28e61 {{(pid=75341) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 23:42:05 user nova-compute[75341]: DEBUG nova.network.neutron [None req-75330891-5bdc-4a0e-88c4-f7178ff76771 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Successfully created port: 71326c15-7e6c-4b5c-88fb-5648e74f1754 {{(pid=75341) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 23:42:05 user nova-compute[75341]: DEBUG nova.network.neutron [req-e6045392-5689-41e4-88f7-eb06e5323ce7 req-8f6f48b6-6c54-40c8-92bf-46d0c4bba775 service nova] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Updated VIF entry in instance network info cache for port 87b091a7-76a0-46e1-b1fd-fd305d1ce55e. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:42:05 user nova-compute[75341]: DEBUG nova.network.neutron [req-e6045392-5689-41e4-88f7-eb06e5323ce7 req-8f6f48b6-6c54-40c8-92bf-46d0c4bba775 service nova] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Updating instance_info_cache with network_info: [{"id": "87b091a7-76a0-46e1-b1fd-fd305d1ce55e", "address": "fa:16:3e:2f:5b:cc", "network": {"id": "0a21b45e-de67-426a-bc33-c012fb2b5528", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1524380697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc16bad01d434f7f9a66247f776d6269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87b091a7-76", "ovs_interfaceid": "87b091a7-76a0-46e1-b1fd-fd305d1ce55e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:42:05 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-e6045392-5689-41e4-88f7-eb06e5323ce7 req-8f6f48b6-6c54-40c8-92bf-46d0c4bba775 service nova] Releasing lock "refresh_cache-163c448b-0183-41bb-b6e0-61917f6ad781" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:42:05 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG nova.network.neutron [None req-75330891-5bdc-4a0e-88c4-f7178ff76771 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Successfully updated port: 71326c15-7e6c-4b5c-88fb-5648e74f1754 {{(pid=75341) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-75330891-5bdc-4a0e-88c4-f7178ff76771 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Acquiring lock "refresh_cache-163c448b-0183-41bb-b6e0-61917f6ad781" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-75330891-5bdc-4a0e-88c4-f7178ff76771 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Acquired lock "refresh_cache-163c448b-0183-41bb-b6e0-61917f6ad781" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG nova.network.neutron [None req-75330891-5bdc-4a0e-88c4-f7178ff76771 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG nova.compute.manager [req-d8ee1b8f-725e-4e4e-be9d-02f9bf0f9e6e req-eb090b47-7de0-4624-8625-1a65269ffb97 service nova] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Received event network-changed-71326c15-7e6c-4b5c-88fb-5648e74f1754 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG nova.compute.manager [req-d8ee1b8f-725e-4e4e-be9d-02f9bf0f9e6e req-eb090b47-7de0-4624-8625-1a65269ffb97 service nova] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Refreshing instance network info cache due to event network-changed-71326c15-7e6c-4b5c-88fb-5648e74f1754. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-d8ee1b8f-725e-4e4e-be9d-02f9bf0f9e6e req-eb090b47-7de0-4624-8625-1a65269ffb97 service nova] Acquiring lock "refresh_cache-163c448b-0183-41bb-b6e0-61917f6ad781" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ecb054f-d471-4eb3-94b4-aac3816abd3c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Calling os-brick to attach iSCSI Volume {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ecb054f-d471-4eb3-94b4-aac3816abd3c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SviFPMDV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:42:06 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-6ecb054f-d471-4eb3-94b4-aac3816abd3c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:42:06 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-6ecb054f-d471-4eb3-94b4-aac3816abd3c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-6ecb054f-d471-4eb3-94b4-aac3816abd3c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:42:06 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-6ecb054f-d471-4eb3-94b4-aac3816abd3c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:42:06 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-6ecb054f-d471-4eb3-94b4-aac3816abd3c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-6ecb054f-d471-4eb3-94b4-aac3816abd3c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:42:06 user nova-compute[75341]: INFO os_brick.initiator.connectors.iscsi [None req-6ecb054f-d471-4eb3-94b4-aac3816abd3c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 23:42:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02 -p 172.16.0.220:3260 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f7bda05-be49-4563-abe8-e4f6bc40651e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ecb054f-d471-4eb3-94b4-aac3816abd3c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 23:42:06 user nova-compute[75341]:  {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02 -p 172.16.0.220:3260 --interface default --op new {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b227fee-0374-40f2-a281-7dcdd0b3e672]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02] added\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ecb054f-d471-4eb3-94b4-aac3816abd3c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02] added
Nov 14 23:42:06 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[be1e268a-5fdd-44a9-bc12-2b1b8b3f76c1]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ecb054f-d471-4eb3-94b4-aac3816abd3c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33aef59-2e84-43c3-8a76-419f879d5ac0]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ecb054f-d471-4eb3-94b4-aac3816abd3c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SviFPMDV {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SviFPMDV" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[554fd9ba-8d2f-4fcb-830c-8ccad2267002]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ecb054f-d471-4eb3-94b4-aac3816abd3c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SviFPMDV'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1fe137-3432-4762-8ca1-177e9568d5a7]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ecb054f-d471-4eb3-94b4-aac3816abd3c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG nova.network.neutron [None req-75330891-5bdc-4a0e-88c4-f7178ff76771 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Updating instance_info_cache with network_info: [{"id": "87b091a7-76a0-46e1-b1fd-fd305d1ce55e", "address": "fa:16:3e:2f:5b:cc", "network": {"id": "0a21b45e-de67-426a-bc33-c012fb2b5528", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1524380697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc16bad01d434f7f9a66247f776d6269", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87b091a7-76", "ovs_interfaceid": "87b091a7-76a0-46e1-b1fd-fd305d1ce55e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "71326c15-7e6c-4b5c-88fb-5648e74f1754", "address": "fa:16:3e:97:bb:6e", "network": {"id": "a2d4fa10-64dc-4465-ba21-2b01b0583a67", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-671649606", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "dc16bad01d434f7f9a66247f776d6269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71326c15-7e", "ovs_interfaceid": "71326c15-7e6c-4b5c-88fb-5648e74f1754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-75330891-5bdc-4a0e-88c4-f7178ff76771 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Releasing lock "refresh_cache-163c448b-0183-41bb-b6e0-61917f6ad781" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-d8ee1b8f-725e-4e4e-be9d-02f9bf0f9e6e req-eb090b47-7de0-4624-8625-1a65269ffb97 service nova] Acquired lock "refresh_cache-163c448b-0183-41bb-b6e0-61917f6ad781" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG nova.network.neutron [req-d8ee1b8f-725e-4e4e-be9d-02f9bf0f9e6e req-eb090b47-7de0-4624-8625-1a65269ffb97 service nova] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Refreshing network info cache for port 71326c15-7e6c-4b5c-88fb-5648e74f1754 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae616567-9664-4304-a535-4692cff2bc24]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ecb054f-d471-4eb3-94b4-aac3816abd3c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)
Nov 14 23:42:06 user nova-compute[75341]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)
Nov 14 23:42:06 user nova-compute[75341]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)
Nov 14 23:42:06 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:42:06 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ecb054f-d471-4eb3-94b4-aac3816abd3c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)
Nov 14 23:42:06 user nova-compute[75341]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)
Nov 14 23:42:06 user nova-compute[75341]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)
Nov 14 23:42:06 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:42:06 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ba33c8e3-e0c8-4913-bb09-f3ab0a33083f tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] Acquiring lock "e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ba33c8e3-e0c8-4913-bb09-f3ab0a33083f tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] Lock "e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02 -p 172.16.0.220:3260 --login {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-75330891-5bdc-4a0e-88c4-f7178ff76771 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T23:40:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1560149904',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1560149904',id=7,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQ3a1x+okDjRVw62hbKhJtP80/zWFyvtGey5wIlVDB0NZ56fG+725fWUXyjh7/+IE35PijjUBR8Wcuw/LlwusTfjzX4MaOP3PLObnIQMoEItEWkt+BvyX7BQ255w2h2Gw==',key_name='tempest-keypair-1289222933',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:40:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='dc16bad01d434f7f9a66247f776d6269',ramdisk_id='',reservation_id='r-3r4vupg5',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1943224082',owner_user_name='tempest-TaggedAttachmentsTest-1943224082-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:40:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48f384876a794dbfa3e7c89e6e20a232',uuid=163c448b-0183-41bb-b6e0-61917f6ad781,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "71326c15-7e6c-4b5c-88fb-5648e74f1754", "address": "fa:16:3e:97:bb:6e", "network": {"id": "a2d4fa10-64dc-4465-ba21-2b01b0583a67", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-671649606", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "dc16bad01d434f7f9a66247f776d6269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71326c15-7e", "ovs_interfaceid": "71326c15-7e6c-4b5c-88fb-5648e74f1754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-75330891-5bdc-4a0e-88c4-f7178ff76771 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Converting VIF {"id": "71326c15-7e6c-4b5c-88fb-5648e74f1754", "address": "fa:16:3e:97:bb:6e", "network": {"id": "a2d4fa10-64dc-4465-ba21-2b01b0583a67", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-671649606", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "dc16bad01d434f7f9a66247f776d6269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71326c15-7e", "ovs_interfaceid": "71326c15-7e6c-4b5c-88fb-5648e74f1754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-75330891-5bdc-4a0e-88c4-f7178ff76771 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:bb:6e,bridge_name='br-int',has_traffic_filtering=True,id=71326c15-7e6c-4b5c-88fb-5648e74f1754,network=Network(a2d4fa10-64dc-4465-ba21-2b01b0583a67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71326c15-7e') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG os_vif [None req-75330891-5bdc-4a0e-88c4-f7178ff76771 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:bb:6e,bridge_name='br-int',has_traffic_filtering=True,id=71326c15-7e6c-4b5c-88fb-5648e74f1754,network=Network(a2d4fa10-64dc-4465-ba21-2b01b0583a67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71326c15-7e') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aafdde6d-31c9-50ca-aea6-0d8d6d39bd7d', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG nova.objects.instance [None req-ba33c8e3-e0c8-4913-bb09-f3ab0a33083f tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] Lazy-loading 'flavor' on Instance uuid e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG nova.compute.manager [req-fa2b2a0c-f849-467f-aa2c-0c5af1aeb901 req-b19a3349-04a4-47cc-aa15-d2ae06a11aed service nova] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Received event network-changed-295dbc30-38ed-4679-b876-719906e8f9f5 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG nova.compute.manager [req-fa2b2a0c-f849-467f-aa2c-0c5af1aeb901 req-b19a3349-04a4-47cc-aa15-d2ae06a11aed service nova] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Refreshing instance network info cache due to event network-changed-295dbc30-38ed-4679-b876-719906e8f9f5. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-fa2b2a0c-f849-467f-aa2c-0c5af1aeb901 req-b19a3349-04a4-47cc-aa15-d2ae06a11aed service nova] Acquiring lock "refresh_cache-e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-fa2b2a0c-f849-467f-aa2c-0c5af1aeb901 req-b19a3349-04a4-47cc-aa15-d2ae06a11aed service nova] Acquired lock "refresh_cache-e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG nova.network.neutron [req-fa2b2a0c-f849-467f-aa2c-0c5af1aeb901 req-b19a3349-04a4-47cc-aa15-d2ae06a11aed service nova] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Refreshing network info cache for port 295dbc30-38ed-4679-b876-719906e8f9f5 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap71326c15-7e, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap71326c15-7e, col_values=(('qos', UUID('617b4755-0098-497b-8bb2-6db755bc74ad')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap71326c15-7e, col_values=(('external_ids', {'iface-id': '71326c15-7e6c-4b5c-88fb-5648e74f1754', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:bb:6e', 'vm-uuid': '163c448b-0183-41bb-b6e0-61917f6ad781'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:06 user nova-compute[75341]: INFO os_vif [None req-75330891-5bdc-4a0e-88c4-f7178ff76771 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:bb:6e,bridge_name='br-int',has_traffic_filtering=True,id=71326c15-7e6c-4b5c-88fb-5648e74f1754,network=Network(a2d4fa10-64dc-4465-ba21-2b01b0583a67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71326c15-7e')
Nov 14 23:42:06 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-75330891-5bdc-4a0e-88c4-f7178ff76771 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T23:40:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1560149904',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1560149904',id=7,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQ3a1x+okDjRVw62hbKhJtP80/zWFyvtGey5wIlVDB0NZ56fG+725fWUXyjh7/+IE35PijjUBR8Wcuw/LlwusTfjzX4MaOP3PLObnIQMoEItEWkt+BvyX7BQ255w2h2Gw==',key_name='tempest-keypair-1289222933',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:40:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='dc16bad01d434f7f9a66247f776d6269',ramdisk_id='',reservation_id='r-3r4vupg5',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1943224082',owner_user_name='tempest-TaggedAttachmentsTest-1943224082-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:40:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48f384876a794dbfa3e7c89e6e20a232',uuid=163c448b-0183-41bb-b6e0-61917f6ad781,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "71326c15-7e6c-4b5c-88fb-5648e74f1754", "address": "fa:16:3e:97:bb:6e", "network": {"id": "a2d4fa10-64dc-4465-ba21-2b01b0583a67", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-671649606", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "dc16bad01d434f7f9a66247f776d6269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71326c15-7e", "ovs_interfaceid": "71326c15-7e6c-4b5c-88fb-5648e74f1754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-75330891-5bdc-4a0e-88c4-f7178ff76771 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Converting VIF {"id": "71326c15-7e6c-4b5c-88fb-5648e74f1754", "address": "fa:16:3e:97:bb:6e", "network": {"id": "a2d4fa10-64dc-4465-ba21-2b01b0583a67", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-671649606", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "dc16bad01d434f7f9a66247f776d6269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71326c15-7e", "ovs_interfaceid": "71326c15-7e6c-4b5c-88fb-5648e74f1754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-75330891-5bdc-4a0e-88c4-f7178ff76771 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:bb:6e,bridge_name='br-int',has_traffic_filtering=True,id=71326c15-7e6c-4b5c-88fb-5648e74f1754,network=Network(a2d4fa10-64dc-4465-ba21-2b01b0583a67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71326c15-7e') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f3ea58-fb07-4076-b982-4e3d305e3144]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ecb054f-d471-4eb3-94b4-aac3816abd3c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02, portal: 172.16.0.220,3260]
Nov 14 23:42:06 user nova-compute[75341]: Login to [iface: default, target: iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02, portal: 172.16.0.220,3260] successful.
Nov 14 23:42:06 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-75330891-5bdc-4a0e-88c4-f7178ff76771 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] attach device xml: <interface type="ethernet">
Nov 14 23:42:06 user nova-compute[75341]:   <mac address="fa:16:3e:97:bb:6e"/>
Nov 14 23:42:06 user nova-compute[75341]:   <model type="virtio"/>
Nov 14 23:42:06 user nova-compute[75341]:   <mtu size="1442"/>
Nov 14 23:42:06 user nova-compute[75341]:   <target dev="tap71326c15-7e"/>
Nov 14 23:42:06 user nova-compute[75341]: </interface>
Nov 14 23:42:06 user nova-compute[75341]:  {{(pid=75341) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[254c3d95-4b30-4fb6-96a8-da8afd47137c]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ecb054f-d471-4eb3-94b4-aac3816abd3c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ca974d-3337-446f-8c6a-2d496211acd6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ecb054f-d471-4eb3-94b4-aac3816abd3c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)
Nov 14 23:42:06 user nova-compute[75341]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)
Nov 14 23:42:06 user nova-compute[75341]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)
Nov 14 23:42:06 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:42:06 user nova-compute[75341]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02 (non-flash)
Nov 14 23:42:06 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ecb054f-d471-4eb3-94b4-aac3816abd3c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)
Nov 14 23:42:06 user nova-compute[75341]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)
Nov 14 23:42:06 user nova-compute[75341]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)
Nov 14 23:42:06 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:42:06 user nova-compute[75341]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02 (non-flash)
Nov 14 23:42:06 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-6ecb054f-d471-4eb3-94b4-aac3816abd3c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ecb054f-d471-4eb3-94b4-aac3816abd3c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Connected to 172.16.0.220:3260 {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-6ecb054f-d471-4eb3-94b4-aac3816abd3c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=75341) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-6ecb054f-d471-4eb3-94b4-aac3816abd3c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75341) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ba33c8e3-e0c8-4913-bb09-f3ab0a33083f tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] Lock "e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.147s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04b1b61-dc4d-484f-bfa3-e84f4b7352b7]: (4, ('- - 0', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-6ecb054f-d471-4eb3-94b4-aac3816abd3c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ecb054f-d471-4eb3-94b4-aac3816abd3c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SviFPMDV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ba33c8e3-e0c8-4913-bb09-f3ab0a33083f tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] Acquiring lock "e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ba33c8e3-e0c8-4913-bb09-f3ab0a33083f tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] Lock "e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:42:07 user nova-compute[75341]: INFO nova.compute.manager [None req-ba33c8e3-e0c8-4913-bb09-f3ab0a33083f tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Attaching volume abce15e6-a0f0-4a23-abd0-0cc190d16fbe to /dev/vdb
Nov 14 23:42:07 user nova-compute[75341]: DEBUG os_brick.utils [None req-ba33c8e3-e0c8-4913-bb09-f3ab0a33083f tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8edb877f-f6aa-4bba-b5a6-5f181bdc06b7 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Calling os-brick to attach iSCSI Volume {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-8edb877f-f6aa-4bba-b5a6-5f181bdc06b7 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKVvsWnF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:42:07 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-8edb877f-f6aa-4bba-b5a6-5f181bdc06b7 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:42:07 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-8edb877f-f6aa-4bba-b5a6-5f181bdc06b7 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d55831-9953-4d09-9057-cb1073740228]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6d1cfca09c9\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1e33de-a98d-49a8-96f5-8464fd8b84b3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-75330891-5bdc-4a0e-88c4-f7178ff76771 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-75330891-5bdc-4a0e-88c4-f7178ff76771 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] No BDM found with device name hda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-75330891-5bdc-4a0e-88c4-f7178ff76771 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] No VIF found with MAC fa:16:3e:2f:5b:cc, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd90ed6-8a21-4e5d-aede-6412a6d6b995]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[db22330b-7f85-4a0b-8893-a817f97a47ba]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-ba33c8e3-e0c8-4913-bb09-f3ab0a33083f tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] Running cmd (subprocess): nvme version {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-ba33c8e3-e0c8-4913-bb09-f3ab0a33083f tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ba33c8e3-e0c8-4913-bb09-f3ab0a33083f tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] nvme not present on system {{(pid=75341) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-75330891-5bdc-4a0e-88c4-f7178ff76771 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 23:42:07 user nova-compute[75341]:   <nova:package version="0.0.0"/>
Nov 14 23:42:07 user nova-compute[75341]:   <nova:name>tempest-device-tagging-server-1560149904</nova:name>
Nov 14 23:42:07 user nova-compute[75341]:   <nova:creationTime>2023-11-14 23:42:07</nova:creationTime>
Nov 14 23:42:07 user nova-compute[75341]:   <nova:flavor name="m1.tiny">
Nov 14 23:42:07 user nova-compute[75341]:     <nova:memory>512</nova:memory>
Nov 14 23:42:07 user nova-compute[75341]:     <nova:disk>1</nova:disk>
Nov 14 23:42:07 user nova-compute[75341]:     <nova:swap>0</nova:swap>
Nov 14 23:42:07 user nova-compute[75341]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 23:42:07 user nova-compute[75341]:     <nova:vcpus>1</nova:vcpus>
Nov 14 23:42:07 user nova-compute[75341]:   </nova:flavor>
Nov 14 23:42:07 user nova-compute[75341]:   <nova:owner>
Nov 14 23:42:07 user nova-compute[75341]:     <nova:user uuid="48f384876a794dbfa3e7c89e6e20a232">tempest-TaggedAttachmentsTest-1943224082-project-member</nova:user>
Nov 14 23:42:07 user nova-compute[75341]:     <nova:project uuid="dc16bad01d434f7f9a66247f776d6269">tempest-TaggedAttachmentsTest-1943224082</nova:project>
Nov 14 23:42:07 user nova-compute[75341]:   </nova:owner>
Nov 14 23:42:07 user nova-compute[75341]:   <nova:root type="image" uuid="e46abb82-b810-490e-a8a1-ccdc5fa1a796"/>
Nov 14 23:42:07 user nova-compute[75341]:   <nova:ports>
Nov 14 23:42:07 user nova-compute[75341]:     <nova:port uuid="87b091a7-76a0-46e1-b1fd-fd305d1ce55e">
Nov 14 23:42:07 user nova-compute[75341]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 23:42:07 user nova-compute[75341]:     </nova:port>
Nov 14 23:42:07 user nova-compute[75341]:     <nova:port uuid="71326c15-7e6c-4b5c-88fb-5648e74f1754">
Nov 14 23:42:07 user nova-compute[75341]:       <nova:ip type="fixed" address="10.10.10.93" ipVersion="4"/>
Nov 14 23:42:07 user nova-compute[75341]:     </nova:port>
Nov 14 23:42:07 user nova-compute[75341]:   </nova:ports>
Nov 14 23:42:07 user nova-compute[75341]: </nova:instance>
Nov 14 23:42:07 user nova-compute[75341]:  {{(pid=75341) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:42:07 user nova-compute[75341]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 23:42:07 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[9796b6b6-2711-4697-834a-0b4883f5197b]: (4, '') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-ba33c8e3-e0c8-4913-bb09-f3ab0a33083f tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75341) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-ba33c8e3-e0c8-4913-bb09-f3ab0a33083f tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-ba33c8e3-e0c8-4913-bb09-f3ab0a33083f tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] LIGHTOS: no hostnqn found. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG os_brick.utils [None req-ba33c8e3-e0c8-4913-bb09-f3ab0a33083f tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6d1cfca09c9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG nova.virt.block_device [None req-ba33c8e3-e0c8-4913-bb09-f3ab0a33083f tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Updating existing volume attachment record: 203de533-2e38-4c84-ac40-05d604c1be18 {{(pid=75341) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-75330891-5bdc-4a0e-88c4-f7178ff76771 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Lock "interface-163c448b-0183-41bb-b6e0-61917f6ad781-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.205s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG nova.network.neutron [req-d8ee1b8f-725e-4e4e-be9d-02f9bf0f9e6e req-eb090b47-7de0-4624-8625-1a65269ffb97 service nova] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Updated VIF entry in instance network info cache for port 71326c15-7e6c-4b5c-88fb-5648e74f1754. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG nova.network.neutron [req-d8ee1b8f-725e-4e4e-be9d-02f9bf0f9e6e req-eb090b47-7de0-4624-8625-1a65269ffb97 service nova] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Updating instance_info_cache with network_info: [{"id": "87b091a7-76a0-46e1-b1fd-fd305d1ce55e", "address": "fa:16:3e:2f:5b:cc", "network": {"id": "0a21b45e-de67-426a-bc33-c012fb2b5528", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1524380697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc16bad01d434f7f9a66247f776d6269", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87b091a7-76", "ovs_interfaceid": "87b091a7-76a0-46e1-b1fd-fd305d1ce55e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "71326c15-7e6c-4b5c-88fb-5648e74f1754", "address": "fa:16:3e:97:bb:6e", "network": {"id": "a2d4fa10-64dc-4465-ba21-2b01b0583a67", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-671649606", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "dc16bad01d434f7f9a66247f776d6269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71326c15-7e", "ovs_interfaceid": "71326c15-7e6c-4b5c-88fb-5648e74f1754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-d8ee1b8f-725e-4e4e-be9d-02f9bf0f9e6e req-eb090b47-7de0-4624-8625-1a65269ffb97 service nova] Releasing lock "refresh_cache-163c448b-0183-41bb-b6e0-61917f6ad781" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG nova.network.neutron [req-fa2b2a0c-f849-467f-aa2c-0c5af1aeb901 req-b19a3349-04a4-47cc-aa15-d2ae06a11aed service nova] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Updated VIF entry in instance network info cache for port 295dbc30-38ed-4679-b876-719906e8f9f5. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG nova.network.neutron [req-fa2b2a0c-f849-467f-aa2c-0c5af1aeb901 req-b19a3349-04a4-47cc-aa15-d2ae06a11aed service nova] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Updating instance_info_cache with network_info: [{"id": "295dbc30-38ed-4679-b876-719906e8f9f5", "address": "fa:16:3e:44:65:00", "network": {"id": "63893f57-4617-4e26-9735-6fea458f5b1d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-258967465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d41edc5e2c0b4dd39fc317727fb22703", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap295dbc30-38", "ovs_interfaceid": "295dbc30-38ed-4679-b876-719906e8f9f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d9e161c0-2247-4516-a8c7-d9231b351965 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Acquiring lock "163c448b-0183-41bb-b6e0-61917f6ad781" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d9e161c0-2247-4516-a8c7-d9231b351965 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Lock "163c448b-0183-41bb-b6e0-61917f6ad781" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-fa2b2a0c-f849-467f-aa2c-0c5af1aeb901 req-b19a3349-04a4-47cc-aa15-d2ae06a11aed service nova] Releasing lock "refresh_cache-e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG nova.objects.instance [None req-d9e161c0-2247-4516-a8c7-d9231b351965 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Lazy-loading 'flavor' on Instance uuid 163c448b-0183-41bb-b6e0-61917f6ad781 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d9e161c0-2247-4516-a8c7-d9231b351965 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Lock "163c448b-0183-41bb-b6e0-61917f6ad781" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.089s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d9e161c0-2247-4516-a8c7-d9231b351965 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Acquiring lock "163c448b-0183-41bb-b6e0-61917f6ad781" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d9e161c0-2247-4516-a8c7-d9231b351965 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Lock "163c448b-0183-41bb-b6e0-61917f6ad781" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:42:07 user nova-compute[75341]: INFO nova.compute.manager [None req-d9e161c0-2247-4516-a8c7-d9231b351965 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Attaching volume 9dccbb6b-a6e2-408a-97e4-d2e10768079b to /dev/vdb
Nov 14 23:42:07 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-6ecb054f-d471-4eb3-94b4-aac3816abd3c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.371s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ecb054f-d471-4eb3-94b4-aac3816abd3c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] <== connect_volume: return (1373ms) {'type': 'block', 'scsi_wwn': '23761613232316266', 'path': '/dev/sdf'} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ecb054f-d471-4eb3-94b4-aac3816abd3c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23761613232316266', 'path': '/dev/sdf'} {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-8edb877f-f6aa-4bba-b5a6-5f181bdc06b7 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.696s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:42:07 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-8edb877f-f6aa-4bba-b5a6-5f181bdc06b7 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:42:07 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-8edb877f-f6aa-4bba-b5a6-5f181bdc06b7 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-8edb877f-f6aa-4bba-b5a6-5f181bdc06b7 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:42:07 user nova-compute[75341]: INFO os_brick.initiator.connectors.iscsi [None req-8edb877f-f6aa-4bba-b5a6-5f181bdc06b7 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 23:42:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 -p 172.16.0.220:3260 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG nova.objects.instance [None req-6ecb054f-d471-4eb3-94b4-aac3816abd3c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Lazy-loading 'flavor' on Instance uuid a0cffbac-f552-47bf-bd6c-dabb70e7c867 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed292fd0-ee44-473a-b8e2-0ab984a09e9c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-8edb877f-f6aa-4bba-b5a6-5f181bdc06b7 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 23:42:07 user nova-compute[75341]:  {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-6ecb054f-d471-4eb3-94b4-aac3816abd3c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 23:42:07 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:42:07 user nova-compute[75341]:   <source dev="/dev/sdf"/>
Nov 14 23:42:07 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:42:07 user nova-compute[75341]:   <serial>6f2c6115-2b76-4800-bb46-0d69bed0ec02</serial>
Nov 14 23:42:07 user nova-compute[75341]: </disk>
Nov 14 23:42:07 user nova-compute[75341]:  {{(pid=75341) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[026317cd-f468-48d2-9c7e-6917c9160918]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2] added\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-8edb877f-f6aa-4bba-b5a6-5f181bdc06b7 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2] added
Nov 14 23:42:07 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG os_brick.utils [None req-d9e161c0-2247-4516-a8c7-d9231b351965 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e659706-7d34-458e-a7aa-7b72843ac086]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-8edb877f-f6aa-4bba-b5a6-5f181bdc06b7 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[af879d78-3c9e-42ce-a13c-537862c0dcc5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6d1cfca09c9\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3f8939-bebd-43bc-a848-a4a8bc36f430]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-8edb877f-f6aa-4bba-b5a6-5f181bdc06b7 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NKVvsWnF {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c87e76-5cb4-4fc9-bd41-29738e631f5f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NKVvsWnF" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[2badfb4a-59b4-4ada-83db-882e6965435b]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-8edb877f-f6aa-4bba-b5a6-5f181bdc06b7 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NKVvsWnF'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[3999e2f4-a385-4ee8-aaf6-fc2b18abeab3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[04918b76-2399-49c2-8327-04d47a565ee0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-d9e161c0-2247-4516-a8c7-d9231b351965 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Running cmd (subprocess): nvme version {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:08 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-d9e161c0-2247-4516-a8c7-d9231b351965 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] 'nvme version' failed. Not Retrying. {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:42:08 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:08 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac7006a-b872-43aa-8d2e-a7ef953ec86d]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:08 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d9e161c0-2247-4516-a8c7-d9231b351965 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] nvme not present on system {{(pid=75341) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 23:42:08 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-8edb877f-f6aa-4bba-b5a6-5f181bdc06b7 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:08 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:08 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:08 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:42:08 user nova-compute[75341]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 23:42:08 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[963e1115-31e7-41a3-b943-a2f8d1dab251]: (4, '') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:08 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-d9e161c0-2247-4516-a8c7-d9231b351965 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75341) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 23:42:08 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-d9e161c0-2247-4516-a8c7-d9231b351965 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 23:42:08 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-d9e161c0-2247-4516-a8c7-d9231b351965 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] LIGHTOS: no hostnqn found. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 23:42:08 user nova-compute[75341]: DEBUG os_brick.utils [None req-d9e161c0-2247-4516-a8c7-d9231b351965 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6d1cfca09c9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:42:08 user nova-compute[75341]: DEBUG nova.virt.block_device [None req-d9e161c0-2247-4516-a8c7-d9231b351965 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Updating existing volume attachment record: 25b61b55-f895-4955-85a0-7cdf264d4372 {{(pid=75341) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 23:42:08 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:08 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[7066a298-ab66-4e1e-b30f-808a057e996e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:08 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-8edb877f-f6aa-4bba-b5a6-5f181bdc06b7 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)
Nov 14 23:42:08 user nova-compute[75341]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)
Nov 14 23:42:08 user nova-compute[75341]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)
Nov 14 23:42:08 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:42:08 user nova-compute[75341]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02 (non-flash)
Nov 14 23:42:08 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:42:08 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-8edb877f-f6aa-4bba-b5a6-5f181bdc06b7 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)
Nov 14 23:42:08 user nova-compute[75341]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)
Nov 14 23:42:08 user nova-compute[75341]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)
Nov 14 23:42:08 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:42:08 user nova-compute[75341]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02 (non-flash)
Nov 14 23:42:08 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:42:08 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 -p 172.16.0.220:3260 --login {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:08 user nova-compute[75341]: DEBUG nova.compute.manager [req-82ab2d25-960b-461d-b90b-ff4836a8b489 req-f2fd347d-cdfd-46c5-b7be-ffc9176fe297 service nova] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Received event network-vif-plugged-71326c15-7e6c-4b5c-88fb-5648e74f1754 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:42:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-82ab2d25-960b-461d-b90b-ff4836a8b489 req-f2fd347d-cdfd-46c5-b7be-ffc9176fe297 service nova] Acquiring lock "163c448b-0183-41bb-b6e0-61917f6ad781-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:42:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-82ab2d25-960b-461d-b90b-ff4836a8b489 req-f2fd347d-cdfd-46c5-b7be-ffc9176fe297 service nova] Lock "163c448b-0183-41bb-b6e0-61917f6ad781-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:42:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-82ab2d25-960b-461d-b90b-ff4836a8b489 req-f2fd347d-cdfd-46c5-b7be-ffc9176fe297 service nova] Lock "163c448b-0183-41bb-b6e0-61917f6ad781-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:42:08 user nova-compute[75341]: DEBUG nova.compute.manager [req-82ab2d25-960b-461d-b90b-ff4836a8b489 req-f2fd347d-cdfd-46c5-b7be-ffc9176fe297 service nova] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] No waiting events found dispatching network-vif-plugged-71326c15-7e6c-4b5c-88fb-5648e74f1754 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:42:08 user nova-compute[75341]: WARNING nova.compute.manager [req-82ab2d25-960b-461d-b90b-ff4836a8b489 req-f2fd347d-cdfd-46c5-b7be-ffc9176fe297 service nova] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Received unexpected event network-vif-plugged-71326c15-7e6c-4b5c-88fb-5648e74f1754 for instance with vm_state active and task_state None.
Nov 14 23:42:08 user nova-compute[75341]: DEBUG nova.compute.manager [req-82ab2d25-960b-461d-b90b-ff4836a8b489 req-f2fd347d-cdfd-46c5-b7be-ffc9176fe297 service nova] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Received event network-vif-plugged-71326c15-7e6c-4b5c-88fb-5648e74f1754 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:42:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-82ab2d25-960b-461d-b90b-ff4836a8b489 req-f2fd347d-cdfd-46c5-b7be-ffc9176fe297 service nova] Acquiring lock "163c448b-0183-41bb-b6e0-61917f6ad781-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:42:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-82ab2d25-960b-461d-b90b-ff4836a8b489 req-f2fd347d-cdfd-46c5-b7be-ffc9176fe297 service nova] Lock "163c448b-0183-41bb-b6e0-61917f6ad781-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:42:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-82ab2d25-960b-461d-b90b-ff4836a8b489 req-f2fd347d-cdfd-46c5-b7be-ffc9176fe297 service nova] Lock "163c448b-0183-41bb-b6e0-61917f6ad781-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:42:08 user nova-compute[75341]: DEBUG nova.compute.manager [req-82ab2d25-960b-461d-b90b-ff4836a8b489 req-f2fd347d-cdfd-46c5-b7be-ffc9176fe297 service nova] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] No waiting events found dispatching network-vif-plugged-71326c15-7e6c-4b5c-88fb-5648e74f1754 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:42:08 user nova-compute[75341]: WARNING nova.compute.manager [req-82ab2d25-960b-461d-b90b-ff4836a8b489 req-f2fd347d-cdfd-46c5-b7be-ffc9176fe297 service nova] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Received unexpected event network-vif-plugged-71326c15-7e6c-4b5c-88fb-5648e74f1754 for instance with vm_state active and task_state None.
Nov 14 23:42:08 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:08 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33ab535-f3c1-46e4-aba3-38ad896f1869]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:08 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-8edb877f-f6aa-4bba-b5a6-5f181bdc06b7 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2, portal: 172.16.0.220,3260]
Nov 14 23:42:08 user nova-compute[75341]: Login to [iface: default, target: iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2, portal: 172.16.0.220,3260] successful.
Nov 14 23:42:08 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:08 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:08 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:08 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[2479db5c-2292-4a1d-8802-4ffb3731d842]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:08 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-8edb877f-f6aa-4bba-b5a6-5f181bdc06b7 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:08 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:08 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:08 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd8d0fa-d609-476e-8cc2-6ddfab5080ee]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:08 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-8edb877f-f6aa-4bba-b5a6-5f181bdc06b7 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)
Nov 14 23:42:08 user nova-compute[75341]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)
Nov 14 23:42:08 user nova-compute[75341]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)
Nov 14 23:42:08 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:42:08 user nova-compute[75341]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02 (non-flash)
Nov 14 23:42:08 user nova-compute[75341]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 (non-flash)
Nov 14 23:42:08 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:42:08 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-8edb877f-f6aa-4bba-b5a6-5f181bdc06b7 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)
Nov 14 23:42:08 user nova-compute[75341]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)
Nov 14 23:42:08 user nova-compute[75341]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)
Nov 14 23:42:08 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:42:08 user nova-compute[75341]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02 (non-flash)
Nov 14 23:42:08 user nova-compute[75341]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 (non-flash)
Nov 14 23:42:08 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:42:08 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-8edb877f-f6aa-4bba-b5a6-5f181bdc06b7 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.374s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:42:08 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-8edb877f-f6aa-4bba-b5a6-5f181bdc06b7 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Connected to 172.16.0.220:3260 {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 23:42:08 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-8edb877f-f6aa-4bba-b5a6-5f181bdc06b7 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=75341) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 23:42:08 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-8edb877f-f6aa-4bba-b5a6-5f181bdc06b7 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75341) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 23:42:08 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:08 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:08 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[389398ef-6147-443f-ab27-5ae7ef9c2c7d]: (4, ('- - 0', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:08 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-8edb877f-f6aa-4bba-b5a6-5f181bdc06b7 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: None {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 23:42:08 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-6ecb054f-d471-4eb3-94b4-aac3816abd3c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:42:08 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-6ecb054f-d471-4eb3-94b4-aac3816abd3c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:42:08 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-6ecb054f-d471-4eb3-94b4-aac3816abd3c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] No VIF found with MAC fa:16:3e:0c:75:47, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:42:09 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-8edb877f-f6aa-4bba-b5a6-5f181bdc06b7 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 23:42:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-8edb877f-f6aa-4bba-b5a6-5f181bdc06b7 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKVvsWnF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 23:42:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-8edb877f-f6aa-4bba-b5a6-5f181bdc06b7 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.407s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:42:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-8edb877f-f6aa-4bba-b5a6-5f181bdc06b7 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] <== connect_volume: return (2103ms) {'type': 'block', 'scsi_wwn': '23366333364376535', 'path': '/dev/sdg'} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:42:09 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8edb877f-f6aa-4bba-b5a6-5f181bdc06b7 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366333364376535', 'path': '/dev/sdg'} {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 23:42:09 user nova-compute[75341]: DEBUG nova.objects.instance [None req-8edb877f-f6aa-4bba-b5a6-5f181bdc06b7 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Lazy-loading 'flavor' on Instance uuid 0e7a53e9-6982-4c93-a830-a49cf0ce76bd {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:42:09 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-8edb877f-f6aa-4bba-b5a6-5f181bdc06b7 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 23:42:09 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:42:09 user nova-compute[75341]:   <source dev="/dev/sdg"/>
Nov 14 23:42:09 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:42:09 user nova-compute[75341]:   <serial>0df8b689-2583-4be4-8499-cc2e54889ac2</serial>
Nov 14 23:42:09 user nova-compute[75341]: </disk>
Nov 14 23:42:09 user nova-compute[75341]:  {{(pid=75341) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 23:42:09 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-8edb877f-f6aa-4bba-b5a6-5f181bdc06b7 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:42:09 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-8edb877f-f6aa-4bba-b5a6-5f181bdc06b7 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:42:09 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-8edb877f-f6aa-4bba-b5a6-5f181bdc06b7 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] No VIF found with MAC fa:16:3e:a0:1d:39, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:42:09 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-036ba073-5506-4b3e-94af-17e6cc858dfc tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] Calling os-brick to attach iSCSI Volume {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 23:42:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-036ba073-5506-4b3e-94af-17e6cc858dfc tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dkUSVXYr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:42:09 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-036ba073-5506-4b3e-94af-17e6cc858dfc tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:42:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-036ba073-5506-4b3e-94af-17e6cc858dfc tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:42:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-036ba073-5506-4b3e-94af-17e6cc858dfc tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:42:09 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-036ba073-5506-4b3e-94af-17e6cc858dfc tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:42:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-036ba073-5506-4b3e-94af-17e6cc858dfc tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:42:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-036ba073-5506-4b3e-94af-17e6cc858dfc tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:42:09 user nova-compute[75341]: INFO os_brick.initiator.connectors.iscsi [None req-036ba073-5506-4b3e-94af-17e6cc858dfc tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 23:42:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3 -p 172.16.0.220:3260 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:09 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc9734c-899c-4294-9311-e9d1e4005aed]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-036ba073-5506-4b3e-94af-17e6cc858dfc tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 23:42:09 user nova-compute[75341]:  {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:09 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[453fcbb8-9423-48ad-b1ce-0c7dc97bc650]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3] added\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-036ba073-5506-4b3e-94af-17e6cc858dfc tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3] added
Nov 14 23:42:09 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:09 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[995e91ca-a882-4b23-9eac-cce410c83110]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-036ba073-5506-4b3e-94af-17e6cc858dfc tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:09 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a16d4f-34da-4659-be7c-04e1ac91ac35]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-036ba073-5506-4b3e-94af-17e6cc858dfc tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dkUSVXYr {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6ecb054f-d471-4eb3-94b4-aac3816abd3c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Lock "a0cffbac-f552-47bf-bd6c-dabb70e7c867" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.249s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:42:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dkUSVXYr" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:09 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[a111d80c-46ee-4406-b7fe-1515397e0ae8]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-036ba073-5506-4b3e-94af-17e6cc858dfc tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dkUSVXYr'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:09 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[57688ece-2934-4b8c-83b2-a35613494355]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-036ba073-5506-4b3e-94af-17e6cc858dfc tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:09 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[05dbc0c3-b9de-46ae-8ef4-2d80e92e17f7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-036ba073-5506-4b3e-94af-17e6cc858dfc tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)
Nov 14 23:42:09 user nova-compute[75341]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)
Nov 14 23:42:09 user nova-compute[75341]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)
Nov 14 23:42:09 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:42:09 user nova-compute[75341]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02 (non-flash)
Nov 14 23:42:09 user nova-compute[75341]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 (non-flash)
Nov 14 23:42:09 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:42:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-036ba073-5506-4b3e-94af-17e6cc858dfc tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)
Nov 14 23:42:09 user nova-compute[75341]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)
Nov 14 23:42:09 user nova-compute[75341]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)
Nov 14 23:42:09 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:42:09 user nova-compute[75341]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02 (non-flash)
Nov 14 23:42:09 user nova-compute[75341]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 (non-flash)
Nov 14 23:42:09 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:42:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3 -p 172.16.0.220:3260 --login {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:10 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:10 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a4ad0b-fe30-4728-af06-c275b997dcd8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:10 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-036ba073-5506-4b3e-94af-17e6cc858dfc tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3, portal: 172.16.0.220,3260]
Nov 14 23:42:10 user nova-compute[75341]: Login to [iface: default, target: iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3, portal: 172.16.0.220,3260] successful.
Nov 14 23:42:10 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:10 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:10 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:10 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e49ecc-95e1-4f81-a94d-36874549f96a]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:10 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-036ba073-5506-4b3e-94af-17e6cc858dfc tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:10 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:10 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:10 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdde9744-6cfe-4e79-baf4-77598d9b6627]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:10 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-036ba073-5506-4b3e-94af-17e6cc858dfc tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)
Nov 14 23:42:10 user nova-compute[75341]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)
Nov 14 23:42:10 user nova-compute[75341]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)
Nov 14 23:42:10 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:42:10 user nova-compute[75341]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02 (non-flash)
Nov 14 23:42:10 user nova-compute[75341]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 (non-flash)
Nov 14 23:42:10 user nova-compute[75341]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3 (non-flash)
Nov 14 23:42:10 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:42:10 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-036ba073-5506-4b3e-94af-17e6cc858dfc tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)
Nov 14 23:42:10 user nova-compute[75341]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)
Nov 14 23:42:10 user nova-compute[75341]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)
Nov 14 23:42:10 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:42:10 user nova-compute[75341]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02 (non-flash)
Nov 14 23:42:10 user nova-compute[75341]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 (non-flash)
Nov 14 23:42:10 user nova-compute[75341]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3 (non-flash)
Nov 14 23:42:10 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:42:10 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-036ba073-5506-4b3e-94af-17e6cc858dfc tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:42:10 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-036ba073-5506-4b3e-94af-17e6cc858dfc tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Connected to 172.16.0.220:3260 {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 23:42:10 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-036ba073-5506-4b3e-94af-17e6cc858dfc tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=75341) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 23:42:10 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-036ba073-5506-4b3e-94af-17e6cc858dfc tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75341) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 23:42:10 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:10 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8edb877f-f6aa-4bba-b5a6-5f181bdc06b7 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Lock "0e7a53e9-6982-4c93-a830-a49cf0ce76bd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.085s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:42:10 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:10 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4fd5aa-4e9f-4ffb-b1e9-fe9b25cc550d]: (4, ('- - 0', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:10 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-036ba073-5506-4b3e-94af-17e6cc858dfc tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 23:42:10 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-036ba073-5506-4b3e-94af-17e6cc858dfc tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dkUSVXYr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 23:42:10 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:10 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-846a5652-8bd6-4385-8b7c-cfe499edc17c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Acquiring lock "a0cffbac-f552-47bf-bd6c-dabb70e7c867" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:42:10 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-846a5652-8bd6-4385-8b7c-cfe499edc17c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Lock "a0cffbac-f552-47bf-bd6c-dabb70e7c867" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:42:10 user nova-compute[75341]: INFO nova.compute.manager [None req-846a5652-8bd6-4385-8b7c-cfe499edc17c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Detaching volume 6f2c6115-2b76-4800-bb46-0d69bed0ec02
Nov 14 23:42:10 user nova-compute[75341]: INFO nova.virt.block_device [None req-846a5652-8bd6-4385-8b7c-cfe499edc17c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Attempting to driver detach volume 6f2c6115-2b76-4800-bb46-0d69bed0ec02 from mountpoint /dev/vdb
Nov 14 23:42:10 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-846a5652-8bd6-4385-8b7c-cfe499edc17c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Attempting to detach device vdb from instance a0cffbac-f552-47bf-bd6c-dabb70e7c867 from the persistent domain config. {{(pid=75341) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 23:42:10 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-846a5652-8bd6-4385-8b7c-cfe499edc17c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 23:42:10 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:42:10 user nova-compute[75341]:   <source dev="/dev/sdf"/>
Nov 14 23:42:10 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:42:10 user nova-compute[75341]:   <serial>6f2c6115-2b76-4800-bb46-0d69bed0ec02</serial>
Nov 14 23:42:10 user nova-compute[75341]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 23:42:10 user nova-compute[75341]: </disk>
Nov 14 23:42:10 user nova-compute[75341]:  {{(pid=75341) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 23:42:10 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-846a5652-8bd6-4385-8b7c-cfe499edc17c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Successfully detached device vdb from instance a0cffbac-f552-47bf-bd6c-dabb70e7c867 from the persistent domain config.
Nov 14 23:42:10 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-846a5652-8bd6-4385-8b7c-cfe499edc17c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a0cffbac-f552-47bf-bd6c-dabb70e7c867 from the live domain config. {{(pid=75341) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 23:42:10 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-846a5652-8bd6-4385-8b7c-cfe499edc17c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 23:42:10 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:42:10 user nova-compute[75341]:   <source dev="/dev/sdf"/>
Nov 14 23:42:10 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:42:10 user nova-compute[75341]:   <serial>6f2c6115-2b76-4800-bb46-0d69bed0ec02</serial>
Nov 14 23:42:10 user nova-compute[75341]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 23:42:10 user nova-compute[75341]: </disk>
Nov 14 23:42:10 user nova-compute[75341]:  {{(pid=75341) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 23:42:11 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-036ba073-5506-4b3e-94af-17e6cc858dfc tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.383s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:42:11 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-036ba073-5506-4b3e-94af-17e6cc858dfc tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] <== connect_volume: return (1385ms) {'type': 'block', 'scsi_wwn': '23835623832653936', 'path': '/dev/sdh'} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:42:11 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-036ba073-5506-4b3e-94af-17e6cc858dfc tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23835623832653936', 'path': '/dev/sdh'} {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 23:42:11 user nova-compute[75341]: DEBUG nova.objects.instance [None req-036ba073-5506-4b3e-94af-17e6cc858dfc tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Lazy-loading 'flavor' on Instance uuid b7d427ed-6ac3-46d9-bebc-d672f465f850 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:42:11 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-036ba073-5506-4b3e-94af-17e6cc858dfc tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 23:42:11 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:42:11 user nova-compute[75341]:   <source dev="/dev/sdh"/>
Nov 14 23:42:11 user nova-compute[75341]:   <target dev="sdc" bus="scsi"/>
Nov 14 23:42:11 user nova-compute[75341]:   <serial>bd8fcacd-78e7-46eb-a630-a974fff87da3</serial>
Nov 14 23:42:11 user nova-compute[75341]:   <address type="drive" controller="0" unit="2"/>
Nov 14 23:42:11 user nova-compute[75341]: </disk>
Nov 14 23:42:11 user nova-compute[75341]:  {{(pid=75341) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 23:42:11 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-846a5652-8bd6-4385-8b7c-cfe499edc17c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a0cffbac-f552-47bf-bd6c-dabb70e7c867 {{(pid=75341) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 23:42:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] Acquiring lock "0e7a53e9-6982-4c93-a830-a49cf0ce76bd" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:42:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] Lock "0e7a53e9-6982-4c93-a830-a49cf0ce76bd" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:42:11 user nova-compute[75341]: DEBUG os_brick.utils [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:42:11 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:11 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:11 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[e638b48b-fe54-4605-bea5-a17c833c3093]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6d1cfca09c9\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:11 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:11 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:11 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[e45be0ce-4763-4247-b7d3-1cbf8eaeecc0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:11 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:11 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:11 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[4334cd4a-7485-4a6f-9701-c3c3872b8233]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:11 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[6380a439-df3e-428e-b005-0a4941e8589e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:11 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] Running cmd (subprocess): nvme version {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:11 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:42:11 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:11 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.nvmeof [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] nvme not present on system {{(pid=75341) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 23:42:11 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:11 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:42:11 user nova-compute[75341]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 23:42:11 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f31126-5c0b-4b4b-a613-06abde9c9e6a]: (4, '') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:11 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75341) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 23:42:11 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 23:42:11 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] LIGHTOS: no hostnqn found. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 23:42:11 user nova-compute[75341]: DEBUG os_brick.utils [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6d1cfca09c9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:42:11 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-036ba073-5506-4b3e-94af-17e6cc858dfc tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] No BDM found with device name sda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:42:11 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-036ba073-5506-4b3e-94af-17e6cc858dfc tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:42:11 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-036ba073-5506-4b3e-94af-17e6cc858dfc tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:42:11 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-036ba073-5506-4b3e-94af-17e6cc858dfc tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] No VIF found with MAC fa:16:3e:1e:60:6f, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:42:11 user nova-compute[75341]: INFO nova.compute.manager [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Swapping volume 0df8b689-2583-4be4-8499-cc2e54889ac2 for f4398b13-aada-4505-95cf-82ff5ca13dc0
Nov 14 23:42:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-036ba073-5506-4b3e-94af-17e6cc858dfc tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Lock "b7d427ed-6ac3-46d9-bebc-d672f465f850" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.489s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:42:12 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba33c8e3-e0c8-4913-bb09-f3ab0a33083f tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Calling os-brick to attach iSCSI Volume {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 23:42:12 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba33c8e3-e0c8-4913-bb09-f3ab0a33083f tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cZGniRJy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:42:12 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-ba33c8e3-e0c8-4913-bb09-f3ab0a33083f tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:42:12 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-ba33c8e3-e0c8-4913-bb09-f3ab0a33083f tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:42:12 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-ba33c8e3-e0c8-4913-bb09-f3ab0a33083f tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:42:12 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-ba33c8e3-e0c8-4913-bb09-f3ab0a33083f tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:42:12 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-ba33c8e3-e0c8-4913-bb09-f3ab0a33083f tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:42:12 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-ba33c8e3-e0c8-4913-bb09-f3ab0a33083f tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:42:12 user nova-compute[75341]: INFO os_brick.initiator.connectors.iscsi [None req-ba33c8e3-e0c8-4913-bb09-f3ab0a33083f tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 23:42:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe -p 172.16.0.220:3260 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:12 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb1d6e6-701f-4087-a7cb-cce457fcb873]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:12 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba33c8e3-e0c8-4913-bb09-f3ab0a33083f tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 23:42:12 user nova-compute[75341]:  {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe -p 172.16.0.220:3260 --interface default --op new {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:12 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6febcb3-0fe7-4141-b569-2111b49316ea]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe] added\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:12 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba33c8e3-e0c8-4913-bb09-f3ab0a33083f tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe] added
Nov 14 23:42:12 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:12 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e51d31-825a-497b-8c8b-73dfb7eecc58]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:12 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba33c8e3-e0c8-4913-bb09-f3ab0a33083f tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:12 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f10bff-d3ae-477e-ba6d-3b48e71be3bb]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:12 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba33c8e3-e0c8-4913-bb09-f3ab0a33083f tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cZGniRJy {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cZGniRJy" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:12 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b0efd9-414c-4be2-b553-885fc5d7d694]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:12 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba33c8e3-e0c8-4913-bb09-f3ab0a33083f tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cZGniRJy'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:12 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[17798090-ccc1-42fb-a1fe-222ee4e93a70]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:12 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba33c8e3-e0c8-4913-bb09-f3ab0a33083f tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:12 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[45dd1cfd-1d78-443e-9fe4-c9b7dbd241ae]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:12 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba33c8e3-e0c8-4913-bb09-f3ab0a33083f tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)
Nov 14 23:42:12 user nova-compute[75341]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)
Nov 14 23:42:12 user nova-compute[75341]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)
Nov 14 23:42:12 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:42:12 user nova-compute[75341]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02 (non-flash)
Nov 14 23:42:12 user nova-compute[75341]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 (non-flash)
Nov 14 23:42:12 user nova-compute[75341]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3 (non-flash)
Nov 14 23:42:12 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:42:12 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba33c8e3-e0c8-4913-bb09-f3ab0a33083f tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)
Nov 14 23:42:12 user nova-compute[75341]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)
Nov 14 23:42:12 user nova-compute[75341]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)
Nov 14 23:42:12 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:42:12 user nova-compute[75341]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02 (non-flash)
Nov 14 23:42:12 user nova-compute[75341]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 (non-flash)
Nov 14 23:42:12 user nova-compute[75341]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3 (non-flash)
Nov 14 23:42:12 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:42:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe -p 172.16.0.220:3260 --login {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:12 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b0b94a-3bc3-48cb-8265-0a876dc24635]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:12 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba33c8e3-e0c8-4913-bb09-f3ab0a33083f tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe, portal: 172.16.0.220,3260]
Nov 14 23:42:12 user nova-compute[75341]: Login to [iface: default, target: iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe, portal: 172.16.0.220,3260] successful.
Nov 14 23:42:12 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:12 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b6c362-55cd-46de-9e01-1f643ed4c77f]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:12 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba33c8e3-e0c8-4913-bb09-f3ab0a33083f tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:12 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4c5a46-78f4-4928-9d32-456a500e4f10]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:12 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba33c8e3-e0c8-4913-bb09-f3ab0a33083f tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe (non-flash)
Nov 14 23:42:12 user nova-compute[75341]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)
Nov 14 23:42:12 user nova-compute[75341]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)
Nov 14 23:42:12 user nova-compute[75341]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)
Nov 14 23:42:12 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:42:12 user nova-compute[75341]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02 (non-flash)
Nov 14 23:42:12 user nova-compute[75341]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 (non-flash)
Nov 14 23:42:12 user nova-compute[75341]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3 (non-flash)
Nov 14 23:42:12 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:42:12 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba33c8e3-e0c8-4913-bb09-f3ab0a33083f tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe (non-flash)
Nov 14 23:42:12 user nova-compute[75341]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)
Nov 14 23:42:12 user nova-compute[75341]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)
Nov 14 23:42:12 user nova-compute[75341]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)
Nov 14 23:42:12 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:42:12 user nova-compute[75341]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02 (non-flash)
Nov 14 23:42:12 user nova-compute[75341]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 (non-flash)
Nov 14 23:42:12 user nova-compute[75341]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3 (non-flash)
Nov 14 23:42:12 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:42:12 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-ba33c8e3-e0c8-4913-bb09-f3ab0a33083f tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:42:12 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba33c8e3-e0c8-4913-bb09-f3ab0a33083f tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] Connected to 172.16.0.220:3260 {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 23:42:12 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-ba33c8e3-e0c8-4913-bb09-f3ab0a33083f tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=75341) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 23:42:12 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-ba33c8e3-e0c8-4913-bb09-f3ab0a33083f tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=75341) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 23:42:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.014s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:12 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e5fa71-ec38-48c7-9e9e-13b22a32a2e9]: (4, ('- - 0', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:12 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-ba33c8e3-e0c8-4913-bb09-f3ab0a33083f tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 23:42:12 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba33c8e3-e0c8-4913-bb09-f3ab0a33083f tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cZGniRJy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 23:42:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8b179434-9771-476d-a9e7-c53b1fc61688 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Acquiring lock "b7d427ed-6ac3-46d9-bebc-d672f465f850" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:42:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8b179434-9771-476d-a9e7-c53b1fc61688 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Lock "b7d427ed-6ac3-46d9-bebc-d672f465f850" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:42:12 user nova-compute[75341]: INFO nova.compute.manager [None req-8b179434-9771-476d-a9e7-c53b1fc61688 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] Detaching volume bd8fcacd-78e7-46eb-a630-a974fff87da3
Nov 14 23:42:12 user nova-compute[75341]: INFO nova.virt.block_device [None req-8b179434-9771-476d-a9e7-c53b1fc61688 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] Attempting to driver detach volume bd8fcacd-78e7-46eb-a630-a974fff87da3 from mountpoint /dev/sdc
Nov 14 23:42:12 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-8b179434-9771-476d-a9e7-c53b1fc61688 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Attempting to detach device sdc from instance b7d427ed-6ac3-46d9-bebc-d672f465f850 from the persistent domain config. {{(pid=75341) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 23:42:12 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-8b179434-9771-476d-a9e7-c53b1fc61688 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 23:42:12 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:42:12 user nova-compute[75341]:   <source dev="/dev/sdh"/>
Nov 14 23:42:12 user nova-compute[75341]:   <target dev="sdc" bus="scsi"/>
Nov 14 23:42:12 user nova-compute[75341]:   <serial>bd8fcacd-78e7-46eb-a630-a974fff87da3</serial>
Nov 14 23:42:12 user nova-compute[75341]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 14 23:42:12 user nova-compute[75341]: </disk>
Nov 14 23:42:12 user nova-compute[75341]:  {{(pid=75341) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 23:42:12 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-8b179434-9771-476d-a9e7-c53b1fc61688 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Successfully detached device sdc from instance b7d427ed-6ac3-46d9-bebc-d672f465f850 from the persistent domain config.
Nov 14 23:42:12 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-8b179434-9771-476d-a9e7-c53b1fc61688 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance b7d427ed-6ac3-46d9-bebc-d672f465f850 from the live domain config. {{(pid=75341) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 23:42:12 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-8b179434-9771-476d-a9e7-c53b1fc61688 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 23:42:12 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:42:12 user nova-compute[75341]:   <source dev="/dev/sdh"/>
Nov 14 23:42:12 user nova-compute[75341]:   <target dev="sdc" bus="scsi"/>
Nov 14 23:42:12 user nova-compute[75341]:   <serial>bd8fcacd-78e7-46eb-a630-a974fff87da3</serial>
Nov 14 23:42:12 user nova-compute[75341]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 14 23:42:12 user nova-compute[75341]: </disk>
Nov 14 23:42:12 user nova-compute[75341]:  {{(pid=75341) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 23:42:13 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9e161c0-2247-4516-a8c7-d9231b351965 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Calling os-brick to attach iSCSI Volume {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 23:42:13 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e161c0-2247-4516-a8c7-d9231b351965 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RovTpHyU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:42:13 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-d9e161c0-2247-4516-a8c7-d9231b351965 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:42:13 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-d9e161c0-2247-4516-a8c7-d9231b351965 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:42:13 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-8b179434-9771-476d-a9e7-c53b1fc61688 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance b7d427ed-6ac3-46d9-bebc-d672f465f850 {{(pid=75341) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 23:42:13 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-ba33c8e3-e0c8-4913-bb09-f3ab0a33083f tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:42:13 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba33c8e3-e0c8-4913-bb09-f3ab0a33083f tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '23266643330323734', 'path': '/dev/sdi'} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:42:13 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba33c8e3-e0c8-4913-bb09-f3ab0a33083f tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23266643330323734', 'path': '/dev/sdi'} {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 23:42:13 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-d9e161c0-2247-4516-a8c7-d9231b351965 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.428s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:42:13 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-d9e161c0-2247-4516-a8c7-d9231b351965 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:42:13 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-d9e161c0-2247-4516-a8c7-d9231b351965 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:42:13 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-d9e161c0-2247-4516-a8c7-d9231b351965 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:42:13 user nova-compute[75341]: INFO os_brick.initiator.connectors.iscsi [None req-d9e161c0-2247-4516-a8c7-d9231b351965 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 23:42:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b -p 172.16.0.220:3260 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:13 user nova-compute[75341]: DEBUG nova.objects.instance [None req-ba33c8e3-e0c8-4913-bb09-f3ab0a33083f tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] Lazy-loading 'flavor' on Instance uuid e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:42:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:13 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[b829dab4-2fcc-4e50-9064-817296b28522]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:13 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e161c0-2247-4516-a8c7-d9231b351965 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 23:42:13 user nova-compute[75341]:  {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b -p 172.16.0.220:3260 --interface default --op new {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:13 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-ba33c8e3-e0c8-4913-bb09-f3ab0a33083f tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] attach device xml: <disk type="block" device="disk">
Nov 14 23:42:13 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:42:13 user nova-compute[75341]:   <source dev="/dev/sdi"/>
Nov 14 23:42:13 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:42:13 user nova-compute[75341]:   <serial>abce15e6-a0f0-4a23-abd0-0cc190d16fbe</serial>
Nov 14 23:42:13 user nova-compute[75341]: </disk>
Nov 14 23:42:13 user nova-compute[75341]:  {{(pid=75341) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 23:42:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:13 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef92bef2-891d-4b1f-969a-8d2ce5909ad5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b] added\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:13 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e161c0-2247-4516-a8c7-d9231b351965 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b] added
Nov 14 23:42:13 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:13 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[73daed5a-5420-44a4-b705-0c094d3acc70]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:13 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e161c0-2247-4516-a8c7-d9231b351965 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:13 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c447f9a-0938-4f0e-a70d-07ada1b3821f]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:13 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e161c0-2247-4516-a8c7-d9231b351965 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RovTpHyU {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RovTpHyU" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:13 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f82705-36e9-49ff-a85f-ed063b586d30]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:13 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e161c0-2247-4516-a8c7-d9231b351965 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RovTpHyU'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:13 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a7a6d5-8a82-4e6f-99d1-91b8c49029e8]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:13 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e161c0-2247-4516-a8c7-d9231b351965 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:13 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c71b5e-2342-4035-8bf7-486557040e2c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:13 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e161c0-2247-4516-a8c7-d9231b351965 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe (non-flash)
Nov 14 23:42:13 user nova-compute[75341]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)
Nov 14 23:42:13 user nova-compute[75341]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)
Nov 14 23:42:13 user nova-compute[75341]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)
Nov 14 23:42:13 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:42:13 user nova-compute[75341]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02 (non-flash)
Nov 14 23:42:13 user nova-compute[75341]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 (non-flash)
Nov 14 23:42:13 user nova-compute[75341]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3 (non-flash)
Nov 14 23:42:13 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:42:13 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e161c0-2247-4516-a8c7-d9231b351965 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe (non-flash)
Nov 14 23:42:13 user nova-compute[75341]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)
Nov 14 23:42:13 user nova-compute[75341]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)
Nov 14 23:42:13 user nova-compute[75341]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)
Nov 14 23:42:13 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:42:13 user nova-compute[75341]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02 (non-flash)
Nov 14 23:42:13 user nova-compute[75341]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 (non-flash)
Nov 14 23:42:13 user nova-compute[75341]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3 (non-flash)
Nov 14 23:42:13 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:42:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b -p 172.16.0.220:3260 --login {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:13 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1b7739-a2bd-4cb1-a04e-7f2fbf7fdf9e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:13 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e161c0-2247-4516-a8c7-d9231b351965 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b, portal: 172.16.0.220,3260]
Nov 14 23:42:13 user nova-compute[75341]: Login to [iface: default, target: iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b, portal: 172.16.0.220,3260] successful.
Nov 14 23:42:13 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:13 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd0e557-1523-434f-88d4-a059cf95954c]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:13 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e161c0-2247-4516-a8c7-d9231b351965 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:13 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41cf786-d583-409d-971d-a7edd141e4cd]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:13 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e161c0-2247-4516-a8c7-d9231b351965 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe (non-flash)
Nov 14 23:42:13 user nova-compute[75341]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b (non-flash)
Nov 14 23:42:13 user nova-compute[75341]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)
Nov 14 23:42:13 user nova-compute[75341]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)
Nov 14 23:42:13 user nova-compute[75341]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)
Nov 14 23:42:13 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:42:13 user nova-compute[75341]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02 (non-flash)
Nov 14 23:42:13 user nova-compute[75341]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 (non-flash)
Nov 14 23:42:13 user nova-compute[75341]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3 (non-flash)
Nov 14 23:42:13 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:42:13 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e161c0-2247-4516-a8c7-d9231b351965 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe (non-flash)
Nov 14 23:42:13 user nova-compute[75341]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b (non-flash)
Nov 14 23:42:13 user nova-compute[75341]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)
Nov 14 23:42:13 user nova-compute[75341]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)
Nov 14 23:42:13 user nova-compute[75341]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)
Nov 14 23:42:13 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:42:13 user nova-compute[75341]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02 (non-flash)
Nov 14 23:42:13 user nova-compute[75341]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 (non-flash)
Nov 14 23:42:13 user nova-compute[75341]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3 (non-flash)
Nov 14 23:42:13 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:42:13 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-d9e161c0-2247-4516-a8c7-d9231b351965 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:42:13 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e161c0-2247-4516-a8c7-d9231b351965 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Connected to 172.16.0.220:3260 {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 23:42:13 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-d9e161c0-2247-4516-a8c7-d9231b351965 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=75341) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 23:42:13 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-d9e161c0-2247-4516-a8c7-d9231b351965 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=75341) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 23:42:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.015s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:13 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f547466-da30-4e90-9426-a1d2a434d8a4]: (4, ('- - 0', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:13 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-d9e161c0-2247-4516-a8c7-d9231b351965 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 23:42:13 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e161c0-2247-4516-a8c7-d9231b351965 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RovTpHyU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 23:42:13 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-ba33c8e3-e0c8-4913-bb09-f3ab0a33083f tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:42:13 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-ba33c8e3-e0c8-4913-bb09-f3ab0a33083f tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:42:13 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-ba33c8e3-e0c8-4913-bb09-f3ab0a33083f tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] No VIF found with MAC fa:16:3e:44:65:00, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:42:14 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ba33c8e3-e0c8-4913-bb09-f3ab0a33083f tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] Lock "e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.014s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:42:14 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-212a4871-d7be-425c-961a-b5538460aafa tempest-VolumesAssistedSnapshotsTest-1252576855 tempest-VolumesAssistedSnapshotsTest-1252576855-project] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] volume_snapshot_create: create_info: {'snapshot_id': 'a310cabc-eaad-46ea-b5ef-506cb34619a3', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75341) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 14 23:42:14 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-212a4871-d7be-425c-961a-b5538460aafa tempest-VolumesAssistedSnapshotsTest-1252576855 tempest-VolumesAssistedSnapshotsTest-1252576855-project] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] snap xml: <domainsnapshot>
Nov 14 23:42:14 user nova-compute[75341]:   <disks>
Nov 14 23:42:14 user nova-compute[75341]:     <disk name="/dev/sdi" snapshot="external" type="file">
Nov 14 23:42:14 user nova-compute[75341]:       <source file="/dev/new_file"/>
Nov 14 23:42:14 user nova-compute[75341]:     </disk>
Nov 14 23:42:14 user nova-compute[75341]:     <disk name="vda" snapshot="no"/>
Nov 14 23:42:14 user nova-compute[75341]:   </disks>
Nov 14 23:42:14 user nova-compute[75341]: </domainsnapshot>
Nov 14 23:42:14 user nova-compute[75341]:  {{(pid=75341) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 14 23:42:14 user nova-compute[75341]: DEBUG nova.objects.instance [None req-212a4871-d7be-425c-961a-b5538460aafa tempest-VolumesAssistedSnapshotsTest-1252576855 tempest-VolumesAssistedSnapshotsTest-1252576855-project] Lazy-loading 'system_metadata' on Instance uuid e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:42:14 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-212a4871-d7be-425c-961a-b5538460aafa tempest-VolumesAssistedSnapshotsTest-1252576855 tempest-VolumesAssistedSnapshotsTest-1252576855-project] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 23:42:14 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-f7d90e02-ba4c-49dc-9562-672926e569a1 tempest-VolumesAssistedSnapshotsTest-1252576855 tempest-VolumesAssistedSnapshotsTest-1252576855-project] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] volume_snapshot_delete: delete_info: {'volume_id': 'abce15e6-a0f0-4a23-abd0-0cc190d16fbe'} {{(pid=75341) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver [None req-f7d90e02-ba4c-49dc-9562-672926e569a1 tempest-VolumesAssistedSnapshotsTest-1252576855 tempest-VolumesAssistedSnapshotsTest-1252576855-project] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Traceback (most recent call last):
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd]     if delete_info['type'] != 'qcow2':
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] KeyError: 'type'
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] 
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver [None req-212a4871-d7be-425c-961a-b5538460aafa tempest-VolumesAssistedSnapshotsTest-1252576855 tempest-VolumesAssistedSnapshotsTest-1252576855-project] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Traceback (most recent call last):
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd]     rv = execute(f, *args, **kwargs)
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd]     six.reraise(c, e, tb)
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd]     raise value
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd]     rv = meth(*args, **kwargs)
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] 
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver [None req-212a4871-d7be-425c-961a-b5538460aafa tempest-VolumesAssistedSnapshotsTest-1252576855 tempest-VolumesAssistedSnapshotsTest-1252576855-project] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Traceback (most recent call last):
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd]     self._volume_snapshot_create(context, instance, guest,
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd]     rv = execute(f, *args, **kwargs)
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd]     six.reraise(c, e, tb)
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd]     raise value
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd]     rv = meth(*args, **kwargs)
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] 
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver [None req-f7d90e02-ba4c-49dc-9562-672926e569a1 tempest-VolumesAssistedSnapshotsTest-1252576855 tempest-VolumesAssistedSnapshotsTest-1252576855-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver 
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver 
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-f468b87e-644f-4692-8fe4-083b43b65d48)
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver 
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver 
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver 
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server [None req-f7d90e02-ba4c-49dc-9562-672926e569a1 tempest-VolumesAssistedSnapshotsTest-1252576855 tempest-VolumesAssistedSnapshotsTest-1252576855-project] Exception during message handling: KeyError: 'type'
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server 
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver [None req-212a4871-d7be-425c-961a-b5538460aafa tempest-VolumesAssistedSnapshotsTest-1252576855 tempest-VolumesAssistedSnapshotsTest-1252576855-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot a310cabc-eaad-46ea-b5ef-506cb34619a3 could not be found.
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver     raise value
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver 
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver 
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot a310cabc-eaad-46ea-b5ef-506cb34619a3 could not be found. (HTTP 404) (Request-ID: req-aee592ad-374f-4b04-a80d-1b4508304eec)
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver 
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver 
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot a310cabc-eaad-46ea-b5ef-506cb34619a3 could not be found.
Nov 14 23:42:14 user nova-compute[75341]: ERROR nova.virt.libvirt.driver 
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server [None req-212a4871-d7be-425c-961a-b5538460aafa tempest-VolumesAssistedSnapshotsTest-1252576855 tempest-VolumesAssistedSnapshotsTest-1252576855-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server     raise value
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 23:42:14 user nova-compute[75341]: ERROR oslo_messaging.rpc.server 
Nov 14 23:42:14 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-d9e161c0-2247-4516-a8c7-d9231b351965 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:42:14 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e161c0-2247-4516-a8c7-d9231b351965 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] <== connect_volume: return (1787ms) {'type': 'block', 'scsi_wwn': '26135666331616437', 'path': '/dev/sdj'} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:42:14 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9e161c0-2247-4516-a8c7-d9231b351965 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135666331616437', 'path': '/dev/sdj'} {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 23:42:14 user nova-compute[75341]: DEBUG nova.objects.instance [None req-d9e161c0-2247-4516-a8c7-d9231b351965 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Lazy-loading 'flavor' on Instance uuid 163c448b-0183-41bb-b6e0-61917f6ad781 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:42:14 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-d9e161c0-2247-4516-a8c7-d9231b351965 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 23:42:14 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:42:14 user nova-compute[75341]:   <source dev="/dev/sdj"/>
Nov 14 23:42:14 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:42:14 user nova-compute[75341]:   <serial>9dccbb6b-a6e2-408a-97e4-d2e10768079b</serial>
Nov 14 23:42:14 user nova-compute[75341]: </disk>
Nov 14 23:42:14 user nova-compute[75341]:  {{(pid=75341) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 23:42:14 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b7e2a016-63cf-4e70-ac72-57426ba8ce7b tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] Acquiring lock "e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:42:14 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b7e2a016-63cf-4e70-ac72-57426ba8ce7b tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] Lock "e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:42:14 user nova-compute[75341]: INFO nova.compute.manager [None req-b7e2a016-63cf-4e70-ac72-57426ba8ce7b tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Detaching volume abce15e6-a0f0-4a23-abd0-0cc190d16fbe
Nov 14 23:42:14 user nova-compute[75341]: INFO nova.virt.block_device [None req-b7e2a016-63cf-4e70-ac72-57426ba8ce7b tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Attempting to driver detach volume abce15e6-a0f0-4a23-abd0-0cc190d16fbe from mountpoint /dev/vdb
Nov 14 23:42:14 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b7e2a016-63cf-4e70-ac72-57426ba8ce7b tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] Attempting to detach device vdb from instance e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd from the persistent domain config. {{(pid=75341) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 23:42:15 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-b7e2a016-63cf-4e70-ac72-57426ba8ce7b tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] detach device xml: <disk type="block" device="disk">
Nov 14 23:42:15 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:42:15 user nova-compute[75341]:   <source dev="/dev/sdi"/>
Nov 14 23:42:15 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:42:15 user nova-compute[75341]:   <serial>abce15e6-a0f0-4a23-abd0-0cc190d16fbe</serial>
Nov 14 23:42:15 user nova-compute[75341]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 23:42:15 user nova-compute[75341]: </disk>
Nov 14 23:42:15 user nova-compute[75341]:  {{(pid=75341) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 23:42:15 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-b7e2a016-63cf-4e70-ac72-57426ba8ce7b tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] Successfully detached device vdb from instance e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd from the persistent domain config.
Nov 14 23:42:15 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b7e2a016-63cf-4e70-ac72-57426ba8ce7b tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd from the live domain config. {{(pid=75341) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 23:42:15 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-b7e2a016-63cf-4e70-ac72-57426ba8ce7b tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] detach device xml: <disk type="block" device="disk">
Nov 14 23:42:15 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:42:15 user nova-compute[75341]:   <source dev="/dev/sdi"/>
Nov 14 23:42:15 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:42:15 user nova-compute[75341]:   <serial>abce15e6-a0f0-4a23-abd0-0cc190d16fbe</serial>
Nov 14 23:42:15 user nova-compute[75341]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 23:42:15 user nova-compute[75341]: </disk>
Nov 14 23:42:15 user nova-compute[75341]:  {{(pid=75341) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 23:42:15 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d9e161c0-2247-4516-a8c7-d9231b351965 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:42:15 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d9e161c0-2247-4516-a8c7-d9231b351965 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] No BDM found with device name hda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:42:15 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d9e161c0-2247-4516-a8c7-d9231b351965 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] No VIF found with MAC fa:16:3e:2f:5b:cc, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:42:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d9e161c0-2247-4516-a8c7-d9231b351965 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Lock "163c448b-0183-41bb-b6e0-61917f6ad781" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.592s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:42:15 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b7e2a016-63cf-4e70-ac72-57426ba8ce7b tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd {{(pid=75341) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 23:42:15 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b67c1d16-5575-49f8-9f81-abf99c198716 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Acquiring lock "163c448b-0183-41bb-b6e0-61917f6ad781" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:42:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b67c1d16-5575-49f8-9f81-abf99c198716 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Lock "163c448b-0183-41bb-b6e0-61917f6ad781" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:42:16 user nova-compute[75341]: INFO nova.compute.manager [None req-b67c1d16-5575-49f8-9f81-abf99c198716 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Detaching volume 9dccbb6b-a6e2-408a-97e4-d2e10768079b
Nov 14 23:42:16 user nova-compute[75341]: INFO nova.virt.block_device [None req-b67c1d16-5575-49f8-9f81-abf99c198716 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Attempting to driver detach volume 9dccbb6b-a6e2-408a-97e4-d2e10768079b from mountpoint /dev/vdb
Nov 14 23:42:16 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b67c1d16-5575-49f8-9f81-abf99c198716 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Attempting to detach device vdb from instance 163c448b-0183-41bb-b6e0-61917f6ad781 from the persistent domain config. {{(pid=75341) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 23:42:16 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-b67c1d16-5575-49f8-9f81-abf99c198716 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 23:42:16 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:42:16 user nova-compute[75341]:   <source dev="/dev/sdj"/>
Nov 14 23:42:16 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:42:16 user nova-compute[75341]:   <serial>9dccbb6b-a6e2-408a-97e4-d2e10768079b</serial>
Nov 14 23:42:16 user nova-compute[75341]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 23:42:16 user nova-compute[75341]: </disk>
Nov 14 23:42:16 user nova-compute[75341]:  {{(pid=75341) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 23:42:16 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-b67c1d16-5575-49f8-9f81-abf99c198716 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Successfully detached device vdb from instance 163c448b-0183-41bb-b6e0-61917f6ad781 from the persistent domain config.
Nov 14 23:42:16 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b67c1d16-5575-49f8-9f81-abf99c198716 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 163c448b-0183-41bb-b6e0-61917f6ad781 from the live domain config. {{(pid=75341) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 23:42:16 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-b67c1d16-5575-49f8-9f81-abf99c198716 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 23:42:16 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:42:16 user nova-compute[75341]:   <source dev="/dev/sdj"/>
Nov 14 23:42:16 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:42:16 user nova-compute[75341]:   <serial>9dccbb6b-a6e2-408a-97e4-d2e10768079b</serial>
Nov 14 23:42:16 user nova-compute[75341]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 23:42:16 user nova-compute[75341]: </disk>
Nov 14 23:42:16 user nova-compute[75341]:  {{(pid=75341) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 23:42:16 user nova-compute[75341]: DEBUG nova.compute.manager [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rhLTVJvU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0e7a53e9-6982-4c93-a830-a49cf0ce76bd', 'attached_at': '', 'detached_at': '', 'volume_id': 'f4398b13-aada-4505-95cf-82ff5ca13dc0', 'serial': 'f4398b13-aada-4505-95cf-82ff5ca13dc0'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKVvsWnF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '0e7a53e9-6982-4c93-a830-a49cf0ce76bd', 'attached_at': '', 'detached_at': '', 'volume_id': '0df8b689-2583-4be4-8499-cc2e54889ac2', 'serial'} {{(pid=75341) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 14 23:42:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:16 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Calling os-brick to attach iSCSI Volume {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 23:42:16 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rhLTVJvU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:42:16 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:42:16 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:42:16 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:42:16 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:42:16 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:42:16 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:42:16 user nova-compute[75341]: INFO os_brick.initiator.connectors.iscsi [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 23:42:16 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b67c1d16-5575-49f8-9f81-abf99c198716 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 163c448b-0183-41bb-b6e0-61917f6ad781 {{(pid=75341) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 23:42:16 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0 -p 172.16.0.220:3260 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:16 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:16 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad06f6b5-2ba0-4949-bcde-b08ff659dac8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:16 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 23:42:16 user nova-compute[75341]:  {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:16 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:16 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:16 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba57978-28f4-4c59-8c1f-cd5a19675127]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0] added\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:16 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0] added
Nov 14 23:42:16 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:16 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:16 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:16 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[741e5269-698a-437a-8f05-f6918ffe43bd]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:16 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:16 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:16 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:16 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd854a97-a201-4c43-a3d8-32f14d8f3cd6]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:16 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:16 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rhLTVJvU {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:16 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rhLTVJvU" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:16 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[877d0688-844c-4be8-914b-93dc622e9f9f]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:16 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rhLTVJvU'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:16 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:16 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:16 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e6cdd1-0487-48c0-9317-0345c5c85d7f]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:16 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:16 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:16 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:16 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6e4d36-5339-4970-8663-273d4eadfeee]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:16 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe (non-flash)
Nov 14 23:42:16 user nova-compute[75341]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b (non-flash)
Nov 14 23:42:16 user nova-compute[75341]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)
Nov 14 23:42:16 user nova-compute[75341]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)
Nov 14 23:42:16 user nova-compute[75341]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)
Nov 14 23:42:16 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:42:16 user nova-compute[75341]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02 (non-flash)
Nov 14 23:42:16 user nova-compute[75341]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 (non-flash)
Nov 14 23:42:16 user nova-compute[75341]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3 (non-flash)
Nov 14 23:42:16 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:42:16 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe (non-flash)
Nov 14 23:42:16 user nova-compute[75341]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b (non-flash)
Nov 14 23:42:16 user nova-compute[75341]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)
Nov 14 23:42:16 user nova-compute[75341]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)
Nov 14 23:42:16 user nova-compute[75341]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)
Nov 14 23:42:16 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:42:16 user nova-compute[75341]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02 (non-flash)
Nov 14 23:42:16 user nova-compute[75341]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 (non-flash)
Nov 14 23:42:16 user nova-compute[75341]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3 (non-flash)
Nov 14 23:42:16 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:42:16 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0 -p 172.16.0.220:3260 --login {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:16 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0 -p 172.16.0.220:3260 --login" returned: 0 in 0.095s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:16 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[fddc9016-9521-48ee-9d1c-f9bf912affbf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:16 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0, portal: 172.16.0.220,3260]
Nov 14 23:42:16 user nova-compute[75341]: Login to [iface: default, target: iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0, portal: 172.16.0.220,3260] successful.
Nov 14 23:42:16 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:16 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:17 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[2276bb74-80f4-4d30-b1fe-b0c4fdb2324c]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:17 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:17 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3852724-5291-489d-9afd-16cb9a77a22f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:17 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe (non-flash)
Nov 14 23:42:17 user nova-compute[75341]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b (non-flash)
Nov 14 23:42:17 user nova-compute[75341]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0 (non-flash)
Nov 14 23:42:17 user nova-compute[75341]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)
Nov 14 23:42:17 user nova-compute[75341]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)
Nov 14 23:42:17 user nova-compute[75341]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)
Nov 14 23:42:17 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:42:17 user nova-compute[75341]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02 (non-flash)
Nov 14 23:42:17 user nova-compute[75341]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 (non-flash)
Nov 14 23:42:17 user nova-compute[75341]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3 (non-flash)
Nov 14 23:42:17 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:42:17 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe (non-flash)
Nov 14 23:42:17 user nova-compute[75341]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b (non-flash)
Nov 14 23:42:17 user nova-compute[75341]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0 (non-flash)
Nov 14 23:42:17 user nova-compute[75341]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)
Nov 14 23:42:17 user nova-compute[75341]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)
Nov 14 23:42:17 user nova-compute[75341]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)
Nov 14 23:42:17 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:42:17 user nova-compute[75341]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02 (non-flash)
Nov 14 23:42:17 user nova-compute[75341]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 (non-flash)
Nov 14 23:42:17 user nova-compute[75341]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3 (non-flash)
Nov 14 23:42:17 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:42:17 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:42:17 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] Connected to 172.16.0.220:3260 {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 23:42:17 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] HCTL ('42', '-', '-', 0) found on session 12 with lun 0 {{(pid=75341) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 23:42:17 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] Scanning host 42 c: -, t: -, l: 0) {{(pid=75341) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 23:42:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:17 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[5564a4e9-367a-47bf-9804-1b5778a77db4]: (4, ('- - 0', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:17 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] Searching for a device in session 12 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 23:42:17 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rhLTVJvU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 23:42:18 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:42:18 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '23830366634353533', 'path': '/dev/sdk'} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:42:18 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830366634353533', 'path': '/dev/sdk'} {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 23:42:18 user nova-compute[75341]: DEBUG nova.objects.instance [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] Lazy-loading 'flavor' on Instance uuid 0e7a53e9-6982-4c93-a830-a49cf0ce76bd {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:42:18 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75341) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 23:42:19 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] COPY block job progress, current cursor: 169869312 final cursor: 1073741824 {{(pid=75341) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 23:42:19 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] COPY block job progress, current cursor: 380633088 final cursor: 1073741824 {{(pid=75341) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 23:42:20 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] COPY block job progress, current cursor: 537919488 final cursor: 1073741824 {{(pid=75341) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 23:42:20 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] COPY block job progress, current cursor: 711983104 final cursor: 1073741824 {{(pid=75341) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 23:42:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:21 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] COPY block job progress, current cursor: 867172352 final cursor: 1073741824 {{(pid=75341) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 23:42:21 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] COPY block job progress, current cursor: 1017118720 final cursor: 1073741824 {{(pid=75341) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 23:42:21 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:22 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75341) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 23:42:22 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] calling os-brick to detach iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 23:42:22 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, {'target_iqn': 'iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKVvsWnF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:42:22 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:42:22 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:42:22 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:42:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:22 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab93c220-b86d-4933-a921-98fe97ba2fbb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:22 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 23:42:22 user nova-compute[75341]: No targets found.
Nov 14 23:42:22 user nova-compute[75341]: iSNS:
Nov 14 23:42:22 user nova-compute[75341]: No targets found.
Nov 14 23:42:22 user nova-compute[75341]: STATIC:
Nov 14 23:42:22 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff
Nov 14 23:42:22 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:42:22 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:42:22 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198
Nov 14 23:42:22 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:42:22 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:42:22 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7
Nov 14 23:42:22 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:42:22 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:42:22 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2
Nov 14 23:42:22 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:42:22 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:42:22 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3
Nov 14 23:42:22 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:42:22 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:42:22 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296
Nov 14 23:42:22 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:42:22 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:42:22 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b
Nov 14 23:42:22 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:42:22 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:42:22 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02
Nov 14 23:42:22 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:42:22 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:42:22 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0
Nov 14 23:42:22 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:42:22 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:42:22 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe
Nov 14 23:42:22 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:42:22 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:42:22 user nova-compute[75341]: FIRMWARE:
Nov 14 23:42:22 user nova-compute[75341]: No targets found.
Nov 14 23:42:22 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:42:22 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 23:42:22 user nova-compute[75341]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 23:42:22 user nova-compute[75341]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75341) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 23:42:22 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2', 0)] {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 23:42:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:22 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcfb5529-4329-4d61-96d1-b968494c7b87]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:22 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[177fa46b-6778-4f65-ac16-b9322b4a36c8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:22 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe (non-flash)
Nov 14 23:42:22 user nova-compute[75341]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b (non-flash)
Nov 14 23:42:22 user nova-compute[75341]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0 (non-flash)
Nov 14 23:42:22 user nova-compute[75341]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)
Nov 14 23:42:22 user nova-compute[75341]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)
Nov 14 23:42:22 user nova-compute[75341]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)
Nov 14 23:42:22 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:42:22 user nova-compute[75341]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02 (non-flash)
Nov 14 23:42:22 user nova-compute[75341]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 (non-flash)
Nov 14 23:42:22 user nova-compute[75341]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3 (non-flash)
Nov 14 23:42:22 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:42:22 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe (non-flash)
Nov 14 23:42:22 user nova-compute[75341]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b (non-flash)
Nov 14 23:42:22 user nova-compute[75341]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0 (non-flash)
Nov 14 23:42:22 user nova-compute[75341]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)
Nov 14 23:42:22 user nova-compute[75341]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)
Nov 14 23:42:22 user nova-compute[75341]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)
Nov 14 23:42:22 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:42:22 user nova-compute[75341]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02 (non-flash)
Nov 14 23:42:22 user nova-compute[75341]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 (non-flash)
Nov 14 23:42:22 user nova-compute[75341]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3 (non-flash)
Nov 14 23:42:22 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:42:22 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18901385e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2'): ({'sdg'}, set())}) {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 23:42:22 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] Removing single pathed devices sdg {{(pid=75341) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 23:42:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:22 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9414e2e-c107-46b0-861e-5225c8f80e68]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:22 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0f7aa7-dc56-409e-a7c2-0b16e3b9e5c5]: (4, ('ok\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:22 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] Flushing IO for device /dev/sdg {{(pid=75341) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 23:42:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:22 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3ddbf6-774b-44ee-bae5-f6185c2e7b4c]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:22 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75341) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 23:42:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.041s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:22 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f261db7-781f-4606-a482-25243f3fee9d]: (4, ('1', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:22 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 23:42:22 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] SCSI volumes sdg have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 23:42:22 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2')] {{(pid=75341) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 23:42:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:22 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef7ce9e-8cf3-4d2c-add7-fd44fb980083]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:22 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 -p 172.16.0.220:3260 --logout {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:22 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1a390a-4c4e-4698-b073-c7274dba882c]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:22 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2, portal: 172.16.0.220,3260]
Nov 14 23:42:22 user nova-compute[75341]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2, portal: 172.16.0.220,3260] successful.
Nov 14 23:42:22 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 -p 172.16.0.220:3260 --op delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:22 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[be90b12a-3246-43f9-84b0-60a02a7297a1]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:22 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:22 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:42:22 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] <== disconnect_volume: return (342ms) None {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:42:22 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Disconnected iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 23:42:22 user nova-compute[75341]: DEBUG nova.compute.manager [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rhLTVJvU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, 'status': 'reserved', 'instance': '0e7a53e9-6982-4c93-a830-a49cf0ce76bd', 'attached_at': '', 'detached_at': '', 'volume_id': 'f4398b13-aada-4505-95cf-82ff5ca13dc0', 'serial'} {{(pid=75341) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 14 23:42:22 user nova-compute[75341]: DEBUG nova.compute.manager [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] swap_volume: removing Cinder connection for volume 0df8b689-2583-4be4-8499-cc2e54889ac2 {{(pid=75341) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 14 23:42:23 user nova-compute[75341]: DEBUG nova.compute.manager [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] swap_volume: Updating volume 0df8b689-2583-4be4-8499-cc2e54889ac2 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "rhLTVJvU", "auth_password": "ZDR2lCcsIQkzB6", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdk", "volume_id": "f4398b13-aada-4505-95cf-82ff5ca13dc0"}, "status": "reserved", "instance": "0e7a53e9-6982-4c93-a830-a49cf0ce76bd", "attached_at": "", "detached_at": "", "volume_id": "f4398b13-aada-4505-95cf-82ff5ca13dc0", "serial": "f4398b13-aada-4505-95cf-82ff5ca13dc0"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'f4398b13-aada-4505-95cf-82ff5ca13dc0', 'no_device': None, 'attachment_id': '3344de64-cfe9-4e5e-83d0-71085f15c165'} {{(pid=75341) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 14 23:42:23 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-10139cc5-f9b2-49dd-9958-db0d06de11e0 tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] Lock "0e7a53e9-6982-4c93-a830-a49cf0ce76bd" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 11.824s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:42:25 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] Acquiring lock "0e7a53e9-6982-4c93-a830-a49cf0ce76bd" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:42:25 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] Lock "0e7a53e9-6982-4c93-a830-a49cf0ce76bd" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:42:25 user nova-compute[75341]: DEBUG os_brick.utils [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:42:25 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:25 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:25 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6787f77-e781-4db4-8b13-d6f125b37023]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6d1cfca09c9\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:25 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:25 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:25 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b7757f-0373-4822-b3b1-f002be2588a6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:25 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:25 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:25 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[dffb6ec4-a793-4621-820f-8f3e95f69cbb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:25 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[49871d20-6531-4eb5-8e59-b66a8fff2c02]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:25 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] Running cmd (subprocess): nvme version {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:25 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:42:25 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] nvme not present on system {{(pid=75341) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 23:42:25 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:25 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:42:25 user nova-compute[75341]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 23:42:25 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb35680-92b4-4c46-aa1b-53fb8e6dbb01]: (4, '') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:25 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75341) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 23:42:25 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 23:42:25 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] LIGHTOS: no hostnqn found. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 23:42:25 user nova-compute[75341]: DEBUG os_brick.utils [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6d1cfca09c9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:42:25 user nova-compute[75341]: INFO nova.compute.manager [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Swapping volume f4398b13-aada-4505-95cf-82ff5ca13dc0 for 0df8b689-2583-4be4-8499-cc2e54889ac2
Nov 14 23:42:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:26 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:27 user nova-compute[75341]: DEBUG nova.compute.manager [req-01d3d65b-d2ec-4b66-b147-4b5f8368098e req-aacc796f-04c8-42a0-902e-e493dfe6d54c service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received event network-changed-d0dd84fa-339a-49ec-9042-96715e2230fe {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:42:27 user nova-compute[75341]: DEBUG nova.compute.manager [req-01d3d65b-d2ec-4b66-b147-4b5f8368098e req-aacc796f-04c8-42a0-902e-e493dfe6d54c service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Refreshing instance network info cache due to event network-changed-d0dd84fa-339a-49ec-9042-96715e2230fe. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:42:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-01d3d65b-d2ec-4b66-b147-4b5f8368098e req-aacc796f-04c8-42a0-902e-e493dfe6d54c service nova] Acquiring lock "refresh_cache-9d03c7a3-e816-43b0-8616-60dea7a4e81a" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:42:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-01d3d65b-d2ec-4b66-b147-4b5f8368098e req-aacc796f-04c8-42a0-902e-e493dfe6d54c service nova] Acquired lock "refresh_cache-9d03c7a3-e816-43b0-8616-60dea7a4e81a" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:42:27 user nova-compute[75341]: DEBUG nova.network.neutron [req-01d3d65b-d2ec-4b66-b147-4b5f8368098e req-aacc796f-04c8-42a0-902e-e493dfe6d54c service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Refreshing network info cache for port d0dd84fa-339a-49ec-9042-96715e2230fe {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:42:27 user nova-compute[75341]: DEBUG nova.network.neutron [req-01d3d65b-d2ec-4b66-b147-4b5f8368098e req-aacc796f-04c8-42a0-902e-e493dfe6d54c service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Updated VIF entry in instance network info cache for port d0dd84fa-339a-49ec-9042-96715e2230fe. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:42:27 user nova-compute[75341]: DEBUG nova.network.neutron [req-01d3d65b-d2ec-4b66-b147-4b5f8368098e req-aacc796f-04c8-42a0-902e-e493dfe6d54c service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Updating instance_info_cache with network_info: [{"id": "d0dd84fa-339a-49ec-9042-96715e2230fe", "address": "fa:16:3e:b5:06:42", "network": {"id": "b499fa7b-6b9d-49c0-a9cd-42306c00c501", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-385863436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0dd84fa-33", "ovs_interfaceid": "d0dd84fa-339a-49ec-9042-96715e2230fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f55964c8-6b58-4464-a352-e5145cc3c518", "address": "fa:16:3e:1b:36:55", "network": {"id": "c135160d-9db9-4271-a134-0cf75c1e862c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1010953674", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf55964c8-6b", "ovs_interfaceid": "f55964c8-6b58-4464-a352-e5145cc3c518", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "eb488639-e98a-4a85-b148-09dbb505f1c9", "address": "fa:16:3e:36:7e:f8", "network": {"id": "c135160d-9db9-4271-a134-0cf75c1e862c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1010953674", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb488639-e9", "ovs_interfaceid": "eb488639-e98a-4a85-b148-09dbb505f1c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "886562c6-312d-4a87-a34a-059f2ba3058a", "address": "fa:16:3e:28:ad:ae", "network": {"id": "c135160d-9db9-4271-a134-0cf75c1e862c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1010953674", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap886562c6-31", "ovs_interfaceid": "886562c6-312d-4a87-a34a-059f2ba3058a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c314df64-6753-4691-a931-1ef8f31a8063", "address": "fa:16:3e:92:14:79", "network": {"id": "c135160d-9db9-4271-a134-0cf75c1e862c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1010953674", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc314df64-67", "ovs_interfaceid": "c314df64-6753-4691-a931-1ef8f31a8063", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8352810c-25a7-4c4d-b13f-196c82e323ee", "address": "fa:16:3e:6d:e3:2c", "network": {"id": "08285f35-6170-45e2-9aaa-cd8a52bbd6cd", "bridge": "br-int", "label": "tempest-device-tagging-net2-454254441", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8352810c-25", "ovs_interfaceid": "8352810c-25a7-4c4d-b13f-196c82e323ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e1611672-3415-4fea-adb0-c7fe74ae6049", "address": "fa:16:3e:70:02:49", "network": {"id": "08285f35-6170-45e2-9aaa-cd8a52bbd6cd", "bridge": "br-int", "label": "tempest-device-tagging-net2-454254441", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1611672-34", "ovs_interfaceid": "e1611672-3415-4fea-adb0-c7fe74ae6049", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:42:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-01d3d65b-d2ec-4b66-b147-4b5f8368098e req-aacc796f-04c8-42a0-902e-e493dfe6d54c service nova] Releasing lock "refresh_cache-9d03c7a3-e816-43b0-8616-60dea7a4e81a" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Acquiring lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Acquiring lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:42:30 user nova-compute[75341]: INFO nova.compute.manager [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Terminating instance
Nov 14 23:42:30 user nova-compute[75341]: DEBUG nova.compute.manager [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Start destroying the instance on the hypervisor. {{(pid=75341) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG nova.compute.manager [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKVvsWnF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0e7a53e9-6982-4c93-a830-a49cf0ce76bd', 'attached_at': '', 'detached_at': '', 'volume_id': '0df8b689-2583-4be4-8499-cc2e54889ac2', 'serial': '0df8b689-2583-4be4-8499-cc2e54889ac2'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rhLTVJvU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk', 'volume_id': 'f4398b13-aada-4505-95cf-82ff5ca13dc0'}, 'status': 'reserved', 'instance': '0e7a53e9-6982-4c93-a830-a49cf0ce76bd', 'attached_at': '', 'detached_at': '', 'volume_id': 'f4398b13-aada-4505-95cf-82ff5ca13dc0', 'serial'} {{(pid=75341) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Calling os-brick to attach iSCSI Volume {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKVvsWnF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:42:30 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:42:30 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:42:30 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:42:30 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:42:30 user nova-compute[75341]: INFO os_brick.initiator.connectors.iscsi [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 23:42:30 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 -p 172.16.0.220:3260 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d6dc77-0e8f-4135-9bbe-d588f72ee40b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 23:42:30 user nova-compute[75341]:  {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[2107ceed-d05b-4194-87a2-b8b3fa9ba4a8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2] added\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2] added
Nov 14 23:42:30 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f7be84-b7cd-4c4e-a739-5888df5d6cb6]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[5320b10e-daff-4102-9e0a-d6f345f3e51b]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NKVvsWnF {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NKVvsWnF" returned: 0 in 0.023s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[3314c3e4-77f5-43ae-899d-d612a3ab8390]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NKVvsWnF'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42c667b-15e0-4f56-b409-c50bdc06002b]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11b0cde-7ffb-4f8b-ba11-ae1bf5ce2b71]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe (non-flash)
Nov 14 23:42:30 user nova-compute[75341]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b (non-flash)
Nov 14 23:42:30 user nova-compute[75341]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0 (non-flash)
Nov 14 23:42:30 user nova-compute[75341]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)
Nov 14 23:42:30 user nova-compute[75341]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)
Nov 14 23:42:30 user nova-compute[75341]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)
Nov 14 23:42:30 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:42:30 user nova-compute[75341]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02 (non-flash)
Nov 14 23:42:30 user nova-compute[75341]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3 (non-flash)
Nov 14 23:42:30 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe (non-flash)
Nov 14 23:42:30 user nova-compute[75341]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b (non-flash)
Nov 14 23:42:30 user nova-compute[75341]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0 (non-flash)
Nov 14 23:42:30 user nova-compute[75341]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)
Nov 14 23:42:30 user nova-compute[75341]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)
Nov 14 23:42:30 user nova-compute[75341]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)
Nov 14 23:42:30 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:42:30 user nova-compute[75341]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02 (non-flash)
Nov 14 23:42:30 user nova-compute[75341]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3 (non-flash)
Nov 14 23:42:30 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 -p 172.16.0.220:3260 --login {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG nova.compute.manager [req-9b1bedc7-13a8-4f7c-9975-5412c069dd65 req-dbc19d0c-c6db-40c7-add8-0d82ebd1f596 service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received event network-vif-unplugged-d0dd84fa-339a-49ec-9042-96715e2230fe {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-9b1bedc7-13a8-4f7c-9975-5412c069dd65 req-dbc19d0c-c6db-40c7-add8-0d82ebd1f596 service nova] Acquiring lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-9b1bedc7-13a8-4f7c-9975-5412c069dd65 req-dbc19d0c-c6db-40c7-add8-0d82ebd1f596 service nova] Lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-9b1bedc7-13a8-4f7c-9975-5412c069dd65 req-dbc19d0c-c6db-40c7-add8-0d82ebd1f596 service nova] Lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG nova.compute.manager [req-9b1bedc7-13a8-4f7c-9975-5412c069dd65 req-dbc19d0c-c6db-40c7-add8-0d82ebd1f596 service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] No waiting events found dispatching network-vif-unplugged-d0dd84fa-339a-49ec-9042-96715e2230fe {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG nova.compute.manager [req-9b1bedc7-13a8-4f7c-9975-5412c069dd65 req-dbc19d0c-c6db-40c7-add8-0d82ebd1f596 service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received event network-vif-unplugged-d0dd84fa-339a-49ec-9042-96715e2230fe for instance with task_state deleting. {{(pid=75341) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 -p 172.16.0.220:3260 --login" returned: 0 in 0.109s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb21ee95-6ae3-4719-af1d-e6d9c03d0e41]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2, portal: 172.16.0.220,3260]
Nov 14 23:42:30 user nova-compute[75341]: Login to [iface: default, target: iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2, portal: 172.16.0.220,3260] successful.
Nov 14 23:42:30 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58f7bfb-d87b-41a0-87a7-842f694baa07]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[0026f45e-d9c3-4512-aff8-3c10ac77aa9f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe (non-flash)
Nov 14 23:42:30 user nova-compute[75341]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b (non-flash)
Nov 14 23:42:30 user nova-compute[75341]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0 (non-flash)
Nov 14 23:42:30 user nova-compute[75341]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 (non-flash)
Nov 14 23:42:30 user nova-compute[75341]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)
Nov 14 23:42:30 user nova-compute[75341]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)
Nov 14 23:42:30 user nova-compute[75341]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)
Nov 14 23:42:30 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:42:30 user nova-compute[75341]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02 (non-flash)
Nov 14 23:42:30 user nova-compute[75341]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3 (non-flash)
Nov 14 23:42:30 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe (non-flash)
Nov 14 23:42:30 user nova-compute[75341]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b (non-flash)
Nov 14 23:42:30 user nova-compute[75341]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0 (non-flash)
Nov 14 23:42:30 user nova-compute[75341]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 (non-flash)
Nov 14 23:42:30 user nova-compute[75341]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)
Nov 14 23:42:30 user nova-compute[75341]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)
Nov 14 23:42:30 user nova-compute[75341]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)
Nov 14 23:42:30 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:42:30 user nova-compute[75341]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02 (non-flash)
Nov 14 23:42:30 user nova-compute[75341]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3 (non-flash)
Nov 14 23:42:30 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.383s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] Connected to 172.16.0.220:3260 {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] HCTL ('38', '-', '-', 0) found on session 13 with lun 0 {{(pid=75341) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] Scanning host 38 c: -, t: -, l: 0) {{(pid=75341) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[5264d3f8-cc92-4630-9010-9bdc50e37d14]: (4, ('- - 0', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] Searching for a device in session 13 and hctl ['38', '*', '*', 0] yield: None {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG nova.compute.manager [req-fc7771c7-3532-45df-840c-fb4790f60231 req-f1a58902-cc1e-4470-9741-4a79ae48aeb1 service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received event network-vif-unplugged-f55964c8-6b58-4464-a352-e5145cc3c518 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-fc7771c7-3532-45df-840c-fb4790f60231 req-f1a58902-cc1e-4470-9741-4a79ae48aeb1 service nova] Acquiring lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-fc7771c7-3532-45df-840c-fb4790f60231 req-f1a58902-cc1e-4470-9741-4a79ae48aeb1 service nova] Lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-fc7771c7-3532-45df-840c-fb4790f60231 req-f1a58902-cc1e-4470-9741-4a79ae48aeb1 service nova] Lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG nova.compute.manager [req-fc7771c7-3532-45df-840c-fb4790f60231 req-f1a58902-cc1e-4470-9741-4a79ae48aeb1 service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] No waiting events found dispatching network-vif-unplugged-f55964c8-6b58-4464-a352-e5145cc3c518 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG nova.compute.manager [req-fc7771c7-3532-45df-840c-fb4790f60231 req-f1a58902-cc1e-4470-9741-4a79ae48aeb1 service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received event network-vif-unplugged-f55964c8-6b58-4464-a352-e5145cc3c518 for instance with task_state deleting. {{(pid=75341) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG nova.compute.manager [req-9eb96180-88d6-4861-aba8-f67bd8b45589 req-36f2d22b-c069-44be-9ecb-b539be9ef686 service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received event network-vif-unplugged-eb488639-e98a-4a85-b148-09dbb505f1c9 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-9eb96180-88d6-4861-aba8-f67bd8b45589 req-36f2d22b-c069-44be-9ecb-b539be9ef686 service nova] Acquiring lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-9eb96180-88d6-4861-aba8-f67bd8b45589 req-36f2d22b-c069-44be-9ecb-b539be9ef686 service nova] Lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-9eb96180-88d6-4861-aba8-f67bd8b45589 req-36f2d22b-c069-44be-9ecb-b539be9ef686 service nova] Lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG nova.compute.manager [req-9eb96180-88d6-4861-aba8-f67bd8b45589 req-36f2d22b-c069-44be-9ecb-b539be9ef686 service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] No waiting events found dispatching network-vif-unplugged-eb488639-e98a-4a85-b148-09dbb505f1c9 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG nova.compute.manager [req-9eb96180-88d6-4861-aba8-f67bd8b45589 req-36f2d22b-c069-44be-9ecb-b539be9ef686 service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received event network-vif-unplugged-eb488639-e98a-4a85-b148-09dbb505f1c9 for instance with task_state deleting. {{(pid=75341) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:31 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-846a5652-8bd6-4385-8b7c-cfe499edc17c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a0cffbac-f552-47bf-bd6c-dabb70e7c867 is timed out.
Nov 14 23:42:31 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-846a5652-8bd6-4385-8b7c-cfe499edc17c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Successfully detached device vdb from instance a0cffbac-f552-47bf-bd6c-dabb70e7c867 from the live domain config.
Nov 14 23:42:31 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-846a5652-8bd6-4385-8b7c-cfe499edc17c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] calling os-brick to detach iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 23:42:31 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-846a5652-8bd6-4385-8b7c-cfe499edc17c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, {'target_iqn': 'iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SviFPMDV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:42:31 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-846a5652-8bd6-4385-8b7c-cfe499edc17c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:42:31 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-846a5652-8bd6-4385-8b7c-cfe499edc17c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:42:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:31 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] Searching for a device in session 13 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 23:42:31 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKVvsWnF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 23:42:31 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.420s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:42:31 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] <== connect_volume: return (1421ms) {'type': 'block', 'scsi_wwn': '23366333364376535', 'path': '/dev/sdg'} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:42:31 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366333364376535', 'path': '/dev/sdg'} {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 23:42:31 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-846a5652-8bd6-4385-8b7c-cfe499edc17c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.213s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:42:31 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:31 user nova-compute[75341]: DEBUG nova.objects.instance [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] Lazy-loading 'flavor' on Instance uuid 0e7a53e9-6982-4c93-a830-a49cf0ce76bd {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:42:31 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:31 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4b3555-7689-4c3e-93d6-d60db9f53676]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:31 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-846a5652-8bd6-4385-8b7c-cfe499edc17c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 23:42:31 user nova-compute[75341]: No targets found.
Nov 14 23:42:31 user nova-compute[75341]: iSNS:
Nov 14 23:42:31 user nova-compute[75341]: No targets found.
Nov 14 23:42:31 user nova-compute[75341]: STATIC:
Nov 14 23:42:31 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff
Nov 14 23:42:31 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:42:31 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:42:31 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198
Nov 14 23:42:31 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:42:31 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:42:31 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7
Nov 14 23:42:31 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:42:31 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:42:31 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2
Nov 14 23:42:31 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:42:31 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:42:31 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3
Nov 14 23:42:31 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:42:31 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:42:31 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296
Nov 14 23:42:31 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:42:31 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:42:31 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b
Nov 14 23:42:31 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:42:31 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:42:31 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02
Nov 14 23:42:31 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:42:31 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:42:31 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0
Nov 14 23:42:31 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:42:31 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:42:31 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe
Nov 14 23:42:31 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:42:31 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:42:31 user nova-compute[75341]: FIRMWARE:
Nov 14 23:42:31 user nova-compute[75341]: No targets found.
Nov 14 23:42:31 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:42:31 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-846a5652-8bd6-4385-8b7c-cfe499edc17c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 23:42:31 user nova-compute[75341]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 23:42:31 user nova-compute[75341]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75341) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 23:42:31 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-846a5652-8bd6-4385-8b7c-cfe499edc17c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02', 0)] {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 23:42:31 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:31 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:31 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d43af0e-4dbf-44cf-9a63-902a7ab2a860]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:31 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:31 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:31 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4394ec1-bc49-4a80-b1f5-a2618a2bdf30]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:31 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-846a5652-8bd6-4385-8b7c-cfe499edc17c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe (non-flash)
Nov 14 23:42:31 user nova-compute[75341]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b (non-flash)
Nov 14 23:42:31 user nova-compute[75341]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0 (non-flash)
Nov 14 23:42:31 user nova-compute[75341]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 (non-flash)
Nov 14 23:42:31 user nova-compute[75341]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)
Nov 14 23:42:31 user nova-compute[75341]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)
Nov 14 23:42:31 user nova-compute[75341]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)
Nov 14 23:42:31 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:42:31 user nova-compute[75341]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02 (non-flash)
Nov 14 23:42:31 user nova-compute[75341]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3 (non-flash)
Nov 14 23:42:31 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:42:31 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-846a5652-8bd6-4385-8b7c-cfe499edc17c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe (non-flash)
Nov 14 23:42:31 user nova-compute[75341]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b (non-flash)
Nov 14 23:42:31 user nova-compute[75341]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0 (non-flash)
Nov 14 23:42:31 user nova-compute[75341]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 (non-flash)
Nov 14 23:42:31 user nova-compute[75341]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)
Nov 14 23:42:31 user nova-compute[75341]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)
Nov 14 23:42:31 user nova-compute[75341]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)
Nov 14 23:42:31 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:42:31 user nova-compute[75341]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02 (non-flash)
Nov 14 23:42:31 user nova-compute[75341]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3 (non-flash)
Nov 14 23:42:31 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:42:31 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-846a5652-8bd6-4385-8b7c-cfe499edc17c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f187027e320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02'): ({'sdf'}, set())}) {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 23:42:31 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-846a5652-8bd6-4385-8b7c-cfe499edc17c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Removing single pathed devices sdf {{(pid=75341) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 23:42:31 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:31 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:31 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4a2c69-a8e5-444d-a187-cba295f482d1]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:31 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:31 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:31 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ac4eda-0568-43ff-8f66-df542c438141]: (4, ('ok\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:31 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-846a5652-8bd6-4385-8b7c-cfe499edc17c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Flushing IO for device /dev/sdf {{(pid=75341) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 23:42:31 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:31 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:31 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1960030-adc9-4eee-b459-1b1b9bb80e29]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:31 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-846a5652-8bd6-4385-8b7c-cfe499edc17c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75341) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 23:42:31 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:31 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.030s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:31 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c37fcd-87c7-457b-8bb1-a0d6bc882faa]: (4, ('1', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:31 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-846a5652-8bd6-4385-8b7c-cfe499edc17c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 23:42:31 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-846a5652-8bd6-4385-8b7c-cfe499edc17c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] SCSI volumes sdf have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 23:42:31 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-846a5652-8bd6-4385-8b7c-cfe499edc17c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02')] {{(pid=75341) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 23:42:31 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:31 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:31 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f2f04b-45e0-459c-9eee-95516b91e10a]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:31 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-846a5652-8bd6-4385-8b7c-cfe499edc17c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:31 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02 -p 172.16.0.220:3260 --logout {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:31 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02 -p 172.16.0.220:3260 --logout" returned: 0 in 0.109s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:31 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff49da7-a78d-4001-8359-0fd269a6a3bb]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:31 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-846a5652-8bd6-4385-8b7c-cfe499edc17c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02, portal: 172.16.0.220,3260]
Nov 14 23:42:31 user nova-compute[75341]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02, portal: 172.16.0.220,3260] successful.
Nov 14 23:42:31 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:31 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02 -p 172.16.0.220:3260 --op delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:31 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f2c6115-2b76-4800-bb46-0d69bed0ec02 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:31 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57ea7b2-3b32-4234-a0a3-bdbcfea64713]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:31 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-846a5652-8bd6-4385-8b7c-cfe499edc17c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:31 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-846a5652-8bd6-4385-8b7c-cfe499edc17c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.406s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:42:31 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-846a5652-8bd6-4385-8b7c-cfe499edc17c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] <== disconnect_volume: return (618ms) None {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:42:31 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-846a5652-8bd6-4385-8b7c-cfe499edc17c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Disconnected iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 23:42:32 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Instance destroyed successfully.
Nov 14 23:42:32 user nova-compute[75341]: DEBUG nova.objects.instance [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Lazy-loading 'resources' on Instance uuid 9d03c7a3-e816-43b0-8616-60dea7a4e81a {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] COPY block job progress, current cursor: 5242880 final cursor: 1073741824 {{(pid=75341) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T23:40:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-993143391',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-993143391',id=9,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiUPPSlFnRUQvBR9O/mDOOgi/KDCGIsTUS9ts2D2JCf7UKa4oJ0is321+3mkZZFGv5oTtL1SS4r0kUkIb28JdNKZeJZCDUMNnN/nhj+h3UTsN88WEzZbLjhSZCfzMNo2w==',key_name='tempest-keypair-931450966',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:41:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b84539186347404ea3cdc32042f70052',ramdisk_id='',reservation_id='r-flwl45cc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-491908434',owner_user_name='tempest-TaggedBootDevicesTest-491908434-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:41:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3078a91c61fb48a98b7c0e1d98117e8f',uuid=9d03c7a3-e816-43b0-8616-60dea7a4e81a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d0dd84fa-339a-49ec-9042-96715e2230fe", "address": "fa:16:3e:b5:06:42", "network": {"id": "b499fa7b-6b9d-49c0-a9cd-42306c00c501", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-385863436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0dd84fa-33", "ovs_interfaceid": "d0dd84fa-339a-49ec-9042-96715e2230fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Converting VIF {"id": "d0dd84fa-339a-49ec-9042-96715e2230fe", "address": "fa:16:3e:b5:06:42", "network": {"id": "b499fa7b-6b9d-49c0-a9cd-42306c00c501", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-385863436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0dd84fa-33", "ovs_interfaceid": "d0dd84fa-339a-49ec-9042-96715e2230fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:06:42,bridge_name='br-int',has_traffic_filtering=True,id=d0dd84fa-339a-49ec-9042-96715e2230fe,network=Network(b499fa7b-6b9d-49c0-a9cd-42306c00c501),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0dd84fa-33') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG os_vif [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:06:42,bridge_name='br-int',has_traffic_filtering=True,id=d0dd84fa-339a-49ec-9042-96715e2230fe,network=Network(b499fa7b-6b9d-49c0-a9cd-42306c00c501),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0dd84fa-33') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd0dd84fa-33, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=059846df-7d36-47b6-afd8-ea07387edfaa) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:32 user nova-compute[75341]: INFO os_vif [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:06:42,bridge_name='br-int',has_traffic_filtering=True,id=d0dd84fa-339a-49ec-9042-96715e2230fe,network=Network(b499fa7b-6b9d-49c0-a9cd-42306c00c501),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0dd84fa-33')
Nov 14 23:42:32 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T23:40:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-993143391',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-993143391',id=9,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiUPPSlFnRUQvBR9O/mDOOgi/KDCGIsTUS9ts2D2JCf7UKa4oJ0is321+3mkZZFGv5oTtL1SS4r0kUkIb28JdNKZeJZCDUMNnN/nhj+h3UTsN88WEzZbLjhSZCfzMNo2w==',key_name='tempest-keypair-931450966',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:41:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b84539186347404ea3cdc32042f70052',ramdisk_id='',reservation_id='r-flwl45cc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-491908434',owner_user_name='tempest-TaggedBootDevicesTest-491908434-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:41:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3078a91c61fb48a98b7c0e1d98117e8f',uuid=9d03c7a3-e816-43b0-8616-60dea7a4e81a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f55964c8-6b58-4464-a352-e5145cc3c518", "address": "fa:16:3e:1b:36:55", "network": {"id": "c135160d-9db9-4271-a134-0cf75c1e862c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1010953674", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf55964c8-6b", "ovs_interfaceid": "f55964c8-6b58-4464-a352-e5145cc3c518", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Converting VIF {"id": "f55964c8-6b58-4464-a352-e5145cc3c518", "address": "fa:16:3e:1b:36:55", "network": {"id": "c135160d-9db9-4271-a134-0cf75c1e862c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1010953674", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf55964c8-6b", "ovs_interfaceid": "f55964c8-6b58-4464-a352-e5145cc3c518", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:36:55,bridge_name='br-int',has_traffic_filtering=True,id=f55964c8-6b58-4464-a352-e5145cc3c518,network=Network(c135160d-9db9-4271-a134-0cf75c1e862c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf55964c8-6b') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG os_vif [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:36:55,bridge_name='br-int',has_traffic_filtering=True,id=f55964c8-6b58-4464-a352-e5145cc3c518,network=Network(c135160d-9db9-4271-a134-0cf75c1e862c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf55964c8-6b') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf55964c8-6b, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=65db1ba1-bd1f-4a44-bc4e-2bd12b024619) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:32 user nova-compute[75341]: INFO os_vif [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:36:55,bridge_name='br-int',has_traffic_filtering=True,id=f55964c8-6b58-4464-a352-e5145cc3c518,network=Network(c135160d-9db9-4271-a134-0cf75c1e862c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf55964c8-6b')
Nov 14 23:42:32 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T23:40:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-993143391',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-993143391',id=9,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiUPPSlFnRUQvBR9O/mDOOgi/KDCGIsTUS9ts2D2JCf7UKa4oJ0is321+3mkZZFGv5oTtL1SS4r0kUkIb28JdNKZeJZCDUMNnN/nhj+h3UTsN88WEzZbLjhSZCfzMNo2w==',key_name='tempest-keypair-931450966',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:41:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b84539186347404ea3cdc32042f70052',ramdisk_id='',reservation_id='r-flwl45cc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-491908434',owner_user_name='tempest-TaggedBootDevicesTest-491908434-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:41:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3078a91c61fb48a98b7c0e1d98117e8f',uuid=9d03c7a3-e816-43b0-8616-60dea7a4e81a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb488639-e98a-4a85-b148-09dbb505f1c9", "address": "fa:16:3e:36:7e:f8", "network": {"id": "c135160d-9db9-4271-a134-0cf75c1e862c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1010953674", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb488639-e9", "ovs_interfaceid": "eb488639-e98a-4a85-b148-09dbb505f1c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Converting VIF {"id": "eb488639-e98a-4a85-b148-09dbb505f1c9", "address": "fa:16:3e:36:7e:f8", "network": {"id": "c135160d-9db9-4271-a134-0cf75c1e862c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1010953674", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb488639-e9", "ovs_interfaceid": "eb488639-e98a-4a85-b148-09dbb505f1c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:7e:f8,bridge_name='br-int',has_traffic_filtering=True,id=eb488639-e98a-4a85-b148-09dbb505f1c9,network=Network(c135160d-9db9-4271-a134-0cf75c1e862c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapeb488639-e9') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG os_vif [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:7e:f8,bridge_name='br-int',has_traffic_filtering=True,id=eb488639-e98a-4a85-b148-09dbb505f1c9,network=Network(c135160d-9db9-4271-a134-0cf75c1e862c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapeb488639-e9') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG nova.compute.manager [req-de5f6dd3-13c2-4af1-9e55-a8afa4bc8929 req-2aa804b8-c644-4ae9-bc6b-e69c7554e9ba service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received event network-vif-plugged-d0dd84fa-339a-49ec-9042-96715e2230fe {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-de5f6dd3-13c2-4af1-9e55-a8afa4bc8929 req-2aa804b8-c644-4ae9-bc6b-e69c7554e9ba service nova] Acquiring lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-de5f6dd3-13c2-4af1-9e55-a8afa4bc8929 req-2aa804b8-c644-4ae9-bc6b-e69c7554e9ba service nova] Lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-de5f6dd3-13c2-4af1-9e55-a8afa4bc8929 req-2aa804b8-c644-4ae9-bc6b-e69c7554e9ba service nova] Lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG nova.compute.manager [req-de5f6dd3-13c2-4af1-9e55-a8afa4bc8929 req-2aa804b8-c644-4ae9-bc6b-e69c7554e9ba service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] No waiting events found dispatching network-vif-plugged-d0dd84fa-339a-49ec-9042-96715e2230fe {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:42:32 user nova-compute[75341]: WARNING nova.compute.manager [req-de5f6dd3-13c2-4af1-9e55-a8afa4bc8929 req-2aa804b8-c644-4ae9-bc6b-e69c7554e9ba service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received unexpected event network-vif-plugged-d0dd84fa-339a-49ec-9042-96715e2230fe for instance with vm_state active and task_state deleting.
Nov 14 23:42:32 user nova-compute[75341]: DEBUG nova.compute.manager [req-de5f6dd3-13c2-4af1-9e55-a8afa4bc8929 req-2aa804b8-c644-4ae9-bc6b-e69c7554e9ba service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received event network-vif-unplugged-8352810c-25a7-4c4d-b13f-196c82e323ee {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-de5f6dd3-13c2-4af1-9e55-a8afa4bc8929 req-2aa804b8-c644-4ae9-bc6b-e69c7554e9ba service nova] Acquiring lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-de5f6dd3-13c2-4af1-9e55-a8afa4bc8929 req-2aa804b8-c644-4ae9-bc6b-e69c7554e9ba service nova] Lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-de5f6dd3-13c2-4af1-9e55-a8afa4bc8929 req-2aa804b8-c644-4ae9-bc6b-e69c7554e9ba service nova] Lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG nova.compute.manager [req-de5f6dd3-13c2-4af1-9e55-a8afa4bc8929 req-2aa804b8-c644-4ae9-bc6b-e69c7554e9ba service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] No waiting events found dispatching network-vif-unplugged-8352810c-25a7-4c4d-b13f-196c82e323ee {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG nova.compute.manager [req-de5f6dd3-13c2-4af1-9e55-a8afa4bc8929 req-2aa804b8-c644-4ae9-bc6b-e69c7554e9ba service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received event network-vif-unplugged-8352810c-25a7-4c4d-b13f-196c82e323ee for instance with task_state deleting. {{(pid=75341) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG nova.compute.manager [req-de5f6dd3-13c2-4af1-9e55-a8afa4bc8929 req-2aa804b8-c644-4ae9-bc6b-e69c7554e9ba service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received event network-vif-plugged-8352810c-25a7-4c4d-b13f-196c82e323ee {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-de5f6dd3-13c2-4af1-9e55-a8afa4bc8929 req-2aa804b8-c644-4ae9-bc6b-e69c7554e9ba service nova] Acquiring lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-de5f6dd3-13c2-4af1-9e55-a8afa4bc8929 req-2aa804b8-c644-4ae9-bc6b-e69c7554e9ba service nova] Lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-de5f6dd3-13c2-4af1-9e55-a8afa4bc8929 req-2aa804b8-c644-4ae9-bc6b-e69c7554e9ba service nova] Lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG nova.compute.manager [req-de5f6dd3-13c2-4af1-9e55-a8afa4bc8929 req-2aa804b8-c644-4ae9-bc6b-e69c7554e9ba service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] No waiting events found dispatching network-vif-plugged-8352810c-25a7-4c4d-b13f-196c82e323ee {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:42:32 user nova-compute[75341]: WARNING nova.compute.manager [req-de5f6dd3-13c2-4af1-9e55-a8afa4bc8929 req-2aa804b8-c644-4ae9-bc6b-e69c7554e9ba service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received unexpected event network-vif-plugged-8352810c-25a7-4c4d-b13f-196c82e323ee for instance with vm_state active and task_state deleting.
Nov 14 23:42:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeb488639-e9, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] COPY block job progress, current cursor: 135266304 final cursor: 1073741824 {{(pid=75341) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=38c6b356-4e9e-4451-8b3a-9e642e67905b) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:32 user nova-compute[75341]: INFO os_vif [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:7e:f8,bridge_name='br-int',has_traffic_filtering=True,id=eb488639-e98a-4a85-b148-09dbb505f1c9,network=Network(c135160d-9db9-4271-a134-0cf75c1e862c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapeb488639-e9')
Nov 14 23:42:32 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T23:40:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-993143391',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-993143391',id=9,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiUPPSlFnRUQvBR9O/mDOOgi/KDCGIsTUS9ts2D2JCf7UKa4oJ0is321+3mkZZFGv5oTtL1SS4r0kUkIb28JdNKZeJZCDUMNnN/nhj+h3UTsN88WEzZbLjhSZCfzMNo2w==',key_name='tempest-keypair-931450966',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:41:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b84539186347404ea3cdc32042f70052',ramdisk_id='',reservation_id='r-flwl45cc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-491908434',owner_user_name='tempest-TaggedBootDevicesTest-491908434-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:41:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3078a91c61fb48a98b7c0e1d98117e8f',uuid=9d03c7a3-e816-43b0-8616-60dea7a4e81a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "886562c6-312d-4a87-a34a-059f2ba3058a", "address": "fa:16:3e:28:ad:ae", "network": {"id": "c135160d-9db9-4271-a134-0cf75c1e862c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1010953674", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap886562c6-31", "ovs_interfaceid": "886562c6-312d-4a87-a34a-059f2ba3058a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Converting VIF {"id": "886562c6-312d-4a87-a34a-059f2ba3058a", "address": "fa:16:3e:28:ad:ae", "network": {"id": "c135160d-9db9-4271-a134-0cf75c1e862c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1010953674", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap886562c6-31", "ovs_interfaceid": "886562c6-312d-4a87-a34a-059f2ba3058a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:ad:ae,bridge_name='br-int',has_traffic_filtering=True,id=886562c6-312d-4a87-a34a-059f2ba3058a,network=Network(c135160d-9db9-4271-a134-0cf75c1e862c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap886562c6-31') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG os_vif [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:ad:ae,bridge_name='br-int',has_traffic_filtering=True,id=886562c6-312d-4a87-a34a-059f2ba3058a,network=Network(c135160d-9db9-4271-a134-0cf75c1e862c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap886562c6-31') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap886562c6-31, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=63a02334-ecc8-4451-b086-9717b080ac58) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG nova.compute.manager [req-8074f66f-2ffa-4492-8212-1dd34ddd8225 req-54ad80e0-6284-4de4-b82a-0ff00784046a service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received event network-vif-plugged-f55964c8-6b58-4464-a352-e5145cc3c518 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-8074f66f-2ffa-4492-8212-1dd34ddd8225 req-54ad80e0-6284-4de4-b82a-0ff00784046a service nova] Acquiring lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-8074f66f-2ffa-4492-8212-1dd34ddd8225 req-54ad80e0-6284-4de4-b82a-0ff00784046a service nova] Lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-8074f66f-2ffa-4492-8212-1dd34ddd8225 req-54ad80e0-6284-4de4-b82a-0ff00784046a service nova] Lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG nova.compute.manager [req-8074f66f-2ffa-4492-8212-1dd34ddd8225 req-54ad80e0-6284-4de4-b82a-0ff00784046a service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] No waiting events found dispatching network-vif-plugged-f55964c8-6b58-4464-a352-e5145cc3c518 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:42:32 user nova-compute[75341]: WARNING nova.compute.manager [req-8074f66f-2ffa-4492-8212-1dd34ddd8225 req-54ad80e0-6284-4de4-b82a-0ff00784046a service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received unexpected event network-vif-plugged-f55964c8-6b58-4464-a352-e5145cc3c518 for instance with vm_state active and task_state deleting.
Nov 14 23:42:32 user nova-compute[75341]: DEBUG nova.compute.manager [req-8074f66f-2ffa-4492-8212-1dd34ddd8225 req-54ad80e0-6284-4de4-b82a-0ff00784046a service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received event network-vif-unplugged-886562c6-312d-4a87-a34a-059f2ba3058a {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-8074f66f-2ffa-4492-8212-1dd34ddd8225 req-54ad80e0-6284-4de4-b82a-0ff00784046a service nova] Acquiring lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-8074f66f-2ffa-4492-8212-1dd34ddd8225 req-54ad80e0-6284-4de4-b82a-0ff00784046a service nova] Lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-8074f66f-2ffa-4492-8212-1dd34ddd8225 req-54ad80e0-6284-4de4-b82a-0ff00784046a service nova] Lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG nova.compute.manager [req-8074f66f-2ffa-4492-8212-1dd34ddd8225 req-54ad80e0-6284-4de4-b82a-0ff00784046a service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] No waiting events found dispatching network-vif-unplugged-886562c6-312d-4a87-a34a-059f2ba3058a {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG nova.compute.manager [req-8074f66f-2ffa-4492-8212-1dd34ddd8225 req-54ad80e0-6284-4de4-b82a-0ff00784046a service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received event network-vif-unplugged-886562c6-312d-4a87-a34a-059f2ba3058a for instance with task_state deleting. {{(pid=75341) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG nova.compute.manager [req-8074f66f-2ffa-4492-8212-1dd34ddd8225 req-54ad80e0-6284-4de4-b82a-0ff00784046a service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received event network-vif-plugged-886562c6-312d-4a87-a34a-059f2ba3058a {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-8074f66f-2ffa-4492-8212-1dd34ddd8225 req-54ad80e0-6284-4de4-b82a-0ff00784046a service nova] Acquiring lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-8074f66f-2ffa-4492-8212-1dd34ddd8225 req-54ad80e0-6284-4de4-b82a-0ff00784046a service nova] Lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-8074f66f-2ffa-4492-8212-1dd34ddd8225 req-54ad80e0-6284-4de4-b82a-0ff00784046a service nova] Lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG nova.compute.manager [req-8074f66f-2ffa-4492-8212-1dd34ddd8225 req-54ad80e0-6284-4de4-b82a-0ff00784046a service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] No waiting events found dispatching network-vif-plugged-886562c6-312d-4a87-a34a-059f2ba3058a {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:42:32 user nova-compute[75341]: WARNING nova.compute.manager [req-8074f66f-2ffa-4492-8212-1dd34ddd8225 req-54ad80e0-6284-4de4-b82a-0ff00784046a service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received unexpected event network-vif-plugged-886562c6-312d-4a87-a34a-059f2ba3058a for instance with vm_state active and task_state deleting.
Nov 14 23:42:32 user nova-compute[75341]: DEBUG nova.compute.manager [req-8074f66f-2ffa-4492-8212-1dd34ddd8225 req-54ad80e0-6284-4de4-b82a-0ff00784046a service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received event network-vif-unplugged-c314df64-6753-4691-a931-1ef8f31a8063 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-8074f66f-2ffa-4492-8212-1dd34ddd8225 req-54ad80e0-6284-4de4-b82a-0ff00784046a service nova] Acquiring lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-8074f66f-2ffa-4492-8212-1dd34ddd8225 req-54ad80e0-6284-4de4-b82a-0ff00784046a service nova] Lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-8074f66f-2ffa-4492-8212-1dd34ddd8225 req-54ad80e0-6284-4de4-b82a-0ff00784046a service nova] Lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG nova.compute.manager [req-8074f66f-2ffa-4492-8212-1dd34ddd8225 req-54ad80e0-6284-4de4-b82a-0ff00784046a service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] No waiting events found dispatching network-vif-unplugged-c314df64-6753-4691-a931-1ef8f31a8063 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG nova.compute.manager [req-8074f66f-2ffa-4492-8212-1dd34ddd8225 req-54ad80e0-6284-4de4-b82a-0ff00784046a service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received event network-vif-unplugged-c314df64-6753-4691-a931-1ef8f31a8063 for instance with task_state deleting. {{(pid=75341) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG nova.compute.manager [req-8074f66f-2ffa-4492-8212-1dd34ddd8225 req-54ad80e0-6284-4de4-b82a-0ff00784046a service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received event network-vif-plugged-c314df64-6753-4691-a931-1ef8f31a8063 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-8074f66f-2ffa-4492-8212-1dd34ddd8225 req-54ad80e0-6284-4de4-b82a-0ff00784046a service nova] Acquiring lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-8074f66f-2ffa-4492-8212-1dd34ddd8225 req-54ad80e0-6284-4de4-b82a-0ff00784046a service nova] Lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-8074f66f-2ffa-4492-8212-1dd34ddd8225 req-54ad80e0-6284-4de4-b82a-0ff00784046a service nova] Lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG nova.compute.manager [req-8074f66f-2ffa-4492-8212-1dd34ddd8225 req-54ad80e0-6284-4de4-b82a-0ff00784046a service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] No waiting events found dispatching network-vif-plugged-c314df64-6753-4691-a931-1ef8f31a8063 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:42:32 user nova-compute[75341]: WARNING nova.compute.manager [req-8074f66f-2ffa-4492-8212-1dd34ddd8225 req-54ad80e0-6284-4de4-b82a-0ff00784046a service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received unexpected event network-vif-plugged-c314df64-6753-4691-a931-1ef8f31a8063 for instance with vm_state active and task_state deleting.
Nov 14 23:42:32 user nova-compute[75341]: DEBUG nova.compute.manager [req-8074f66f-2ffa-4492-8212-1dd34ddd8225 req-54ad80e0-6284-4de4-b82a-0ff00784046a service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received event network-vif-unplugged-e1611672-3415-4fea-adb0-c7fe74ae6049 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-8074f66f-2ffa-4492-8212-1dd34ddd8225 req-54ad80e0-6284-4de4-b82a-0ff00784046a service nova] Acquiring lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-8074f66f-2ffa-4492-8212-1dd34ddd8225 req-54ad80e0-6284-4de4-b82a-0ff00784046a service nova] Lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-8074f66f-2ffa-4492-8212-1dd34ddd8225 req-54ad80e0-6284-4de4-b82a-0ff00784046a service nova] Lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG nova.compute.manager [req-8074f66f-2ffa-4492-8212-1dd34ddd8225 req-54ad80e0-6284-4de4-b82a-0ff00784046a service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] No waiting events found dispatching network-vif-unplugged-e1611672-3415-4fea-adb0-c7fe74ae6049 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG nova.compute.manager [req-8074f66f-2ffa-4492-8212-1dd34ddd8225 req-54ad80e0-6284-4de4-b82a-0ff00784046a service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received event network-vif-unplugged-e1611672-3415-4fea-adb0-c7fe74ae6049 for instance with task_state deleting. {{(pid=75341) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG nova.compute.manager [req-8074f66f-2ffa-4492-8212-1dd34ddd8225 req-54ad80e0-6284-4de4-b82a-0ff00784046a service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received event network-vif-plugged-e1611672-3415-4fea-adb0-c7fe74ae6049 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-8074f66f-2ffa-4492-8212-1dd34ddd8225 req-54ad80e0-6284-4de4-b82a-0ff00784046a service nova] Acquiring lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-8074f66f-2ffa-4492-8212-1dd34ddd8225 req-54ad80e0-6284-4de4-b82a-0ff00784046a service nova] Lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-8074f66f-2ffa-4492-8212-1dd34ddd8225 req-54ad80e0-6284-4de4-b82a-0ff00784046a service nova] Lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG nova.compute.manager [req-8074f66f-2ffa-4492-8212-1dd34ddd8225 req-54ad80e0-6284-4de4-b82a-0ff00784046a service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] No waiting events found dispatching network-vif-plugged-e1611672-3415-4fea-adb0-c7fe74ae6049 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:42:32 user nova-compute[75341]: WARNING nova.compute.manager [req-8074f66f-2ffa-4492-8212-1dd34ddd8225 req-54ad80e0-6284-4de4-b82a-0ff00784046a service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received unexpected event network-vif-plugged-e1611672-3415-4fea-adb0-c7fe74ae6049 for instance with vm_state active and task_state deleting.
Nov 14 23:42:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:32 user nova-compute[75341]: INFO os_vif [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:ad:ae,bridge_name='br-int',has_traffic_filtering=True,id=886562c6-312d-4a87-a34a-059f2ba3058a,network=Network(c135160d-9db9-4271-a134-0cf75c1e862c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap886562c6-31')
Nov 14 23:42:32 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T23:40:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-993143391',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-993143391',id=9,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiUPPSlFnRUQvBR9O/mDOOgi/KDCGIsTUS9ts2D2JCf7UKa4oJ0is321+3mkZZFGv5oTtL1SS4r0kUkIb28JdNKZeJZCDUMNnN/nhj+h3UTsN88WEzZbLjhSZCfzMNo2w==',key_name='tempest-keypair-931450966',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:41:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b84539186347404ea3cdc32042f70052',ramdisk_id='',reservation_id='r-flwl45cc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-491908434',owner_user_name='tempest-TaggedBootDevicesTest-491908434-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:41:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3078a91c61fb48a98b7c0e1d98117e8f',uuid=9d03c7a3-e816-43b0-8616-60dea7a4e81a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c314df64-6753-4691-a931-1ef8f31a8063", "address": "fa:16:3e:92:14:79", "network": {"id": "c135160d-9db9-4271-a134-0cf75c1e862c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1010953674", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc314df64-67", "ovs_interfaceid": "c314df64-6753-4691-a931-1ef8f31a8063", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Converting VIF {"id": "c314df64-6753-4691-a931-1ef8f31a8063", "address": "fa:16:3e:92:14:79", "network": {"id": "c135160d-9db9-4271-a134-0cf75c1e862c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1010953674", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc314df64-67", "ovs_interfaceid": "c314df64-6753-4691-a931-1ef8f31a8063", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:14:79,bridge_name='br-int',has_traffic_filtering=True,id=c314df64-6753-4691-a931-1ef8f31a8063,network=Network(c135160d-9db9-4271-a134-0cf75c1e862c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc314df64-67') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG os_vif [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:14:79,bridge_name='br-int',has_traffic_filtering=True,id=c314df64-6753-4691-a931-1ef8f31a8063,network=Network(c135160d-9db9-4271-a134-0cf75c1e862c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc314df64-67') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG nova.compute.manager [req-6e707417-bae5-49d6-a4aa-b5d551c009c5 req-6d228fc0-ff30-409d-8287-1e1cdc1ba02a service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received event network-vif-plugged-eb488639-e98a-4a85-b148-09dbb505f1c9 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6e707417-bae5-49d6-a4aa-b5d551c009c5 req-6d228fc0-ff30-409d-8287-1e1cdc1ba02a service nova] Acquiring lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6e707417-bae5-49d6-a4aa-b5d551c009c5 req-6d228fc0-ff30-409d-8287-1e1cdc1ba02a service nova] Lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6e707417-bae5-49d6-a4aa-b5d551c009c5 req-6d228fc0-ff30-409d-8287-1e1cdc1ba02a service nova] Lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG nova.compute.manager [req-6e707417-bae5-49d6-a4aa-b5d551c009c5 req-6d228fc0-ff30-409d-8287-1e1cdc1ba02a service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] No waiting events found dispatching network-vif-plugged-eb488639-e98a-4a85-b148-09dbb505f1c9 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:42:32 user nova-compute[75341]: WARNING nova.compute.manager [req-6e707417-bae5-49d6-a4aa-b5d551c009c5 req-6d228fc0-ff30-409d-8287-1e1cdc1ba02a service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received unexpected event network-vif-plugged-eb488639-e98a-4a85-b148-09dbb505f1c9 for instance with vm_state active and task_state deleting.
Nov 14 23:42:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc314df64-67, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9d09a7f2-e1f8-4b5b-8f3b-c05df45978ab) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:32 user nova-compute[75341]: INFO os_vif [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:14:79,bridge_name='br-int',has_traffic_filtering=True,id=c314df64-6753-4691-a931-1ef8f31a8063,network=Network(c135160d-9db9-4271-a134-0cf75c1e862c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc314df64-67')
Nov 14 23:42:32 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T23:40:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-993143391',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-993143391',id=9,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiUPPSlFnRUQvBR9O/mDOOgi/KDCGIsTUS9ts2D2JCf7UKa4oJ0is321+3mkZZFGv5oTtL1SS4r0kUkIb28JdNKZeJZCDUMNnN/nhj+h3UTsN88WEzZbLjhSZCfzMNo2w==',key_name='tempest-keypair-931450966',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:41:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b84539186347404ea3cdc32042f70052',ramdisk_id='',reservation_id='r-flwl45cc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-491908434',owner_user_name='tempest-TaggedBootDevicesTest-491908434-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:41:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3078a91c61fb48a98b7c0e1d98117e8f',uuid=9d03c7a3-e816-43b0-8616-60dea7a4e81a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8352810c-25a7-4c4d-b13f-196c82e323ee", "address": "fa:16:3e:6d:e3:2c", "network": {"id": "08285f35-6170-45e2-9aaa-cd8a52bbd6cd", "bridge": "br-int", "label": "tempest-device-tagging-net2-454254441", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8352810c-25", "ovs_interfaceid": "8352810c-25a7-4c4d-b13f-196c82e323ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Converting VIF {"id": "8352810c-25a7-4c4d-b13f-196c82e323ee", "address": "fa:16:3e:6d:e3:2c", "network": {"id": "08285f35-6170-45e2-9aaa-cd8a52bbd6cd", "bridge": "br-int", "label": "tempest-device-tagging-net2-454254441", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8352810c-25", "ovs_interfaceid": "8352810c-25a7-4c4d-b13f-196c82e323ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:e3:2c,bridge_name='br-int',has_traffic_filtering=True,id=8352810c-25a7-4c4d-b13f-196c82e323ee,network=Network(08285f35-6170-45e2-9aaa-cd8a52bbd6cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8352810c-25') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG os_vif [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:e3:2c,bridge_name='br-int',has_traffic_filtering=True,id=8352810c-25a7-4c4d-b13f-196c82e323ee,network=Network(08285f35-6170-45e2-9aaa-cd8a52bbd6cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8352810c-25') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8352810c-25, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=09448534-820c-4354-ad31-cc4aacd26cc1) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:32 user nova-compute[75341]: INFO os_vif [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:e3:2c,bridge_name='br-int',has_traffic_filtering=True,id=8352810c-25a7-4c4d-b13f-196c82e323ee,network=Network(08285f35-6170-45e2-9aaa-cd8a52bbd6cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8352810c-25')
Nov 14 23:42:32 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T23:40:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-993143391',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-993143391',id=9,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiUPPSlFnRUQvBR9O/mDOOgi/KDCGIsTUS9ts2D2JCf7UKa4oJ0is321+3mkZZFGv5oTtL1SS4r0kUkIb28JdNKZeJZCDUMNnN/nhj+h3UTsN88WEzZbLjhSZCfzMNo2w==',key_name='tempest-keypair-931450966',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:41:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b84539186347404ea3cdc32042f70052',ramdisk_id='',reservation_id='r-flwl45cc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-491908434',owner_user_name='tempest-TaggedBootDevicesTest-491908434-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:41:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3078a91c61fb48a98b7c0e1d98117e8f',uuid=9d03c7a3-e816-43b0-8616-60dea7a4e81a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e1611672-3415-4fea-adb0-c7fe74ae6049", "address": "fa:16:3e:70:02:49", "network": {"id": "08285f35-6170-45e2-9aaa-cd8a52bbd6cd", "bridge": "br-int", "label": "tempest-device-tagging-net2-454254441", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1611672-34", "ovs_interfaceid": "e1611672-3415-4fea-adb0-c7fe74ae6049", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Converting VIF {"id": "e1611672-3415-4fea-adb0-c7fe74ae6049", "address": "fa:16:3e:70:02:49", "network": {"id": "08285f35-6170-45e2-9aaa-cd8a52bbd6cd", "bridge": "br-int", "label": "tempest-device-tagging-net2-454254441", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1611672-34", "ovs_interfaceid": "e1611672-3415-4fea-adb0-c7fe74ae6049", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:02:49,bridge_name='br-int',has_traffic_filtering=True,id=e1611672-3415-4fea-adb0-c7fe74ae6049,network=Network(08285f35-6170-45e2-9aaa-cd8a52bbd6cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1611672-34') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG os_vif [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:02:49,bridge_name='br-int',has_traffic_filtering=True,id=e1611672-3415-4fea-adb0-c7fe74ae6049,network=Network(08285f35-6170-45e2-9aaa-cd8a52bbd6cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1611672-34') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape1611672-34, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f7304662-59cf-4175-83fa-0a50f2982477) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:32 user nova-compute[75341]: INFO os_vif [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:02:49,bridge_name='br-int',has_traffic_filtering=True,id=e1611672-3415-4fea-adb0-c7fe74ae6049,network=Network(08285f35-6170-45e2-9aaa-cd8a52bbd6cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1611672-34')
Nov 14 23:42:32 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] calling os-brick to detach iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, {'target_iqn': 'iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'glxYfjrN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:42:32 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:42:32 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26731d8-a273-49fe-b16d-bd5945816607]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 23:42:32 user nova-compute[75341]: No targets found.
Nov 14 23:42:32 user nova-compute[75341]: iSNS:
Nov 14 23:42:32 user nova-compute[75341]: No targets found.
Nov 14 23:42:32 user nova-compute[75341]: STATIC:
Nov 14 23:42:32 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff
Nov 14 23:42:32 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:42:32 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:42:32 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198
Nov 14 23:42:32 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:42:32 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:42:32 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7
Nov 14 23:42:32 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:42:32 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:42:32 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2
Nov 14 23:42:32 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:42:32 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:42:32 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3
Nov 14 23:42:32 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:42:32 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:42:32 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296
Nov 14 23:42:32 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:42:32 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:42:32 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b
Nov 14 23:42:32 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:42:32 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:42:32 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0
Nov 14 23:42:32 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:42:32 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:42:32 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe
Nov 14 23:42:32 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:42:32 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:42:32 user nova-compute[75341]: FIRMWARE:
Nov 14 23:42:32 user nova-compute[75341]: No targets found.
Nov 14 23:42:32 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 23:42:32 user nova-compute[75341]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 23:42:32 user nova-compute[75341]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75341) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198', 0)] {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 23:42:32 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce3e8c6-abf7-492b-a2f3-f6f9f89fd649]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[be302c0c-c0a7-4dea-9622-559b0cbaee96]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe (non-flash)
Nov 14 23:42:33 user nova-compute[75341]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b (non-flash)
Nov 14 23:42:33 user nova-compute[75341]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0 (non-flash)
Nov 14 23:42:33 user nova-compute[75341]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 (non-flash)
Nov 14 23:42:33 user nova-compute[75341]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)
Nov 14 23:42:33 user nova-compute[75341]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)
Nov 14 23:42:33 user nova-compute[75341]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)
Nov 14 23:42:33 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:42:33 user nova-compute[75341]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3 (non-flash)
Nov 14 23:42:33 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe (non-flash)
Nov 14 23:42:33 user nova-compute[75341]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b (non-flash)
Nov 14 23:42:33 user nova-compute[75341]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0 (non-flash)
Nov 14 23:42:33 user nova-compute[75341]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 (non-flash)
Nov 14 23:42:33 user nova-compute[75341]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 (non-flash)
Nov 14 23:42:33 user nova-compute[75341]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)
Nov 14 23:42:33 user nova-compute[75341]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)
Nov 14 23:42:33 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:42:33 user nova-compute[75341]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3 (non-flash)
Nov 14 23:42:33 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f189025b400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198'): ({'sdb'}, set())}) {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Removing single pathed devices sdb {{(pid=75341) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] COPY block job progress, current cursor: 279969792 final cursor: 1073741824 {{(pid=75341) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd83dc7d-fad6-404e-ba1b-8bbb2e793a85]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7bf1817-c0eb-474c-960d-c44e18f7968a]: (4, ('ok\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Flushing IO for device /dev/sdb {{(pid=75341) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2e9e2d-52f7-4707-913a-97234b31ec99]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75341) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb0bcc0-1ce4-4604-8e3c-45c05b08d90e]: (4, ('1', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] SCSI volumes sdb have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198')] {{(pid=75341) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[04edde87-990f-4597-8ca4-968736ec7251]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 -p 172.16.0.220:3260 --logout {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:33 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-8b179434-9771-476d-a9e7-c53b1fc61688 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance b7d427ed-6ac3-46d9-bebc-d672f465f850 is timed out.
Nov 14 23:42:33 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-8b179434-9771-476d-a9e7-c53b1fc61688 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Successfully detached device sdc from instance b7d427ed-6ac3-46d9-bebc-d672f465f850 from the live domain config.
Nov 14 23:42:33 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b179434-9771-476d-a9e7-c53b1fc61688 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] calling os-brick to detach iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b179434-9771-476d-a9e7-c53b1fc61688 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, {'target_iqn': 'iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dkUSVXYr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:42:33 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-8b179434-9771-476d-a9e7-c53b1fc61688 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:42:33 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-8b179434-9771-476d-a9e7-c53b1fc61688 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG nova.objects.instance [None req-846a5652-8bd6-4385-8b7c-cfe499edc17c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Lazy-loading 'flavor' on Instance uuid a0cffbac-f552-47bf-bd6c-dabb70e7c867 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 -p 172.16.0.220:3260 --logout" returned: 0 in 0.099s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9adc55-843d-402f-93b2-2a1d08816019]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198, portal: 172.16.0.220,3260]
Nov 14 23:42:33 user nova-compute[75341]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198, portal: 172.16.0.220,3260] successful.
Nov 14 23:42:33 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 -p 172.16.0.220:3260 --op delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-846a5652-8bd6-4385-8b7c-cfe499edc17c tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Lock "a0cffbac-f552-47bf-bd6c-dabb70e7c867" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.551s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0ec4ce3-c9fb-4d11-8fbe-1e0dfa350198 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec3d5bf-a28c-4d43-acc8-67f378d81064]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.389s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] <== disconnect_volume: return (390ms) None {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Disconnected iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-8b179434-9771-476d-a9e7-c53b1fc61688 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.126s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] calling os-brick to detach iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, {'target_iqn': 'iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TQoDFnwl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:42:33 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:42:33 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb5b1eb-15ab-45b2-bfab-6db6b4655427]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b179434-9771-476d-a9e7-c53b1fc61688 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 23:42:33 user nova-compute[75341]: No targets found.
Nov 14 23:42:33 user nova-compute[75341]: iSNS:
Nov 14 23:42:33 user nova-compute[75341]: No targets found.
Nov 14 23:42:33 user nova-compute[75341]: STATIC:
Nov 14 23:42:33 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff
Nov 14 23:42:33 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:42:33 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:42:33 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7
Nov 14 23:42:33 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:42:33 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:42:33 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2
Nov 14 23:42:33 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:42:33 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:42:33 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3
Nov 14 23:42:33 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:42:33 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:42:33 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296
Nov 14 23:42:33 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:42:33 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:42:33 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b
Nov 14 23:42:33 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:42:33 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:42:33 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0
Nov 14 23:42:33 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:42:33 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:42:33 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe
Nov 14 23:42:33 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:42:33 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:42:33 user nova-compute[75341]: FIRMWARE:
Nov 14 23:42:33 user nova-compute[75341]: No targets found.
Nov 14 23:42:33 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b179434-9771-476d-a9e7-c53b1fc61688 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 23:42:33 user nova-compute[75341]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 23:42:33 user nova-compute[75341]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75341) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b179434-9771-476d-a9e7-c53b1fc61688 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3', 0)] {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[da12417b-3950-43ad-bb80-4b8e52f3d306]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[994f70ac-5f52-4079-99a8-3a4acb8bffc3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b179434-9771-476d-a9e7-c53b1fc61688 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe (non-flash)
Nov 14 23:42:33 user nova-compute[75341]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b (non-flash)
Nov 14 23:42:33 user nova-compute[75341]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0 (non-flash)
Nov 14 23:42:33 user nova-compute[75341]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 (non-flash)
Nov 14 23:42:33 user nova-compute[75341]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)
Nov 14 23:42:33 user nova-compute[75341]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)
Nov 14 23:42:33 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:42:33 user nova-compute[75341]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3 (non-flash)
Nov 14 23:42:33 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b179434-9771-476d-a9e7-c53b1fc61688 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe (non-flash)
Nov 14 23:42:33 user nova-compute[75341]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b (non-flash)
Nov 14 23:42:33 user nova-compute[75341]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0 (non-flash)
Nov 14 23:42:33 user nova-compute[75341]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 (non-flash)
Nov 14 23:42:33 user nova-compute[75341]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)
Nov 14 23:42:33 user nova-compute[75341]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)
Nov 14 23:42:33 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:42:33 user nova-compute[75341]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3 (non-flash)
Nov 14 23:42:33 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b179434-9771-476d-a9e7-c53b1fc61688 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18903f7130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3'): ({'sdh'}, set())}) {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-8b179434-9771-476d-a9e7-c53b1fc61688 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Removing single pathed devices sdh {{(pid=75341) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b4edfa-9563-4bcb-9339-413c220f496e]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2a9029-47bd-440c-9385-2f225a3dc85f]: (4, ('ok\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-8b179434-9771-476d-a9e7-c53b1fc61688 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Flushing IO for device /dev/sdh {{(pid=75341) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe9eab2-5942-4681-9e01-31e7a2a7d749]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-8b179434-9771-476d-a9e7-c53b1fc61688 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75341) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.035s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee96999-7e82-4a50-af8d-9515da264fb0]: (4, ('1', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-8b179434-9771-476d-a9e7-c53b1fc61688 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-8b179434-9771-476d-a9e7-c53b1fc61688 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] SCSI volumes sdh have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b179434-9771-476d-a9e7-c53b1fc61688 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3')] {{(pid=75341) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] COPY block job progress, current cursor: 420478976 final cursor: 1073741824 {{(pid=75341) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec84d237-6617-4539-8e3d-c1346959a43d]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b179434-9771-476d-a9e7-c53b1fc61688 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3 -p 172.16.0.220:3260 --logout {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[b693cfd1-de26-4e10-81d1-a7cec3db009c]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b179434-9771-476d-a9e7-c53b1fc61688 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3, portal: 172.16.0.220,3260]
Nov 14 23:42:33 user nova-compute[75341]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3, portal: 172.16.0.220,3260] successful.
Nov 14 23:42:33 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3 -p 172.16.0.220:3260 --op delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd8fcacd-78e7-46eb-a630-a974fff87da3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad146e3a-0720-4fc0-b0b1-b4c3d07fc1e7]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b179434-9771-476d-a9e7-c53b1fc61688 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-8b179434-9771-476d-a9e7-c53b1fc61688 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b179434-9771-476d-a9e7-c53b1fc61688 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] <== disconnect_volume: return (486ms) None {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b179434-9771-476d-a9e7-c53b1fc61688 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] Disconnected iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.359s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[21740c81-da54-476c-9a52-c2f6012d04e0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 23:42:33 user nova-compute[75341]: No targets found.
Nov 14 23:42:33 user nova-compute[75341]: iSNS:
Nov 14 23:42:33 user nova-compute[75341]: No targets found.
Nov 14 23:42:33 user nova-compute[75341]: STATIC:
Nov 14 23:42:33 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff
Nov 14 23:42:33 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:42:33 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:42:33 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7
Nov 14 23:42:33 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:42:33 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:42:33 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2
Nov 14 23:42:33 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:42:33 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:42:33 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296
Nov 14 23:42:33 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:42:33 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:42:33 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b
Nov 14 23:42:33 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:42:33 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:42:33 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0
Nov 14 23:42:33 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:42:33 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:42:33 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe
Nov 14 23:42:33 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:42:33 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:42:33 user nova-compute[75341]: FIRMWARE:
Nov 14 23:42:33 user nova-compute[75341]: No targets found.
Nov 14 23:42:33 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 23:42:33 user nova-compute[75341]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 23:42:33 user nova-compute[75341]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75341) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff', 0)] {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[d950c233-2f92-4c12-a4aa-ca8e8cd44baa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[37963c86-55e0-4c9c-924c-05d2587d1224]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe (non-flash)
Nov 14 23:42:33 user nova-compute[75341]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b (non-flash)
Nov 14 23:42:33 user nova-compute[75341]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0 (non-flash)
Nov 14 23:42:33 user nova-compute[75341]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 (non-flash)
Nov 14 23:42:33 user nova-compute[75341]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)
Nov 14 23:42:33 user nova-compute[75341]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)
Nov 14 23:42:33 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:42:33 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe (non-flash)
Nov 14 23:42:33 user nova-compute[75341]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b (non-flash)
Nov 14 23:42:33 user nova-compute[75341]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0 (non-flash)
Nov 14 23:42:33 user nova-compute[75341]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 (non-flash)
Nov 14 23:42:33 user nova-compute[75341]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff (non-flash)
Nov 14 23:42:33 user nova-compute[75341]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)
Nov 14 23:42:33 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:42:33 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18900f9cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff'): ({'sdc'}, set())}) {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Removing single pathed devices sdc {{(pid=75341) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4bee230-d2fa-463b-910f-9a68f65b9d37]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[d76a3246-c580-4b12-b405-d242e1afc6de]: (4, ('ok\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Flushing IO for device /dev/sdc {{(pid=75341) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[b417397f-a638-4ec9-983d-fec454da8f12]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75341) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.059s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7a319f-aac8-457a-859e-88b5e54ff6f4]: (4, ('1', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] SCSI volumes sdc have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff')] {{(pid=75341) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e1e7cc-2e23-463f-9050-529da948a10e]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff -p 172.16.0.220:3260 --logout {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:34 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:34 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa9442c-ba43-4ff0-8673-64d934b79bae]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:34 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff, portal: 172.16.0.220,3260]
Nov 14 23:42:34 user nova-compute[75341]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff, portal: 172.16.0.220,3260] successful.
Nov 14 23:42:34 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:34 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff -p 172.16.0.220:3260 --op delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:34 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] COPY block job progress, current cursor: 581959680 final cursor: 1073741824 {{(pid=75341) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 23:42:34 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d39d66b-22ae-4f70-bd8e-1e9df2b517ff -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:34 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab2bb25-6f10-4421-a115-07f32115d710]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:34 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:34 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:42:34 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] <== disconnect_volume: return (725ms) None {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:42:34 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Disconnected iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 23:42:34 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] calling os-brick to detach iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 23:42:34 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, {'target_iqn': 'iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'szGZitIm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:42:34 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:42:34 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:42:34 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:42:34 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:34 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:34 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[daef5c25-7067-410d-a266-9c5067179143]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:34 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 23:42:34 user nova-compute[75341]: No targets found.
Nov 14 23:42:34 user nova-compute[75341]: iSNS:
Nov 14 23:42:34 user nova-compute[75341]: No targets found.
Nov 14 23:42:34 user nova-compute[75341]: STATIC:
Nov 14 23:42:34 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7
Nov 14 23:42:34 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:42:34 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:42:34 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2
Nov 14 23:42:34 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:42:34 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:42:34 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296
Nov 14 23:42:34 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:42:34 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:42:34 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b
Nov 14 23:42:34 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:42:34 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:42:34 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0
Nov 14 23:42:34 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:42:34 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:42:34 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe
Nov 14 23:42:34 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:42:34 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:42:34 user nova-compute[75341]: FIRMWARE:
Nov 14 23:42:34 user nova-compute[75341]: No targets found.
Nov 14 23:42:34 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:42:34 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 23:42:34 user nova-compute[75341]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 23:42:34 user nova-compute[75341]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75341) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 23:42:34 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296', 0)] {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 23:42:34 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:34 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:34 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae50f08a-2b41-42be-ad61-e989813467ff]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:34 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:34 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:34 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[e918889d-a425-4c32-8bc5-7faa2bcadc27]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:34 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe (non-flash)
Nov 14 23:42:34 user nova-compute[75341]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b (non-flash)
Nov 14 23:42:34 user nova-compute[75341]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0 (non-flash)
Nov 14 23:42:34 user nova-compute[75341]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 (non-flash)
Nov 14 23:42:34 user nova-compute[75341]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)
Nov 14 23:42:34 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:42:34 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:42:34 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe (non-flash)
Nov 14 23:42:34 user nova-compute[75341]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b (non-flash)
Nov 14 23:42:34 user nova-compute[75341]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0 (non-flash)
Nov 14 23:42:34 user nova-compute[75341]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 (non-flash)
Nov 14 23:42:34 user nova-compute[75341]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 (non-flash)
Nov 14 23:42:34 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:42:34 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:42:34 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18900f9cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296'): ({'sdd'}, set())}) {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 23:42:34 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Removing single pathed devices sdd {{(pid=75341) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 23:42:34 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:34 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:34 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77a5dc5-8ed1-4a16-8bc4-4df7048c05fe]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:34 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:34 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:34 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[e101fa1b-b480-4a7a-b11a-5be7ff4696af]: (4, ('ok\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:34 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Flushing IO for device /dev/sdd {{(pid=75341) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 23:42:34 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:34 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:34 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09a974f-1a5e-46f3-9402-4712200d37d3]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:34 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75341) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 23:42:34 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:34 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:34 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6fbb76-0c4b-46e4-87e7-77a2e628b353]: (4, ('1', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:34 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 23:42:34 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] SCSI volumes sdd have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 23:42:34 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296')] {{(pid=75341) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 23:42:34 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:34 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:34 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1228092-6f2a-4466-809c-c75cd7d1a8e4]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:34 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:34 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 -p 172.16.0.220:3260 --logout {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:34 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 -p 172.16.0.220:3260 --logout" returned: 0 in 0.092s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:34 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ac980a-b99b-4d38-b40f-7e3f9b1c6b26]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:34 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296, portal: 172.16.0.220,3260]
Nov 14 23:42:34 user nova-compute[75341]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296, portal: 172.16.0.220,3260] successful.
Nov 14 23:42:34 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:34 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 -p 172.16.0.220:3260 --op delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:34 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de5d17dd-51c3-42bc-9950-b815f8d48296 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:34 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bed15be-d23b-46b3-9329-df78dc440117]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:34 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:34 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.378s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:42:34 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] <== disconnect_volume: return (379ms) None {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:42:34 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Disconnected iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 23:42:34 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Deleting instance files /opt/stack/data/nova/instances/9d03c7a3-e816-43b0-8616-60dea7a4e81a_del
Nov 14 23:42:34 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Deletion of /opt/stack/data/nova/instances/9d03c7a3-e816-43b0-8616-60dea7a4e81a_del complete
Nov 14 23:42:34 user nova-compute[75341]: INFO nova.compute.manager [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Took 4.43 seconds to destroy the instance on the hypervisor.
Nov 14 23:42:34 user nova-compute[75341]: DEBUG oslo.service.loopingcall [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75341) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 23:42:34 user nova-compute[75341]: DEBUG nova.compute.manager [-] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Deallocating network for instance {{(pid=75341) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 23:42:34 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] deallocate_for_instance() {{(pid=75341) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 23:42:34 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] COPY block job progress, current cursor: 732954624 final cursor: 1073741824 {{(pid=75341) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 23:42:34 user nova-compute[75341]: DEBUG nova.objects.instance [None req-8b179434-9771-476d-a9e7-c53b1fc61688 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Lazy-loading 'flavor' on Instance uuid b7d427ed-6ac3-46d9-bebc-d672f465f850 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:42:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8b179434-9771-476d-a9e7-c53b1fc61688 tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Lock "b7d427ed-6ac3-46d9-bebc-d672f465f850" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.247s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] COPY block job progress, current cursor: 902823936 final cursor: 1073741824 {{(pid=75341) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 23:42:35 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-b7e2a016-63cf-4e70-ac72-57426ba8ce7b tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd is timed out.
Nov 14 23:42:35 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-b7e2a016-63cf-4e70-ac72-57426ba8ce7b tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] Successfully detached device vdb from instance e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd from the live domain config.
Nov 14 23:42:35 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7e2a016-63cf-4e70-ac72-57426ba8ce7b tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] calling os-brick to detach iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e2a016-63cf-4e70-ac72-57426ba8ce7b tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, {'target_iqn': 'iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cZGniRJy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:42:35 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-b7e2a016-63cf-4e70-ac72-57426ba8ce7b tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:42:35 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-b7e2a016-63cf-4e70-ac72-57426ba8ce7b tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-b7e2a016-63cf-4e70-ac72-57426ba8ce7b tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.037s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25dda08-d9b1-494a-81a4-cf02f4041f3d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e2a016-63cf-4e70-ac72-57426ba8ce7b tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 23:42:35 user nova-compute[75341]: No targets found.
Nov 14 23:42:35 user nova-compute[75341]: iSNS:
Nov 14 23:42:35 user nova-compute[75341]: No targets found.
Nov 14 23:42:35 user nova-compute[75341]: STATIC:
Nov 14 23:42:35 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7
Nov 14 23:42:35 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:42:35 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:42:35 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2
Nov 14 23:42:35 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:42:35 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:42:35 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b
Nov 14 23:42:35 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:42:35 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:42:35 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0
Nov 14 23:42:35 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:42:35 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:42:35 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe
Nov 14 23:42:35 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:42:35 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:42:35 user nova-compute[75341]: FIRMWARE:
Nov 14 23:42:35 user nova-compute[75341]: No targets found.
Nov 14 23:42:35 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e2a016-63cf-4e70-ac72-57426ba8ce7b tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 23:42:35 user nova-compute[75341]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 23:42:35 user nova-compute[75341]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75341) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e2a016-63cf-4e70-ac72-57426ba8ce7b tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe', 0)] {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[62edf7e2-09c9-42a1-889f-64aebf44d55b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75341) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c2d6a4e-52a7-4ed0-8bd5-26a7513d91e8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e2a016-63cf-4e70-ac72-57426ba8ce7b tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe (non-flash)
Nov 14 23:42:35 user nova-compute[75341]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b (non-flash)
Nov 14 23:42:35 user nova-compute[75341]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0 (non-flash)
Nov 14 23:42:35 user nova-compute[75341]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 (non-flash)
Nov 14 23:42:35 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:42:35 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e2a016-63cf-4e70-ac72-57426ba8ce7b tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe (non-flash)
Nov 14 23:42:35 user nova-compute[75341]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b (non-flash)
Nov 14 23:42:35 user nova-compute[75341]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0 (non-flash)
Nov 14 23:42:35 user nova-compute[75341]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 (non-flash)
Nov 14 23:42:35 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:42:35 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e2a016-63cf-4e70-ac72-57426ba8ce7b tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18701dda20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe'): ({'sdi'}, set())}) {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-b7e2a016-63cf-4e70-ac72-57426ba8ce7b tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] Removing single pathed devices sdi {{(pid=75341) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[379b02c4-5bfd-4996-8993-df2bbdf3aa38]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2ab5cf-e32c-4608-9c1b-190e28e43255]: (4, ('ok\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-b7e2a016-63cf-4e70-ac72-57426ba8ce7b tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] Flushing IO for device /dev/sdi {{(pid=75341) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c0a106-3247-48c4-b2a8-9f7cba713abd]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-b7e2a016-63cf-4e70-ac72-57426ba8ce7b tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75341) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] calling os-brick to detach iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, {'target_iqn': 'iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rhLTVJvU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk', 'volume_id': 'f4398b13-aada-4505-95cf-82ff5ca13dc0'}, None), 'kwargs': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:42:35 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:42:35 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.046s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec521f0-ce1a-4d2e-bec5-97aba3b365e9]: (4, ('1', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-b7e2a016-63cf-4e70-ac72-57426ba8ce7b tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-b7e2a016-63cf-4e70-ac72-57426ba8ce7b tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] SCSI volumes sdi have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e2a016-63cf-4e70-ac72-57426ba8ce7b tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe')] {{(pid=75341) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[896fd0cf-3c1c-40bd-970c-3cfe222f7805]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e2a016-63cf-4e70-ac72-57426ba8ce7b tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe -p 172.16.0.220:3260 --logout {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-74d891d2-6542-4750-b0da-ee47d4b1eb3e tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Acquiring lock "b7d427ed-6ac3-46d9-bebc-d672f465f850" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-74d891d2-6542-4750-b0da-ee47d4b1eb3e tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Lock "b7d427ed-6ac3-46d9-bebc-d672f465f850" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-74d891d2-6542-4750-b0da-ee47d4b1eb3e tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Acquiring lock "b7d427ed-6ac3-46d9-bebc-d672f465f850-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-74d891d2-6542-4750-b0da-ee47d4b1eb3e tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Lock "b7d427ed-6ac3-46d9-bebc-d672f465f850-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-74d891d2-6542-4750-b0da-ee47d4b1eb3e tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Lock "b7d427ed-6ac3-46d9-bebc-d672f465f850-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:42:35 user nova-compute[75341]: INFO nova.compute.manager [None req-74d891d2-6542-4750-b0da-ee47d4b1eb3e tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] Terminating instance
Nov 14 23:42:35 user nova-compute[75341]: DEBUG nova.compute.manager [None req-74d891d2-6542-4750-b0da-ee47d4b1eb3e tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] Start destroying the instance on the hypervisor. {{(pid=75341) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf22336-a5ca-424a-a83d-c50a966963ca]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e2a016-63cf-4e70-ac72-57426ba8ce7b tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe, portal: 172.16.0.220,3260]
Nov 14 23:42:35 user nova-compute[75341]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe, portal: 172.16.0.220,3260] successful.
Nov 14 23:42:35 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe -p 172.16.0.220:3260 --op delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abce15e6-a0f0-4a23-abd0-0cc190d16fbe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[7595aa7c-36da-40ee-a0b9-c59e8528135b]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e2a016-63cf-4e70-ac72-57426ba8ce7b tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-b7e2a016-63cf-4e70-ac72-57426ba8ce7b tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e2a016-63cf-4e70-ac72-57426ba8ce7b tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] <== disconnect_volume: return (365ms) None {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7e2a016-63cf-4e70-ac72-57426ba8ce7b tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Disconnected iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.172s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a49190-9b6c-4fb8-8846-3012e4fdeeda]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 23:42:35 user nova-compute[75341]: No targets found.
Nov 14 23:42:35 user nova-compute[75341]: iSNS:
Nov 14 23:42:35 user nova-compute[75341]: No targets found.
Nov 14 23:42:35 user nova-compute[75341]: STATIC:
Nov 14 23:42:35 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7
Nov 14 23:42:35 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:42:35 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:42:35 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2
Nov 14 23:42:35 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:42:35 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:42:35 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b
Nov 14 23:42:35 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:42:35 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:42:35 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0
Nov 14 23:42:35 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:42:35 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:42:35 user nova-compute[75341]: FIRMWARE:
Nov 14 23:42:35 user nova-compute[75341]: No targets found.
Nov 14 23:42:35 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 23:42:35 user nova-compute[75341]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 23:42:35 user nova-compute[75341]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75341) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0', 0)] {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4959a64-3a56-40b0-a204-2e057c1e17ba]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[43dd16cd-defe-4492-82f4-d2d355d2bb06]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b (non-flash)
Nov 14 23:42:35 user nova-compute[75341]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0 (non-flash)
Nov 14 23:42:35 user nova-compute[75341]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 (non-flash)
Nov 14 23:42:35 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:42:35 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b (non-flash)
Nov 14 23:42:35 user nova-compute[75341]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0 (non-flash)
Nov 14 23:42:35 user nova-compute[75341]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 (non-flash)
Nov 14 23:42:35 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:42:35 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18903f9510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0'): ({'sdk'}, set())}) {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] Removing single pathed devices sdk {{(pid=75341) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2324710-cb40-4864-9514-2ae2eb0dd5f6]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:35 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[04748ddb-fe04-4a50-b75c-cf09275f5be2]: (4, ('ok\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] Flushing IO for device /dev/sdk {{(pid=75341) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.012s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c9815b-7b27-416e-8924-7ff638cfc44b]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=75341) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.049s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[f351ec40-42bf-490d-ab36-2c4d3ee3f337]: (4, ('1', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] Checking to see if SCSI volumes sdk have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] SCSI volumes sdk have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0')] {{(pid=75341) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG nova.compute.manager [req-aba85c5c-5f4f-4cd9-8fb9-544e0fbde10a req-4f0218c5-e1f6-44b0-bbdb-f450f2ad46d0 service nova] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] Received event network-vif-unplugged-a0990271-0de2-47ce-a33e-75cb022ba7c6 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-aba85c5c-5f4f-4cd9-8fb9-544e0fbde10a req-4f0218c5-e1f6-44b0-bbdb-f450f2ad46d0 service nova] Acquiring lock "b7d427ed-6ac3-46d9-bebc-d672f465f850-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-aba85c5c-5f4f-4cd9-8fb9-544e0fbde10a req-4f0218c5-e1f6-44b0-bbdb-f450f2ad46d0 service nova] Lock "b7d427ed-6ac3-46d9-bebc-d672f465f850-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-aba85c5c-5f4f-4cd9-8fb9-544e0fbde10a req-4f0218c5-e1f6-44b0-bbdb-f450f2ad46d0 service nova] Lock "b7d427ed-6ac3-46d9-bebc-d672f465f850-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG nova.compute.manager [req-aba85c5c-5f4f-4cd9-8fb9-544e0fbde10a req-4f0218c5-e1f6-44b0-bbdb-f450f2ad46d0 service nova] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] No waiting events found dispatching network-vif-unplugged-a0990271-0de2-47ce-a33e-75cb022ba7c6 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG nova.compute.manager [req-aba85c5c-5f4f-4cd9-8fb9-544e0fbde10a req-4f0218c5-e1f6-44b0-bbdb-f450f2ad46d0 service nova] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] Received event network-vif-unplugged-a0990271-0de2-47ce-a33e-75cb022ba7c6 for instance with task_state deleting. {{(pid=75341) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[732d5d2a-5b37-4b4c-82af-1a1f2e01a06d]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0 -p 172.16.0.220:3260 --logout {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb486220-3598-4499-8bcb-3656254f2c1b]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0, portal: 172.16.0.220,3260]
Nov 14 23:42:36 user nova-compute[75341]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0, portal: 172.16.0.220,3260] successful.
Nov 14 23:42:36 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0 -p 172.16.0.220:3260 --op delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4398b13-aada-4505-95cf-82ff5ca13dc0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1a7e76-889f-4bd6-b917-bd2ee5d4bb2d]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] <== disconnect_volume: return (514ms) None {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Disconnected iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG nova.compute.manager [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKVvsWnF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '0e7a53e9-6982-4c93-a830-a49cf0ce76bd', 'attached_at': '', 'detached_at': '', 'volume_id': '0df8b689-2583-4be4-8499-cc2e54889ac2', 'serial'} {{(pid=75341) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG nova.compute.manager [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] swap_volume: removing Cinder connection for volume f4398b13-aada-4505-95cf-82ff5ca13dc0 {{(pid=75341) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG nova.compute.manager [req-6832ec10-c3f9-4345-8789-703d26ddcb97 req-db12b802-b1f7-45b2-88d5-58cc3023ea7f service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received event network-vif-deleted-886562c6-312d-4a87-a34a-059f2ba3058a {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:42:36 user nova-compute[75341]: INFO nova.compute.manager [req-6832ec10-c3f9-4345-8789-703d26ddcb97 req-db12b802-b1f7-45b2-88d5-58cc3023ea7f service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Neutron deleted interface 886562c6-312d-4a87-a34a-059f2ba3058a; detaching it from the instance and deleting it from the info cache
Nov 14 23:42:36 user nova-compute[75341]: DEBUG nova.network.neutron [req-6832ec10-c3f9-4345-8789-703d26ddcb97 req-db12b802-b1f7-45b2-88d5-58cc3023ea7f service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Updating instance_info_cache with network_info: [{"id": "d0dd84fa-339a-49ec-9042-96715e2230fe", "address": "fa:16:3e:b5:06:42", "network": {"id": "b499fa7b-6b9d-49c0-a9cd-42306c00c501", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-385863436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0dd84fa-33", "ovs_interfaceid": "d0dd84fa-339a-49ec-9042-96715e2230fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f55964c8-6b58-4464-a352-e5145cc3c518", "address": "fa:16:3e:1b:36:55", "network": {"id": "c135160d-9db9-4271-a134-0cf75c1e862c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1010953674", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf55964c8-6b", "ovs_interfaceid": "f55964c8-6b58-4464-a352-e5145cc3c518", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "eb488639-e98a-4a85-b148-09dbb505f1c9", "address": "fa:16:3e:36:7e:f8", "network": {"id": "c135160d-9db9-4271-a134-0cf75c1e862c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1010953674", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb488639-e9", "ovs_interfaceid": "eb488639-e98a-4a85-b148-09dbb505f1c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c314df64-6753-4691-a931-1ef8f31a8063", "address": "fa:16:3e:92:14:79", "network": {"id": "c135160d-9db9-4271-a134-0cf75c1e862c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1010953674", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc314df64-67", "ovs_interfaceid": "c314df64-6753-4691-a931-1ef8f31a8063", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8352810c-25a7-4c4d-b13f-196c82e323ee", "address": "fa:16:3e:6d:e3:2c", "network": {"id": "08285f35-6170-45e2-9aaa-cd8a52bbd6cd", "bridge": "br-int", "label": "tempest-device-tagging-net2-454254441", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8352810c-25", "ovs_interfaceid": "8352810c-25a7-4c4d-b13f-196c82e323ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e1611672-3415-4fea-adb0-c7fe74ae6049", "address": "fa:16:3e:70:02:49", "network": {"id": "08285f35-6170-45e2-9aaa-cd8a52bbd6cd", "bridge": "br-int", "label": "tempest-device-tagging-net2-454254441", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1611672-34", "ovs_interfaceid": "e1611672-3415-4fea-adb0-c7fe74ae6049", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:42:36 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] Instance destroyed successfully.
Nov 14 23:42:36 user nova-compute[75341]: DEBUG nova.objects.instance [None req-74d891d2-6542-4750-b0da-ee47d4b1eb3e tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Lazy-loading 'resources' on Instance uuid b7d427ed-6ac3-46d9-bebc-d672f465f850 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-74d891d2-6542-4750-b0da-ee47d4b1eb3e tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T23:40:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1398479448',display_name='tempest-AttachSCSIVolumeTestJSON-server-1398479448',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1398479448',id=6,image_ref='a951ec1b-8017-4b82-9177-9f43ba7742e6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKMj1s2fpdHbB8JRXDfgTyaGC39337y50YVBeGXzIDB6EY1FkoxsWbt2+Zduh2jedtzYhG9cPGluAwUF6mfzm46O/G80KewIMaVLz800PlvGay1c0gNPzCjtmDecT/0TPA==',key_name='tempest-keypair-20970062',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:40:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f1bc48ec5e944fe7b9bd6d87b32fdad7',ramdisk_id='',reservation_id='r-40d1nhv3',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a951ec1b-8017-4b82-9177-9f43ba7742e6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1408306292',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1408306292-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:40:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e63bc65c932e4685b00b6b10e4f019a7',uuid=b7d427ed-6ac3-46d9-bebc-d672f465f850,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a0990271-0de2-47ce-a33e-75cb022ba7c6", "address": "fa:16:3e:1e:60:6f", "network": {"id": "1bb9b4c1-b9b7-4ba6-8d17-879af734945f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1477588770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bc48ec5e944fe7b9bd6d87b32fdad7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0990271-0d", "ovs_interfaceid": "a0990271-0de2-47ce-a33e-75cb022ba7c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-74d891d2-6542-4750-b0da-ee47d4b1eb3e tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Converting VIF {"id": "a0990271-0de2-47ce-a33e-75cb022ba7c6", "address": "fa:16:3e:1e:60:6f", "network": {"id": "1bb9b4c1-b9b7-4ba6-8d17-879af734945f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1477588770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bc48ec5e944fe7b9bd6d87b32fdad7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0990271-0d", "ovs_interfaceid": "a0990271-0de2-47ce-a33e-75cb022ba7c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-74d891d2-6542-4750-b0da-ee47d4b1eb3e tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:60:6f,bridge_name='br-int',has_traffic_filtering=True,id=a0990271-0de2-47ce-a33e-75cb022ba7c6,network=Network(1bb9b4c1-b9b7-4ba6-8d17-879af734945f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0990271-0d') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG os_vif [None req-74d891d2-6542-4750-b0da-ee47d4b1eb3e tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:60:6f,bridge_name='br-int',has_traffic_filtering=True,id=a0990271-0de2-47ce-a33e-75cb022ba7c6,network=Network(1bb9b4c1-b9b7-4ba6-8d17-879af734945f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0990271-0d') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa0990271-0d, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=23ef7eb0-d56c-491c-a6c9-31f934e361a3) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG nova.compute.manager [req-6832ec10-c3f9-4345-8789-703d26ddcb97 req-db12b802-b1f7-45b2-88d5-58cc3023ea7f service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Detach interface failed, port_id=886562c6-312d-4a87-a34a-059f2ba3058a, reason: Instance 9d03c7a3-e816-43b0-8616-60dea7a4e81a could not be found. {{(pid=75341) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:36 user nova-compute[75341]: INFO os_vif [None req-74d891d2-6542-4750-b0da-ee47d4b1eb3e tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:60:6f,bridge_name='br-int',has_traffic_filtering=True,id=a0990271-0de2-47ce-a33e-75cb022ba7c6,network=Network(1bb9b4c1-b9b7-4ba6-8d17-879af734945f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0990271-0d')
Nov 14 23:42:36 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-74d891d2-6542-4750-b0da-ee47d4b1eb3e tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] Deleting instance files /opt/stack/data/nova/instances/b7d427ed-6ac3-46d9-bebc-d672f465f850_del
Nov 14 23:42:36 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-74d891d2-6542-4750-b0da-ee47d4b1eb3e tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] Deletion of /opt/stack/data/nova/instances/b7d427ed-6ac3-46d9-bebc-d672f465f850_del complete
Nov 14 23:42:36 user nova-compute[75341]: INFO nova.compute.manager [None req-74d891d2-6542-4750-b0da-ee47d4b1eb3e tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 14 23:42:36 user nova-compute[75341]: DEBUG oslo.service.loopingcall [None req-74d891d2-6542-4750-b0da-ee47d4b1eb3e tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75341) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG nova.compute.manager [-] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] Deallocating network for instance {{(pid=75341) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] deallocate_for_instance() {{(pid=75341) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 23:42:36 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-b67c1d16-5575-49f8-9f81-abf99c198716 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 163c448b-0183-41bb-b6e0-61917f6ad781 is timed out.
Nov 14 23:42:36 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-b67c1d16-5575-49f8-9f81-abf99c198716 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Successfully detached device vdb from instance 163c448b-0183-41bb-b6e0-61917f6ad781 from the live domain config.
Nov 14 23:42:36 user nova-compute[75341]: DEBUG nova.objects.instance [None req-b7e2a016-63cf-4e70-ac72-57426ba8ce7b tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] Lazy-loading 'flavor' on Instance uuid e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b67c1d16-5575-49f8-9f81-abf99c198716 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] calling os-brick to detach iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b67c1d16-5575-49f8-9f81-abf99c198716 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, {'target_iqn': 'iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RovTpHyU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:42:36 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-b67c1d16-5575-49f8-9f81-abf99c198716 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:42:36 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-b67c1d16-5575-49f8-9f81-abf99c198716 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-b67c1d16-5575-49f8-9f81-abf99c198716 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea59fb14-b35e-471c-bd4e-3543b562bd2d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b67c1d16-5575-49f8-9f81-abf99c198716 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 23:42:36 user nova-compute[75341]: No targets found.
Nov 14 23:42:36 user nova-compute[75341]: iSNS:
Nov 14 23:42:36 user nova-compute[75341]: No targets found.
Nov 14 23:42:36 user nova-compute[75341]: STATIC:
Nov 14 23:42:36 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7
Nov 14 23:42:36 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:42:36 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:42:36 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2
Nov 14 23:42:36 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:42:36 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:42:36 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b
Nov 14 23:42:36 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:42:36 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:42:36 user nova-compute[75341]: FIRMWARE:
Nov 14 23:42:36 user nova-compute[75341]: No targets found.
Nov 14 23:42:36 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b67c1d16-5575-49f8-9f81-abf99c198716 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 23:42:36 user nova-compute[75341]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 23:42:36 user nova-compute[75341]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75341) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b67c1d16-5575-49f8-9f81-abf99c198716 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b', 0)] {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b7e2a016-63cf-4e70-ac72-57426ba8ce7b tempest-VolumesAssistedSnapshotsTest-1014281882 tempest-VolumesAssistedSnapshotsTest-1014281882-project-admin] Lock "e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.858s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[1706f5b6-6ecf-4dac-9669-d5209e1430d2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[8386494f-2cf7-4245-acd9-ddd6f1cc73fd]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b67c1d16-5575-49f8-9f81-abf99c198716 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b (non-flash)
Nov 14 23:42:36 user nova-compute[75341]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 (non-flash)
Nov 14 23:42:36 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:42:36 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b67c1d16-5575-49f8-9f81-abf99c198716 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b (non-flash)
Nov 14 23:42:36 user nova-compute[75341]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 (non-flash)
Nov 14 23:42:36 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:42:36 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b67c1d16-5575-49f8-9f81-abf99c198716 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18704560e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b'): ({'sdj'}, set())}) {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-b67c1d16-5575-49f8-9f81-abf99c198716 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Removing single pathed devices sdj {{(pid=75341) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5375264-ef15-48b7-b439-5b39c049e530]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e44b498-5a92-4fef-9b94-48b726313977]: (4, ('ok\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-b67c1d16-5575-49f8-9f81-abf99c198716 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Flushing IO for device /dev/sdj {{(pid=75341) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.012s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb5270e-f0df-4129-a8fa-526e512bcbd7]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-b67c1d16-5575-49f8-9f81-abf99c198716 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=75341) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.040s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f308e61-04c7-4bbc-8b7f-70a69426c412]: (4, ('1', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-b67c1d16-5575-49f8-9f81-abf99c198716 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-b67c1d16-5575-49f8-9f81-abf99c198716 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] SCSI volumes sdj have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b67c1d16-5575-49f8-9f81-abf99c198716 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b')] {{(pid=75341) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3a3d9a-490b-494e-bec8-abaf25f09afd]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b67c1d16-5575-49f8-9f81-abf99c198716 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:36 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b -p 172.16.0.220:3260 --logout {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:37 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:37 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[06162c7b-18bb-4dfb-a675-b2cf212d8fe3]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:37 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b67c1d16-5575-49f8-9f81-abf99c198716 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b, portal: 172.16.0.220,3260]
Nov 14 23:42:37 user nova-compute[75341]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b, portal: 172.16.0.220,3260] successful.
Nov 14 23:42:37 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:37 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b -p 172.16.0.220:3260 --op delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:37 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dccbb6b-a6e2-408a-97e4-d2e10768079b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:37 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[cabd13cb-1709-4e79-b16c-18b3ea89608e]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:37 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b67c1d16-5575-49f8-9f81-abf99c198716 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:37 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-b67c1d16-5575-49f8-9f81-abf99c198716 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:42:37 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b67c1d16-5575-49f8-9f81-abf99c198716 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] <== disconnect_volume: return (302ms) None {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:42:37 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b67c1d16-5575-49f8-9f81-abf99c198716 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Disconnected iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 23:42:37 user nova-compute[75341]: DEBUG nova.compute.manager [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] swap_volume: Updating volume f4398b13-aada-4505-95cf-82ff5ca13dc0 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "NKVvsWnF", "auth_password": "aFqBdT0IjYPAxJ", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdg", "volume_id": "0df8b689-2583-4be4-8499-cc2e54889ac2"}, "status": "reserved", "instance": "0e7a53e9-6982-4c93-a830-a49cf0ce76bd", "attached_at": "", "detached_at": "", "volume_id": "0df8b689-2583-4be4-8499-cc2e54889ac2", "serial": "0df8b689-2583-4be4-8499-cc2e54889ac2"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '0df8b689-2583-4be4-8499-cc2e54889ac2', 'no_device': None, 'attachment_id': '21c0bf10-dcd3-4ecb-8f47-b1e8fe7b5c5e'} {{(pid=75341) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 14 23:42:37 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0a8aa7b1-3e46-44c4-978e-a26326155e4c tempest-TestVolumeSwap-494104417 tempest-TestVolumeSwap-494104417-project-admin] Lock "0e7a53e9-6982-4c93-a830-a49cf0ce76bd" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 12.308s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:42:37 user nova-compute[75341]: DEBUG nova.objects.instance [None req-b67c1d16-5575-49f8-9f81-abf99c198716 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Lazy-loading 'flavor' on Instance uuid 163c448b-0183-41bb-b6e0-61917f6ad781 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:42:37 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:42:37 user nova-compute[75341]: INFO nova.compute.manager [-] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] Took 1.13 seconds to deallocate network for instance.
Nov 14 23:42:37 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b67c1d16-5575-49f8-9f81-abf99c198716 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Lock "163c448b-0183-41bb-b6e0-61917f6ad781" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.652s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:42:37 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-74d891d2-6542-4750-b0da-ee47d4b1eb3e tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:42:37 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-74d891d2-6542-4750-b0da-ee47d4b1eb3e tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:42:38 user nova-compute[75341]: DEBUG nova.compute.manager [req-a44a489c-dc57-4dcb-a680-1961063cde98 req-6af0804c-11e6-4c86-8210-001ac55b0fed service nova] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] Received event network-vif-plugged-a0990271-0de2-47ce-a33e-75cb022ba7c6 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:42:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a44a489c-dc57-4dcb-a680-1961063cde98 req-6af0804c-11e6-4c86-8210-001ac55b0fed service nova] Acquiring lock "b7d427ed-6ac3-46d9-bebc-d672f465f850-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:42:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a44a489c-dc57-4dcb-a680-1961063cde98 req-6af0804c-11e6-4c86-8210-001ac55b0fed service nova] Lock "b7d427ed-6ac3-46d9-bebc-d672f465f850-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:42:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a44a489c-dc57-4dcb-a680-1961063cde98 req-6af0804c-11e6-4c86-8210-001ac55b0fed service nova] Lock "b7d427ed-6ac3-46d9-bebc-d672f465f850-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:42:38 user nova-compute[75341]: DEBUG nova.compute.manager [req-a44a489c-dc57-4dcb-a680-1961063cde98 req-6af0804c-11e6-4c86-8210-001ac55b0fed service nova] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] No waiting events found dispatching network-vif-plugged-a0990271-0de2-47ce-a33e-75cb022ba7c6 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:42:38 user nova-compute[75341]: WARNING nova.compute.manager [req-a44a489c-dc57-4dcb-a680-1961063cde98 req-6af0804c-11e6-4c86-8210-001ac55b0fed service nova] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] Received unexpected event network-vif-plugged-a0990271-0de2-47ce-a33e-75cb022ba7c6 for instance with vm_state deleted and task_state None.
Nov 14 23:42:38 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-74d891d2-6542-4750-b0da-ee47d4b1eb3e tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:42:38 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-74d891d2-6542-4750-b0da-ee47d4b1eb3e tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:42:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-74d891d2-6542-4750-b0da-ee47d4b1eb3e tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.341s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:42:38 user nova-compute[75341]: INFO nova.scheduler.client.report [None req-74d891d2-6542-4750-b0da-ee47d4b1eb3e tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Deleted allocations for instance b7d427ed-6ac3-46d9-bebc-d672f465f850
Nov 14 23:42:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-74d891d2-6542-4750-b0da-ee47d4b1eb3e tempest-AttachSCSIVolumeTestJSON-1408306292 tempest-AttachSCSIVolumeTestJSON-1408306292-project-member] Lock "b7d427ed-6ac3-46d9-bebc-d672f465f850" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.583s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:42:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-12f8f839-2123-4ee8-83a1-8cff48fef99d tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Acquiring lock "0e7a53e9-6982-4c93-a830-a49cf0ce76bd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:42:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-12f8f839-2123-4ee8-83a1-8cff48fef99d tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Lock "0e7a53e9-6982-4c93-a830-a49cf0ce76bd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:42:38 user nova-compute[75341]: INFO nova.compute.manager [None req-12f8f839-2123-4ee8-83a1-8cff48fef99d tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Detaching volume 0df8b689-2583-4be4-8499-cc2e54889ac2
Nov 14 23:42:38 user nova-compute[75341]: INFO nova.virt.block_device [None req-12f8f839-2123-4ee8-83a1-8cff48fef99d tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Attempting to driver detach volume 0df8b689-2583-4be4-8499-cc2e54889ac2 from mountpoint /dev/vdb
Nov 14 23:42:38 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-12f8f839-2123-4ee8-83a1-8cff48fef99d tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Attempting to detach device vdb from instance 0e7a53e9-6982-4c93-a830-a49cf0ce76bd from the persistent domain config. {{(pid=75341) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 23:42:38 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-12f8f839-2123-4ee8-83a1-8cff48fef99d tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 23:42:38 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:42:38 user nova-compute[75341]:   <source dev="/dev/sdg"/>
Nov 14 23:42:38 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:42:38 user nova-compute[75341]:   <serial>0df8b689-2583-4be4-8499-cc2e54889ac2</serial>
Nov 14 23:42:38 user nova-compute[75341]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 23:42:38 user nova-compute[75341]: </disk>
Nov 14 23:42:38 user nova-compute[75341]:  {{(pid=75341) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 23:42:38 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-12f8f839-2123-4ee8-83a1-8cff48fef99d tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Successfully detached device vdb from instance 0e7a53e9-6982-4c93-a830-a49cf0ce76bd from the persistent domain config.
Nov 14 23:42:38 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-12f8f839-2123-4ee8-83a1-8cff48fef99d tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0e7a53e9-6982-4c93-a830-a49cf0ce76bd from the live domain config. {{(pid=75341) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 23:42:38 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-12f8f839-2123-4ee8-83a1-8cff48fef99d tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 23:42:38 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:42:38 user nova-compute[75341]:   <source dev="/dev/sdg"/>
Nov 14 23:42:38 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:42:38 user nova-compute[75341]:   <serial>0df8b689-2583-4be4-8499-cc2e54889ac2</serial>
Nov 14 23:42:38 user nova-compute[75341]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 23:42:38 user nova-compute[75341]: </disk>
Nov 14 23:42:38 user nova-compute[75341]:  {{(pid=75341) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 23:42:38 user nova-compute[75341]: DEBUG nova.compute.manager [req-f4979a8e-87a5-4920-922e-f824210597c3 req-48aded0c-4f44-4c9d-b863-44a0e5d3b79f service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received event network-vif-deleted-8352810c-25a7-4c4d-b13f-196c82e323ee {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:42:38 user nova-compute[75341]: INFO nova.compute.manager [req-f4979a8e-87a5-4920-922e-f824210597c3 req-48aded0c-4f44-4c9d-b863-44a0e5d3b79f service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Neutron deleted interface 8352810c-25a7-4c4d-b13f-196c82e323ee; detaching it from the instance and deleting it from the info cache
Nov 14 23:42:38 user nova-compute[75341]: DEBUG nova.network.neutron [req-f4979a8e-87a5-4920-922e-f824210597c3 req-48aded0c-4f44-4c9d-b863-44a0e5d3b79f service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Updating instance_info_cache with network_info: [{"id": "d0dd84fa-339a-49ec-9042-96715e2230fe", "address": "fa:16:3e:b5:06:42", "network": {"id": "b499fa7b-6b9d-49c0-a9cd-42306c00c501", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-385863436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0dd84fa-33", "ovs_interfaceid": "d0dd84fa-339a-49ec-9042-96715e2230fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f55964c8-6b58-4464-a352-e5145cc3c518", "address": "fa:16:3e:1b:36:55", "network": {"id": "c135160d-9db9-4271-a134-0cf75c1e862c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1010953674", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf55964c8-6b", "ovs_interfaceid": "f55964c8-6b58-4464-a352-e5145cc3c518", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "eb488639-e98a-4a85-b148-09dbb505f1c9", "address": "fa:16:3e:36:7e:f8", "network": {"id": "c135160d-9db9-4271-a134-0cf75c1e862c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1010953674", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb488639-e9", "ovs_interfaceid": "eb488639-e98a-4a85-b148-09dbb505f1c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c314df64-6753-4691-a931-1ef8f31a8063", "address": "fa:16:3e:92:14:79", "network": {"id": "c135160d-9db9-4271-a134-0cf75c1e862c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1010953674", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc314df64-67", "ovs_interfaceid": "c314df64-6753-4691-a931-1ef8f31a8063", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e1611672-3415-4fea-adb0-c7fe74ae6049", "address": "fa:16:3e:70:02:49", "network": {"id": "08285f35-6170-45e2-9aaa-cd8a52bbd6cd", "bridge": "br-int", "label": "tempest-device-tagging-net2-454254441", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1611672-34", "ovs_interfaceid": "e1611672-3415-4fea-adb0-c7fe74ae6049", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:42:38 user nova-compute[75341]: DEBUG nova.compute.manager [req-f4979a8e-87a5-4920-922e-f824210597c3 req-48aded0c-4f44-4c9d-b863-44a0e5d3b79f service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Detach interface failed, port_id=8352810c-25a7-4c4d-b13f-196c82e323ee, reason: Instance 9d03c7a3-e816-43b0-8616-60dea7a4e81a could not be found. {{(pid=75341) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 23:42:38 user nova-compute[75341]: DEBUG nova.compute.manager [req-f4979a8e-87a5-4920-922e-f824210597c3 req-48aded0c-4f44-4c9d-b863-44a0e5d3b79f service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received event network-vif-deleted-e1611672-3415-4fea-adb0-c7fe74ae6049 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:42:38 user nova-compute[75341]: INFO nova.compute.manager [req-f4979a8e-87a5-4920-922e-f824210597c3 req-48aded0c-4f44-4c9d-b863-44a0e5d3b79f service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Neutron deleted interface e1611672-3415-4fea-adb0-c7fe74ae6049; detaching it from the instance and deleting it from the info cache
Nov 14 23:42:38 user nova-compute[75341]: DEBUG nova.network.neutron [req-f4979a8e-87a5-4920-922e-f824210597c3 req-48aded0c-4f44-4c9d-b863-44a0e5d3b79f service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Updating instance_info_cache with network_info: [{"id": "d0dd84fa-339a-49ec-9042-96715e2230fe", "address": "fa:16:3e:b5:06:42", "network": {"id": "b499fa7b-6b9d-49c0-a9cd-42306c00c501", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-385863436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0dd84fa-33", "ovs_interfaceid": "d0dd84fa-339a-49ec-9042-96715e2230fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f55964c8-6b58-4464-a352-e5145cc3c518", "address": "fa:16:3e:1b:36:55", "network": {"id": "c135160d-9db9-4271-a134-0cf75c1e862c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1010953674", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf55964c8-6b", "ovs_interfaceid": "f55964c8-6b58-4464-a352-e5145cc3c518", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "eb488639-e98a-4a85-b148-09dbb505f1c9", "address": "fa:16:3e:36:7e:f8", "network": {"id": "c135160d-9db9-4271-a134-0cf75c1e862c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1010953674", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb488639-e9", "ovs_interfaceid": "eb488639-e98a-4a85-b148-09dbb505f1c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c314df64-6753-4691-a931-1ef8f31a8063", "address": "fa:16:3e:92:14:79", "network": {"id": "c135160d-9db9-4271-a134-0cf75c1e862c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1010953674", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc314df64-67", "ovs_interfaceid": "c314df64-6753-4691-a931-1ef8f31a8063", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:42:38 user nova-compute[75341]: DEBUG nova.compute.manager [req-f4979a8e-87a5-4920-922e-f824210597c3 req-48aded0c-4f44-4c9d-b863-44a0e5d3b79f service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Detach interface failed, port_id=e1611672-3415-4fea-adb0-c7fe74ae6049, reason: Instance 9d03c7a3-e816-43b0-8616-60dea7a4e81a could not be found. {{(pid=75341) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 23:42:38 user nova-compute[75341]: DEBUG nova.compute.manager [req-f4979a8e-87a5-4920-922e-f824210597c3 req-48aded0c-4f44-4c9d-b863-44a0e5d3b79f service nova] [instance: b7d427ed-6ac3-46d9-bebc-d672f465f850] Received event network-vif-deleted-a0990271-0de2-47ce-a33e-75cb022ba7c6 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:42:38 user nova-compute[75341]: DEBUG nova.compute.manager [req-f4979a8e-87a5-4920-922e-f824210597c3 req-48aded0c-4f44-4c9d-b863-44a0e5d3b79f service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received event network-vif-deleted-c314df64-6753-4691-a931-1ef8f31a8063 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:42:38 user nova-compute[75341]: INFO nova.compute.manager [req-f4979a8e-87a5-4920-922e-f824210597c3 req-48aded0c-4f44-4c9d-b863-44a0e5d3b79f service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Neutron deleted interface c314df64-6753-4691-a931-1ef8f31a8063; detaching it from the instance and deleting it from the info cache
Nov 14 23:42:38 user nova-compute[75341]: DEBUG nova.network.neutron [req-f4979a8e-87a5-4920-922e-f824210597c3 req-48aded0c-4f44-4c9d-b863-44a0e5d3b79f service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Updating instance_info_cache with network_info: [{"id": "d0dd84fa-339a-49ec-9042-96715e2230fe", "address": "fa:16:3e:b5:06:42", "network": {"id": "b499fa7b-6b9d-49c0-a9cd-42306c00c501", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-385863436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0dd84fa-33", "ovs_interfaceid": "d0dd84fa-339a-49ec-9042-96715e2230fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f55964c8-6b58-4464-a352-e5145cc3c518", "address": "fa:16:3e:1b:36:55", "network": {"id": "c135160d-9db9-4271-a134-0cf75c1e862c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1010953674", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf55964c8-6b", "ovs_interfaceid": "f55964c8-6b58-4464-a352-e5145cc3c518", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "eb488639-e98a-4a85-b148-09dbb505f1c9", "address": "fa:16:3e:36:7e:f8", "network": {"id": "c135160d-9db9-4271-a134-0cf75c1e862c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1010953674", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b84539186347404ea3cdc32042f70052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb488639-e9", "ovs_interfaceid": "eb488639-e98a-4a85-b148-09dbb505f1c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:42:38 user nova-compute[75341]: DEBUG nova.compute.manager [req-f4979a8e-87a5-4920-922e-f824210597c3 req-48aded0c-4f44-4c9d-b863-44a0e5d3b79f service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Detach interface failed, port_id=c314df64-6753-4691-a931-1ef8f31a8063, reason: Instance 9d03c7a3-e816-43b0-8616-60dea7a4e81a could not be found. {{(pid=75341) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 23:42:38 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:42:38 user nova-compute[75341]: INFO nova.compute.manager [-] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Took 4.23 seconds to deallocate network for instance.
Nov 14 23:42:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f8088b9d-354a-432d-96d0-5738c8897958 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Acquiring lock "interface-163c448b-0183-41bb-b6e0-61917f6ad781-71326c15-7e6c-4b5c-88fb-5648e74f1754" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:42:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f8088b9d-354a-432d-96d0-5738c8897958 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Lock "interface-163c448b-0183-41bb-b6e0-61917f6ad781-71326c15-7e6c-4b5c-88fb-5648e74f1754" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:42:38 user nova-compute[75341]: DEBUG nova.objects.instance [None req-f8088b9d-354a-432d-96d0-5738c8897958 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Lazy-loading 'flavor' on Instance uuid 163c448b-0183-41bb-b6e0-61917f6ad781 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:42:38 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-f8088b9d-354a-432d-96d0-5738c8897958 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T23:40:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1560149904',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1560149904',id=7,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQ3a1x+okDjRVw62hbKhJtP80/zWFyvtGey5wIlVDB0NZ56fG+725fWUXyjh7/+IE35PijjUBR8Wcuw/LlwusTfjzX4MaOP3PLObnIQMoEItEWkt+BvyX7BQ255w2h2Gw==',key_name='tempest-keypair-1289222933',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:40:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dc16bad01d434f7f9a66247f776d6269',ramdisk_id='',reservation_id='r-3r4vupg5',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1943224082',owner_user_name='tempest-TaggedAttachmentsTest-1943224082-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:40:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48f384876a794dbfa3e7c89e6e20a232',uuid=163c448b-0183-41bb-b6e0-61917f6ad781,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "71326c15-7e6c-4b5c-88fb-5648e74f1754", "address": "fa:16:3e:97:bb:6e", "network": {"id": "a2d4fa10-64dc-4465-ba21-2b01b0583a67", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-671649606", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "dc16bad01d434f7f9a66247f776d6269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71326c15-7e", "ovs_interfaceid": "71326c15-7e6c-4b5c-88fb-5648e74f1754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:42:38 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-f8088b9d-354a-432d-96d0-5738c8897958 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Converting VIF {"id": "71326c15-7e6c-4b5c-88fb-5648e74f1754", "address": "fa:16:3e:97:bb:6e", "network": {"id": "a2d4fa10-64dc-4465-ba21-2b01b0583a67", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-671649606", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "dc16bad01d434f7f9a66247f776d6269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71326c15-7e", "ovs_interfaceid": "71326c15-7e6c-4b5c-88fb-5648e74f1754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:42:38 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-f8088b9d-354a-432d-96d0-5738c8897958 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:bb:6e,bridge_name='br-int',has_traffic_filtering=True,id=71326c15-7e6c-4b5c-88fb-5648e74f1754,network=Network(a2d4fa10-64dc-4465-ba21-2b01b0583a67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71326c15-7e') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:42:38 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-f8088b9d-354a-432d-96d0-5738c8897958 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:97:bb:6e"/><model type="virtio"/><mtu size="1442"/><target dev="tap71326c15-7e"/></interface> {{(pid=75341) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 23:42:38 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-f8088b9d-354a-432d-96d0-5738c8897958 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:97:bb:6e"/><model type="virtio"/><mtu size="1442"/><target dev="tap71326c15-7e"/></interface> {{(pid=75341) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 23:42:38 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-f8088b9d-354a-432d-96d0-5738c8897958 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Attempting to detach device tap71326c15-7e from instance 163c448b-0183-41bb-b6e0-61917f6ad781 from the persistent domain config. {{(pid=75341) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 23:42:38 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-f8088b9d-354a-432d-96d0-5738c8897958 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] detach device xml: <interface type="ethernet">
Nov 14 23:42:38 user nova-compute[75341]:   <mac address="fa:16:3e:97:bb:6e"/>
Nov 14 23:42:38 user nova-compute[75341]:   <model type="virtio"/>
Nov 14 23:42:38 user nova-compute[75341]:   <mtu size="1442"/>
Nov 14 23:42:38 user nova-compute[75341]:   <target dev="tap71326c15-7e"/>
Nov 14 23:42:38 user nova-compute[75341]: </interface>
Nov 14 23:42:38 user nova-compute[75341]:  {{(pid=75341) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 23:42:38 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-f8088b9d-354a-432d-96d0-5738c8897958 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:97:bb:6e"/><model type="virtio"/><mtu size="1442"/><target dev="tap71326c15-7e"/></interface> {{(pid=75341) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 23:42:38 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-f8088b9d-354a-432d-96d0-5738c8897958 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:97:bb:6e"/><model type="virtio"/><mtu size="1442"/><target dev="tap71326c15-7e"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 14 23:42:38 user nova-compute[75341]:   <name>instance-00000007</name>
Nov 14 23:42:38 user nova-compute[75341]:   <uuid>163c448b-0183-41bb-b6e0-61917f6ad781</uuid>
Nov 14 23:42:38 user nova-compute[75341]:   <metadata>
Nov 14 23:42:38 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 23:42:38 user nova-compute[75341]:   <nova:package version="0.0.0"/>
Nov 14 23:42:38 user nova-compute[75341]:   <nova:name>tempest-device-tagging-server-1560149904</nova:name>
Nov 14 23:42:38 user nova-compute[75341]:   <nova:creationTime>2023-11-14 23:42:07</nova:creationTime>
Nov 14 23:42:38 user nova-compute[75341]:   <nova:flavor name="m1.tiny">
Nov 14 23:42:38 user nova-compute[75341]:     <nova:memory>512</nova:memory>
Nov 14 23:42:38 user nova-compute[75341]:     <nova:disk>1</nova:disk>
Nov 14 23:42:38 user nova-compute[75341]:     <nova:swap>0</nova:swap>
Nov 14 23:42:38 user nova-compute[75341]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 23:42:38 user nova-compute[75341]:     <nova:vcpus>1</nova:vcpus>
Nov 14 23:42:38 user nova-compute[75341]:   </nova:flavor>
Nov 14 23:42:38 user nova-compute[75341]:   <nova:owner>
Nov 14 23:42:38 user nova-compute[75341]:     <nova:user uuid="48f384876a794dbfa3e7c89e6e20a232">tempest-TaggedAttachmentsTest-1943224082-project-member</nova:user>
Nov 14 23:42:38 user nova-compute[75341]:     <nova:project uuid="dc16bad01d434f7f9a66247f776d6269">tempest-TaggedAttachmentsTest-1943224082</nova:project>
Nov 14 23:42:38 user nova-compute[75341]:   </nova:owner>
Nov 14 23:42:38 user nova-compute[75341]:   <nova:root type="image" uuid="e46abb82-b810-490e-a8a1-ccdc5fa1a796"/>
Nov 14 23:42:38 user nova-compute[75341]:   <nova:ports>
Nov 14 23:42:38 user nova-compute[75341]:     <nova:port uuid="87b091a7-76a0-46e1-b1fd-fd305d1ce55e">
Nov 14 23:42:38 user nova-compute[75341]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 23:42:38 user nova-compute[75341]:     </nova:port>
Nov 14 23:42:38 user nova-compute[75341]:     <nova:port uuid="71326c15-7e6c-4b5c-88fb-5648e74f1754">
Nov 14 23:42:38 user nova-compute[75341]:       <nova:ip type="fixed" address="10.10.10.93" ipVersion="4"/>
Nov 14 23:42:38 user nova-compute[75341]:     </nova:port>
Nov 14 23:42:38 user nova-compute[75341]:   </nova:ports>
Nov 14 23:42:38 user nova-compute[75341]: </nova:instance>
Nov 14 23:42:38 user nova-compute[75341]:   </metadata>
Nov 14 23:42:38 user nova-compute[75341]:   <memory unit='KiB'>524288</memory>
Nov 14 23:42:38 user nova-compute[75341]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 14 23:42:38 user nova-compute[75341]:   <vcpu placement='static'>1</vcpu>
Nov 14 23:42:38 user nova-compute[75341]:   <resource>
Nov 14 23:42:38 user nova-compute[75341]:     <partition>/machine</partition>
Nov 14 23:42:38 user nova-compute[75341]:   </resource>
Nov 14 23:42:38 user nova-compute[75341]:   <sysinfo type='smbios'>
Nov 14 23:42:38 user nova-compute[75341]:     <system>
Nov 14 23:42:38 user nova-compute[75341]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 14 23:42:38 user nova-compute[75341]:       <entry name='product'>OpenStack Nova</entry>
Nov 14 23:42:38 user nova-compute[75341]:       <entry name='version'>0.0.0</entry>
Nov 14 23:42:38 user nova-compute[75341]:       <entry name='serial'>163c448b-0183-41bb-b6e0-61917f6ad781</entry>
Nov 14 23:42:38 user nova-compute[75341]:       <entry name='uuid'>163c448b-0183-41bb-b6e0-61917f6ad781</entry>
Nov 14 23:42:38 user nova-compute[75341]:       <entry name='family'>Virtual Machine</entry>
Nov 14 23:42:38 user nova-compute[75341]:     </system>
Nov 14 23:42:38 user nova-compute[75341]:   </sysinfo>
Nov 14 23:42:38 user nova-compute[75341]:   <os>
Nov 14 23:42:38 user nova-compute[75341]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 14 23:42:38 user nova-compute[75341]:     <boot dev='hd'/>
Nov 14 23:42:38 user nova-compute[75341]:     <smbios mode='sysinfo'/>
Nov 14 23:42:38 user nova-compute[75341]:   </os>
Nov 14 23:42:38 user nova-compute[75341]:   <features>
Nov 14 23:42:38 user nova-compute[75341]:     <acpi/>
Nov 14 23:42:38 user nova-compute[75341]:     <apic/>
Nov 14 23:42:38 user nova-compute[75341]:     <vmcoreinfo state='on'/>
Nov 14 23:42:38 user nova-compute[75341]:   </features>
Nov 14 23:42:38 user nova-compute[75341]:   <cpu mode='custom' match='exact' check='full'>
Nov 14 23:42:38 user nova-compute[75341]:     <model fallback='forbid'>Nehalem</model>
Nov 14 23:42:38 user nova-compute[75341]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 14 23:42:38 user nova-compute[75341]:     <feature policy='require' name='vme'/>
Nov 14 23:42:38 user nova-compute[75341]:     <feature policy='require' name='x2apic'/>
Nov 14 23:42:38 user nova-compute[75341]:     <feature policy='require' name='hypervisor'/>
Nov 14 23:42:38 user nova-compute[75341]:   </cpu>
Nov 14 23:42:38 user nova-compute[75341]:   <clock offset='utc'>
Nov 14 23:42:38 user nova-compute[75341]:     <timer name='pit' tickpolicy='delay'/>
Nov 14 23:42:38 user nova-compute[75341]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 14 23:42:38 user nova-compute[75341]:     <timer name='hpet' present='no'/>
Nov 14 23:42:38 user nova-compute[75341]:   </clock>
Nov 14 23:42:38 user nova-compute[75341]:   <on_poweroff>destroy</on_poweroff>
Nov 14 23:42:38 user nova-compute[75341]:   <on_reboot>restart</on_reboot>
Nov 14 23:42:38 user nova-compute[75341]:   <on_crash>destroy</on_crash>
Nov 14 23:42:38 user nova-compute[75341]:   <devices>
Nov 14 23:42:38 user nova-compute[75341]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 23:42:38 user nova-compute[75341]:     <disk type='file' device='disk'>
Nov 14 23:42:38 user nova-compute[75341]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 14 23:42:38 user nova-compute[75341]:       <source file='/opt/stack/data/nova/instances/163c448b-0183-41bb-b6e0-61917f6ad781/disk' index='2'/>
Nov 14 23:42:38 user nova-compute[75341]:       <backingStore type='file' index='3'>
Nov 14 23:42:38 user nova-compute[75341]:         <format type='raw'/>
Nov 14 23:42:38 user nova-compute[75341]:         <source file='/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740'/>
Nov 14 23:42:38 user nova-compute[75341]:         <backingStore/>
Nov 14 23:42:38 user nova-compute[75341]:       </backingStore>
Nov 14 23:42:38 user nova-compute[75341]:       <target dev='vda' bus='virtio'/>
Nov 14 23:42:38 user nova-compute[75341]:       <alias name='virtio-disk0'/>
Nov 14 23:42:38 user nova-compute[75341]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 14 23:42:38 user nova-compute[75341]:     </disk>
Nov 14 23:42:38 user nova-compute[75341]:     <disk type='file' device='cdrom'>
Nov 14 23:42:38 user nova-compute[75341]:       <driver name='qemu' type='raw' cache='none'/>
Nov 14 23:42:38 user nova-compute[75341]:       <source file='/opt/stack/data/nova/instances/163c448b-0183-41bb-b6e0-61917f6ad781/disk.config' index='1'/>
Nov 14 23:42:38 user nova-compute[75341]:       <backingStore/>
Nov 14 23:42:38 user nova-compute[75341]:       <target dev='hda' bus='ide'/>
Nov 14 23:42:38 user nova-compute[75341]:       <readonly/>
Nov 14 23:42:38 user nova-compute[75341]:       <alias name='ide0-0-0'/>
Nov 14 23:42:38 user nova-compute[75341]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 14 23:42:38 user nova-compute[75341]:     </disk>
Nov 14 23:42:38 user nova-compute[75341]:     <controller type='usb' index='0' model='none'>
Nov 14 23:42:38 user nova-compute[75341]:       <alias name='usb'/>
Nov 14 23:42:38 user nova-compute[75341]:     </controller>
Nov 14 23:42:38 user nova-compute[75341]:     <controller type='pci' index='0' model='pci-root'>
Nov 14 23:42:38 user nova-compute[75341]:       <alias name='pci.0'/>
Nov 14 23:42:38 user nova-compute[75341]:     </controller>
Nov 14 23:42:38 user nova-compute[75341]:     <controller type='ide' index='0'>
Nov 14 23:42:38 user nova-compute[75341]:       <alias name='ide'/>
Nov 14 23:42:38 user nova-compute[75341]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 14 23:42:38 user nova-compute[75341]:     </controller>
Nov 14 23:42:38 user nova-compute[75341]:     <interface type='ethernet'>
Nov 14 23:42:38 user nova-compute[75341]:       <mac address='fa:16:3e:2f:5b:cc'/>
Nov 14 23:42:38 user nova-compute[75341]:       <target dev='tap87b091a7-76'/>
Nov 14 23:42:38 user nova-compute[75341]:       <model type='virtio'/>
Nov 14 23:42:38 user nova-compute[75341]:       <mtu size='1442'/>
Nov 14 23:42:38 user nova-compute[75341]:       <alias name='net0'/>
Nov 14 23:42:38 user nova-compute[75341]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 14 23:42:38 user nova-compute[75341]:     </interface>
Nov 14 23:42:38 user nova-compute[75341]:     <interface type='ethernet'>
Nov 14 23:42:38 user nova-compute[75341]:       <mac address='fa:16:3e:97:bb:6e'/>
Nov 14 23:42:38 user nova-compute[75341]:       <target dev='tap71326c15-7e'/>
Nov 14 23:42:38 user nova-compute[75341]:       <model type='virtio'/>
Nov 14 23:42:38 user nova-compute[75341]:       <mtu size='1442'/>
Nov 14 23:42:38 user nova-compute[75341]:       <alias name='net1'/>
Nov 14 23:42:38 user nova-compute[75341]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 14 23:42:38 user nova-compute[75341]:     </interface>
Nov 14 23:42:38 user nova-compute[75341]:     <serial type='pty'>
Nov 14 23:42:38 user nova-compute[75341]:       <source path='/dev/pts/7'/>
Nov 14 23:42:38 user nova-compute[75341]:       <log file='/opt/stack/data/nova/instances/163c448b-0183-41bb-b6e0-61917f6ad781/console.log' append='off'/>
Nov 14 23:42:38 user nova-compute[75341]:       <target type='isa-serial' port='0'>
Nov 14 23:42:38 user nova-compute[75341]:         <model name='isa-serial'/>
Nov 14 23:42:38 user nova-compute[75341]:       </target>
Nov 14 23:42:38 user nova-compute[75341]:       <alias name='serial0'/>
Nov 14 23:42:38 user nova-compute[75341]:     </serial>
Nov 14 23:42:38 user nova-compute[75341]:     <console type='pty' tty='/dev/pts/7'>
Nov 14 23:42:38 user nova-compute[75341]:       <source path='/dev/pts/7'/>
Nov 14 23:42:38 user nova-compute[75341]:       <log file='/opt/stack/data/nova/instances/163c448b-0183-41bb-b6e0-61917f6ad781/console.log' append='off'/>
Nov 14 23:42:38 user nova-compute[75341]:       <target type='serial' port='0'/>
Nov 14 23:42:38 user nova-compute[75341]:       <alias name='serial0'/>
Nov 14 23:42:38 user nova-compute[75341]:     </console>
Nov 14 23:42:38 user nova-compute[75341]:     <input type='mouse' bus='ps2'>
Nov 14 23:42:38 user nova-compute[75341]:       <alias name='input0'/>
Nov 14 23:42:38 user nova-compute[75341]:     </input>
Nov 14 23:42:38 user nova-compute[75341]:     <input type='keyboard' bus='ps2'>
Nov 14 23:42:38 user nova-compute[75341]:       <alias name='input1'/>
Nov 14 23:42:38 user nova-compute[75341]:     </input>
Nov 14 23:42:38 user nova-compute[75341]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 14 23:42:38 user nova-compute[75341]:       <listen type='address' address='0.0.0.0'/>
Nov 14 23:42:38 user nova-compute[75341]:     </graphics>
Nov 14 23:42:38 user nova-compute[75341]:     <audio id='1' type='none'/>
Nov 14 23:42:38 user nova-compute[75341]:     <video>
Nov 14 23:42:38 user nova-compute[75341]:       <model type='virtio' heads='1' primary='yes'/>
Nov 14 23:42:38 user nova-compute[75341]:       <alias name='video0'/>
Nov 14 23:42:38 user nova-compute[75341]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 14 23:42:38 user nova-compute[75341]:     </video>
Nov 14 23:42:38 user nova-compute[75341]:     <memballoon model='virtio'>
Nov 14 23:42:38 user nova-compute[75341]:       <stats period='10'/>
Nov 14 23:42:38 user nova-compute[75341]:       <alias name='balloon0'/>
Nov 14 23:42:38 user nova-compute[75341]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 14 23:42:38 user nova-compute[75341]:     </memballoon>
Nov 14 23:42:38 user nova-compute[75341]:     <rng model='virtio'>
Nov 14 23:42:38 user nova-compute[75341]:       <backend model='random'>/dev/urandom</backend>
Nov 14 23:42:38 user nova-compute[75341]:       <alias name='rng0'/>
Nov 14 23:42:38 user nova-compute[75341]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 14 23:42:38 user nova-compute[75341]:     </rng>
Nov 14 23:42:38 user nova-compute[75341]:   </devices>
Nov 14 23:42:38 user nova-compute[75341]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 14 23:42:38 user nova-compute[75341]:     <label>libvirt-163c448b-0183-41bb-b6e0-61917f6ad781</label>
Nov 14 23:42:38 user nova-compute[75341]:     <imagelabel>libvirt-163c448b-0183-41bb-b6e0-61917f6ad781</imagelabel>
Nov 14 23:42:38 user nova-compute[75341]:   </seclabel>
Nov 14 23:42:38 user nova-compute[75341]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 14 23:42:38 user nova-compute[75341]:     <label>+64055:+108</label>
Nov 14 23:42:38 user nova-compute[75341]:     <imagelabel>+64055:+108</imagelabel>
Nov 14 23:42:38 user nova-compute[75341]:   </seclabel>
Nov 14 23:42:38 user nova-compute[75341]: </domain>
Nov 14 23:42:38 user nova-compute[75341]:  {{(pid=75341) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 14 23:42:38 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-f8088b9d-354a-432d-96d0-5738c8897958 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Successfully detached device tap71326c15-7e from instance 163c448b-0183-41bb-b6e0-61917f6ad781 from the persistent domain config.
Nov 14 23:42:38 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-f8088b9d-354a-432d-96d0-5738c8897958 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] (1/8): Attempting to detach device tap71326c15-7e with device alias net1 from instance 163c448b-0183-41bb-b6e0-61917f6ad781 from the live domain config. {{(pid=75341) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 23:42:38 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-f8088b9d-354a-432d-96d0-5738c8897958 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] detach device xml: <interface type="ethernet">
Nov 14 23:42:38 user nova-compute[75341]:   <mac address="fa:16:3e:97:bb:6e"/>
Nov 14 23:42:38 user nova-compute[75341]:   <model type="virtio"/>
Nov 14 23:42:38 user nova-compute[75341]:   <mtu size="1442"/>
Nov 14 23:42:38 user nova-compute[75341]:   <target dev="tap71326c15-7e"/>
Nov 14 23:42:38 user nova-compute[75341]: </interface>
Nov 14 23:42:38 user nova-compute[75341]:  {{(pid=75341) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 23:42:39 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-12f8f839-2123-4ee8-83a1-8cff48fef99d tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0e7a53e9-6982-4c93-a830-a49cf0ce76bd {{(pid=75341) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 23:42:39 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:39 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-f8088b9d-354a-432d-96d0-5738c8897958 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Start waiting for the detach event from libvirt for device tap71326c15-7e with device alias net1 for instance 163c448b-0183-41bb-b6e0-61917f6ad781 {{(pid=75341) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 23:42:39 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:39 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:39 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:40 user nova-compute[75341]: DEBUG nova.compute.manager [req-726adc1e-4707-44a8-a1e0-f4d63fadc460 req-a934d12b-68ec-413a-951e-b2276229d3f2 service nova] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Received event network-vif-deleted-d0dd84fa-339a-49ec-9042-96715e2230fe {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:42:40 user nova-compute[75341]: DEBUG nova.compute.manager [req-726adc1e-4707-44a8-a1e0-f4d63fadc460 req-a934d12b-68ec-413a-951e-b2276229d3f2 service nova] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Received event network-vif-unplugged-71326c15-7e6c-4b5c-88fb-5648e74f1754 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:42:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-726adc1e-4707-44a8-a1e0-f4d63fadc460 req-a934d12b-68ec-413a-951e-b2276229d3f2 service nova] Acquiring lock "163c448b-0183-41bb-b6e0-61917f6ad781-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:42:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-726adc1e-4707-44a8-a1e0-f4d63fadc460 req-a934d12b-68ec-413a-951e-b2276229d3f2 service nova] Lock "163c448b-0183-41bb-b6e0-61917f6ad781-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:42:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-726adc1e-4707-44a8-a1e0-f4d63fadc460 req-a934d12b-68ec-413a-951e-b2276229d3f2 service nova] Lock "163c448b-0183-41bb-b6e0-61917f6ad781-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:42:40 user nova-compute[75341]: DEBUG nova.compute.manager [req-726adc1e-4707-44a8-a1e0-f4d63fadc460 req-a934d12b-68ec-413a-951e-b2276229d3f2 service nova] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] No waiting events found dispatching network-vif-unplugged-71326c15-7e6c-4b5c-88fb-5648e74f1754 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:42:40 user nova-compute[75341]: WARNING nova.compute.manager [req-726adc1e-4707-44a8-a1e0-f4d63fadc460 req-a934d12b-68ec-413a-951e-b2276229d3f2 service nova] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Received unexpected event network-vif-unplugged-71326c15-7e6c-4b5c-88fb-5648e74f1754 for instance with vm_state active and task_state None.
Nov 14 23:42:40 user nova-compute[75341]: DEBUG nova.compute.manager [req-726adc1e-4707-44a8-a1e0-f4d63fadc460 req-a934d12b-68ec-413a-951e-b2276229d3f2 service nova] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Received event network-vif-plugged-71326c15-7e6c-4b5c-88fb-5648e74f1754 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:42:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-726adc1e-4707-44a8-a1e0-f4d63fadc460 req-a934d12b-68ec-413a-951e-b2276229d3f2 service nova] Acquiring lock "163c448b-0183-41bb-b6e0-61917f6ad781-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:42:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-726adc1e-4707-44a8-a1e0-f4d63fadc460 req-a934d12b-68ec-413a-951e-b2276229d3f2 service nova] Lock "163c448b-0183-41bb-b6e0-61917f6ad781-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:42:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-726adc1e-4707-44a8-a1e0-f4d63fadc460 req-a934d12b-68ec-413a-951e-b2276229d3f2 service nova] Lock "163c448b-0183-41bb-b6e0-61917f6ad781-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:42:40 user nova-compute[75341]: DEBUG nova.compute.manager [req-726adc1e-4707-44a8-a1e0-f4d63fadc460 req-a934d12b-68ec-413a-951e-b2276229d3f2 service nova] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] No waiting events found dispatching network-vif-plugged-71326c15-7e6c-4b5c-88fb-5648e74f1754 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:42:40 user nova-compute[75341]: WARNING nova.compute.manager [req-726adc1e-4707-44a8-a1e0-f4d63fadc460 req-a934d12b-68ec-413a-951e-b2276229d3f2 service nova] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Received unexpected event network-vif-plugged-71326c15-7e6c-4b5c-88fb-5648e74f1754 for instance with vm_state active and task_state None.
Nov 14 23:42:40 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:41 user nova-compute[75341]: INFO nova.compute.manager [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] [instance: 9d03c7a3-e816-43b0-8616-60dea7a4e81a] Took 2.28 seconds to detach 3 volumes for instance.
Nov 14 23:42:41 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:42:41 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:42:41 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:42:41 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:42:41 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.309s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:42:41 user nova-compute[75341]: INFO nova.scheduler.client.report [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Deleted allocations for instance 9d03c7a3-e816-43b0-8616-60dea7a4e81a
Nov 14 23:42:41 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6d086aa0-3c4f-413d-a42e-b72eb0b12070 tempest-TaggedBootDevicesTest-491908434 tempest-TaggedBootDevicesTest-491908434-project-member] Lock "9d03c7a3-e816-43b0-8616-60dea7a4e81a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.452s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:42:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:42 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:42:42 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Starting heal instance info cache {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 23:42:42 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Skipping network cache update for instance because it has been migrated to another host. {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9966}}
Nov 14 23:42:43 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "refresh_cache-a0cffbac-f552-47bf-bd6c-dabb70e7c867" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:42:43 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquired lock "refresh_cache-a0cffbac-f552-47bf-bd6c-dabb70e7c867" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:42:43 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Forcefully refreshing network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 23:42:44 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Updating instance_info_cache with network_info: [{"id": "8a863ecb-919e-42ac-8507-1c9af9135895", "address": "fa:16:3e:0c:75:47", "network": {"id": "a59b651e-81c5-4a68-b694-1e84de25e915", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1023462603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8a897400c74100ad6c115397bc84ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a863ecb-91", "ovs_interfaceid": "8a863ecb-919e-42ac-8507-1c9af9135895", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:42:44 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Releasing lock "refresh_cache-a0cffbac-f552-47bf-bd6c-dabb70e7c867" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:42:44 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Updated the network info_cache for instance {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 23:42:44 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:42:44 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:42:44 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:42:44 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:42:44 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75341) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 23:42:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:44 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:42:46 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:46 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:42:46 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:42:46 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:42:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:42:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:42:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:42:46 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75341) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 23:42:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/163c448b-0183-41bb-b6e0-61917f6ad781/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/163c448b-0183-41bb-b6e0-61917f6ad781/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/163c448b-0183-41bb-b6e0-61917f6ad781/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/163c448b-0183-41bb-b6e0-61917f6ad781/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0cffbac-f552-47bf-bd6c-dabb70e7c867/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0cffbac-f552-47bf-bd6c-dabb70e7c867/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0cffbac-f552-47bf-bd6c-dabb70e7c867/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0cffbac-f552-47bf-bd6c-dabb70e7c867/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44080c0d-56eb-4987-aa4b-59f161dcbc0b/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:48 user nova-compute[75341]: DEBUG nova.compute.manager [req-49be6534-f073-45d0-89a2-77663ddb4777 req-9271ac44-ca9a-4d8f-8a0b-b9c47d965093 service nova] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Received event network-changed-611fe585-b169-4ec5-97cf-8ebdf5060502 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:42:48 user nova-compute[75341]: DEBUG nova.compute.manager [req-49be6534-f073-45d0-89a2-77663ddb4777 req-9271ac44-ca9a-4d8f-8a0b-b9c47d965093 service nova] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Refreshing instance network info cache due to event network-changed-611fe585-b169-4ec5-97cf-8ebdf5060502. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:42:48 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-49be6534-f073-45d0-89a2-77663ddb4777 req-9271ac44-ca9a-4d8f-8a0b-b9c47d965093 service nova] Acquiring lock "refresh_cache-44080c0d-56eb-4987-aa4b-59f161dcbc0b" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:42:48 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-49be6534-f073-45d0-89a2-77663ddb4777 req-9271ac44-ca9a-4d8f-8a0b-b9c47d965093 service nova] Acquired lock "refresh_cache-44080c0d-56eb-4987-aa4b-59f161dcbc0b" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:42:48 user nova-compute[75341]: DEBUG nova.network.neutron [req-49be6534-f073-45d0-89a2-77663ddb4777 req-9271ac44-ca9a-4d8f-8a0b-b9c47d965093 service nova] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Refreshing network info cache for port 611fe585-b169-4ec5-97cf-8ebdf5060502 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:42:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44080c0d-56eb-4987-aa4b-59f161dcbc0b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44080c0d-56eb-4987-aa4b-59f161dcbc0b/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44080c0d-56eb-4987-aa4b-59f161dcbc0b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e7a53e9-6982-4c93-a830-a49cf0ce76bd/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e7a53e9-6982-4c93-a830-a49cf0ce76bd/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e7a53e9-6982-4c93-a830-a49cf0ce76bd/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:48 user nova-compute[75341]: DEBUG nova.network.neutron [req-49be6534-f073-45d0-89a2-77663ddb4777 req-9271ac44-ca9a-4d8f-8a0b-b9c47d965093 service nova] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Updated VIF entry in instance network info cache for port 611fe585-b169-4ec5-97cf-8ebdf5060502. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:42:48 user nova-compute[75341]: DEBUG nova.network.neutron [req-49be6534-f073-45d0-89a2-77663ddb4777 req-9271ac44-ca9a-4d8f-8a0b-b9c47d965093 service nova] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Updating instance_info_cache with network_info: [{"id": "611fe585-b169-4ec5-97cf-8ebdf5060502", "address": "fa:16:3e:ce:7e:2b", "network": {"id": "4b25a4f0-0f86-4f96-9228-c8e9a60b401d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1630866661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a263dc99759446c9a226892c0d81a0d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap611fe585-b1", "ovs_interfaceid": "611fe585-b169-4ec5-97cf-8ebdf5060502", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:42:48 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-49be6534-f073-45d0-89a2-77663ddb4777 req-9271ac44-ca9a-4d8f-8a0b-b9c47d965093 service nova] Releasing lock "refresh_cache-44080c0d-56eb-4987-aa4b-59f161dcbc0b" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:42:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e7a53e9-6982-4c93-a830-a49cf0ce76bd/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-5dc1a5e3-d20f-460b-b331-a7e0e277068e tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Acquiring lock "44080c0d-56eb-4987-aa4b-59f161dcbc0b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:42:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-5dc1a5e3-d20f-460b-b331-a7e0e277068e tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Lock "44080c0d-56eb-4987-aa4b-59f161dcbc0b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:42:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:49 user nova-compute[75341]: DEBUG nova.objects.instance [None req-5dc1a5e3-d20f-460b-b331-a7e0e277068e tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Lazy-loading 'flavor' on Instance uuid 44080c0d-56eb-4987-aa4b-59f161dcbc0b {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:42:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-5dc1a5e3-d20f-460b-b331-a7e0e277068e tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Lock "44080c0d-56eb-4987-aa4b-59f161dcbc0b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.089s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:42:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:49 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 23:42:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8d3b42b-11b5-477a-afb1-80a1786b693b/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-5dc1a5e3-d20f-460b-b331-a7e0e277068e tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Acquiring lock "44080c0d-56eb-4987-aa4b-59f161dcbc0b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:42:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-5dc1a5e3-d20f-460b-b331-a7e0e277068e tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Lock "44080c0d-56eb-4987-aa4b-59f161dcbc0b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:42:49 user nova-compute[75341]: INFO nova.compute.manager [None req-5dc1a5e3-d20f-460b-b331-a7e0e277068e tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Attaching volume 84172a25-a3fe-442b-940c-3e6dbc7a1a23 to /dev/vdb
Nov 14 23:42:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:49 user nova-compute[75341]: DEBUG os_brick.utils [None req-5dc1a5e3-d20f-460b-b331-a7e0e277068e tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:42:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:49 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[10235007-dfee-406c-8406-708939c62d6b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6d1cfca09c9\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:49 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[44415bfa-c6cb-4114-baad-64eee33eaebb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8d3b42b-11b5-477a-afb1-80a1786b693b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8d3b42b-11b5-477a-afb1-80a1786b693b/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:49 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[03044386-0022-4cb0-b8b5-82c56fb1c1eb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:49 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[069dcdce-92bd-4faa-816e-b9de578228a0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-5dc1a5e3-d20f-460b-b331-a7e0e277068e tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Running cmd (subprocess): nvme version {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-5dc1a5e3-d20f-460b-b331-a7e0e277068e tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] 'nvme version' failed. Not Retrying. {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:42:49 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5dc1a5e3-d20f-460b-b331-a7e0e277068e tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] nvme not present on system {{(pid=75341) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 23:42:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:42:49 user nova-compute[75341]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 23:42:49 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b11d039-6b79-4795-9967-f716c165515b]: (4, '') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:49 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-5dc1a5e3-d20f-460b-b331-a7e0e277068e tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75341) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 23:42:49 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-5dc1a5e3-d20f-460b-b331-a7e0e277068e tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 23:42:49 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-5dc1a5e3-d20f-460b-b331-a7e0e277068e tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] LIGHTOS: no hostnqn found. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 23:42:49 user nova-compute[75341]: DEBUG os_brick.utils [None req-5dc1a5e3-d20f-460b-b331-a7e0e277068e tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6d1cfca09c9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:42:49 user nova-compute[75341]: DEBUG nova.virt.block_device [None req-5dc1a5e3-d20f-460b-b331-a7e0e277068e tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Updating existing volume attachment record: 1eaa3c31-3552-4551-85fa-7fd134c11b0e {{(pid=75341) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 23:42:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8d3b42b-11b5-477a-afb1-80a1786b693b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:50 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:42:50 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:42:50 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Hypervisor/Node resource view: name=user free_ram=7565MB free_disk=25.654541015625GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75341) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 23:42:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:42:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:42:50 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 881351d7-31f9-44f4-8571-8f540bbec29c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:42:50 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance a0cffbac-f552-47bf-bd6c-dabb70e7c867 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:42:50 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 0e7a53e9-6982-4c93-a830-a49cf0ce76bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:42:50 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 163c448b-0183-41bb-b6e0-61917f6ad781 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:42:50 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:42:50 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 44080c0d-56eb-4987-aa4b-59f161dcbc0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:42:50 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 0223a98e-e08f-4a0f-a707-3770c7a99b00 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:42:50 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance d8d3b42b-11b5-477a-afb1-80a1786b693b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:42:50 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 23:42:50 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 23:42:50 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:42:50 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:42:50 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Compute_service record updated for user:user {{(pid=75341) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 23:42:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.455s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:42:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:54 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5dc1a5e3-d20f-460b-b331-a7e0e277068e tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Calling os-brick to attach iSCSI Volume {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 23:42:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc1a5e3-d20f-460b-b331-a7e0e277068e tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MtLTdblJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:42:54 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-5dc1a5e3-d20f-460b-b331-a7e0e277068e tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:42:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-5dc1a5e3-d20f-460b-b331-a7e0e277068e tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:42:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-5dc1a5e3-d20f-460b-b331-a7e0e277068e tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:42:54 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-5dc1a5e3-d20f-460b-b331-a7e0e277068e tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:42:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-5dc1a5e3-d20f-460b-b331-a7e0e277068e tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:42:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-5dc1a5e3-d20f-460b-b331-a7e0e277068e tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:42:54 user nova-compute[75341]: INFO os_brick.initiator.connectors.iscsi [None req-5dc1a5e3-d20f-460b-b331-a7e0e277068e tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 23:42:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 -p 172.16.0.220:3260 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:54 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a2920f-f293-47b6-ba1b-8d6804bd5a8d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc1a5e3-d20f-460b-b331-a7e0e277068e tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 23:42:54 user nova-compute[75341]:  {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 -p 172.16.0.220:3260 --interface default --op new {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:54 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c94917-02ad-4864-b739-74c863d6b9fd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23] added\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc1a5e3-d20f-460b-b331-a7e0e277068e tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23] added
Nov 14 23:42:54 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:54 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb00e23-7dd0-41e0-9d03-1288e59e3ceb]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc1a5e3-d20f-460b-b331-a7e0e277068e tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:54 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[473415c4-73eb-4916-9073-b93fa5118ef6]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc1a5e3-d20f-460b-b331-a7e0e277068e tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MtLTdblJ {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MtLTdblJ" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:54 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[af3ebe03-8fb7-4d01-95fb-874b6f6c786e]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc1a5e3-d20f-460b-b331-a7e0e277068e tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MtLTdblJ'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:54 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5aec44d-a5ac-4082-8ae3-7b4c548d8fbe]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc1a5e3-d20f-460b-b331-a7e0e277068e tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:54 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[cecfddf4-37fd-4d5a-a06e-0f459848cd1d]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc1a5e3-d20f-460b-b331-a7e0e277068e tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 (non-flash)
Nov 14 23:42:54 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:42:54 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:42:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc1a5e3-d20f-460b-b331-a7e0e277068e tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 (non-flash)
Nov 14 23:42:54 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:42:54 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:42:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 -p 172.16.0.220:3260 --login {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:54 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab9d3c8-5d4a-4fe3-b31f-66dec12cba5a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc1a5e3-d20f-460b-b331-a7e0e277068e tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23, portal: 172.16.0.220,3260]
Nov 14 23:42:54 user nova-compute[75341]: Login to [iface: default, target: iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23, portal: 172.16.0.220,3260] successful.
Nov 14 23:42:54 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:54 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2a5bb4-082c-4ba3-8876-dfca93532d4a]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc1a5e3-d20f-460b-b331-a7e0e277068e tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:54 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[248bbe18-9782-483d-86e4-77a199b39604]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc1a5e3-d20f-460b-b331-a7e0e277068e tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 (non-flash)
Nov 14 23:42:54 user nova-compute[75341]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 (non-flash)
Nov 14 23:42:54 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:42:54 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:42:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc1a5e3-d20f-460b-b331-a7e0e277068e tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 (non-flash)
Nov 14 23:42:54 user nova-compute[75341]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 (non-flash)
Nov 14 23:42:54 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:42:54 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:42:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-5dc1a5e3-d20f-460b-b331-a7e0e277068e tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:42:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc1a5e3-d20f-460b-b331-a7e0e277068e tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Connected to 172.16.0.220:3260 {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 23:42:54 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-5dc1a5e3-d20f-460b-b331-a7e0e277068e tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=75341) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 23:42:54 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-5dc1a5e3-d20f-460b-b331-a7e0e277068e tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75341) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 23:42:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:54 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1d8519-df5c-4d8e-8930-afea824d37bd]: (4, ('- - 0', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:54 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-5dc1a5e3-d20f-460b-b331-a7e0e277068e tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 23:42:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc1a5e3-d20f-460b-b331-a7e0e277068e tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MtLTdblJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 23:42:55 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-5dc1a5e3-d20f-460b-b331-a7e0e277068e tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:42:55 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc1a5e3-d20f-460b-b331-a7e0e277068e tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '26532303462633366', 'path': '/dev/sdb'} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:42:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5dc1a5e3-d20f-460b-b331-a7e0e277068e tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532303462633366', 'path': '/dev/sdb'} {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 23:42:55 user nova-compute[75341]: DEBUG nova.objects.instance [None req-5dc1a5e3-d20f-460b-b331-a7e0e277068e tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Lazy-loading 'flavor' on Instance uuid 44080c0d-56eb-4987-aa4b-59f161dcbc0b {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:42:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-5dc1a5e3-d20f-460b-b331-a7e0e277068e tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 23:42:55 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:42:55 user nova-compute[75341]:   <source dev="/dev/sdb"/>
Nov 14 23:42:55 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:42:55 user nova-compute[75341]:   <serial>84172a25-a3fe-442b-940c-3e6dbc7a1a23</serial>
Nov 14 23:42:55 user nova-compute[75341]: </disk>
Nov 14 23:42:55 user nova-compute[75341]:  {{(pid=75341) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 23:42:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-5dc1a5e3-d20f-460b-b331-a7e0e277068e tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:42:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-5dc1a5e3-d20f-460b-b331-a7e0e277068e tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:42:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-5dc1a5e3-d20f-460b-b331-a7e0e277068e tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] No VIF found with MAC fa:16:3e:ce:7e:2b, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:42:56 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-5dc1a5e3-d20f-460b-b331-a7e0e277068e tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Lock "44080c0d-56eb-4987-aa4b-59f161dcbc0b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.631s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:42:56 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Acquiring lock "cffc86d5-2ac6-4dd1-bdcd-5832c134d179" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:42:56 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Lock "cffc86d5-2ac6-4dd1-bdcd-5832c134d179" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:42:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:56 user nova-compute[75341]: DEBUG nova.compute.manager [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Starting instance... {{(pid=75341) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 23:42:56 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:42:56 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:42:56 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75341) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 23:42:56 user nova-compute[75341]: INFO nova.compute.claims [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Claim successful on node user
Nov 14 23:42:56 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:42:57 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:42:57 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.344s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:42:57 user nova-compute[75341]: DEBUG nova.compute.manager [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Start building networks asynchronously for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 23:42:57 user nova-compute[75341]: DEBUG nova.compute.manager [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Allocating IP information in the background. {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 23:42:57 user nova-compute[75341]: DEBUG nova.network.neutron [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] allocate_for_instance() {{(pid=75341) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 23:42:57 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 23:42:57 user nova-compute[75341]: DEBUG nova.compute.manager [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Start building block device mappings for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 23:42:57 user nova-compute[75341]: DEBUG nova.policy [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2440829d0b0e4d4d8f8266c4e8162223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e4a2efc0fc47a482755f1c375aff46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75341) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 23:42:57 user nova-compute[75341]: INFO nova.virt.block_device [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Booting with volume b7af2f07-212b-4210-b473-6e1da973682c at /dev/vda
Nov 14 23:42:57 user nova-compute[75341]: DEBUG os_brick.utils [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:42:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:57 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2984de3-7848-483a-8bfc-8455f9e83f58]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6d1cfca09c9\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:57 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c17946-3978-47d0-83ca-4c94c3f530b4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:57 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[de512095-e94c-41b1-8ca1-438863ce4b38]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:57 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94933ed-1ce8-4d56-a007-c01f0bb03fff]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Running cmd (subprocess): nvme version {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] 'nvme version' failed. Not Retrying. {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:42:57 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] nvme not present on system {{(pid=75341) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 23:42:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:42:57 user nova-compute[75341]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 23:42:57 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d263ad-41e3-49f3-80a8-d729ea151617]: (4, '') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:57 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75341) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 23:42:57 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 23:42:57 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] LIGHTOS: no hostnqn found. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 23:42:57 user nova-compute[75341]: DEBUG os_brick.utils [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6d1cfca09c9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:42:57 user nova-compute[75341]: DEBUG nova.virt.block_device [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Updating existing volume attachment record: 949dadf6-7fad-4c36-b725-b54bca688bd0 {{(pid=75341) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 23:42:57 user nova-compute[75341]: DEBUG nova.network.neutron [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Successfully created port: cdc268e0-0a9a-44cf-87ef-0baca1547f68 {{(pid=75341) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 23:42:58 user nova-compute[75341]: DEBUG nova.network.neutron [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Successfully updated port: cdc268e0-0a9a-44cf-87ef-0baca1547f68 {{(pid=75341) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 23:42:58 user nova-compute[75341]: DEBUG nova.compute.manager [req-55960a6c-6ee3-4d29-97c3-814a83fc0b5c req-5fb2f77b-76ca-42d2-a743-8661cebf2dcc service nova] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Received event network-changed-cdc268e0-0a9a-44cf-87ef-0baca1547f68 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:42:58 user nova-compute[75341]: DEBUG nova.compute.manager [req-55960a6c-6ee3-4d29-97c3-814a83fc0b5c req-5fb2f77b-76ca-42d2-a743-8661cebf2dcc service nova] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Refreshing instance network info cache due to event network-changed-cdc268e0-0a9a-44cf-87ef-0baca1547f68. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:42:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-55960a6c-6ee3-4d29-97c3-814a83fc0b5c req-5fb2f77b-76ca-42d2-a743-8661cebf2dcc service nova] Acquiring lock "refresh_cache-cffc86d5-2ac6-4dd1-bdcd-5832c134d179" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:42:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-55960a6c-6ee3-4d29-97c3-814a83fc0b5c req-5fb2f77b-76ca-42d2-a743-8661cebf2dcc service nova] Acquired lock "refresh_cache-cffc86d5-2ac6-4dd1-bdcd-5832c134d179" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:42:58 user nova-compute[75341]: DEBUG nova.network.neutron [req-55960a6c-6ee3-4d29-97c3-814a83fc0b5c req-5fb2f77b-76ca-42d2-a743-8661cebf2dcc service nova] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Refreshing network info cache for port cdc268e0-0a9a-44cf-87ef-0baca1547f68 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:42:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Acquiring lock "refresh_cache-cffc86d5-2ac6-4dd1-bdcd-5832c134d179" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:42:58 user nova-compute[75341]: DEBUG nova.network.neutron [req-55960a6c-6ee3-4d29-97c3-814a83fc0b5c req-5fb2f77b-76ca-42d2-a743-8661cebf2dcc service nova] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Instance cache missing network info. {{(pid=75341) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 23:42:58 user nova-compute[75341]: DEBUG nova.network.neutron [req-55960a6c-6ee3-4d29-97c3-814a83fc0b5c req-5fb2f77b-76ca-42d2-a743-8661cebf2dcc service nova] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:42:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-55960a6c-6ee3-4d29-97c3-814a83fc0b5c req-5fb2f77b-76ca-42d2-a743-8661cebf2dcc service nova] Releasing lock "refresh_cache-cffc86d5-2ac6-4dd1-bdcd-5832c134d179" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:42:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Acquired lock "refresh_cache-cffc86d5-2ac6-4dd1-bdcd-5832c134d179" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:42:58 user nova-compute[75341]: DEBUG nova.network.neutron [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 23:42:58 user nova-compute[75341]: DEBUG nova.network.neutron [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Instance cache missing network info. {{(pid=75341) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 23:42:58 user nova-compute[75341]: DEBUG nova.network.neutron [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Updating instance_info_cache with network_info: [{"id": "cdc268e0-0a9a-44cf-87ef-0baca1547f68", "address": "fa:16:3e:10:94:5a", "network": {"id": "c832523e-13e4-44da-9e4b-a4f3e5a276fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1155631271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e4a2efc0fc47a482755f1c375aff46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdc268e0-0a", "ovs_interfaceid": "cdc268e0-0a9a-44cf-87ef-0baca1547f68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:42:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Releasing lock "refresh_cache-cffc86d5-2ac6-4dd1-bdcd-5832c134d179" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:42:58 user nova-compute[75341]: DEBUG nova.compute.manager [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Instance network_info: |[{"id": "cdc268e0-0a9a-44cf-87ef-0baca1547f68", "address": "fa:16:3e:10:94:5a", "network": {"id": "c832523e-13e4-44da-9e4b-a4f3e5a276fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1155631271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e4a2efc0fc47a482755f1c375aff46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdc268e0-0a", "ovs_interfaceid": "cdc268e0-0a9a-44cf-87ef-0baca1547f68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 23:42:59 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-12f8f839-2123-4ee8-83a1-8cff48fef99d tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0e7a53e9-6982-4c93-a830-a49cf0ce76bd is timed out.
Nov 14 23:42:59 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-12f8f839-2123-4ee8-83a1-8cff48fef99d tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Successfully detached device vdb from instance 0e7a53e9-6982-4c93-a830-a49cf0ce76bd from the live domain config.
Nov 14 23:42:59 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12f8f839-2123-4ee8-83a1-8cff48fef99d tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] calling os-brick to detach iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 23:42:59 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f8f839-2123-4ee8-83a1-8cff48fef99d tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, {'target_iqn': 'iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKVvsWnF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'volume_id': '0df8b689-2583-4be4-8499-cc2e54889ac2'}, None), 'kwargs': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:42:59 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-12f8f839-2123-4ee8-83a1-8cff48fef99d tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:42:59 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-12f8f839-2123-4ee8-83a1-8cff48fef99d tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:42:59 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-12f8f839-2123-4ee8-83a1-8cff48fef99d tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:42:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:59 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c5cb5e-fb5e-4a5d-a6e2-6fd82580d471]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:59 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f8f839-2123-4ee8-83a1-8cff48fef99d tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 23:42:59 user nova-compute[75341]: No targets found.
Nov 14 23:42:59 user nova-compute[75341]: iSNS:
Nov 14 23:42:59 user nova-compute[75341]: No targets found.
Nov 14 23:42:59 user nova-compute[75341]: STATIC:
Nov 14 23:42:59 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7
Nov 14 23:42:59 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:42:59 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:42:59 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2
Nov 14 23:42:59 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:42:59 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:42:59 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23
Nov 14 23:42:59 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:42:59 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:42:59 user nova-compute[75341]: FIRMWARE:
Nov 14 23:42:59 user nova-compute[75341]: No targets found.
Nov 14 23:42:59 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:42:59 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f8f839-2123-4ee8-83a1-8cff48fef99d tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 23:42:59 user nova-compute[75341]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 23:42:59 user nova-compute[75341]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75341) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 23:42:59 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f8f839-2123-4ee8-83a1-8cff48fef99d tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2', 0)] {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 23:42:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:59 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[a891b314-64e8-4e19-b125-12ed0c06d158]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:59 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0a3c4e-e40f-420b-a82f-b9462bf47fee]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:59 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f8f839-2123-4ee8-83a1-8cff48fef99d tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 (non-flash)
Nov 14 23:42:59 user nova-compute[75341]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 (non-flash)
Nov 14 23:42:59 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:42:59 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:42:59 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f8f839-2123-4ee8-83a1-8cff48fef99d tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 (non-flash)
Nov 14 23:42:59 user nova-compute[75341]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 (non-flash)
Nov 14 23:42:59 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:42:59 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:42:59 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f8f839-2123-4ee8-83a1-8cff48fef99d tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18903f7250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2'): ({'sdg'}, set())}) {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 23:42:59 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-12f8f839-2123-4ee8-83a1-8cff48fef99d tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Removing single pathed devices sdg {{(pid=75341) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 23:42:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:59 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e1590d-e9b8-46e6-b9ca-7845af1b6ca1]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:59 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6b4d46-d424-4264-a976-286638fe6c0e]: (4, ('ok\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:59 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-12f8f839-2123-4ee8-83a1-8cff48fef99d tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Flushing IO for device /dev/sdg {{(pid=75341) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 23:42:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:59 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0bdb10-734c-40ab-8f22-71288f96e668]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:59 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-12f8f839-2123-4ee8-83a1-8cff48fef99d tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75341) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 23:42:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.038s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:59 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc348a83-c21b-40b5-93eb-acebd05eb981]: (4, ('1', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:59 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-12f8f839-2123-4ee8-83a1-8cff48fef99d tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 23:42:59 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-12f8f839-2123-4ee8-83a1-8cff48fef99d tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] SCSI volumes sdg have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 23:42:59 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f8f839-2123-4ee8-83a1-8cff48fef99d tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2')] {{(pid=75341) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 23:42:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:59 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-f8088b9d-354a-432d-96d0-5738c8897958 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Waiting for libvirt event about the detach of device tap71326c15-7e with device alias net1 from instance 163c448b-0183-41bb-b6e0-61917f6ad781 is timed out.
Nov 14 23:42:59 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-f8088b9d-354a-432d-96d0-5738c8897958 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:97:bb:6e"/><model type="virtio"/><mtu size="1442"/><target dev="tap71326c15-7e"/></interface> {{(pid=75341) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 23:42:59 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-f8088b9d-354a-432d-96d0-5738c8897958 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:97:bb:6e"/><model type="virtio"/><mtu size="1442"/><target dev="tap71326c15-7e"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 14 23:42:59 user nova-compute[75341]:   <name>instance-00000007</name>
Nov 14 23:42:59 user nova-compute[75341]:   <uuid>163c448b-0183-41bb-b6e0-61917f6ad781</uuid>
Nov 14 23:42:59 user nova-compute[75341]:   <metadata>
Nov 14 23:42:59 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 23:42:59 user nova-compute[75341]:   <nova:package version="0.0.0"/>
Nov 14 23:42:59 user nova-compute[75341]:   <nova:name>tempest-device-tagging-server-1560149904</nova:name>
Nov 14 23:42:59 user nova-compute[75341]:   <nova:creationTime>2023-11-14 23:42:07</nova:creationTime>
Nov 14 23:42:59 user nova-compute[75341]:   <nova:flavor name="m1.tiny">
Nov 14 23:42:59 user nova-compute[75341]:     <nova:memory>512</nova:memory>
Nov 14 23:42:59 user nova-compute[75341]:     <nova:disk>1</nova:disk>
Nov 14 23:42:59 user nova-compute[75341]:     <nova:swap>0</nova:swap>
Nov 14 23:42:59 user nova-compute[75341]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 23:42:59 user nova-compute[75341]:     <nova:vcpus>1</nova:vcpus>
Nov 14 23:42:59 user nova-compute[75341]:   </nova:flavor>
Nov 14 23:42:59 user nova-compute[75341]:   <nova:owner>
Nov 14 23:42:59 user nova-compute[75341]:     <nova:user uuid="48f384876a794dbfa3e7c89e6e20a232">tempest-TaggedAttachmentsTest-1943224082-project-member</nova:user>
Nov 14 23:42:59 user nova-compute[75341]:     <nova:project uuid="dc16bad01d434f7f9a66247f776d6269">tempest-TaggedAttachmentsTest-1943224082</nova:project>
Nov 14 23:42:59 user nova-compute[75341]:   </nova:owner>
Nov 14 23:42:59 user nova-compute[75341]:   <nova:root type="image" uuid="e46abb82-b810-490e-a8a1-ccdc5fa1a796"/>
Nov 14 23:42:59 user nova-compute[75341]:   <nova:ports>
Nov 14 23:42:59 user nova-compute[75341]:     <nova:port uuid="87b091a7-76a0-46e1-b1fd-fd305d1ce55e">
Nov 14 23:42:59 user nova-compute[75341]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 23:42:59 user nova-compute[75341]:     </nova:port>
Nov 14 23:42:59 user nova-compute[75341]:     <nova:port uuid="71326c15-7e6c-4b5c-88fb-5648e74f1754">
Nov 14 23:42:59 user nova-compute[75341]:       <nova:ip type="fixed" address="10.10.10.93" ipVersion="4"/>
Nov 14 23:42:59 user nova-compute[75341]:     </nova:port>
Nov 14 23:42:59 user nova-compute[75341]:   </nova:ports>
Nov 14 23:42:59 user nova-compute[75341]: </nova:instance>
Nov 14 23:42:59 user nova-compute[75341]:   </metadata>
Nov 14 23:42:59 user nova-compute[75341]:   <memory unit='KiB'>524288</memory>
Nov 14 23:42:59 user nova-compute[75341]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 14 23:42:59 user nova-compute[75341]:   <vcpu placement='static'>1</vcpu>
Nov 14 23:42:59 user nova-compute[75341]:   <resource>
Nov 14 23:42:59 user nova-compute[75341]:     <partition>/machine</partition>
Nov 14 23:42:59 user nova-compute[75341]:   </resource>
Nov 14 23:42:59 user nova-compute[75341]:   <sysinfo type='smbios'>
Nov 14 23:42:59 user nova-compute[75341]:     <system>
Nov 14 23:42:59 user nova-compute[75341]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 14 23:42:59 user nova-compute[75341]:       <entry name='product'>OpenStack Nova</entry>
Nov 14 23:42:59 user nova-compute[75341]:       <entry name='version'>0.0.0</entry>
Nov 14 23:42:59 user nova-compute[75341]:       <entry name='serial'>163c448b-0183-41bb-b6e0-61917f6ad781</entry>
Nov 14 23:42:59 user nova-compute[75341]:       <entry name='uuid'>163c448b-0183-41bb-b6e0-61917f6ad781</entry>
Nov 14 23:42:59 user nova-compute[75341]:       <entry name='family'>Virtual Machine</entry>
Nov 14 23:42:59 user nova-compute[75341]:     </system>
Nov 14 23:42:59 user nova-compute[75341]:   </sysinfo>
Nov 14 23:42:59 user nova-compute[75341]:   <os>
Nov 14 23:42:59 user nova-compute[75341]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 14 23:42:59 user nova-compute[75341]:     <boot dev='hd'/>
Nov 14 23:42:59 user nova-compute[75341]:     <smbios mode='sysinfo'/>
Nov 14 23:42:59 user nova-compute[75341]:   </os>
Nov 14 23:42:59 user nova-compute[75341]:   <features>
Nov 14 23:42:59 user nova-compute[75341]:     <acpi/>
Nov 14 23:42:59 user nova-compute[75341]:     <apic/>
Nov 14 23:42:59 user nova-compute[75341]:     <vmcoreinfo state='on'/>
Nov 14 23:42:59 user nova-compute[75341]:   </features>
Nov 14 23:42:59 user nova-compute[75341]:   <cpu mode='custom' match='exact' check='full'>
Nov 14 23:42:59 user nova-compute[75341]:     <model fallback='forbid'>Nehalem</model>
Nov 14 23:42:59 user nova-compute[75341]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 14 23:42:59 user nova-compute[75341]:     <feature policy='require' name='vme'/>
Nov 14 23:42:59 user nova-compute[75341]:     <feature policy='require' name='x2apic'/>
Nov 14 23:42:59 user nova-compute[75341]:     <feature policy='require' name='hypervisor'/>
Nov 14 23:42:59 user nova-compute[75341]:   </cpu>
Nov 14 23:42:59 user nova-compute[75341]:   <clock offset='utc'>
Nov 14 23:42:59 user nova-compute[75341]:     <timer name='pit' tickpolicy='delay'/>
Nov 14 23:42:59 user nova-compute[75341]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 14 23:42:59 user nova-compute[75341]:     <timer name='hpet' present='no'/>
Nov 14 23:42:59 user nova-compute[75341]:   </clock>
Nov 14 23:42:59 user nova-compute[75341]:   <on_poweroff>destroy</on_poweroff>
Nov 14 23:42:59 user nova-compute[75341]:   <on_reboot>restart</on_reboot>
Nov 14 23:42:59 user nova-compute[75341]:   <on_crash>destroy</on_crash>
Nov 14 23:42:59 user nova-compute[75341]:   <devices>
Nov 14 23:42:59 user nova-compute[75341]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 23:42:59 user nova-compute[75341]:     <disk type='file' device='disk'>
Nov 14 23:42:59 user nova-compute[75341]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 14 23:42:59 user nova-compute[75341]:       <source file='/opt/stack/data/nova/instances/163c448b-0183-41bb-b6e0-61917f6ad781/disk' index='2'/>
Nov 14 23:42:59 user nova-compute[75341]:       <backingStore type='file' index='3'>
Nov 14 23:42:59 user nova-compute[75341]:         <format type='raw'/>
Nov 14 23:42:59 user nova-compute[75341]:         <source file='/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740'/>
Nov 14 23:42:59 user nova-compute[75341]:         <backingStore/>
Nov 14 23:42:59 user nova-compute[75341]:       </backingStore>
Nov 14 23:42:59 user nova-compute[75341]:       <target dev='vda' bus='virtio'/>
Nov 14 23:42:59 user nova-compute[75341]:       <alias name='virtio-disk0'/>
Nov 14 23:42:59 user nova-compute[75341]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 14 23:42:59 user nova-compute[75341]:     </disk>
Nov 14 23:42:59 user nova-compute[75341]:     <disk type='file' device='cdrom'>
Nov 14 23:42:59 user nova-compute[75341]:       <driver name='qemu' type='raw' cache='none'/>
Nov 14 23:42:59 user nova-compute[75341]:       <source file='/opt/stack/data/nova/instances/163c448b-0183-41bb-b6e0-61917f6ad781/disk.config' index='1'/>
Nov 14 23:42:59 user nova-compute[75341]:       <backingStore/>
Nov 14 23:42:59 user nova-compute[75341]:       <target dev='hda' bus='ide'/>
Nov 14 23:42:59 user nova-compute[75341]:       <readonly/>
Nov 14 23:42:59 user nova-compute[75341]:       <alias name='ide0-0-0'/>
Nov 14 23:42:59 user nova-compute[75341]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 14 23:42:59 user nova-compute[75341]:     </disk>
Nov 14 23:42:59 user nova-compute[75341]:     <controller type='usb' index='0' model='none'>
Nov 14 23:42:59 user nova-compute[75341]:       <alias name='usb'/>
Nov 14 23:42:59 user nova-compute[75341]:     </controller>
Nov 14 23:42:59 user nova-compute[75341]:     <controller type='pci' index='0' model='pci-root'>
Nov 14 23:42:59 user nova-compute[75341]:       <alias name='pci.0'/>
Nov 14 23:42:59 user nova-compute[75341]:     </controller>
Nov 14 23:42:59 user nova-compute[75341]:     <controller type='ide' index='0'>
Nov 14 23:42:59 user nova-compute[75341]:       <alias name='ide'/>
Nov 14 23:42:59 user nova-compute[75341]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 14 23:42:59 user nova-compute[75341]:     </controller>
Nov 14 23:42:59 user nova-compute[75341]:     <interface type='ethernet'>
Nov 14 23:42:59 user nova-compute[75341]:       <mac address='fa:16:3e:2f:5b:cc'/>
Nov 14 23:42:59 user nova-compute[75341]:       <target dev='tap87b091a7-76'/>
Nov 14 23:42:59 user nova-compute[75341]:       <model type='virtio'/>
Nov 14 23:42:59 user nova-compute[75341]:       <mtu size='1442'/>
Nov 14 23:42:59 user nova-compute[75341]:       <alias name='net0'/>
Nov 14 23:42:59 user nova-compute[75341]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 14 23:42:59 user nova-compute[75341]:     </interface>
Nov 14 23:42:59 user nova-compute[75341]:     <serial type='pty'>
Nov 14 23:42:59 user nova-compute[75341]:       <source path='/dev/pts/7'/>
Nov 14 23:42:59 user nova-compute[75341]:       <log file='/opt/stack/data/nova/instances/163c448b-0183-41bb-b6e0-61917f6ad781/console.log' append='off'/>
Nov 14 23:42:59 user nova-compute[75341]:       <target type='isa-serial' port='0'>
Nov 14 23:42:59 user nova-compute[75341]:         <model name='isa-serial'/>
Nov 14 23:42:59 user nova-compute[75341]:       </target>
Nov 14 23:42:59 user nova-compute[75341]:       <alias name='serial0'/>
Nov 14 23:42:59 user nova-compute[75341]:     </serial>
Nov 14 23:42:59 user nova-compute[75341]:     <console type='pty' tty='/dev/pts/7'>
Nov 14 23:42:59 user nova-compute[75341]:       <source path='/dev/pts/7'/>
Nov 14 23:42:59 user nova-compute[75341]:       <log file='/opt/stack/data/nova/instances/163c448b-0183-41bb-b6e0-61917f6ad781/console.log' append='off'/>
Nov 14 23:42:59 user nova-compute[75341]:       <target type='serial' port='0'/>
Nov 14 23:42:59 user nova-compute[75341]:       <alias name='serial0'/>
Nov 14 23:42:59 user nova-compute[75341]:     </console>
Nov 14 23:42:59 user nova-compute[75341]:     <input type='mouse' bus='ps2'>
Nov 14 23:42:59 user nova-compute[75341]:       <alias name='input0'/>
Nov 14 23:42:59 user nova-compute[75341]:     </input>
Nov 14 23:42:59 user nova-compute[75341]:     <input type='keyboard' bus='ps2'>
Nov 14 23:42:59 user nova-compute[75341]:       <alias name='input1'/>
Nov 14 23:42:59 user nova-compute[75341]:     </input>
Nov 14 23:42:59 user nova-compute[75341]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 14 23:42:59 user nova-compute[75341]:       <listen type='address' address='0.0.0.0'/>
Nov 14 23:42:59 user nova-compute[75341]:     </graphics>
Nov 14 23:42:59 user nova-compute[75341]:     <audio id='1' type='none'/>
Nov 14 23:42:59 user nova-compute[75341]:     <video>
Nov 14 23:42:59 user nova-compute[75341]:       <model type='virtio' heads='1' primary='yes'/>
Nov 14 23:42:59 user nova-compute[75341]:       <alias name='video0'/>
Nov 14 23:42:59 user nova-compute[75341]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 14 23:42:59 user nova-compute[75341]:     </video>
Nov 14 23:42:59 user nova-compute[75341]:     <memballoon model='virtio'>
Nov 14 23:42:59 user nova-compute[75341]:       <stats period='10'/>
Nov 14 23:42:59 user nova-compute[75341]:       <alias name='balloon0'/>
Nov 14 23:42:59 user nova-compute[75341]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 14 23:42:59 user nova-compute[75341]:     </memballoon>
Nov 14 23:42:59 user nova-compute[75341]:     <rng model='virtio'>
Nov 14 23:42:59 user nova-compute[75341]:       <backend model='random'>/dev/urandom</backend>
Nov 14 23:42:59 user nova-compute[75341]:       <alias name='rng0'/>
Nov 14 23:42:59 user nova-compute[75341]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 14 23:42:59 user nova-compute[75341]:     </rng>
Nov 14 23:42:59 user nova-compute[75341]:   </devices>
Nov 14 23:42:59 user nova-compute[75341]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 14 23:42:59 user nova-compute[75341]:     <label>libvirt-163c448b-0183-41bb-b6e0-61917f6ad781</label>
Nov 14 23:42:59 user nova-compute[75341]:     <imagelabel>libvirt-163c448b-0183-41bb-b6e0-61917f6ad781</imagelabel>
Nov 14 23:42:59 user nova-compute[75341]:   </seclabel>
Nov 14 23:42:59 user nova-compute[75341]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 14 23:42:59 user nova-compute[75341]:     <label>+64055:+108</label>
Nov 14 23:42:59 user nova-compute[75341]:     <imagelabel>+64055:+108</imagelabel>
Nov 14 23:42:59 user nova-compute[75341]:   </seclabel>
Nov 14 23:42:59 user nova-compute[75341]: </domain>
Nov 14 23:42:59 user nova-compute[75341]:  {{(pid=75341) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 14 23:42:59 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-f8088b9d-354a-432d-96d0-5738c8897958 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Successfully detached device tap71326c15-7e from instance 163c448b-0183-41bb-b6e0-61917f6ad781 from the live domain config.
Nov 14 23:42:59 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-f8088b9d-354a-432d-96d0-5738c8897958 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T23:40:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1560149904',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1560149904',id=7,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQ3a1x+okDjRVw62hbKhJtP80/zWFyvtGey5wIlVDB0NZ56fG+725fWUXyjh7/+IE35PijjUBR8Wcuw/LlwusTfjzX4MaOP3PLObnIQMoEItEWkt+BvyX7BQ255w2h2Gw==',key_name='tempest-keypair-1289222933',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:40:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dc16bad01d434f7f9a66247f776d6269',ramdisk_id='',reservation_id='r-3r4vupg5',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1943224082',owner_user_name='tempest-TaggedAttachmentsTest-1943224082-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:40:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48f384876a794dbfa3e7c89e6e20a232',uuid=163c448b-0183-41bb-b6e0-61917f6ad781,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "71326c15-7e6c-4b5c-88fb-5648e74f1754", "address": "fa:16:3e:97:bb:6e", "network": {"id": "a2d4fa10-64dc-4465-ba21-2b01b0583a67", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-671649606", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "dc16bad01d434f7f9a66247f776d6269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71326c15-7e", "ovs_interfaceid": "71326c15-7e6c-4b5c-88fb-5648e74f1754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 23:42:59 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-f8088b9d-354a-432d-96d0-5738c8897958 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Converting VIF {"id": "71326c15-7e6c-4b5c-88fb-5648e74f1754", "address": "fa:16:3e:97:bb:6e", "network": {"id": "a2d4fa10-64dc-4465-ba21-2b01b0583a67", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-671649606", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "dc16bad01d434f7f9a66247f776d6269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71326c15-7e", "ovs_interfaceid": "71326c15-7e6c-4b5c-88fb-5648e74f1754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:42:59 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-f8088b9d-354a-432d-96d0-5738c8897958 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:bb:6e,bridge_name='br-int',has_traffic_filtering=True,id=71326c15-7e6c-4b5c-88fb-5648e74f1754,network=Network(a2d4fa10-64dc-4465-ba21-2b01b0583a67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71326c15-7e') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:42:59 user nova-compute[75341]: DEBUG os_vif [None req-f8088b9d-354a-432d-96d0-5738c8897958 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:bb:6e,bridge_name='br-int',has_traffic_filtering=True,id=71326c15-7e6c-4b5c-88fb-5648e74f1754,network=Network(a2d4fa10-64dc-4465-ba21-2b01b0583a67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71326c15-7e') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 23:42:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:59 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc17a64-7025-4a94-a9aa-2ddb6e6a32cd]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:59 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f8f839-2123-4ee8-83a1-8cff48fef99d tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:59 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:59 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap71326c15-7e, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:42:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 -p 172.16.0.220:3260 --logout {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:59 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:59 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:42:59 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:59 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=617b4755-0098-497b-8bb2-6db755bc74ad) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:42:59 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:59 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:42:59 user nova-compute[75341]: INFO os_vif [None req-f8088b9d-354a-432d-96d0-5738c8897958 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:bb:6e,bridge_name='br-int',has_traffic_filtering=True,id=71326c15-7e6c-4b5c-88fb-5648e74f1754,network=Network(a2d4fa10-64dc-4465-ba21-2b01b0583a67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71326c15-7e')
Nov 14 23:42:59 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-f8088b9d-354a-432d-96d0-5738c8897958 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 23:42:59 user nova-compute[75341]:   <nova:package version="0.0.0"/>
Nov 14 23:42:59 user nova-compute[75341]:   <nova:name>tempest-device-tagging-server-1560149904</nova:name>
Nov 14 23:42:59 user nova-compute[75341]:   <nova:creationTime>2023-11-14 23:42:59</nova:creationTime>
Nov 14 23:42:59 user nova-compute[75341]:   <nova:flavor name="m1.tiny">
Nov 14 23:42:59 user nova-compute[75341]:     <nova:memory>512</nova:memory>
Nov 14 23:42:59 user nova-compute[75341]:     <nova:disk>1</nova:disk>
Nov 14 23:42:59 user nova-compute[75341]:     <nova:swap>0</nova:swap>
Nov 14 23:42:59 user nova-compute[75341]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 23:42:59 user nova-compute[75341]:     <nova:vcpus>1</nova:vcpus>
Nov 14 23:42:59 user nova-compute[75341]:   </nova:flavor>
Nov 14 23:42:59 user nova-compute[75341]:   <nova:owner>
Nov 14 23:42:59 user nova-compute[75341]:     <nova:user uuid="48f384876a794dbfa3e7c89e6e20a232">tempest-TaggedAttachmentsTest-1943224082-project-member</nova:user>
Nov 14 23:42:59 user nova-compute[75341]:     <nova:project uuid="dc16bad01d434f7f9a66247f776d6269">tempest-TaggedAttachmentsTest-1943224082</nova:project>
Nov 14 23:42:59 user nova-compute[75341]:   </nova:owner>
Nov 14 23:42:59 user nova-compute[75341]:   <nova:root type="image" uuid="e46abb82-b810-490e-a8a1-ccdc5fa1a796"/>
Nov 14 23:42:59 user nova-compute[75341]:   <nova:ports>
Nov 14 23:42:59 user nova-compute[75341]:     <nova:port uuid="87b091a7-76a0-46e1-b1fd-fd305d1ce55e">
Nov 14 23:42:59 user nova-compute[75341]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 23:42:59 user nova-compute[75341]:     </nova:port>
Nov 14 23:42:59 user nova-compute[75341]:   </nova:ports>
Nov 14 23:42:59 user nova-compute[75341]: </nova:instance>
Nov 14 23:42:59 user nova-compute[75341]:  {{(pid=75341) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 14 23:42:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:59 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4cd7096-759a-4363-91f0-8bfe251000d8]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:59 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f8f839-2123-4ee8-83a1-8cff48fef99d tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2, portal: 172.16.0.220,3260]
Nov 14 23:42:59 user nova-compute[75341]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2, portal: 172.16.0.220,3260] successful.
Nov 14 23:42:59 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 -p 172.16.0.220:3260 --op delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:42:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0df8b689-2583-4be4-8499-cc2e54889ac2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:42:59 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a27e07f-8727-43e7-9d2f-368dc7726b2f]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:42:59 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f8f839-2123-4ee8-83a1-8cff48fef99d tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:42:59 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-12f8f839-2123-4ee8-83a1-8cff48fef99d tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:42:59 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f8f839-2123-4ee8-83a1-8cff48fef99d tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] <== disconnect_volume: return (307ms) None {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:42:59 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12f8f839-2123-4ee8-83a1-8cff48fef99d tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Disconnected iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 23:42:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f8088b9d-354a-432d-96d0-5738c8897958 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Acquiring lock "refresh_cache-163c448b-0183-41bb-b6e0-61917f6ad781" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:42:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f8088b9d-354a-432d-96d0-5738c8897958 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Acquired lock "refresh_cache-163c448b-0183-41bb-b6e0-61917f6ad781" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:42:59 user nova-compute[75341]: DEBUG nova.network.neutron [None req-f8088b9d-354a-432d-96d0-5738c8897958 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 23:43:00 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c981d88b-7242-4e04-8368-14371fe46aac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Acquiring lock "44080c0d-56eb-4987-aa4b-59f161dcbc0b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:43:00 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c981d88b-7242-4e04-8368-14371fe46aac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Lock "44080c0d-56eb-4987-aa4b-59f161dcbc0b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:43:00 user nova-compute[75341]: DEBUG nova.objects.instance [None req-c981d88b-7242-4e04-8368-14371fe46aac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Lazy-loading 'flavor' on Instance uuid 44080c0d-56eb-4987-aa4b-59f161dcbc0b {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:43:00 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c981d88b-7242-4e04-8368-14371fe46aac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Lock "44080c0d-56eb-4987-aa4b-59f161dcbc0b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:43:00 user nova-compute[75341]: INFO nova.network.neutron [None req-f8088b9d-354a-432d-96d0-5738c8897958 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Port 71326c15-7e6c-4b5c-88fb-5648e74f1754 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Nov 14 23:43:00 user nova-compute[75341]: DEBUG nova.network.neutron [None req-f8088b9d-354a-432d-96d0-5738c8897958 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Updating instance_info_cache with network_info: [{"id": "87b091a7-76a0-46e1-b1fd-fd305d1ce55e", "address": "fa:16:3e:2f:5b:cc", "network": {"id": "0a21b45e-de67-426a-bc33-c012fb2b5528", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1524380697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc16bad01d434f7f9a66247f776d6269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87b091a7-76", "ovs_interfaceid": "87b091a7-76a0-46e1-b1fd-fd305d1ce55e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:43:00 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f8088b9d-354a-432d-96d0-5738c8897958 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Releasing lock "refresh_cache-163c448b-0183-41bb-b6e0-61917f6ad781" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:43:00 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f8088b9d-354a-432d-96d0-5738c8897958 tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Lock "interface-163c448b-0183-41bb-b6e0-61917f6ad781-71326c15-7e6c-4b5c-88fb-5648e74f1754" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.335s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:43:00 user nova-compute[75341]: DEBUG nova.objects.instance [None req-12f8f839-2123-4ee8-83a1-8cff48fef99d tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Lazy-loading 'flavor' on Instance uuid 0e7a53e9-6982-4c93-a830-a49cf0ce76bd {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:43:00 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-12f8f839-2123-4ee8-83a1-8cff48fef99d tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Lock "0e7a53e9-6982-4c93-a830-a49cf0ce76bd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.896s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:43:00 user nova-compute[75341]: DEBUG nova.compute.manager [req-cc371214-fac9-4601-a5bc-092601a0d3d8 req-95545637-e622-430d-8cdc-c30deb37dcf4 service nova] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Received event network-vif-deleted-71326c15-7e6c-4b5c-88fb-5648e74f1754 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:43:00 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c981d88b-7242-4e04-8368-14371fe46aac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Acquiring lock "44080c0d-56eb-4987-aa4b-59f161dcbc0b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:43:00 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c981d88b-7242-4e04-8368-14371fe46aac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Lock "44080c0d-56eb-4987-aa4b-59f161dcbc0b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:43:00 user nova-compute[75341]: INFO nova.compute.manager [None req-c981d88b-7242-4e04-8368-14371fe46aac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Attaching volume 2c5ff4fb-63c7-46c8-bfd2-d373ba3e0695 to /dev/vdc
Nov 14 23:43:00 user nova-compute[75341]: DEBUG os_brick.utils [None req-c981d88b-7242-4e04-8368-14371fe46aac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:43:00 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:00 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:00 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[edfccf66-257d-4e17-aa16-60d8e5252e43]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6d1cfca09c9\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:00 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:00 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:00 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[09750b59-ec06-43e7-a42c-fb6caf7eebd6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:00 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:00 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:00 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3befd87-7e28-4773-a23a-dbc6198aef87]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:00 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[893d1b61-a2ea-4be2-ac59-310eefca7acc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:00 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-c981d88b-7242-4e04-8368-14371fe46aac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Running cmd (subprocess): nvme version {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:00 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-c981d88b-7242-4e04-8368-14371fe46aac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] 'nvme version' failed. Not Retrying. {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:43:00 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c981d88b-7242-4e04-8368-14371fe46aac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] nvme not present on system {{(pid=75341) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 23:43:00 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:00 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:43:00 user nova-compute[75341]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 23:43:00 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c5300f-3a2b-4779-b145-760d9a0bd947]: (4, '') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:00 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-c981d88b-7242-4e04-8368-14371fe46aac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75341) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 23:43:00 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-c981d88b-7242-4e04-8368-14371fe46aac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 23:43:00 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-c981d88b-7242-4e04-8368-14371fe46aac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] LIGHTOS: no hostnqn found. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 23:43:00 user nova-compute[75341]: DEBUG os_brick.utils [None req-c981d88b-7242-4e04-8368-14371fe46aac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6d1cfca09c9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:43:00 user nova-compute[75341]: DEBUG nova.virt.block_device [None req-c981d88b-7242-4e04-8368-14371fe46aac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Updating existing volume attachment record: 9da57443-26e0-46fc-93e8-af31cab9dfbe {{(pid=75341) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 23:43:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Acquiring lock "3c73d0da-fea9-4098-a0e8-c070f22969f4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Lock "3c73d0da-fea9-4098-a0e8-c070f22969f4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG nova.compute.manager [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: 3c73d0da-fea9-4098-a0e8-c070f22969f4] Starting instance... {{(pid=75341) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG nova.compute.manager [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Start spawning the instance on the hypervisor. {{(pid=75341) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Creating instance directory {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 23:43:02 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Creating image(s)
Nov 14 23:43:02 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Did not create local disks {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Ensure instance console log exists: /opt/stack/data/nova/instances/cffc86d5-2ac6-4dd1-bdcd-5832c134d179/console.log {{(pid=75341) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Start _get_guest_xml network_info=[{"id": "cdc268e0-0a9a-44cf-87ef-0baca1547f68", "address": "fa:16:3e:10:94:5a", "network": {"id": "c832523e-13e4-44da-9e4b-a4f3e5a276fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1155631271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e4a2efc0fc47a482755f1c375aff46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdc268e0-0a", "ovs_interfaceid": "cdc268e0-0a9a-44cf-87ef-0baca1547f68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '949dadf6-7fad-4c36-b725-b54bca688bd0', 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cDKCeEGM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cffc86d5-2ac6-4dd1-bdcd-5832c134d179', 'attached_at': '', 'detached_at': '', 'volume_id': 'b7af2f07-212b-4210-b473-6e1da973682c', 'serial': 'b7af2f07-212b-4210-b473-6e1da973682c'}, 'delete_on_termination': True, 'volume_type': None} {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75341) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 23:43:02 user nova-compute[75341]: INFO nova.compute.claims [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: 3c73d0da-fea9-4098-a0e8-c070f22969f4] Claim successful on node user
Nov 14 23:43:02 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:43:02 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:43:02 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Calling os-brick to attach iSCSI Volume {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cDKCeEGM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:43:02 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:43:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:43:02 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:43:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:43:02 user nova-compute[75341]: INFO os_brick.initiator.connectors.iscsi [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 23:43:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c -p 172.16.0.220:3260 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[1047fddb-872a-4aaf-8b06-11e38b1ceddd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 23:43:02 user nova-compute[75341]:  {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c -p 172.16.0.220:3260 --interface default --op new {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[176a834a-aaa5-4eb8-9671-16fa1a4a6743]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c] added\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c] added
Nov 14 23:43:02 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f76f5e-c5cc-4d07-82ac-445d0d6d9621]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[018f8c57-2b95-4d84-8c53-06bdb7a3bcb2]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cDKCeEGM {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cDKCeEGM" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c8e1d8-e574-4057-b929-b3dc9c622a50]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cDKCeEGM'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ae7391-c221-404a-a629-bac0e937fada]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[13061bed-dfdf-4ab9-9673-4b5865feb917]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 (non-flash)
Nov 14 23:43:02 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:43:02 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 (non-flash)
Nov 14 23:43:02 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:43:02 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c -p 172.16.0.220:3260 --login {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e7927e-8595-4b6d-a0a1-28d45d940c79]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c, portal: 172.16.0.220,3260]
Nov 14 23:43:02 user nova-compute[75341]: Login to [iface: default, target: iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c, portal: 172.16.0.220,3260] successful.
Nov 14 23:43:02 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8adf98-ceca-4362-9ba7-05957fcf3c2d]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67774c4-ad8e-4213-9faf-c559ae102b1f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 (non-flash)
Nov 14 23:43:02 user nova-compute[75341]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)
Nov 14 23:43:02 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:43:02 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 (non-flash)
Nov 14 23:43:02 user nova-compute[75341]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)
Nov 14 23:43:02 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:43:02 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Connected to 172.16.0.220:3260 {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] HCTL ('34', '-', '-', 0) found on session 15 with lun 0 {{(pid=75341) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75341) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0d355d-892e-4a3e-96cd-ea623c341c4f]: (4, ('- - 0', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: None {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.455s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG nova.compute.manager [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: 3c73d0da-fea9-4098-a0e8-c070f22969f4] Start building networks asynchronously for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG nova.compute.manager [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: 3c73d0da-fea9-4098-a0e8-c070f22969f4] Allocating IP information in the background. {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG nova.network.neutron [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: 3c73d0da-fea9-4098-a0e8-c070f22969f4] allocate_for_instance() {{(pid=75341) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 23:43:02 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: 3c73d0da-fea9-4098-a0e8-c070f22969f4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 23:43:02 user nova-compute[75341]: DEBUG nova.compute.manager [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: 3c73d0da-fea9-4098-a0e8-c070f22969f4] Start building block device mappings for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG nova.policy [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7cc85fb2b1a141578ba9558bc79ccc02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c8a897400c74100ad6c115397bc84ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75341) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG nova.compute.manager [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: 3c73d0da-fea9-4098-a0e8-c070f22969f4] Start spawning the instance on the hypervisor. {{(pid=75341) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: 3c73d0da-fea9-4098-a0e8-c070f22969f4] Creating instance directory {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 23:43:02 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: 3c73d0da-fea9-4098-a0e8-c070f22969f4] Creating image(s)
Nov 14 23:43:02 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Acquiring lock "/opt/stack/data/nova/instances/3c73d0da-fea9-4098-a0e8-c070f22969f4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Lock "/opt/stack/data/nova/instances/3c73d0da-fea9-4098-a0e8-c070f22969f4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Lock "/opt/stack/data/nova/instances/3c73d0da-fea9-4098-a0e8-c070f22969f4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:43:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.193s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Acquiring lock "4754efee9a6d73d3647f2add2cfe86c291949740" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:43:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:43:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.183s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/3c73d0da-fea9-4098-a0e8-c070f22969f4/disk 1073741824 {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/3c73d0da-fea9-4098-a0e8-c070f22969f4/disk 1073741824" returned: 0 in 0.051s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:43:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:03 user nova-compute[75341]: DEBUG nova.network.neutron [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: 3c73d0da-fea9-4098-a0e8-c070f22969f4] Successfully created port: 2d5bc584-626d-49ee-874b-2d5028226ba1 {{(pid=75341) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 23:43:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.183s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:03 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3c73d0da-fea9-4098-a0e8-c070f22969f4/disk. size=1073741824 {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 23:43:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c73d0da-fea9-4098-a0e8-c070f22969f4/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:03 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 23:43:03 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cDKCeEGM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 23:43:03 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:43:03 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '23633656130666432', 'path': '/dev/sdc'} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:43:03 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23633656130666432', 'path': '/dev/sdc'} {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 23:43:03 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:42:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1214898251',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1214898251',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC6p7TTrcora+tA8J6m0Z8kOp9lfGZbeJCVFa4lV20FoOtQs2zaUuehWyGMh3Ev7R8XPb9IKUQhdgHH/8HhowDTVW2MDgUCdP9iYWVYcDyU1L7qQlvAFOYXZMtN51fblTQ==',key_name='tempest-keypair-849876031',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7e4a2efc0fc47a482755f1c375aff46',ramdisk_id='',reservation_id='r-p3kv7sbi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-863325357',owner_user_name='tempest-ServerActionsV293TestJSON-863325357-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:42:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2440829d0b0e4d4d8f8266c4e8162223',uuid=cffc86d5-2ac6-4dd1-bdcd-5832c134d179,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cdc268e0-0a9a-44cf-87ef-0baca1547f68", "address": "fa:16:3e:10:94:5a", "network": {"id": "c832523e-13e4-44da-9e4b-a4f3e5a276fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1155631271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e4a2efc0fc47a482755f1c375aff46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdc268e0-0a", "ovs_interfaceid": "cdc268e0-0a9a-44cf-87ef-0baca1547f68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:43:03 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Converting VIF {"id": "cdc268e0-0a9a-44cf-87ef-0baca1547f68", "address": "fa:16:3e:10:94:5a", "network": {"id": "c832523e-13e4-44da-9e4b-a4f3e5a276fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1155631271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e4a2efc0fc47a482755f1c375aff46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdc268e0-0a", "ovs_interfaceid": "cdc268e0-0a9a-44cf-87ef-0baca1547f68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:43:03 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:94:5a,bridge_name='br-int',has_traffic_filtering=True,id=cdc268e0-0a9a-44cf-87ef-0baca1547f68,network=Network(c832523e-13e4-44da-9e4b-a4f3e5a276fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdc268e0-0a') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:43:03 user nova-compute[75341]: DEBUG nova.objects.instance [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Lazy-loading 'pci_devices' on Instance uuid cffc86d5-2ac6-4dd1-bdcd-5832c134d179 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:43:03 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] End _get_guest_xml xml=<domain type="kvm">
Nov 14 23:43:03 user nova-compute[75341]:   <uuid>cffc86d5-2ac6-4dd1-bdcd-5832c134d179</uuid>
Nov 14 23:43:03 user nova-compute[75341]:   <name>instance-0000000d</name>
Nov 14 23:43:03 user nova-compute[75341]:   <memory>524288</memory>
Nov 14 23:43:03 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 14 23:43:03 user nova-compute[75341]:   <metadata>
Nov 14 23:43:03 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 23:43:03 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 14 23:43:03 user nova-compute[75341]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1214898251</nova:name>
Nov 14 23:43:03 user nova-compute[75341]:       <nova:creationTime>2023-11-14 23:43:02</nova:creationTime>
Nov 14 23:43:03 user nova-compute[75341]:       <nova:flavor name="m1.tiny">
Nov 14 23:43:03 user nova-compute[75341]:         <nova:memory>512</nova:memory>
Nov 14 23:43:03 user nova-compute[75341]:         <nova:disk>1</nova:disk>
Nov 14 23:43:03 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 14 23:43:03 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 23:43:03 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 14 23:43:03 user nova-compute[75341]:       </nova:flavor>
Nov 14 23:43:03 user nova-compute[75341]:       <nova:owner>
Nov 14 23:43:03 user nova-compute[75341]:         <nova:user uuid="2440829d0b0e4d4d8f8266c4e8162223">tempest-ServerActionsV293TestJSON-863325357-project-member</nova:user>
Nov 14 23:43:03 user nova-compute[75341]:         <nova:project uuid="b7e4a2efc0fc47a482755f1c375aff46">tempest-ServerActionsV293TestJSON-863325357</nova:project>
Nov 14 23:43:03 user nova-compute[75341]:       </nova:owner>
Nov 14 23:43:03 user nova-compute[75341]:       <nova:ports>
Nov 14 23:43:03 user nova-compute[75341]:         <nova:port uuid="cdc268e0-0a9a-44cf-87ef-0baca1547f68">
Nov 14 23:43:03 user nova-compute[75341]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 23:43:03 user nova-compute[75341]:         </nova:port>
Nov 14 23:43:03 user nova-compute[75341]:       </nova:ports>
Nov 14 23:43:03 user nova-compute[75341]:     </nova:instance>
Nov 14 23:43:03 user nova-compute[75341]:   </metadata>
Nov 14 23:43:03 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 14 23:43:03 user nova-compute[75341]:     <system>
Nov 14 23:43:03 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 23:43:03 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 14 23:43:03 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 14 23:43:03 user nova-compute[75341]:       <entry name="serial">cffc86d5-2ac6-4dd1-bdcd-5832c134d179</entry>
Nov 14 23:43:03 user nova-compute[75341]:       <entry name="uuid">cffc86d5-2ac6-4dd1-bdcd-5832c134d179</entry>
Nov 14 23:43:03 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 14 23:43:03 user nova-compute[75341]:     </system>
Nov 14 23:43:03 user nova-compute[75341]:   </sysinfo>
Nov 14 23:43:03 user nova-compute[75341]:   <os>
Nov 14 23:43:03 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 23:43:03 user nova-compute[75341]:     <boot dev="hd"/>
Nov 14 23:43:03 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 14 23:43:03 user nova-compute[75341]:   </os>
Nov 14 23:43:03 user nova-compute[75341]:   <features>
Nov 14 23:43:03 user nova-compute[75341]:     <acpi/>
Nov 14 23:43:03 user nova-compute[75341]:     <apic/>
Nov 14 23:43:03 user nova-compute[75341]:     <vmcoreinfo/>
Nov 14 23:43:03 user nova-compute[75341]:   </features>
Nov 14 23:43:03 user nova-compute[75341]:   <clock offset="utc">
Nov 14 23:43:03 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 23:43:03 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 23:43:03 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 14 23:43:03 user nova-compute[75341]:   </clock>
Nov 14 23:43:03 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 14 23:43:03 user nova-compute[75341]:     <model>Nehalem</model>
Nov 14 23:43:03 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 23:43:03 user nova-compute[75341]:   </cpu>
Nov 14 23:43:03 user nova-compute[75341]:   <devices>
Nov 14 23:43:03 user nova-compute[75341]:     <disk type="block" device="disk">
Nov 14 23:43:03 user nova-compute[75341]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:43:03 user nova-compute[75341]:       <source dev="/dev/sdc"/>
Nov 14 23:43:03 user nova-compute[75341]:       <target dev="vda" bus="virtio"/>
Nov 14 23:43:03 user nova-compute[75341]:       <serial>b7af2f07-212b-4210-b473-6e1da973682c</serial>
Nov 14 23:43:03 user nova-compute[75341]:     </disk>
Nov 14 23:43:03 user nova-compute[75341]:     <interface type="ethernet">
Nov 14 23:43:03 user nova-compute[75341]:       <mac address="fa:16:3e:10:94:5a"/>
Nov 14 23:43:03 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:43:03 user nova-compute[75341]:       <mtu size="1442"/>
Nov 14 23:43:03 user nova-compute[75341]:       <target dev="tapcdc268e0-0a"/>
Nov 14 23:43:03 user nova-compute[75341]:     </interface>
Nov 14 23:43:03 user nova-compute[75341]:     <serial type="pty">
Nov 14 23:43:03 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/cffc86d5-2ac6-4dd1-bdcd-5832c134d179/console.log" append="off"/>
Nov 14 23:43:03 user nova-compute[75341]:     </serial>
Nov 14 23:43:03 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 23:43:03 user nova-compute[75341]:     <video>
Nov 14 23:43:03 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:43:03 user nova-compute[75341]:     </video>
Nov 14 23:43:03 user nova-compute[75341]:     <rng model="virtio">
Nov 14 23:43:03 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 14 23:43:03 user nova-compute[75341]:     </rng>
Nov 14 23:43:03 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 14 23:43:03 user nova-compute[75341]:     <memballoon model="virtio">
Nov 14 23:43:03 user nova-compute[75341]:       <stats period="10"/>
Nov 14 23:43:03 user nova-compute[75341]:     </memballoon>
Nov 14 23:43:03 user nova-compute[75341]:   </devices>
Nov 14 23:43:03 user nova-compute[75341]: </domain>
Nov 14 23:43:03 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 23:43:03 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:42:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1214898251',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1214898251',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC6p7TTrcora+tA8J6m0Z8kOp9lfGZbeJCVFa4lV20FoOtQs2zaUuehWyGMh3Ev7R8XPb9IKUQhdgHH/8HhowDTVW2MDgUCdP9iYWVYcDyU1L7qQlvAFOYXZMtN51fblTQ==',key_name='tempest-keypair-849876031',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7e4a2efc0fc47a482755f1c375aff46',ramdisk_id='',reservation_id='r-p3kv7sbi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-863325357',owner_user_name='tempest-ServerActionsV293TestJSON-863325357-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:42:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2440829d0b0e4d4d8f8266c4e8162223',uuid=cffc86d5-2ac6-4dd1-bdcd-5832c134d179,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cdc268e0-0a9a-44cf-87ef-0baca1547f68", "address": "fa:16:3e:10:94:5a", "network": {"id": "c832523e-13e4-44da-9e4b-a4f3e5a276fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1155631271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e4a2efc0fc47a482755f1c375aff46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdc268e0-0a", "ovs_interfaceid": "cdc268e0-0a9a-44cf-87ef-0baca1547f68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 23:43:03 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Converting VIF {"id": "cdc268e0-0a9a-44cf-87ef-0baca1547f68", "address": "fa:16:3e:10:94:5a", "network": {"id": "c832523e-13e4-44da-9e4b-a4f3e5a276fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1155631271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e4a2efc0fc47a482755f1c375aff46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdc268e0-0a", "ovs_interfaceid": "cdc268e0-0a9a-44cf-87ef-0baca1547f68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:43:03 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:94:5a,bridge_name='br-int',has_traffic_filtering=True,id=cdc268e0-0a9a-44cf-87ef-0baca1547f68,network=Network(c832523e-13e4-44da-9e4b-a4f3e5a276fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdc268e0-0a') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:43:03 user nova-compute[75341]: DEBUG os_vif [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:94:5a,bridge_name='br-int',has_traffic_filtering=True,id=cdc268e0-0a9a-44cf-87ef-0baca1547f68,network=Network(c832523e-13e4-44da-9e4b-a4f3e5a276fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdc268e0-0a') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 23:43:03 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:03 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:43:03 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 23:43:03 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:03 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '52f36119-cd31-51b1-92b3-c2a155c13111', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:43:03 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:03 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:43:03 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:03 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcdc268e0-0a, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:43:03 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcdc268e0-0a, col_values=(('qos', UUID('b3af2308-d92b-48f7-87ca-d7efe0f263ab')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:43:03 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcdc268e0-0a, col_values=(('external_ids', {'iface-id': 'cdc268e0-0a9a-44cf-87ef-0baca1547f68', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:94:5a', 'vm-uuid': 'cffc86d5-2ac6-4dd1-bdcd-5832c134d179'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:43:03 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:03 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:43:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c73d0da-fea9-4098-a0e8-c070f22969f4/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:03 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Cannot resize image /opt/stack/data/nova/instances/3c73d0da-fea9-4098-a0e8-c070f22969f4/disk to a smaller size. {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 23:43:03 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: 3c73d0da-fea9-4098-a0e8-c070f22969f4] Created local disks {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 23:43:03 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: 3c73d0da-fea9-4098-a0e8-c070f22969f4] Ensure instance console log exists: /opt/stack/data/nova/instances/3c73d0da-fea9-4098-a0e8-c070f22969f4/console.log {{(pid=75341) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 23:43:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:43:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:43:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:43:03 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:03 user nova-compute[75341]: INFO os_vif [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:94:5a,bridge_name='br-int',has_traffic_filtering=True,id=cdc268e0-0a9a-44cf-87ef-0baca1547f68,network=Network(c832523e-13e4-44da-9e4b-a4f3e5a276fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdc268e0-0a')
Nov 14 23:43:03 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:43:03 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] No VIF found with MAC fa:16:3e:10:94:5a, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:43:03 user nova-compute[75341]: DEBUG nova.network.neutron [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: 3c73d0da-fea9-4098-a0e8-c070f22969f4] Successfully updated port: 2d5bc584-626d-49ee-874b-2d5028226ba1 {{(pid=75341) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 23:43:04 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Acquiring lock "refresh_cache-3c73d0da-fea9-4098-a0e8-c070f22969f4" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:43:04 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Acquired lock "refresh_cache-3c73d0da-fea9-4098-a0e8-c070f22969f4" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:43:04 user nova-compute[75341]: DEBUG nova.network.neutron [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: 3c73d0da-fea9-4098-a0e8-c070f22969f4] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 23:43:04 user nova-compute[75341]: DEBUG nova.compute.manager [req-bda853e3-320a-4053-81b9-5184934492e6 req-01cedf5c-c79a-4a50-a17c-10917bdc5a90 service nova] [instance: 3c73d0da-fea9-4098-a0e8-c070f22969f4] Received event network-changed-2d5bc584-626d-49ee-874b-2d5028226ba1 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:43:04 user nova-compute[75341]: DEBUG nova.compute.manager [req-bda853e3-320a-4053-81b9-5184934492e6 req-01cedf5c-c79a-4a50-a17c-10917bdc5a90 service nova] [instance: 3c73d0da-fea9-4098-a0e8-c070f22969f4] Refreshing instance network info cache due to event network-changed-2d5bc584-626d-49ee-874b-2d5028226ba1. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:43:04 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-bda853e3-320a-4053-81b9-5184934492e6 req-01cedf5c-c79a-4a50-a17c-10917bdc5a90 service nova] Acquiring lock "refresh_cache-3c73d0da-fea9-4098-a0e8-c070f22969f4" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:43:04 user nova-compute[75341]: DEBUG nova.network.neutron [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: 3c73d0da-fea9-4098-a0e8-c070f22969f4] Instance cache missing network info. {{(pid=75341) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 23:43:04 user nova-compute[75341]: DEBUG nova.network.neutron [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: 3c73d0da-fea9-4098-a0e8-c070f22969f4] Updating instance_info_cache with network_info: [{"id": "2d5bc584-626d-49ee-874b-2d5028226ba1", "address": "fa:16:3e:b8:ab:7b", "network": {"id": "a59b651e-81c5-4a68-b694-1e84de25e915", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1023462603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8a897400c74100ad6c115397bc84ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d5bc584-62", "ovs_interfaceid": "2d5bc584-626d-49ee-874b-2d5028226ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:43:04 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Releasing lock "refresh_cache-3c73d0da-fea9-4098-a0e8-c070f22969f4" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:43:04 user nova-compute[75341]: DEBUG nova.compute.manager [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: 3c73d0da-fea9-4098-a0e8-c070f22969f4] Instance network_info: |[{"id": "2d5bc584-626d-49ee-874b-2d5028226ba1", "address": "fa:16:3e:b8:ab:7b", "network": {"id": "a59b651e-81c5-4a68-b694-1e84de25e915", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1023462603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8a897400c74100ad6c115397bc84ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d5bc584-62", "ovs_interfaceid": "2d5bc584-626d-49ee-874b-2d5028226ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 23:43:04 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-bda853e3-320a-4053-81b9-5184934492e6 req-01cedf5c-c79a-4a50-a17c-10917bdc5a90 service nova] Acquired lock "refresh_cache-3c73d0da-fea9-4098-a0e8-c070f22969f4" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:43:04 user nova-compute[75341]: DEBUG nova.network.neutron [req-bda853e3-320a-4053-81b9-5184934492e6 req-01cedf5c-c79a-4a50-a17c-10917bdc5a90 service nova] [instance: 3c73d0da-fea9-4098-a0e8-c070f22969f4] Refreshing network info cache for port 2d5bc584-626d-49ee-874b-2d5028226ba1 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:43:04 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: 3c73d0da-fea9-4098-a0e8-c070f22969f4] Start _get_guest_xml network_info=[{"id": "2d5bc584-626d-49ee-874b-2d5028226ba1", "address": "fa:16:3e:b8:ab:7b", "network": {"id": "a59b651e-81c5-4a68-b694-1e84de25e915", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1023462603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8a897400c74100ad6c115397bc84ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d5bc584-62", "ovs_interfaceid": "2d5bc584-626d-49ee-874b-2d5028226ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encrypted': False, 'image_id': 'e46abb82-b810-490e-a8a1-ccdc5fa1a796'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 23:43:04 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:43:04 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:43:04 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 23:43:04 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 23:43:04 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 23:43:04 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 23:43:04 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 23:43:04 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 23:43:04 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 23:43:04 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 23:43:04 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 23:43:04 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 23:43:04 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 23:43:04 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 23:43:04 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 23:43:04 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 23:43:04 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 23:43:04 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 23:43:04 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:43:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1632014469',display_name='tempest-VolumesAdminNegativeTest-server-1632014469',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1632014469',id=14,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c8a897400c74100ad6c115397bc84ff',ramdisk_id='',reservation_id='r-trozxw8g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2087255478',owner_user_name='tempest-VolumesAdminNegativeTest-2087255478-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:43:03Z,user_data=None,user_id='7cc85fb2b1a141578ba9558bc79ccc02',uuid=3c73d0da-fea9-4098-a0e8-c070f22969f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d5bc584-626d-49ee-874b-2d5028226ba1", "address": "fa:16:3e:b8:ab:7b", "network": {"id": "a59b651e-81c5-4a68-b694-1e84de25e915", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1023462603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8a897400c74100ad6c115397bc84ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d5bc584-62", "ovs_interfaceid": "2d5bc584-626d-49ee-874b-2d5028226ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:43:04 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Converting VIF {"id": "2d5bc584-626d-49ee-874b-2d5028226ba1", "address": "fa:16:3e:b8:ab:7b", "network": {"id": "a59b651e-81c5-4a68-b694-1e84de25e915", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1023462603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8a897400c74100ad6c115397bc84ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d5bc584-62", "ovs_interfaceid": "2d5bc584-626d-49ee-874b-2d5028226ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:43:04 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:ab:7b,bridge_name='br-int',has_traffic_filtering=True,id=2d5bc584-626d-49ee-874b-2d5028226ba1,network=Network(a59b651e-81c5-4a68-b694-1e84de25e915),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d5bc584-62') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:43:04 user nova-compute[75341]: DEBUG nova.objects.instance [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Lazy-loading 'pci_devices' on Instance uuid 3c73d0da-fea9-4098-a0e8-c070f22969f4 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:43:04 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: 3c73d0da-fea9-4098-a0e8-c070f22969f4] End _get_guest_xml xml=<domain type="kvm">
Nov 14 23:43:04 user nova-compute[75341]:   <uuid>3c73d0da-fea9-4098-a0e8-c070f22969f4</uuid>
Nov 14 23:43:04 user nova-compute[75341]:   <name>instance-0000000e</name>
Nov 14 23:43:04 user nova-compute[75341]:   <memory>524288</memory>
Nov 14 23:43:04 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 14 23:43:04 user nova-compute[75341]:   <metadata>
Nov 14 23:43:04 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 23:43:04 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 14 23:43:04 user nova-compute[75341]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1632014469</nova:name>
Nov 14 23:43:04 user nova-compute[75341]:       <nova:creationTime>2023-11-14 23:43:04</nova:creationTime>
Nov 14 23:43:04 user nova-compute[75341]:       <nova:flavor name="m1.tiny">
Nov 14 23:43:04 user nova-compute[75341]:         <nova:memory>512</nova:memory>
Nov 14 23:43:04 user nova-compute[75341]:         <nova:disk>1</nova:disk>
Nov 14 23:43:04 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 14 23:43:04 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 23:43:04 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 14 23:43:04 user nova-compute[75341]:       </nova:flavor>
Nov 14 23:43:04 user nova-compute[75341]:       <nova:owner>
Nov 14 23:43:04 user nova-compute[75341]:         <nova:user uuid="7cc85fb2b1a141578ba9558bc79ccc02">tempest-VolumesAdminNegativeTest-2087255478-project-member</nova:user>
Nov 14 23:43:04 user nova-compute[75341]:         <nova:project uuid="7c8a897400c74100ad6c115397bc84ff">tempest-VolumesAdminNegativeTest-2087255478</nova:project>
Nov 14 23:43:04 user nova-compute[75341]:       </nova:owner>
Nov 14 23:43:04 user nova-compute[75341]:       <nova:root type="image" uuid="e46abb82-b810-490e-a8a1-ccdc5fa1a796"/>
Nov 14 23:43:04 user nova-compute[75341]:       <nova:ports>
Nov 14 23:43:04 user nova-compute[75341]:         <nova:port uuid="2d5bc584-626d-49ee-874b-2d5028226ba1">
Nov 14 23:43:04 user nova-compute[75341]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 23:43:04 user nova-compute[75341]:         </nova:port>
Nov 14 23:43:04 user nova-compute[75341]:       </nova:ports>
Nov 14 23:43:04 user nova-compute[75341]:     </nova:instance>
Nov 14 23:43:04 user nova-compute[75341]:   </metadata>
Nov 14 23:43:04 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 14 23:43:04 user nova-compute[75341]:     <system>
Nov 14 23:43:04 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 23:43:04 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 14 23:43:04 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 14 23:43:04 user nova-compute[75341]:       <entry name="serial">3c73d0da-fea9-4098-a0e8-c070f22969f4</entry>
Nov 14 23:43:04 user nova-compute[75341]:       <entry name="uuid">3c73d0da-fea9-4098-a0e8-c070f22969f4</entry>
Nov 14 23:43:04 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 14 23:43:04 user nova-compute[75341]:     </system>
Nov 14 23:43:04 user nova-compute[75341]:   </sysinfo>
Nov 14 23:43:04 user nova-compute[75341]:   <os>
Nov 14 23:43:04 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 23:43:04 user nova-compute[75341]:     <boot dev="hd"/>
Nov 14 23:43:04 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 14 23:43:04 user nova-compute[75341]:   </os>
Nov 14 23:43:04 user nova-compute[75341]:   <features>
Nov 14 23:43:04 user nova-compute[75341]:     <acpi/>
Nov 14 23:43:04 user nova-compute[75341]:     <apic/>
Nov 14 23:43:04 user nova-compute[75341]:     <vmcoreinfo/>
Nov 14 23:43:04 user nova-compute[75341]:   </features>
Nov 14 23:43:04 user nova-compute[75341]:   <clock offset="utc">
Nov 14 23:43:04 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 23:43:04 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 23:43:04 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 14 23:43:04 user nova-compute[75341]:   </clock>
Nov 14 23:43:04 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 14 23:43:04 user nova-compute[75341]:     <model>Nehalem</model>
Nov 14 23:43:04 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 23:43:04 user nova-compute[75341]:   </cpu>
Nov 14 23:43:04 user nova-compute[75341]:   <devices>
Nov 14 23:43:04 user nova-compute[75341]:     <disk type="file" device="disk">
Nov 14 23:43:04 user nova-compute[75341]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 23:43:04 user nova-compute[75341]:       <source file="/opt/stack/data/nova/instances/3c73d0da-fea9-4098-a0e8-c070f22969f4/disk"/>
Nov 14 23:43:04 user nova-compute[75341]:       <target dev="vda" bus="virtio"/>
Nov 14 23:43:04 user nova-compute[75341]:     </disk>
Nov 14 23:43:04 user nova-compute[75341]:     <interface type="ethernet">
Nov 14 23:43:04 user nova-compute[75341]:       <mac address="fa:16:3e:b8:ab:7b"/>
Nov 14 23:43:04 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:43:04 user nova-compute[75341]:       <mtu size="1442"/>
Nov 14 23:43:04 user nova-compute[75341]:       <target dev="tap2d5bc584-62"/>
Nov 14 23:43:04 user nova-compute[75341]:     </interface>
Nov 14 23:43:04 user nova-compute[75341]:     <serial type="pty">
Nov 14 23:43:04 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/3c73d0da-fea9-4098-a0e8-c070f22969f4/console.log" append="off"/>
Nov 14 23:43:04 user nova-compute[75341]:     </serial>
Nov 14 23:43:04 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 23:43:04 user nova-compute[75341]:     <video>
Nov 14 23:43:04 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:43:04 user nova-compute[75341]:     </video>
Nov 14 23:43:04 user nova-compute[75341]:     <rng model="virtio">
Nov 14 23:43:04 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 14 23:43:04 user nova-compute[75341]:     </rng>
Nov 14 23:43:04 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 14 23:43:04 user nova-compute[75341]:     <memballoon model="virtio">
Nov 14 23:43:04 user nova-compute[75341]:       <stats period="10"/>
Nov 14 23:43:04 user nova-compute[75341]:     </memballoon>
Nov 14 23:43:04 user nova-compute[75341]:   </devices>
Nov 14 23:43:04 user nova-compute[75341]: </domain>
Nov 14 23:43:04 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 23:43:04 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:43:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1632014469',display_name='tempest-VolumesAdminNegativeTest-server-1632014469',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1632014469',id=14,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c8a897400c74100ad6c115397bc84ff',ramdisk_id='',reservation_id='r-trozxw8g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2087255478',owner_user_name='tempest-VolumesAdminNegativeTest-2087255478-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:43:03Z,user_data=None,user_id='7cc85fb2b1a141578ba9558bc79ccc02',uuid=3c73d0da-fea9-4098-a0e8-c070f22969f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d5bc584-626d-49ee-874b-2d5028226ba1", "address": "fa:16:3e:b8:ab:7b", "network": {"id": "a59b651e-81c5-4a68-b694-1e84de25e915", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1023462603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8a897400c74100ad6c115397bc84ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d5bc584-62", "ovs_interfaceid": "2d5bc584-626d-49ee-874b-2d5028226ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 23:43:04 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Converting VIF {"id": "2d5bc584-626d-49ee-874b-2d5028226ba1", "address": "fa:16:3e:b8:ab:7b", "network": {"id": "a59b651e-81c5-4a68-b694-1e84de25e915", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1023462603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8a897400c74100ad6c115397bc84ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d5bc584-62", "ovs_interfaceid": "2d5bc584-626d-49ee-874b-2d5028226ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:43:04 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:ab:7b,bridge_name='br-int',has_traffic_filtering=True,id=2d5bc584-626d-49ee-874b-2d5028226ba1,network=Network(a59b651e-81c5-4a68-b694-1e84de25e915),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d5bc584-62') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:43:04 user nova-compute[75341]: DEBUG os_vif [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:ab:7b,bridge_name='br-int',has_traffic_filtering=True,id=2d5bc584-626d-49ee-874b-2d5028226ba1,network=Network(a59b651e-81c5-4a68-b694-1e84de25e915),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d5bc584-62') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 23:43:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:43:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 23:43:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '28c52ffb-2bfa-504b-983d-5765f0c1bb8d', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:43:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:43:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2d5bc584-62, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:43:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2d5bc584-62, col_values=(('qos', UUID('e45ad624-772b-4321-a2a7-d8bc4e65759b')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:43:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2d5bc584-62, col_values=(('external_ids', {'iface-id': '2d5bc584-626d-49ee-874b-2d5028226ba1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:ab:7b', 'vm-uuid': '3c73d0da-fea9-4098-a0e8-c070f22969f4'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:43:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:43:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:04 user nova-compute[75341]: INFO os_vif [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:ab:7b,bridge_name='br-int',has_traffic_filtering=True,id=2d5bc584-626d-49ee-874b-2d5028226ba1,network=Network(a59b651e-81c5-4a68-b694-1e84de25e915),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d5bc584-62')
Nov 14 23:43:04 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:43:04 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] No VIF found with MAC fa:16:3e:b8:ab:7b, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:43:04 user nova-compute[75341]: DEBUG nova.network.neutron [req-bda853e3-320a-4053-81b9-5184934492e6 req-01cedf5c-c79a-4a50-a17c-10917bdc5a90 service nova] [instance: 3c73d0da-fea9-4098-a0e8-c070f22969f4] Updated VIF entry in instance network info cache for port 2d5bc584-626d-49ee-874b-2d5028226ba1. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:43:04 user nova-compute[75341]: DEBUG nova.network.neutron [req-bda853e3-320a-4053-81b9-5184934492e6 req-01cedf5c-c79a-4a50-a17c-10917bdc5a90 service nova] [instance: 3c73d0da-fea9-4098-a0e8-c070f22969f4] Updating instance_info_cache with network_info: [{"id": "2d5bc584-626d-49ee-874b-2d5028226ba1", "address": "fa:16:3e:b8:ab:7b", "network": {"id": "a59b651e-81c5-4a68-b694-1e84de25e915", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1023462603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8a897400c74100ad6c115397bc84ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d5bc584-62", "ovs_interfaceid": "2d5bc584-626d-49ee-874b-2d5028226ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:43:04 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-bda853e3-320a-4053-81b9-5184934492e6 req-01cedf5c-c79a-4a50-a17c-10917bdc5a90 service nova] Releasing lock "refresh_cache-3c73d0da-fea9-4098-a0e8-c070f22969f4" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:43:05 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c981d88b-7242-4e04-8368-14371fe46aac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Calling os-brick to attach iSCSI Volume {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 23:43:05 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c981d88b-7242-4e04-8368-14371fe46aac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2c5ff4fb-63c7-46c8-bfd2-d373ba3e0695', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aVLObcrl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:43:05 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-c981d88b-7242-4e04-8368-14371fe46aac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:43:05 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-c981d88b-7242-4e04-8368-14371fe46aac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:43:05 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-c981d88b-7242-4e04-8368-14371fe46aac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:43:05 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-c981d88b-7242-4e04-8368-14371fe46aac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:43:05 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-c981d88b-7242-4e04-8368-14371fe46aac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c5ff4fb-63c7-46c8-bfd2-d373ba3e0695" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:43:05 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-c981d88b-7242-4e04-8368-14371fe46aac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c5ff4fb-63c7-46c8-bfd2-d373ba3e0695" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:43:05 user nova-compute[75341]: INFO os_brick.initiator.connectors.iscsi [None req-c981d88b-7242-4e04-8368-14371fe46aac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 23:43:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c5ff4fb-63c7-46c8-bfd2-d373ba3e0695 -p 172.16.0.220:3260 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c5ff4fb-63c7-46c8-bfd2-d373ba3e0695 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:05 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7924fdd-955b-4679-bbeb-822fb8080b0d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:05 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c981d88b-7242-4e04-8368-14371fe46aac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 23:43:05 user nova-compute[75341]:  {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:43:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c5ff4fb-63c7-46c8-bfd2-d373ba3e0695 -p 172.16.0.220:3260 --interface default --op new {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c5ff4fb-63c7-46c8-bfd2-d373ba3e0695 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:05 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6254ff-622b-4ba8-9f74-d648404db93a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c5ff4fb-63c7-46c8-bfd2-d373ba3e0695] added\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:05 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c981d88b-7242-4e04-8368-14371fe46aac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c5ff4fb-63c7-46c8-bfd2-d373ba3e0695] added
Nov 14 23:43:05 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:43:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c5ff4fb-63c7-46c8-bfd2-d373ba3e0695 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c5ff4fb-63c7-46c8-bfd2-d373ba3e0695 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:05 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a2aa1a1-e131-4d68-a1f5-d7e2543bf56d]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:05 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c981d88b-7242-4e04-8368-14371fe46aac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:43:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c5ff4fb-63c7-46c8-bfd2-d373ba3e0695 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c5ff4fb-63c7-46c8-bfd2-d373ba3e0695 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:05 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b4b7c6c-50a1-45a2-bad6-8e3a23ad53e2]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:05 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c981d88b-7242-4e04-8368-14371fe46aac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:43:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c5ff4fb-63c7-46c8-bfd2-d373ba3e0695 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aVLObcrl {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c5ff4fb-63c7-46c8-bfd2-d373ba3e0695 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aVLObcrl" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:05 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3400ea-8b9e-4f8a-8bb6-6a6ed1ecffcd]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:05 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c981d88b-7242-4e04-8368-14371fe46aac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aVLObcrl'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:43:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c5ff4fb-63c7-46c8-bfd2-d373ba3e0695 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c5ff4fb-63c7-46c8-bfd2-d373ba3e0695 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:05 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a7d566b-e6d8-42fa-9aea-f4d3b2ba65e3]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:05 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c981d88b-7242-4e04-8368-14371fe46aac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:43:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:05 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e36a6d2-a261-48e9-9c43-d4977d0d3389]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:05 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c981d88b-7242-4e04-8368-14371fe46aac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 (non-flash)
Nov 14 23:43:05 user nova-compute[75341]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)
Nov 14 23:43:05 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:43:05 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:43:05 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c981d88b-7242-4e04-8368-14371fe46aac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 (non-flash)
Nov 14 23:43:05 user nova-compute[75341]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)
Nov 14 23:43:05 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:43:05 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:43:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c5ff4fb-63c7-46c8-bfd2-d373ba3e0695 -p 172.16.0.220:3260 --login {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c5ff4fb-63c7-46c8-bfd2-d373ba3e0695 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:05 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f48261-6a4b-4e60-af16-0837636b8589]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c5ff4fb-63c7-46c8-bfd2-d373ba3e0695, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2c5ff4fb-63c7-46c8-bfd2-d373ba3e0695, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:05 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c981d88b-7242-4e04-8368-14371fe46aac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c5ff4fb-63c7-46c8-bfd2-d373ba3e0695, portal: 172.16.0.220,3260]
Nov 14 23:43:05 user nova-compute[75341]: Login to [iface: default, target: iqn.2010-10.org.openstack:2c5ff4fb-63c7-46c8-bfd2-d373ba3e0695, portal: 172.16.0.220,3260] successful.
Nov 14 23:43:05 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:43:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c5ff4fb-63c7-46c8-bfd2-d373ba3e0695 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c5ff4fb-63c7-46c8-bfd2-d373ba3e0695 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:05 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df235a8-f2ce-444e-9a02-b9dcdfa0da13]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:05 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c981d88b-7242-4e04-8368-14371fe46aac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:43:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:05 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39f8cae-41e2-4d16-b280-f4cd148af032]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c5ff4fb-63c7-46c8-bfd2-d373ba3e0695 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:05 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c981d88b-7242-4e04-8368-14371fe46aac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 (non-flash)
Nov 14 23:43:05 user nova-compute[75341]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)
Nov 14 23:43:05 user nova-compute[75341]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c5ff4fb-63c7-46c8-bfd2-d373ba3e0695 (non-flash)
Nov 14 23:43:05 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:43:05 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:43:05 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c981d88b-7242-4e04-8368-14371fe46aac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 (non-flash)
Nov 14 23:43:05 user nova-compute[75341]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)
Nov 14 23:43:05 user nova-compute[75341]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c5ff4fb-63c7-46c8-bfd2-d373ba3e0695 (non-flash)
Nov 14 23:43:05 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:43:05 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:43:05 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-c981d88b-7242-4e04-8368-14371fe46aac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c5ff4fb-63c7-46c8-bfd2-d373ba3e0695" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:43:05 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c981d88b-7242-4e04-8368-14371fe46aac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Connected to 172.16.0.220:3260 {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 23:43:05 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-c981d88b-7242-4e04-8368-14371fe46aac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] HCTL ('35', '-', '-', 0) found on session 16 with lun 0 {{(pid=75341) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 23:43:05 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-c981d88b-7242-4e04-8368-14371fe46aac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75341) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 23:43:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:05 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c21563-e5b5-45b1-89f5-106d881b0305]: (4, ('- - 0', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:05 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-c981d88b-7242-4e04-8368-14371fe46aac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Searching for a device in session 16 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 23:43:05 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c981d88b-7242-4e04-8368-14371fe46aac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:2c5ff4fb-63c7-46c8-bfd2-d373ba3e0695', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aVLObcrl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 23:43:05 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:05 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:06 user nova-compute[75341]: DEBUG nova.compute.manager [req-51d1803f-98dc-4a19-812e-f4b24b12d9b4 req-7c159ce3-f3d5-4251-a596-5d8178db1d40 service nova] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Received event network-changed-dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:43:06 user nova-compute[75341]: DEBUG nova.compute.manager [req-51d1803f-98dc-4a19-812e-f4b24b12d9b4 req-7c159ce3-f3d5-4251-a596-5d8178db1d40 service nova] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Refreshing instance network info cache due to event network-changed-dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:43:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-51d1803f-98dc-4a19-812e-f4b24b12d9b4 req-7c159ce3-f3d5-4251-a596-5d8178db1d40 service nova] Acquiring lock "refresh_cache-0223a98e-e08f-4a0f-a707-3770c7a99b00" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:43:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-51d1803f-98dc-4a19-812e-f4b24b12d9b4 req-7c159ce3-f3d5-4251-a596-5d8178db1d40 service nova] Acquired lock "refresh_cache-0223a98e-e08f-4a0f-a707-3770c7a99b00" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:43:06 user nova-compute[75341]: DEBUG nova.network.neutron [req-51d1803f-98dc-4a19-812e-f4b24b12d9b4 req-7c159ce3-f3d5-4251-a596-5d8178db1d40 service nova] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Refreshing network info cache for port dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:43:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:06 user nova-compute[75341]: DEBUG nova.compute.manager [req-1a7d8e98-99bd-4fa4-8900-1d2d112f234e req-0e8c469c-4f1e-41d9-867f-af084a0c533d service nova] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Received event network-vif-plugged-cdc268e0-0a9a-44cf-87ef-0baca1547f68 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:43:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-1a7d8e98-99bd-4fa4-8900-1d2d112f234e req-0e8c469c-4f1e-41d9-867f-af084a0c533d service nova] Acquiring lock "cffc86d5-2ac6-4dd1-bdcd-5832c134d179-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:43:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-1a7d8e98-99bd-4fa4-8900-1d2d112f234e req-0e8c469c-4f1e-41d9-867f-af084a0c533d service nova] Lock "cffc86d5-2ac6-4dd1-bdcd-5832c134d179-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:43:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-1a7d8e98-99bd-4fa4-8900-1d2d112f234e req-0e8c469c-4f1e-41d9-867f-af084a0c533d service nova] Lock "cffc86d5-2ac6-4dd1-bdcd-5832c134d179-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:43:06 user nova-compute[75341]: DEBUG nova.compute.manager [req-1a7d8e98-99bd-4fa4-8900-1d2d112f234e req-0e8c469c-4f1e-41d9-867f-af084a0c533d service nova] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] No waiting events found dispatching network-vif-plugged-cdc268e0-0a9a-44cf-87ef-0baca1547f68 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:43:06 user nova-compute[75341]: WARNING nova.compute.manager [req-1a7d8e98-99bd-4fa4-8900-1d2d112f234e req-0e8c469c-4f1e-41d9-867f-af084a0c533d service nova] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Received unexpected event network-vif-plugged-cdc268e0-0a9a-44cf-87ef-0baca1547f68 for instance with vm_state building and task_state spawning.
Nov 14 23:43:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:06 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-c981d88b-7242-4e04-8368-14371fe46aac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:43:06 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c981d88b-7242-4e04-8368-14371fe46aac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23638356264646461', 'path': '/dev/sdd'} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:43:06 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c981d88b-7242-4e04-8368-14371fe46aac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638356264646461', 'path': '/dev/sdd'} {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 23:43:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:06 user nova-compute[75341]: DEBUG nova.objects.instance [None req-c981d88b-7242-4e04-8368-14371fe46aac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Lazy-loading 'flavor' on Instance uuid 44080c0d-56eb-4987-aa4b-59f161dcbc0b {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:43:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:06 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-c981d88b-7242-4e04-8368-14371fe46aac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 23:43:06 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:43:06 user nova-compute[75341]:   <source dev="/dev/sdd"/>
Nov 14 23:43:06 user nova-compute[75341]:   <target dev="vdc" bus="virtio"/>
Nov 14 23:43:06 user nova-compute[75341]:   <serial>2c5ff4fb-63c7-46c8-bfd2-d373ba3e0695</serial>
Nov 14 23:43:06 user nova-compute[75341]: </disk>
Nov 14 23:43:06 user nova-compute[75341]:  {{(pid=75341) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 23:43:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-87dfb7cd-3d4b-449d-af60-7c091add090d tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Acquiring lock "0223a98e-e08f-4a0f-a707-3770c7a99b00" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:43:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-87dfb7cd-3d4b-449d-af60-7c091add090d tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Lock "0223a98e-e08f-4a0f-a707-3770c7a99b00" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:43:06 user nova-compute[75341]: INFO nova.compute.manager [None req-87dfb7cd-3d4b-449d-af60-7c091add090d tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Shelve offloading
Nov 14 23:43:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:07 user nova-compute[75341]: DEBUG nova.network.neutron [req-51d1803f-98dc-4a19-812e-f4b24b12d9b4 req-7c159ce3-f3d5-4251-a596-5d8178db1d40 service nova] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Updated VIF entry in instance network info cache for port dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:43:07 user nova-compute[75341]: DEBUG nova.network.neutron [req-51d1803f-98dc-4a19-812e-f4b24b12d9b4 req-7c159ce3-f3d5-4251-a596-5d8178db1d40 service nova] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Updating instance_info_cache with network_info: [{"id": "dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e", "address": "fa:16:3e:19:cd:2f", "network": {"id": "eb5b5fbb-4747-49e9-a830-c9ab1c4d4af7", "bridge": "br-int", "label": "tempest-TestShelveInstance-261763164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9beb6cd1f92a46f4a37459b75b7ff1d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbe5cbca-08", "ovs_interfaceid": "dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:43:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-51d1803f-98dc-4a19-812e-f4b24b12d9b4 req-7c159ce3-f3d5-4251-a596-5d8178db1d40 service nova] Releasing lock "refresh_cache-0223a98e-e08f-4a0f-a707-3770c7a99b00" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:43:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:07 user nova-compute[75341]: DEBUG nova.compute.manager [req-3963b020-8c4d-4b1b-a86c-c747cbb67a32 req-055dcc79-ffd8-44a8-966d-4064cee48aff service nova] [instance: 3c73d0da-fea9-4098-a0e8-c070f22969f4] Received event network-vif-plugged-2d5bc584-626d-49ee-874b-2d5028226ba1 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:43:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-3963b020-8c4d-4b1b-a86c-c747cbb67a32 req-055dcc79-ffd8-44a8-966d-4064cee48aff service nova] Acquiring lock "3c73d0da-fea9-4098-a0e8-c070f22969f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:43:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-3963b020-8c4d-4b1b-a86c-c747cbb67a32 req-055dcc79-ffd8-44a8-966d-4064cee48aff service nova] Lock "3c73d0da-fea9-4098-a0e8-c070f22969f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:43:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-3963b020-8c4d-4b1b-a86c-c747cbb67a32 req-055dcc79-ffd8-44a8-966d-4064cee48aff service nova] Lock "3c73d0da-fea9-4098-a0e8-c070f22969f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:43:07 user nova-compute[75341]: DEBUG nova.compute.manager [req-3963b020-8c4d-4b1b-a86c-c747cbb67a32 req-055dcc79-ffd8-44a8-966d-4064cee48aff service nova] [instance: 3c73d0da-fea9-4098-a0e8-c070f22969f4] No waiting events found dispatching network-vif-plugged-2d5bc584-626d-49ee-874b-2d5028226ba1 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:43:07 user nova-compute[75341]: WARNING nova.compute.manager [req-3963b020-8c4d-4b1b-a86c-c747cbb67a32 req-055dcc79-ffd8-44a8-966d-4064cee48aff service nova] [instance: 3c73d0da-fea9-4098-a0e8-c070f22969f4] Received unexpected event network-vif-plugged-2d5bc584-626d-49ee-874b-2d5028226ba1 for instance with vm_state building and task_state spawning.
Nov 14 23:43:07 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c981d88b-7242-4e04-8368-14371fe46aac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:43:07 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c981d88b-7242-4e04-8368-14371fe46aac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:43:07 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c981d88b-7242-4e04-8368-14371fe46aac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:43:07 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c981d88b-7242-4e04-8368-14371fe46aac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] No VIF found with MAC fa:16:3e:ce:7e:2b, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:43:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ae81e657-f5cb-4fdb-819e-b43d13ea4584 tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] Acquiring lock "e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:43:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ae81e657-f5cb-4fdb-819e-b43d13ea4584 tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] Lock "e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:43:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ae81e657-f5cb-4fdb-819e-b43d13ea4584 tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] Acquiring lock "e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:43:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ae81e657-f5cb-4fdb-819e-b43d13ea4584 tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] Lock "e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:43:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ae81e657-f5cb-4fdb-819e-b43d13ea4584 tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] Lock "e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:43:07 user nova-compute[75341]: INFO nova.compute.manager [None req-ae81e657-f5cb-4fdb-819e-b43d13ea4584 tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Terminating instance
Nov 14 23:43:07 user nova-compute[75341]: DEBUG nova.compute.manager [None req-ae81e657-f5cb-4fdb-819e-b43d13ea4584 tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Start destroying the instance on the hypervisor. {{(pid=75341) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 23:43:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c981d88b-7242-4e04-8368-14371fe46aac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Lock "44080c0d-56eb-4987-aa4b-59f161dcbc0b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.427s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:43:07 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Instance destroyed successfully.
Nov 14 23:43:07 user nova-compute[75341]: DEBUG nova.compute.manager [None req-87dfb7cd-3d4b-449d-af60-7c091add090d tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 23:43:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-87dfb7cd-3d4b-449d-af60-7c091add090d tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Acquiring lock "refresh_cache-0223a98e-e08f-4a0f-a707-3770c7a99b00" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:43:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-87dfb7cd-3d4b-449d-af60-7c091add090d tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Acquired lock "refresh_cache-0223a98e-e08f-4a0f-a707-3770c7a99b00" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:43:07 user nova-compute[75341]: DEBUG nova.network.neutron [None req-87dfb7cd-3d4b-449d-af60-7c091add090d tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 23:43:08 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Instance destroyed successfully.
Nov 14 23:43:08 user nova-compute[75341]: DEBUG nova.objects.instance [None req-ae81e657-f5cb-4fdb-819e-b43d13ea4584 tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] Lazy-loading 'resources' on Instance uuid e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:43:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-11ad3580-c067-4a1e-9a5b-596d2a5066d8 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Acquiring lock "44080c0d-56eb-4987-aa4b-59f161dcbc0b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:43:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-11ad3580-c067-4a1e-9a5b-596d2a5066d8 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Lock "44080c0d-56eb-4987-aa4b-59f161dcbc0b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:43:08 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-ae81e657-f5cb-4fdb-819e-b43d13ea4584 tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:40:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1573672987',display_name='tempest-VolumesAssistedSnapshotsTest-server-1573672987',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1573672987',id=8,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN0bK/whtQcGfmPPRHzKnlcdVjJXzM2upZiGMg2fbCCpgADOm7kKv13te8hP3HQp12UZq5dXZyrCd+oJtiS6AET7IPNdikKuZ8PJkRm17fjBrgZomCWtLQu//pZTAjicKw==',key_name='tempest-keypair-27419633',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:40:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d41edc5e2c0b4dd39fc317727fb22703',ramdisk_id='',reservation_id='r-6c5mkc5j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1143044886',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1143044886-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:40:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d5ddb1cd696433ebda85b9450ebb836',uuid=e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "295dbc30-38ed-4679-b876-719906e8f9f5", "address": "fa:16:3e:44:65:00", "network": {"id": "63893f57-4617-4e26-9735-6fea458f5b1d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-258967465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d41edc5e2c0b4dd39fc317727fb22703", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap295dbc30-38", "ovs_interfaceid": "295dbc30-38ed-4679-b876-719906e8f9f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 23:43:08 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-ae81e657-f5cb-4fdb-819e-b43d13ea4584 tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] Converting VIF {"id": "295dbc30-38ed-4679-b876-719906e8f9f5", "address": "fa:16:3e:44:65:00", "network": {"id": "63893f57-4617-4e26-9735-6fea458f5b1d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-258967465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d41edc5e2c0b4dd39fc317727fb22703", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap295dbc30-38", "ovs_interfaceid": "295dbc30-38ed-4679-b876-719906e8f9f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:43:08 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-ae81e657-f5cb-4fdb-819e-b43d13ea4584 tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:65:00,bridge_name='br-int',has_traffic_filtering=True,id=295dbc30-38ed-4679-b876-719906e8f9f5,network=Network(63893f57-4617-4e26-9735-6fea458f5b1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap295dbc30-38') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:43:08 user nova-compute[75341]: DEBUG os_vif [None req-ae81e657-f5cb-4fdb-819e-b43d13ea4584 tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:65:00,bridge_name='br-int',has_traffic_filtering=True,id=295dbc30-38ed-4679-b876-719906e8f9f5,network=Network(63893f57-4617-4e26-9735-6fea458f5b1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap295dbc30-38') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 23:43:08 user nova-compute[75341]: INFO nova.compute.manager [None req-11ad3580-c067-4a1e-9a5b-596d2a5066d8 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Detaching volume 2c5ff4fb-63c7-46c8-bfd2-d373ba3e0695
Nov 14 23:43:08 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:08 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap295dbc30-38, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:43:08 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:08 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:43:08 user nova-compute[75341]: DEBUG nova.network.neutron [None req-87dfb7cd-3d4b-449d-af60-7c091add090d tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Updating instance_info_cache with network_info: [{"id": "dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e", "address": "fa:16:3e:19:cd:2f", "network": {"id": "eb5b5fbb-4747-49e9-a830-c9ab1c4d4af7", "bridge": "br-int", "label": "tempest-TestShelveInstance-261763164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9beb6cd1f92a46f4a37459b75b7ff1d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbe5cbca-08", "ovs_interfaceid": "dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:43:08 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:08 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:08 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=baa03cf3-7f35-420b-919d-a4bc461bedd3) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:43:08 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:08 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:43:08 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:08 user nova-compute[75341]: INFO os_vif [None req-ae81e657-f5cb-4fdb-819e-b43d13ea4584 tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:65:00,bridge_name='br-int',has_traffic_filtering=True,id=295dbc30-38ed-4679-b876-719906e8f9f5,network=Network(63893f57-4617-4e26-9735-6fea458f5b1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap295dbc30-38')
Nov 14 23:43:08 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-ae81e657-f5cb-4fdb-819e-b43d13ea4584 tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Deleting instance files /opt/stack/data/nova/instances/e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd_del
Nov 14 23:43:08 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-ae81e657-f5cb-4fdb-819e-b43d13ea4584 tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Deletion of /opt/stack/data/nova/instances/e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd_del complete
Nov 14 23:43:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-87dfb7cd-3d4b-449d-af60-7c091add090d tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Releasing lock "refresh_cache-0223a98e-e08f-4a0f-a707-3770c7a99b00" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:43:08 user nova-compute[75341]: INFO nova.virt.block_device [None req-11ad3580-c067-4a1e-9a5b-596d2a5066d8 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Attempting to driver detach volume 2c5ff4fb-63c7-46c8-bfd2-d373ba3e0695 from mountpoint /dev/vdc
Nov 14 23:43:08 user nova-compute[75341]: INFO nova.compute.manager [None req-ae81e657-f5cb-4fdb-819e-b43d13ea4584 tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 14 23:43:08 user nova-compute[75341]: DEBUG oslo.service.loopingcall [None req-ae81e657-f5cb-4fdb-819e-b43d13ea4584 tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75341) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 23:43:08 user nova-compute[75341]: DEBUG nova.compute.manager [-] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Deallocating network for instance {{(pid=75341) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 23:43:08 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] deallocate_for_instance() {{(pid=75341) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 23:43:08 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-11ad3580-c067-4a1e-9a5b-596d2a5066d8 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Attempting to detach device vdc from instance 44080c0d-56eb-4987-aa4b-59f161dcbc0b from the persistent domain config. {{(pid=75341) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 23:43:08 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-11ad3580-c067-4a1e-9a5b-596d2a5066d8 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 23:43:08 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:43:08 user nova-compute[75341]:   <source dev="/dev/sdd"/>
Nov 14 23:43:08 user nova-compute[75341]:   <target dev="vdc" bus="virtio"/>
Nov 14 23:43:08 user nova-compute[75341]:   <serial>2c5ff4fb-63c7-46c8-bfd2-d373ba3e0695</serial>
Nov 14 23:43:08 user nova-compute[75341]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 23:43:08 user nova-compute[75341]: </disk>
Nov 14 23:43:08 user nova-compute[75341]:  {{(pid=75341) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 23:43:08 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-11ad3580-c067-4a1e-9a5b-596d2a5066d8 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Successfully detached device vdc from instance 44080c0d-56eb-4987-aa4b-59f161dcbc0b from the persistent domain config.
Nov 14 23:43:08 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-11ad3580-c067-4a1e-9a5b-596d2a5066d8 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 44080c0d-56eb-4987-aa4b-59f161dcbc0b from the live domain config. {{(pid=75341) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 23:43:08 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-11ad3580-c067-4a1e-9a5b-596d2a5066d8 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 23:43:08 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:43:08 user nova-compute[75341]:   <source dev="/dev/sdd"/>
Nov 14 23:43:08 user nova-compute[75341]:   <target dev="vdc" bus="virtio"/>
Nov 14 23:43:08 user nova-compute[75341]:   <serial>2c5ff4fb-63c7-46c8-bfd2-d373ba3e0695</serial>
Nov 14 23:43:08 user nova-compute[75341]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 23:43:08 user nova-compute[75341]: </disk>
Nov 14 23:43:08 user nova-compute[75341]:  {{(pid=75341) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 23:43:08 user nova-compute[75341]: DEBUG nova.compute.manager [req-a22a104a-24e4-4f36-92c0-bbd6c45f3a3e req-aca67a99-a64d-4cd5-a42b-439e571686e9 service nova] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Received event network-vif-plugged-cdc268e0-0a9a-44cf-87ef-0baca1547f68 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:43:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a22a104a-24e4-4f36-92c0-bbd6c45f3a3e req-aca67a99-a64d-4cd5-a42b-439e571686e9 service nova] Acquiring lock "cffc86d5-2ac6-4dd1-bdcd-5832c134d179-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:43:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a22a104a-24e4-4f36-92c0-bbd6c45f3a3e req-aca67a99-a64d-4cd5-a42b-439e571686e9 service nova] Lock "cffc86d5-2ac6-4dd1-bdcd-5832c134d179-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:43:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a22a104a-24e4-4f36-92c0-bbd6c45f3a3e req-aca67a99-a64d-4cd5-a42b-439e571686e9 service nova] Lock "cffc86d5-2ac6-4dd1-bdcd-5832c134d179-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:43:08 user nova-compute[75341]: DEBUG nova.compute.manager [req-a22a104a-24e4-4f36-92c0-bbd6c45f3a3e req-aca67a99-a64d-4cd5-a42b-439e571686e9 service nova] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] No waiting events found dispatching network-vif-plugged-cdc268e0-0a9a-44cf-87ef-0baca1547f68 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:43:08 user nova-compute[75341]: WARNING nova.compute.manager [req-a22a104a-24e4-4f36-92c0-bbd6c45f3a3e req-aca67a99-a64d-4cd5-a42b-439e571686e9 service nova] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Received unexpected event network-vif-plugged-cdc268e0-0a9a-44cf-87ef-0baca1547f68 for instance with vm_state building and task_state spawning.
Nov 14 23:43:08 user nova-compute[75341]: DEBUG nova.compute.manager [req-a22a104a-24e4-4f36-92c0-bbd6c45f3a3e req-aca67a99-a64d-4cd5-a42b-439e571686e9 service nova] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Received event network-vif-unplugged-dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:43:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a22a104a-24e4-4f36-92c0-bbd6c45f3a3e req-aca67a99-a64d-4cd5-a42b-439e571686e9 service nova] Acquiring lock "0223a98e-e08f-4a0f-a707-3770c7a99b00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:43:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a22a104a-24e4-4f36-92c0-bbd6c45f3a3e req-aca67a99-a64d-4cd5-a42b-439e571686e9 service nova] Lock "0223a98e-e08f-4a0f-a707-3770c7a99b00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:43:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a22a104a-24e4-4f36-92c0-bbd6c45f3a3e req-aca67a99-a64d-4cd5-a42b-439e571686e9 service nova] Lock "0223a98e-e08f-4a0f-a707-3770c7a99b00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:43:08 user nova-compute[75341]: DEBUG nova.compute.manager [req-a22a104a-24e4-4f36-92c0-bbd6c45f3a3e req-aca67a99-a64d-4cd5-a42b-439e571686e9 service nova] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] No waiting events found dispatching network-vif-unplugged-dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:43:08 user nova-compute[75341]: WARNING nova.compute.manager [req-a22a104a-24e4-4f36-92c0-bbd6c45f3a3e req-aca67a99-a64d-4cd5-a42b-439e571686e9 service nova] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Received unexpected event network-vif-unplugged-dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e for instance with vm_state active and task_state shelving.
Nov 14 23:43:08 user nova-compute[75341]: DEBUG nova.compute.manager [req-a22a104a-24e4-4f36-92c0-bbd6c45f3a3e req-aca67a99-a64d-4cd5-a42b-439e571686e9 service nova] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Received event network-vif-plugged-dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:43:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a22a104a-24e4-4f36-92c0-bbd6c45f3a3e req-aca67a99-a64d-4cd5-a42b-439e571686e9 service nova] Acquiring lock "0223a98e-e08f-4a0f-a707-3770c7a99b00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:43:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a22a104a-24e4-4f36-92c0-bbd6c45f3a3e req-aca67a99-a64d-4cd5-a42b-439e571686e9 service nova] Lock "0223a98e-e08f-4a0f-a707-3770c7a99b00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:43:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a22a104a-24e4-4f36-92c0-bbd6c45f3a3e req-aca67a99-a64d-4cd5-a42b-439e571686e9 service nova] Lock "0223a98e-e08f-4a0f-a707-3770c7a99b00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.008s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:43:08 user nova-compute[75341]: DEBUG nova.compute.manager [req-a22a104a-24e4-4f36-92c0-bbd6c45f3a3e req-aca67a99-a64d-4cd5-a42b-439e571686e9 service nova] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] No waiting events found dispatching network-vif-plugged-dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:43:08 user nova-compute[75341]: WARNING nova.compute.manager [req-a22a104a-24e4-4f36-92c0-bbd6c45f3a3e req-aca67a99-a64d-4cd5-a42b-439e571686e9 service nova] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Received unexpected event network-vif-plugged-dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e for instance with vm_state active and task_state shelving.
Nov 14 23:43:09 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-11ad3580-c067-4a1e-9a5b-596d2a5066d8 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 44080c0d-56eb-4987-aa4b-59f161dcbc0b {{(pid=75341) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG nova.compute.manager [req-d9db51c8-9877-4668-882a-4dda8132f54a req-53b167fe-498d-41cc-b05e-baec9737693d service nova] [instance: 3c73d0da-fea9-4098-a0e8-c070f22969f4] Received event network-vif-plugged-2d5bc584-626d-49ee-874b-2d5028226ba1 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-d9db51c8-9877-4668-882a-4dda8132f54a req-53b167fe-498d-41cc-b05e-baec9737693d service nova] Acquiring lock "3c73d0da-fea9-4098-a0e8-c070f22969f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-d9db51c8-9877-4668-882a-4dda8132f54a req-53b167fe-498d-41cc-b05e-baec9737693d service nova] Lock "3c73d0da-fea9-4098-a0e8-c070f22969f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-d9db51c8-9877-4668-882a-4dda8132f54a req-53b167fe-498d-41cc-b05e-baec9737693d service nova] Lock "3c73d0da-fea9-4098-a0e8-c070f22969f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG nova.compute.manager [req-d9db51c8-9877-4668-882a-4dda8132f54a req-53b167fe-498d-41cc-b05e-baec9737693d service nova] [instance: 3c73d0da-fea9-4098-a0e8-c070f22969f4] No waiting events found dispatching network-vif-plugged-2d5bc584-626d-49ee-874b-2d5028226ba1 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:43:09 user nova-compute[75341]: WARNING nova.compute.manager [req-d9db51c8-9877-4668-882a-4dda8132f54a req-53b167fe-498d-41cc-b05e-baec9737693d service nova] [instance: 3c73d0da-fea9-4098-a0e8-c070f22969f4] Received unexpected event network-vif-plugged-2d5bc584-626d-49ee-874b-2d5028226ba1 for instance with vm_state building and task_state spawning.
Nov 14 23:43:09 user nova-compute[75341]: DEBUG nova.compute.manager [req-d9db51c8-9877-4668-882a-4dda8132f54a req-53b167fe-498d-41cc-b05e-baec9737693d service nova] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Received event network-changed-9032b49d-13a3-4049-bada-48eb30ea932a {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG nova.compute.manager [req-d9db51c8-9877-4668-882a-4dda8132f54a req-53b167fe-498d-41cc-b05e-baec9737693d service nova] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Refreshing instance network info cache due to event network-changed-9032b49d-13a3-4049-bada-48eb30ea932a. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-d9db51c8-9877-4668-882a-4dda8132f54a req-53b167fe-498d-41cc-b05e-baec9737693d service nova] Acquiring lock "refresh_cache-d8d3b42b-11b5-477a-afb1-80a1786b693b" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-d9db51c8-9877-4668-882a-4dda8132f54a req-53b167fe-498d-41cc-b05e-baec9737693d service nova] Acquired lock "refresh_cache-d8d3b42b-11b5-477a-afb1-80a1786b693b" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG nova.network.neutron [req-d9db51c8-9877-4668-882a-4dda8132f54a req-53b167fe-498d-41cc-b05e-baec9737693d service nova] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Refreshing network info cache for port 9032b49d-13a3-4049-bada-48eb30ea932a {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:43:09 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Instance destroyed successfully.
Nov 14 23:43:09 user nova-compute[75341]: DEBUG nova.objects.instance [None req-87dfb7cd-3d4b-449d-af60-7c091add090d tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Lazy-loading 'resources' on Instance uuid 0223a98e-e08f-4a0f-a707-3770c7a99b00 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-87dfb7cd-3d4b-449d-af60-7c091add090d tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:41:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-745577741',display_name='tempest-TestShelveInstance-server-745577741',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-745577741',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCC/fpuT6kOHQaV9HZ2f/yPGx85iWhp/2ZbngnYaFTTZ0up9RjcbLjQe5XMoVflV9AQ+bAmt83ts1O90HoYfCtqnb8fvFlLRjy7CrBRwtOEIR115LUYMUcjq8rDRKo0GlA==',key_name='tempest-TestShelveInstance-272108759',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:41:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9beb6cd1f92a46f4a37459b75b7ff1d4',ramdisk_id='',reservation_id='r-w770xi1a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1537108126',owner_user_name='tempest-TestShelveInstance-1537108126-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:41:26Z,user_data=None,user_id='ee1ed14495f14c7e8bddfde73dbb3a29',uuid=0223a98e-e08f-4a0f-a707-3770c7a99b00,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e", "address": "fa:16:3e:19:cd:2f", "network": {"id": "eb5b5fbb-4747-49e9-a830-c9ab1c4d4af7", "bridge": "br-int", "label": "tempest-TestShelveInstance-261763164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9beb6cd1f92a46f4a37459b75b7ff1d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbe5cbca-08", "ovs_interfaceid": "dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-87dfb7cd-3d4b-449d-af60-7c091add090d tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Converting VIF {"id": "dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e", "address": "fa:16:3e:19:cd:2f", "network": {"id": "eb5b5fbb-4747-49e9-a830-c9ab1c4d4af7", "bridge": "br-int", "label": "tempest-TestShelveInstance-261763164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9beb6cd1f92a46f4a37459b75b7ff1d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbe5cbca-08", "ovs_interfaceid": "dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-87dfb7cd-3d4b-449d-af60-7c091add090d tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:cd:2f,bridge_name='br-int',has_traffic_filtering=True,id=dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e,network=Network(eb5b5fbb-4747-49e9-a830-c9ab1c4d4af7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbe5cbca-08') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG os_vif [None req-87dfb7cd-3d4b-449d-af60-7c091add090d tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:cd:2f,bridge_name='br-int',has_traffic_filtering=True,id=dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e,network=Network(eb5b5fbb-4747-49e9-a830-c9ab1c4d4af7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbe5cbca-08') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdbe5cbca-08, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8d0e34ee-7827-46a3-9e47-3567643526d3) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:09 user nova-compute[75341]: INFO os_vif [None req-87dfb7cd-3d4b-449d-af60-7c091add090d tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:cd:2f,bridge_name='br-int',has_traffic_filtering=True,id=dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e,network=Network(eb5b5fbb-4747-49e9-a830-c9ab1c4d4af7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbe5cbca-08')
Nov 14 23:43:09 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87dfb7cd-3d4b-449d-af60-7c091add090d tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] calling os-brick to detach iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-87dfb7cd-3d4b-449d-af60-7c091add090d tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, {'target_iqn': 'iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fjgHolcY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:43:09 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-87dfb7cd-3d4b-449d-af60-7c091add090d tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:43:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-87dfb7cd-3d4b-449d-af60-7c091add090d tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-87dfb7cd-3d4b-449d-af60-7c091add090d tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG nova.compute.manager [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: 3c73d0da-fea9-4098-a0e8-c070f22969f4] Instance event wait completed in 0 seconds for  {{(pid=75341) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: 3c73d0da-fea9-4098-a0e8-c070f22969f4] Guest created on hypervisor {{(pid=75341) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[816f6f28-9c26-4ee7-a8a8-4be5e149c91f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2c5ff4fb-63c7-46c8-bfd2-d373ba3e0695\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-87dfb7cd-3d4b-449d-af60-7c091add090d tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 23:43:09 user nova-compute[75341]: No targets found.
Nov 14 23:43:09 user nova-compute[75341]: iSNS:
Nov 14 23:43:09 user nova-compute[75341]: No targets found.
Nov 14 23:43:09 user nova-compute[75341]: STATIC:
Nov 14 23:43:09 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7
Nov 14 23:43:09 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:43:09 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:43:09 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c
Nov 14 23:43:09 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:43:09 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:43:09 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23
Nov 14 23:43:09 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:43:09 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:43:09 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:2c5ff4fb-63c7-46c8-bfd2-d373ba3e0695
Nov 14 23:43:09 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:43:09 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:43:09 user nova-compute[75341]: FIRMWARE:
Nov 14 23:43:09 user nova-compute[75341]: No targets found.
Nov 14 23:43:09 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-87dfb7cd-3d4b-449d-af60-7c091add090d tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 23:43:09 user nova-compute[75341]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 23:43:09 user nova-compute[75341]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75341) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-87dfb7cd-3d4b-449d-af60-7c091add090d tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7', 0)] {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG nova.compute.manager [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Instance event wait completed in 0 seconds for  {{(pid=75341) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Guest created on hypervisor {{(pid=75341) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 23:43:09 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 3c73d0da-fea9-4098-a0e8-c070f22969f4] Instance spawned successfully.
Nov 14 23:43:09 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: 3c73d0da-fea9-4098-a0e8-c070f22969f4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 23:43:09 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Instance spawned successfully.
Nov 14 23:43:09 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b1e35e-e862-4c36-8029-3a2328ae1b9b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c5ff4fb-63c7-46c8-bfd2-d373ba3e0695\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: 3c73d0da-fea9-4098-a0e8-c070f22969f4] Found default for hw_cdrom_bus of ide {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: 3c73d0da-fea9-4098-a0e8-c070f22969f4] Found default for hw_disk_bus of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: 3c73d0da-fea9-4098-a0e8-c070f22969f4] Found default for hw_input_bus of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: 3c73d0da-fea9-4098-a0e8-c070f22969f4] Found default for hw_pointer_model of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: 3c73d0da-fea9-4098-a0e8-c070f22969f4] Found default for hw_video_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: 3c73d0da-fea9-4098-a0e8-c070f22969f4] Found default for hw_vif_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[cadb142b-da2a-4b2a-af7e-0779c82ea01a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c5ff4fb-63c7-46c8-bfd2-d373ba3e0695 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-87dfb7cd-3d4b-449d-af60-7c091add090d tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 (non-flash)
Nov 14 23:43:09 user nova-compute[75341]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)
Nov 14 23:43:09 user nova-compute[75341]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c5ff4fb-63c7-46c8-bfd2-d373ba3e0695 (non-flash)
Nov 14 23:43:09 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:43:09 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-87dfb7cd-3d4b-449d-af60-7c091add090d tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 (non-flash)
Nov 14 23:43:09 user nova-compute[75341]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)
Nov 14 23:43:09 user nova-compute[75341]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c5ff4fb-63c7-46c8-bfd2-d373ba3e0695 (non-flash)
Nov 14 23:43:09 user nova-compute[75341]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:43:09 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-87dfb7cd-3d4b-449d-af60-7c091add090d tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1850707ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7'): ({'sde'}, set())}) {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-87dfb7cd-3d4b-449d-af60-7c091add090d tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Removing single pathed devices sde {{(pid=75341) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Found default for hw_cdrom_bus of ide {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Found default for hw_disk_bus of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Found default for hw_input_bus of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Found default for hw_pointer_model of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Found default for hw_video_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Found default for hw_vif_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:43:09 user nova-compute[75341]: INFO nova.compute.manager [-] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Took 1.13 seconds to deallocate network for instance.
Nov 14 23:43:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[51621537-3181-4982-ab31-fca3583ffdc8]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb89aebd-643d-4c26-8150-aa107579d4d1]: (4, ('ok\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-87dfb7cd-3d4b-449d-af60-7c091add090d tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Flushing IO for device /dev/sde {{(pid=75341) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d56040-dedc-4d41-a802-c3bf4ef6df28]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-87dfb7cd-3d4b-449d-af60-7c091add090d tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75341) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:09 user nova-compute[75341]: INFO nova.compute.manager [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: 3c73d0da-fea9-4098-a0e8-c070f22969f4] Took 6.89 seconds to spawn the instance on the hypervisor.
Nov 14 23:43:09 user nova-compute[75341]: DEBUG nova.compute.manager [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: 3c73d0da-fea9-4098-a0e8-c070f22969f4] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 23:43:09 user nova-compute[75341]: INFO nova.compute.manager [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Took 7.59 seconds to spawn the instance on the hypervisor.
Nov 14 23:43:09 user nova-compute[75341]: DEBUG nova.compute.manager [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ae81e657-f5cb-4fdb-819e-b43d13ea4584 tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ae81e657-f5cb-4fdb-819e-b43d13ea4584 tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.059s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d600ef0-5142-44d3-99d1-ab34e4d18310]: (4, ('1', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-87dfb7cd-3d4b-449d-af60-7c091add090d tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-87dfb7cd-3d4b-449d-af60-7c091add090d tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] SCSI volumes sde have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-87dfb7cd-3d4b-449d-af60-7c091add090d tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7')] {{(pid=75341) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[36149f93-8656-4559-a260-e722c04b8643]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-87dfb7cd-3d4b-449d-af60-7c091add090d tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 -p 172.16.0.220:3260 --logout {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:09 user nova-compute[75341]: INFO nova.compute.manager [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: 3c73d0da-fea9-4098-a0e8-c070f22969f4] Took 7.67 seconds to build instance.
Nov 14 23:43:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-89cbb10f-d236-46c6-abd4-d95e6ef95065 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Lock "3c73d0da-fea9-4098-a0e8-c070f22969f4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.810s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[14cfe233-e6db-42e5-937d-248cb613e929]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-87dfb7cd-3d4b-449d-af60-7c091add090d tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7, portal: 172.16.0.220,3260]
Nov 14 23:43:09 user nova-compute[75341]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7, portal: 172.16.0.220,3260] successful.
Nov 14 23:43:09 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 -p 172.16.0.220:3260 --op delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:09 user nova-compute[75341]: INFO nova.compute.manager [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Took 13.21 seconds to build instance.
Nov 14 23:43:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0df587-f5a2-4552-8aa9-9f087856e0e3]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-87dfb7cd-3d4b-449d-af60-7c091add090d tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-87dfb7cd-3d4b-449d-af60-7c091add090d tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.377s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-87dfb7cd-3d4b-449d-af60-7c091add090d tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] <== disconnect_volume: return (381ms) None {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87dfb7cd-3d4b-449d-af60-7c091add090d tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Disconnected iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 23:43:09 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-87dfb7cd-3d4b-449d-af60-7c091add090d tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Deleting instance files /opt/stack/data/nova/instances/0223a98e-e08f-4a0f-a707-3770c7a99b00_del
Nov 14 23:43:09 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-87dfb7cd-3d4b-449d-af60-7c091add090d tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Deletion of /opt/stack/data/nova/instances/0223a98e-e08f-4a0f-a707-3770c7a99b00_del complete
Nov 14 23:43:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-dad8dedf-04b9-4faa-b393-a5269f567312 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Lock "cffc86d5-2ac6-4dd1-bdcd-5832c134d179" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.316s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG nova.network.neutron [req-d9db51c8-9877-4668-882a-4dda8132f54a req-53b167fe-498d-41cc-b05e-baec9737693d service nova] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Updated VIF entry in instance network info cache for port 9032b49d-13a3-4049-bada-48eb30ea932a. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG nova.network.neutron [req-d9db51c8-9877-4668-882a-4dda8132f54a req-53b167fe-498d-41cc-b05e-baec9737693d service nova] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Updating instance_info_cache with network_info: [{"id": "9032b49d-13a3-4049-bada-48eb30ea932a", "address": "fa:16:3e:12:b9:0d", "network": {"id": "3a83bb9c-6349-46b4-a0ee-a1bd8530b4df", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-310072341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bff46be1f8b45bc95a7924ef327bf46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9032b49d-13", "ovs_interfaceid": "9032b49d-13a3-4049-bada-48eb30ea932a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-d9db51c8-9877-4668-882a-4dda8132f54a req-53b167fe-498d-41cc-b05e-baec9737693d service nova] Releasing lock "refresh_cache-d8d3b42b-11b5-477a-afb1-80a1786b693b" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG nova.compute.manager [req-d9db51c8-9877-4668-882a-4dda8132f54a req-53b167fe-498d-41cc-b05e-baec9737693d service nova] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Received event network-vif-unplugged-295dbc30-38ed-4679-b876-719906e8f9f5 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-d9db51c8-9877-4668-882a-4dda8132f54a req-53b167fe-498d-41cc-b05e-baec9737693d service nova] Acquiring lock "e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-d9db51c8-9877-4668-882a-4dda8132f54a req-53b167fe-498d-41cc-b05e-baec9737693d service nova] Lock "e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-d9db51c8-9877-4668-882a-4dda8132f54a req-53b167fe-498d-41cc-b05e-baec9737693d service nova] Lock "e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG nova.compute.manager [req-d9db51c8-9877-4668-882a-4dda8132f54a req-53b167fe-498d-41cc-b05e-baec9737693d service nova] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] No waiting events found dispatching network-vif-unplugged-295dbc30-38ed-4679-b876-719906e8f9f5 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG nova.compute.manager [req-d9db51c8-9877-4668-882a-4dda8132f54a req-53b167fe-498d-41cc-b05e-baec9737693d service nova] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Received event network-vif-unplugged-295dbc30-38ed-4679-b876-719906e8f9f5 for instance with task_state deleting. {{(pid=75341) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG nova.compute.manager [req-d9db51c8-9877-4668-882a-4dda8132f54a req-53b167fe-498d-41cc-b05e-baec9737693d service nova] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Received event network-vif-plugged-295dbc30-38ed-4679-b876-719906e8f9f5 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-d9db51c8-9877-4668-882a-4dda8132f54a req-53b167fe-498d-41cc-b05e-baec9737693d service nova] Acquiring lock "e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:43:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-d9db51c8-9877-4668-882a-4dda8132f54a req-53b167fe-498d-41cc-b05e-baec9737693d service nova] Lock "e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:43:10 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-d9db51c8-9877-4668-882a-4dda8132f54a req-53b167fe-498d-41cc-b05e-baec9737693d service nova] Lock "e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:43:10 user nova-compute[75341]: DEBUG nova.compute.manager [req-d9db51c8-9877-4668-882a-4dda8132f54a req-53b167fe-498d-41cc-b05e-baec9737693d service nova] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] No waiting events found dispatching network-vif-plugged-295dbc30-38ed-4679-b876-719906e8f9f5 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:43:10 user nova-compute[75341]: WARNING nova.compute.manager [req-d9db51c8-9877-4668-882a-4dda8132f54a req-53b167fe-498d-41cc-b05e-baec9737693d service nova] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Received unexpected event network-vif-plugged-295dbc30-38ed-4679-b876-719906e8f9f5 for instance with vm_state active and task_state deleting.
Nov 14 23:43:10 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-ae81e657-f5cb-4fdb-819e-b43d13ea4584 tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:43:10 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-ae81e657-f5cb-4fdb-819e-b43d13ea4584 tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:43:10 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ae81e657-f5cb-4fdb-819e-b43d13ea4584 tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.443s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:43:10 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-70f3b6a8-3eb3-4e78-9881-45adaed89f9d tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Acquiring lock "d8d3b42b-11b5-477a-afb1-80a1786b693b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:43:10 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-70f3b6a8-3eb3-4e78-9881-45adaed89f9d tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Lock "d8d3b42b-11b5-477a-afb1-80a1786b693b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:43:10 user nova-compute[75341]: DEBUG nova.objects.instance [None req-70f3b6a8-3eb3-4e78-9881-45adaed89f9d tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Lazy-loading 'flavor' on Instance uuid d8d3b42b-11b5-477a-afb1-80a1786b693b {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:43:10 user nova-compute[75341]: INFO nova.scheduler.client.report [None req-ae81e657-f5cb-4fdb-819e-b43d13ea4584 tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] Deleted allocations for instance e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd
Nov 14 23:43:10 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-70f3b6a8-3eb3-4e78-9881-45adaed89f9d tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Lock "d8d3b42b-11b5-477a-afb1-80a1786b693b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.079s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:43:10 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ae81e657-f5cb-4fdb-819e-b43d13ea4584 tempest-VolumesAssistedSnapshotsTest-1143044886 tempest-VolumesAssistedSnapshotsTest-1143044886-project-member] Lock "e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.821s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:43:10 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-70f3b6a8-3eb3-4e78-9881-45adaed89f9d tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Acquiring lock "d8d3b42b-11b5-477a-afb1-80a1786b693b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:43:10 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-70f3b6a8-3eb3-4e78-9881-45adaed89f9d tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Lock "d8d3b42b-11b5-477a-afb1-80a1786b693b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:43:10 user nova-compute[75341]: INFO nova.compute.manager [None req-70f3b6a8-3eb3-4e78-9881-45adaed89f9d tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Attaching volume 1cc5edd0-ae05-4793-9338-6bc0ffd9255a to /dev/vdb
Nov 14 23:43:10 user nova-compute[75341]: DEBUG os_brick.utils [None req-70f3b6a8-3eb3-4e78-9881-45adaed89f9d tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:43:10 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:10 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:10 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3378a5e-548f-4a46-82e3-2028e4a694b1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6d1cfca09c9\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:10 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:10 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:10 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[9603536a-7657-48be-b50f-08855fb7893a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:10 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:10 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:10 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf6c028-e04d-43d7-8da5-36f5ce257d14]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:10 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9f7b46-3994-4bc8-b632-c18712b4136f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:10 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-70f3b6a8-3eb3-4e78-9881-45adaed89f9d tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Running cmd (subprocess): nvme version {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:10 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-70f3b6a8-3eb3-4e78-9881-45adaed89f9d tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] 'nvme version' failed. Not Retrying. {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:43:10 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.nvmeof [None req-70f3b6a8-3eb3-4e78-9881-45adaed89f9d tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] nvme not present on system {{(pid=75341) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 23:43:10 user nova-compute[75341]: DEBUG nova.compute.manager [req-c4c22c0d-1857-4457-be3e-9e888eaac941 req-43457d07-1c7a-43b4-9747-5b521edf48a3 service nova] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Received event network-changed-dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:43:10 user nova-compute[75341]: DEBUG nova.compute.manager [req-c4c22c0d-1857-4457-be3e-9e888eaac941 req-43457d07-1c7a-43b4-9747-5b521edf48a3 service nova] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Refreshing instance network info cache due to event network-changed-dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:43:10 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-c4c22c0d-1857-4457-be3e-9e888eaac941 req-43457d07-1c7a-43b4-9747-5b521edf48a3 service nova] Acquiring lock "refresh_cache-0223a98e-e08f-4a0f-a707-3770c7a99b00" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:43:10 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-c4c22c0d-1857-4457-be3e-9e888eaac941 req-43457d07-1c7a-43b4-9747-5b521edf48a3 service nova] Acquired lock "refresh_cache-0223a98e-e08f-4a0f-a707-3770c7a99b00" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:43:10 user nova-compute[75341]: DEBUG nova.network.neutron [req-c4c22c0d-1857-4457-be3e-9e888eaac941 req-43457d07-1c7a-43b4-9747-5b521edf48a3 service nova] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Refreshing network info cache for port dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:43:10 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:10 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:43:10 user nova-compute[75341]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 23:43:10 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e143b1-11f2-49ba-9b30-49d3e5bab7e1]: (4, '') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:10 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-70f3b6a8-3eb3-4e78-9881-45adaed89f9d tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75341) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 23:43:10 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-70f3b6a8-3eb3-4e78-9881-45adaed89f9d tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 23:43:10 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-70f3b6a8-3eb3-4e78-9881-45adaed89f9d tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] LIGHTOS: no hostnqn found. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 23:43:10 user nova-compute[75341]: DEBUG os_brick.utils [None req-70f3b6a8-3eb3-4e78-9881-45adaed89f9d tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6d1cfca09c9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:43:10 user nova-compute[75341]: DEBUG nova.virt.block_device [None req-70f3b6a8-3eb3-4e78-9881-45adaed89f9d tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Updating existing volume attachment record: 7eabc27f-a363-44bf-bf5e-6fae3f33fc3f {{(pid=75341) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 23:43:10 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:11 user nova-compute[75341]: DEBUG nova.network.neutron [req-c4c22c0d-1857-4457-be3e-9e888eaac941 req-43457d07-1c7a-43b4-9747-5b521edf48a3 service nova] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Updated VIF entry in instance network info cache for port dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:43:11 user nova-compute[75341]: DEBUG nova.network.neutron [req-c4c22c0d-1857-4457-be3e-9e888eaac941 req-43457d07-1c7a-43b4-9747-5b521edf48a3 service nova] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Updating instance_info_cache with network_info: [{"id": "dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e", "address": "fa:16:3e:19:cd:2f", "network": {"id": "eb5b5fbb-4747-49e9-a830-c9ab1c4d4af7", "bridge": null, "label": "tempest-TestShelveInstance-261763164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9beb6cd1f92a46f4a37459b75b7ff1d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapdbe5cbca-08", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:43:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-c4c22c0d-1857-4457-be3e-9e888eaac941 req-43457d07-1c7a-43b4-9747-5b521edf48a3 service nova] Releasing lock "refresh_cache-0223a98e-e08f-4a0f-a707-3770c7a99b00" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:43:11 user nova-compute[75341]: DEBUG nova.compute.manager [req-c4c22c0d-1857-4457-be3e-9e888eaac941 req-43457d07-1c7a-43b4-9747-5b521edf48a3 service nova] [instance: e1c2d7ad-69ef-4bbf-a27b-c24c5fc1ebcd] Received event network-vif-deleted-295dbc30-38ed-4679-b876-719906e8f9f5 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:43:11 user nova-compute[75341]: INFO nova.scheduler.client.report [None req-87dfb7cd-3d4b-449d-af60-7c091add090d tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Deleted allocations for instance 0223a98e-e08f-4a0f-a707-3770c7a99b00
Nov 14 23:43:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-87dfb7cd-3d4b-449d-af60-7c091add090d tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:43:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-87dfb7cd-3d4b-449d-af60-7c091add090d tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:43:11 user nova-compute[75341]: DEBUG nova.objects.instance [None req-87dfb7cd-3d4b-449d-af60-7c091add090d tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Lazy-loading 'numa_topology' on Instance uuid 0223a98e-e08f-4a0f-a707-3770c7a99b00 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:43:11 user nova-compute[75341]: DEBUG nova.objects.base [None req-87dfb7cd-3d4b-449d-af60-7c091add090d tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Object Instance<0223a98e-e08f-4a0f-a707-3770c7a99b00> lazy-loaded attributes: resources,numa_topology {{(pid=75341) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 23:43:11 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-87dfb7cd-3d4b-449d-af60-7c091add090d tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:43:11 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-87dfb7cd-3d4b-449d-af60-7c091add090d tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:43:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-87dfb7cd-3d4b-449d-af60-7c091add090d tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.449s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:43:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-87dfb7cd-3d4b-449d-af60-7c091add090d tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Lock "0223a98e-e08f-4a0f-a707-3770c7a99b00" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 5.070s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:43:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:15 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70f3b6a8-3eb3-4e78-9881-45adaed89f9d tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Calling os-brick to attach iSCSI Volume {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 23:43:15 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f3b6a8-3eb3-4e78-9881-45adaed89f9d tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1cc5edd0-ae05-4793-9338-6bc0ffd9255a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aULxGEXZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:43:15 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-70f3b6a8-3eb3-4e78-9881-45adaed89f9d tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:43:15 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-70f3b6a8-3eb3-4e78-9881-45adaed89f9d tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:43:15 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-70f3b6a8-3eb3-4e78-9881-45adaed89f9d tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:43:15 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-70f3b6a8-3eb3-4e78-9881-45adaed89f9d tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:43:15 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-70f3b6a8-3eb3-4e78-9881-45adaed89f9d tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1cc5edd0-ae05-4793-9338-6bc0ffd9255a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:43:15 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-70f3b6a8-3eb3-4e78-9881-45adaed89f9d tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1cc5edd0-ae05-4793-9338-6bc0ffd9255a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:43:15 user nova-compute[75341]: INFO os_brick.initiator.connectors.iscsi [None req-70f3b6a8-3eb3-4e78-9881-45adaed89f9d tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 23:43:15 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cc5edd0-ae05-4793-9338-6bc0ffd9255a -p 172.16.0.220:3260 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:15 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cc5edd0-ae05-4793-9338-6bc0ffd9255a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:15 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[25093ae8-956b-4dad-a864-09c23c002855]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:15 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f3b6a8-3eb3-4e78-9881-45adaed89f9d tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 23:43:15 user nova-compute[75341]:  {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:43:15 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cc5edd0-ae05-4793-9338-6bc0ffd9255a -p 172.16.0.220:3260 --interface default --op new {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:15 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cc5edd0-ae05-4793-9338-6bc0ffd9255a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:15 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[d802713d-1d01-4552-a349-5e2a2a061921]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1cc5edd0-ae05-4793-9338-6bc0ffd9255a] added\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:15 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f3b6a8-3eb3-4e78-9881-45adaed89f9d tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1cc5edd0-ae05-4793-9338-6bc0ffd9255a] added
Nov 14 23:43:15 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:43:15 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cc5edd0-ae05-4793-9338-6bc0ffd9255a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:15 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cc5edd0-ae05-4793-9338-6bc0ffd9255a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:15 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf644bb-8bff-4bb4-85f8-99cb87f5f0da]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:15 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f3b6a8-3eb3-4e78-9881-45adaed89f9d tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:43:15 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cc5edd0-ae05-4793-9338-6bc0ffd9255a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:15 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cc5edd0-ae05-4793-9338-6bc0ffd9255a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:15 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd2a45d-0845-4f0a-aea1-d13094a186db]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:15 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f3b6a8-3eb3-4e78-9881-45adaed89f9d tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:43:15 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cc5edd0-ae05-4793-9338-6bc0ffd9255a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aULxGEXZ {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:15 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cc5edd0-ae05-4793-9338-6bc0ffd9255a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aULxGEXZ" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:15 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1d28ab-8192-40a7-9f74-a6b0b57f62eb]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:15 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f3b6a8-3eb3-4e78-9881-45adaed89f9d tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aULxGEXZ'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:43:15 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cc5edd0-ae05-4793-9338-6bc0ffd9255a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:15 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cc5edd0-ae05-4793-9338-6bc0ffd9255a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:15 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e07b1e-46c2-48b8-86cd-6012f5ad5663]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:15 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f3b6a8-3eb3-4e78-9881-45adaed89f9d tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:43:15 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:15 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:15 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[0450f698-5863-480a-9c39-8abe8bba9a7c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c5ff4fb-63c7-46c8-bfd2-d373ba3e0695 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:15 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f3b6a8-3eb3-4e78-9881-45adaed89f9d tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 (non-flash)
Nov 14 23:43:15 user nova-compute[75341]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)
Nov 14 23:43:15 user nova-compute[75341]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c5ff4fb-63c7-46c8-bfd2-d373ba3e0695 (non-flash)
Nov 14 23:43:15 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:43:15 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f3b6a8-3eb3-4e78-9881-45adaed89f9d tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 (non-flash)
Nov 14 23:43:15 user nova-compute[75341]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)
Nov 14 23:43:15 user nova-compute[75341]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c5ff4fb-63c7-46c8-bfd2-d373ba3e0695 (non-flash)
Nov 14 23:43:15 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:43:15 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cc5edd0-ae05-4793-9338-6bc0ffd9255a -p 172.16.0.220:3260 --login {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:15 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cc5edd0-ae05-4793-9338-6bc0ffd9255a -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:15 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddda0128-efb4-4bdc-b6d2-961db3d96147]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1cc5edd0-ae05-4793-9338-6bc0ffd9255a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1cc5edd0-ae05-4793-9338-6bc0ffd9255a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:15 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f3b6a8-3eb3-4e78-9881-45adaed89f9d tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1cc5edd0-ae05-4793-9338-6bc0ffd9255a, portal: 172.16.0.220,3260]
Nov 14 23:43:15 user nova-compute[75341]: Login to [iface: default, target: iqn.2010-10.org.openstack:1cc5edd0-ae05-4793-9338-6bc0ffd9255a, portal: 172.16.0.220,3260] successful.
Nov 14 23:43:15 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:43:15 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cc5edd0-ae05-4793-9338-6bc0ffd9255a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:15 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cc5edd0-ae05-4793-9338-6bc0ffd9255a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:15 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd3257d-1dc2-4b10-9fa5-cb7ba2b54b32]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:15 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f3b6a8-3eb3-4e78-9881-45adaed89f9d tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:43:15 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:15 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:15 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba34f9f5-8de2-4f7e-8b5a-dc5a9436f86d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c5ff4fb-63c7-46c8-bfd2-d373ba3e0695 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cc5edd0-ae05-4793-9338-6bc0ffd9255a (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:15 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f3b6a8-3eb3-4e78-9881-45adaed89f9d tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 (non-flash)
Nov 14 23:43:15 user nova-compute[75341]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)
Nov 14 23:43:15 user nova-compute[75341]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c5ff4fb-63c7-46c8-bfd2-d373ba3e0695 (non-flash)
Nov 14 23:43:15 user nova-compute[75341]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cc5edd0-ae05-4793-9338-6bc0ffd9255a (non-flash)
Nov 14 23:43:15 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:43:15 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f3b6a8-3eb3-4e78-9881-45adaed89f9d tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 (non-flash)
Nov 14 23:43:15 user nova-compute[75341]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)
Nov 14 23:43:15 user nova-compute[75341]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c5ff4fb-63c7-46c8-bfd2-d373ba3e0695 (non-flash)
Nov 14 23:43:15 user nova-compute[75341]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cc5edd0-ae05-4793-9338-6bc0ffd9255a (non-flash)
Nov 14 23:43:15 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:43:15 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-70f3b6a8-3eb3-4e78-9881-45adaed89f9d tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1cc5edd0-ae05-4793-9338-6bc0ffd9255a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:43:15 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f3b6a8-3eb3-4e78-9881-45adaed89f9d tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Connected to 172.16.0.220:3260 {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 23:43:15 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-70f3b6a8-3eb3-4e78-9881-45adaed89f9d tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] HCTL ('36', '-', '-', 0) found on session 17 with lun 0 {{(pid=75341) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 23:43:15 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-70f3b6a8-3eb3-4e78-9881-45adaed89f9d tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75341) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 23:43:15 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:15 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:15 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:15 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[3342bacb-81f8-493b-9f46-ac01ed6de851]: (4, ('- - 0', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:15 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-70f3b6a8-3eb3-4e78-9881-45adaed89f9d tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Searching for a device in session 17 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 23:43:15 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f3b6a8-3eb3-4e78-9881-45adaed89f9d tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:1cc5edd0-ae05-4793-9338-6bc0ffd9255a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aULxGEXZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 23:43:16 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-70f3b6a8-3eb3-4e78-9881-45adaed89f9d tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:43:16 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f3b6a8-3eb3-4e78-9881-45adaed89f9d tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23334633935636335', 'path': '/dev/sde'} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:43:16 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70f3b6a8-3eb3-4e78-9881-45adaed89f9d tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334633935636335', 'path': '/dev/sde'} {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 23:43:16 user nova-compute[75341]: DEBUG nova.objects.instance [None req-70f3b6a8-3eb3-4e78-9881-45adaed89f9d tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Lazy-loading 'flavor' on Instance uuid d8d3b42b-11b5-477a-afb1-80a1786b693b {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:43:16 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-70f3b6a8-3eb3-4e78-9881-45adaed89f9d tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 23:43:16 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:43:16 user nova-compute[75341]:   <source dev="/dev/sde"/>
Nov 14 23:43:16 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:43:16 user nova-compute[75341]:   <serial>1cc5edd0-ae05-4793-9338-6bc0ffd9255a</serial>
Nov 14 23:43:16 user nova-compute[75341]: </disk>
Nov 14 23:43:16 user nova-compute[75341]:  {{(pid=75341) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 23:43:17 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-70f3b6a8-3eb3-4e78-9881-45adaed89f9d tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:43:17 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-70f3b6a8-3eb3-4e78-9881-45adaed89f9d tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:43:17 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-70f3b6a8-3eb3-4e78-9881-45adaed89f9d tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] No VIF found with MAC fa:16:3e:12:b9:0d, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:43:17 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-70f3b6a8-3eb3-4e78-9881-45adaed89f9d tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Lock "d8d3b42b-11b5-477a-afb1-80a1786b693b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.952s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:43:19 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c7c89a04-9a39-489f-8e3a-2fb3c984f218 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Acquiring lock "d8d3b42b-11b5-477a-afb1-80a1786b693b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:43:19 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c7c89a04-9a39-489f-8e3a-2fb3c984f218 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Lock "d8d3b42b-11b5-477a-afb1-80a1786b693b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:43:19 user nova-compute[75341]: INFO nova.compute.manager [None req-c7c89a04-9a39-489f-8e3a-2fb3c984f218 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Detaching volume 1cc5edd0-ae05-4793-9338-6bc0ffd9255a
Nov 14 23:43:19 user nova-compute[75341]: INFO nova.virt.block_device [None req-c7c89a04-9a39-489f-8e3a-2fb3c984f218 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Attempting to driver detach volume 1cc5edd0-ae05-4793-9338-6bc0ffd9255a from mountpoint /dev/vdb
Nov 14 23:43:19 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c7c89a04-9a39-489f-8e3a-2fb3c984f218 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Attempting to detach device vdb from instance d8d3b42b-11b5-477a-afb1-80a1786b693b from the persistent domain config. {{(pid=75341) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 23:43:19 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-c7c89a04-9a39-489f-8e3a-2fb3c984f218 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 23:43:19 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:43:19 user nova-compute[75341]:   <source dev="/dev/sde"/>
Nov 14 23:43:19 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:43:19 user nova-compute[75341]:   <serial>1cc5edd0-ae05-4793-9338-6bc0ffd9255a</serial>
Nov 14 23:43:19 user nova-compute[75341]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 23:43:19 user nova-compute[75341]: </disk>
Nov 14 23:43:19 user nova-compute[75341]:  {{(pid=75341) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 23:43:19 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-c7c89a04-9a39-489f-8e3a-2fb3c984f218 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Successfully detached device vdb from instance d8d3b42b-11b5-477a-afb1-80a1786b693b from the persistent domain config.
Nov 14 23:43:19 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c7c89a04-9a39-489f-8e3a-2fb3c984f218 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d8d3b42b-11b5-477a-afb1-80a1786b693b from the live domain config. {{(pid=75341) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 23:43:19 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-c7c89a04-9a39-489f-8e3a-2fb3c984f218 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 23:43:19 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:43:19 user nova-compute[75341]:   <source dev="/dev/sde"/>
Nov 14 23:43:19 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:43:19 user nova-compute[75341]:   <serial>1cc5edd0-ae05-4793-9338-6bc0ffd9255a</serial>
Nov 14 23:43:19 user nova-compute[75341]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 23:43:19 user nova-compute[75341]: </disk>
Nov 14 23:43:19 user nova-compute[75341]:  {{(pid=75341) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 23:43:19 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:19 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c7c89a04-9a39-489f-8e3a-2fb3c984f218 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d8d3b42b-11b5-477a-afb1-80a1786b693b {{(pid=75341) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 23:43:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:28 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6ce2b30d-ca25-4379-b9c1-9f183461f689 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Acquiring lock "0e7a53e9-6982-4c93-a830-a49cf0ce76bd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:43:28 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6ce2b30d-ca25-4379-b9c1-9f183461f689 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Lock "0e7a53e9-6982-4c93-a830-a49cf0ce76bd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:43:28 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6ce2b30d-ca25-4379-b9c1-9f183461f689 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Acquiring lock "0e7a53e9-6982-4c93-a830-a49cf0ce76bd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:43:28 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6ce2b30d-ca25-4379-b9c1-9f183461f689 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Lock "0e7a53e9-6982-4c93-a830-a49cf0ce76bd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:43:28 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6ce2b30d-ca25-4379-b9c1-9f183461f689 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Lock "0e7a53e9-6982-4c93-a830-a49cf0ce76bd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:43:28 user nova-compute[75341]: INFO nova.compute.manager [None req-6ce2b30d-ca25-4379-b9c1-9f183461f689 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Terminating instance
Nov 14 23:43:28 user nova-compute[75341]: DEBUG nova.compute.manager [None req-6ce2b30d-ca25-4379-b9c1-9f183461f689 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Start destroying the instance on the hypervisor. {{(pid=75341) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 23:43:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG nova.compute.manager [req-7fb52974-2172-4196-b462-7c65bf2923d5 req-163ad235-3ca1-4e60-9086-018cc0cf3750 service nova] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Received event network-vif-unplugged-6f1be2e1-796a-4b73-a56f-2a5286945ea3 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-7fb52974-2172-4196-b462-7c65bf2923d5 req-163ad235-3ca1-4e60-9086-018cc0cf3750 service nova] Acquiring lock "0e7a53e9-6982-4c93-a830-a49cf0ce76bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-7fb52974-2172-4196-b462-7c65bf2923d5 req-163ad235-3ca1-4e60-9086-018cc0cf3750 service nova] Lock "0e7a53e9-6982-4c93-a830-a49cf0ce76bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-7fb52974-2172-4196-b462-7c65bf2923d5 req-163ad235-3ca1-4e60-9086-018cc0cf3750 service nova] Lock "0e7a53e9-6982-4c93-a830-a49cf0ce76bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG nova.compute.manager [req-7fb52974-2172-4196-b462-7c65bf2923d5 req-163ad235-3ca1-4e60-9086-018cc0cf3750 service nova] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] No waiting events found dispatching network-vif-unplugged-6f1be2e1-796a-4b73-a56f-2a5286945ea3 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG nova.compute.manager [req-7fb52974-2172-4196-b462-7c65bf2923d5 req-163ad235-3ca1-4e60-9086-018cc0cf3750 service nova] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Received event network-vif-unplugged-6f1be2e1-796a-4b73-a56f-2a5286945ea3 for instance with task_state deleting. {{(pid=75341) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 23:43:29 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-11ad3580-c067-4a1e-9a5b-596d2a5066d8 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 44080c0d-56eb-4987-aa4b-59f161dcbc0b is timed out.
Nov 14 23:43:29 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-11ad3580-c067-4a1e-9a5b-596d2a5066d8 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Successfully detached device vdc from instance 44080c0d-56eb-4987-aa4b-59f161dcbc0b from the live domain config.
Nov 14 23:43:29 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11ad3580-c067-4a1e-9a5b-596d2a5066d8 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] calling os-brick to detach iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ad3580-c067-4a1e-9a5b-596d2a5066d8 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, {'target_iqn': 'iqn.2010-10.org.openstack:2c5ff4fb-63c7-46c8-bfd2-d373ba3e0695', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aVLObcrl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:43:29 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-11ad3580-c067-4a1e-9a5b-596d2a5066d8 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:43:29 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-11ad3580-c067-4a1e-9a5b-596d2a5066d8 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-11ad3580-c067-4a1e-9a5b-596d2a5066d8 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90d6cd6-2a24-4aef-939a-03458bb153a0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1cc5edd0-ae05-4793-9338-6bc0ffd9255a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2c5ff4fb-63c7-46c8-bfd2-d373ba3e0695\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ad3580-c067-4a1e-9a5b-596d2a5066d8 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 23:43:29 user nova-compute[75341]: No targets found.
Nov 14 23:43:29 user nova-compute[75341]: iSNS:
Nov 14 23:43:29 user nova-compute[75341]: No targets found.
Nov 14 23:43:29 user nova-compute[75341]: STATIC:
Nov 14 23:43:29 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:1cc5edd0-ae05-4793-9338-6bc0ffd9255a
Nov 14 23:43:29 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:43:29 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:43:29 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c
Nov 14 23:43:29 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:43:29 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:43:29 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23
Nov 14 23:43:29 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:43:29 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:43:29 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:2c5ff4fb-63c7-46c8-bfd2-d373ba3e0695
Nov 14 23:43:29 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:43:29 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:43:29 user nova-compute[75341]: FIRMWARE:
Nov 14 23:43:29 user nova-compute[75341]: No targets found.
Nov 14 23:43:29 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ad3580-c067-4a1e-9a5b-596d2a5066d8 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 23:43:29 user nova-compute[75341]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 23:43:29 user nova-compute[75341]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75341) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ad3580-c067-4a1e-9a5b-596d2a5066d8 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c5ff4fb-63c7-46c8-bfd2-d373ba3e0695', 0)] {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca42397-24c5-4364-b2ce-8747453e7b98]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1cc5edd0-ae05-4793-9338-6bc0ffd9255a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c5ff4fb-63c7-46c8-bfd2-d373ba3e0695\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[15870934-421b-4df6-beae-875ed9c82baf]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c5ff4fb-63c7-46c8-bfd2-d373ba3e0695 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cc5edd0-ae05-4793-9338-6bc0ffd9255a (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ad3580-c067-4a1e-9a5b-596d2a5066d8 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 (non-flash)
Nov 14 23:43:29 user nova-compute[75341]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)
Nov 14 23:43:29 user nova-compute[75341]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c5ff4fb-63c7-46c8-bfd2-d373ba3e0695 (non-flash)
Nov 14 23:43:29 user nova-compute[75341]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cc5edd0-ae05-4793-9338-6bc0ffd9255a (non-flash)
Nov 14 23:43:29 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ad3580-c067-4a1e-9a5b-596d2a5066d8 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 (non-flash)
Nov 14 23:43:29 user nova-compute[75341]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)
Nov 14 23:43:29 user nova-compute[75341]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c5ff4fb-63c7-46c8-bfd2-d373ba3e0695 (non-flash)
Nov 14 23:43:29 user nova-compute[75341]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cc5edd0-ae05-4793-9338-6bc0ffd9255a (non-flash)
Nov 14 23:43:29 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ad3580-c067-4a1e-9a5b-596d2a5066d8 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18507163b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c5ff4fb-63c7-46c8-bfd2-d373ba3e0695'): ({'sdd'}, set())}) {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-11ad3580-c067-4a1e-9a5b-596d2a5066d8 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Removing single pathed devices sdd {{(pid=75341) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed38c75-8de6-4665-ad6c-348a1fe1eb0c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcee947a-a463-4ce5-9036-788e1131726b]: (4, ('ok\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-11ad3580-c067-4a1e-9a5b-596d2a5066d8 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Flushing IO for device /dev/sdd {{(pid=75341) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6465137-a7d2-404f-bdc9-1f925cdc701a]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-11ad3580-c067-4a1e-9a5b-596d2a5066d8 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75341) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0fcc35-8cef-43d0-9e89-b4e078f01fc2]: (4, ('1', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-11ad3580-c067-4a1e-9a5b-596d2a5066d8 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-11ad3580-c067-4a1e-9a5b-596d2a5066d8 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] SCSI volumes sdd have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ad3580-c067-4a1e-9a5b-596d2a5066d8 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c5ff4fb-63c7-46c8-bfd2-d373ba3e0695')] {{(pid=75341) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c5ff4fb-63c7-46c8-bfd2-d373ba3e0695 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c5ff4fb-63c7-46c8-bfd2-d373ba3e0695 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6b0fd6-43d6-4d9e-a82f-bbdad20b4767]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ad3580-c067-4a1e-9a5b-596d2a5066d8 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c5ff4fb-63c7-46c8-bfd2-d373ba3e0695 -p 172.16.0.220:3260 --logout {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:29 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Instance destroyed successfully.
Nov 14 23:43:29 user nova-compute[75341]: DEBUG nova.objects.instance [None req-6ce2b30d-ca25-4379-b9c1-9f183461f689 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Lazy-loading 'resources' on Instance uuid 0e7a53e9-6982-4c93-a830-a49cf0ce76bd {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-6ce2b30d-ca25-4379-b9c1-9f183461f689 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:40:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2055548980',display_name='tempest-TestVolumeSwap-server-2055548980',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2055548980',id=5,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxavwXSG442lyT36C24aCCYnv3KPxzEVSTsX+bLTYR5aG6QoAXbYBEOHyRynDVjR4HdR3O5SO+UFQA6Wd1y9wCyxP5e9Dr7A7aMi0IP7zsHTJxUDMkAXDIgckWNJ7fP6Q==',key_name='tempest-keypair-1225229560',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:40:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aaee8b9e61234bc68b1da5fceb349cb6',ramdisk_id='',reservation_id='r-e334ge8g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1447465409',owner_user_name='tempest-TestVolumeSwap-1447465409-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:40:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='666ca2b69b3f487687ba900bd04221d4',uuid=0e7a53e9-6982-4c93-a830-a49cf0ce76bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f1be2e1-796a-4b73-a56f-2a5286945ea3", "address": "fa:16:3e:a0:1d:39", "network": {"id": "7071106e-e54c-4358-97b0-3c0778da8843", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2081310732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaee8b9e61234bc68b1da5fceb349cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f1be2e1-79", "ovs_interfaceid": "6f1be2e1-796a-4b73-a56f-2a5286945ea3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-6ce2b30d-ca25-4379-b9c1-9f183461f689 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Converting VIF {"id": "6f1be2e1-796a-4b73-a56f-2a5286945ea3", "address": "fa:16:3e:a0:1d:39", "network": {"id": "7071106e-e54c-4358-97b0-3c0778da8843", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2081310732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaee8b9e61234bc68b1da5fceb349cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f1be2e1-79", "ovs_interfaceid": "6f1be2e1-796a-4b73-a56f-2a5286945ea3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-6ce2b30d-ca25-4379-b9c1-9f183461f689 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a0:1d:39,bridge_name='br-int',has_traffic_filtering=True,id=6f1be2e1-796a-4b73-a56f-2a5286945ea3,network=Network(7071106e-e54c-4358-97b0-3c0778da8843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f1be2e1-79') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG os_vif [None req-6ce2b30d-ca25-4379-b9c1-9f183461f689 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:1d:39,bridge_name='br-int',has_traffic_filtering=True,id=6f1be2e1-796a-4b73-a56f-2a5286945ea3,network=Network(7071106e-e54c-4358-97b0-3c0778da8843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f1be2e1-79') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c5ff4fb-63c7-46c8-bfd2-d373ba3e0695 -p 172.16.0.220:3260 --logout" returned: 0 in 0.104s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[94127b55-5bbe-4cba-a48b-ec83a9099820]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:2c5ff4fb-63c7-46c8-bfd2-d373ba3e0695, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:2c5ff4fb-63c7-46c8-bfd2-d373ba3e0695, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ad3580-c067-4a1e-9a5b-596d2a5066d8 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:2c5ff4fb-63c7-46c8-bfd2-d373ba3e0695, portal: 172.16.0.220,3260]
Nov 14 23:43:29 user nova-compute[75341]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:2c5ff4fb-63c7-46c8-bfd2-d373ba3e0695, portal: 172.16.0.220,3260] successful.
Nov 14 23:43:29 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6f1be2e1-79, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c5ff4fb-63c7-46c8-bfd2-d373ba3e0695 -p 172.16.0.220:3260 --op delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=49ff06ba-aef0-4ad5-a044-fb1cf1e3c3dd) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:43:29 user nova-compute[75341]: INFO os_vif [None req-6ce2b30d-ca25-4379-b9c1-9f183461f689 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:1d:39,bridge_name='br-int',has_traffic_filtering=True,id=6f1be2e1-796a-4b73-a56f-2a5286945ea3,network=Network(7071106e-e54c-4358-97b0-3c0778da8843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f1be2e1-79')
Nov 14 23:43:29 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-6ce2b30d-ca25-4379-b9c1-9f183461f689 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Deleting instance files /opt/stack/data/nova/instances/0e7a53e9-6982-4c93-a830-a49cf0ce76bd_del
Nov 14 23:43:29 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-6ce2b30d-ca25-4379-b9c1-9f183461f689 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Deletion of /opt/stack/data/nova/instances/0e7a53e9-6982-4c93-a830-a49cf0ce76bd_del complete
Nov 14 23:43:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c5ff4fb-63c7-46c8-bfd2-d373ba3e0695 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[396b7e7a-b1d5-4822-a283-54c3b0ad321f]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ad3580-c067-4a1e-9a5b-596d2a5066d8 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-11ad3580-c067-4a1e-9a5b-596d2a5066d8 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.460s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ad3580-c067-4a1e-9a5b-596d2a5066d8 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] <== disconnect_volume: return (461ms) None {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11ad3580-c067-4a1e-9a5b-596d2a5066d8 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Disconnected iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 23:43:29 user nova-compute[75341]: INFO nova.compute.manager [None req-6ce2b30d-ca25-4379-b9c1-9f183461f689 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 14 23:43:29 user nova-compute[75341]: DEBUG oslo.service.loopingcall [None req-6ce2b30d-ca25-4379-b9c1-9f183461f689 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75341) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG nova.compute.manager [-] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Deallocating network for instance {{(pid=75341) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] deallocate_for_instance() {{(pid=75341) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b248e434-194c-4fba-b4a0-aaf0ca8b98ab tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Acquiring lock "163c448b-0183-41bb-b6e0-61917f6ad781" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b248e434-194c-4fba-b4a0-aaf0ca8b98ab tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Lock "163c448b-0183-41bb-b6e0-61917f6ad781" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b248e434-194c-4fba-b4a0-aaf0ca8b98ab tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Acquiring lock "163c448b-0183-41bb-b6e0-61917f6ad781-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b248e434-194c-4fba-b4a0-aaf0ca8b98ab tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Lock "163c448b-0183-41bb-b6e0-61917f6ad781-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b248e434-194c-4fba-b4a0-aaf0ca8b98ab tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Lock "163c448b-0183-41bb-b6e0-61917f6ad781-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:43:29 user nova-compute[75341]: INFO nova.compute.manager [None req-b248e434-194c-4fba-b4a0-aaf0ca8b98ab tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Terminating instance
Nov 14 23:43:29 user nova-compute[75341]: DEBUG nova.compute.manager [None req-b248e434-194c-4fba-b4a0-aaf0ca8b98ab tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Start destroying the instance on the hypervisor. {{(pid=75341) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:30 user nova-compute[75341]: DEBUG nova.objects.instance [None req-11ad3580-c067-4a1e-9a5b-596d2a5066d8 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Lazy-loading 'flavor' on Instance uuid 44080c0d-56eb-4987-aa4b-59f161dcbc0b {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:43:30 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-11ad3580-c067-4a1e-9a5b-596d2a5066d8 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Lock "44080c0d-56eb-4987-aa4b-59f161dcbc0b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.104s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:43:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:30 user nova-compute[75341]: DEBUG nova.compute.manager [req-86c4d46a-b777-43b1-8400-c81f13e86772 req-a70a41f2-9ba2-4b49-b223-3f2810ab6c36 service nova] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Received event network-vif-unplugged-87b091a7-76a0-46e1-b1fd-fd305d1ce55e {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:43:30 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-86c4d46a-b777-43b1-8400-c81f13e86772 req-a70a41f2-9ba2-4b49-b223-3f2810ab6c36 service nova] Acquiring lock "163c448b-0183-41bb-b6e0-61917f6ad781-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:43:30 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-86c4d46a-b777-43b1-8400-c81f13e86772 req-a70a41f2-9ba2-4b49-b223-3f2810ab6c36 service nova] Lock "163c448b-0183-41bb-b6e0-61917f6ad781-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:43:30 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-86c4d46a-b777-43b1-8400-c81f13e86772 req-a70a41f2-9ba2-4b49-b223-3f2810ab6c36 service nova] Lock "163c448b-0183-41bb-b6e0-61917f6ad781-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:43:30 user nova-compute[75341]: DEBUG nova.compute.manager [req-86c4d46a-b777-43b1-8400-c81f13e86772 req-a70a41f2-9ba2-4b49-b223-3f2810ab6c36 service nova] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] No waiting events found dispatching network-vif-unplugged-87b091a7-76a0-46e1-b1fd-fd305d1ce55e {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:43:30 user nova-compute[75341]: DEBUG nova.compute.manager [req-86c4d46a-b777-43b1-8400-c81f13e86772 req-a70a41f2-9ba2-4b49-b223-3f2810ab6c36 service nova] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Received event network-vif-unplugged-87b091a7-76a0-46e1-b1fd-fd305d1ce55e for instance with task_state deleting. {{(pid=75341) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 23:43:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:30 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Instance destroyed successfully.
Nov 14 23:43:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:30 user nova-compute[75341]: DEBUG nova.objects.instance [None req-b248e434-194c-4fba-b4a0-aaf0ca8b98ab tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Lazy-loading 'resources' on Instance uuid 163c448b-0183-41bb-b6e0-61917f6ad781 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:43:30 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-b248e434-194c-4fba-b4a0-aaf0ca8b98ab tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T23:40:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1560149904',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1560149904',id=7,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQ3a1x+okDjRVw62hbKhJtP80/zWFyvtGey5wIlVDB0NZ56fG+725fWUXyjh7/+IE35PijjUBR8Wcuw/LlwusTfjzX4MaOP3PLObnIQMoEItEWkt+BvyX7BQ255w2h2Gw==',key_name='tempest-keypair-1289222933',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:40:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dc16bad01d434f7f9a66247f776d6269',ramdisk_id='',reservation_id='r-3r4vupg5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1943224082',owner_user_name='tempest-TaggedAttachmentsTest-1943224082-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:40:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48f384876a794dbfa3e7c89e6e20a232',uuid=163c448b-0183-41bb-b6e0-61917f6ad781,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "87b091a7-76a0-46e1-b1fd-fd305d1ce55e", "address": "fa:16:3e:2f:5b:cc", "network": {"id": "0a21b45e-de67-426a-bc33-c012fb2b5528", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1524380697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc16bad01d434f7f9a66247f776d6269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87b091a7-76", "ovs_interfaceid": "87b091a7-76a0-46e1-b1fd-fd305d1ce55e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 23:43:30 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-b248e434-194c-4fba-b4a0-aaf0ca8b98ab tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Converting VIF {"id": "87b091a7-76a0-46e1-b1fd-fd305d1ce55e", "address": "fa:16:3e:2f:5b:cc", "network": {"id": "0a21b45e-de67-426a-bc33-c012fb2b5528", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1524380697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc16bad01d434f7f9a66247f776d6269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87b091a7-76", "ovs_interfaceid": "87b091a7-76a0-46e1-b1fd-fd305d1ce55e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:43:30 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-b248e434-194c-4fba-b4a0-aaf0ca8b98ab tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:5b:cc,bridge_name='br-int',has_traffic_filtering=True,id=87b091a7-76a0-46e1-b1fd-fd305d1ce55e,network=Network(0a21b45e-de67-426a-bc33-c012fb2b5528),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87b091a7-76') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:43:30 user nova-compute[75341]: DEBUG os_vif [None req-b248e434-194c-4fba-b4a0-aaf0ca8b98ab tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:5b:cc,bridge_name='br-int',has_traffic_filtering=True,id=87b091a7-76a0-46e1-b1fd-fd305d1ce55e,network=Network(0a21b45e-de67-426a-bc33-c012fb2b5528),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87b091a7-76') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 23:43:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap87b091a7-76, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:43:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:43:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4ac4dc7e-96d1-49ef-9c3f-91d7f6dbd6e4) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:43:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:30 user nova-compute[75341]: INFO os_vif [None req-b248e434-194c-4fba-b4a0-aaf0ca8b98ab tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:5b:cc,bridge_name='br-int',has_traffic_filtering=True,id=87b091a7-76a0-46e1-b1fd-fd305d1ce55e,network=Network(0a21b45e-de67-426a-bc33-c012fb2b5528),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87b091a7-76')
Nov 14 23:43:30 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-b248e434-194c-4fba-b4a0-aaf0ca8b98ab tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Deleting instance files /opt/stack/data/nova/instances/163c448b-0183-41bb-b6e0-61917f6ad781_del
Nov 14 23:43:30 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-b248e434-194c-4fba-b4a0-aaf0ca8b98ab tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Deletion of /opt/stack/data/nova/instances/163c448b-0183-41bb-b6e0-61917f6ad781_del complete
Nov 14 23:43:30 user nova-compute[75341]: INFO nova.compute.manager [None req-b248e434-194c-4fba-b4a0-aaf0ca8b98ab tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 14 23:43:30 user nova-compute[75341]: DEBUG oslo.service.loopingcall [None req-b248e434-194c-4fba-b4a0-aaf0ca8b98ab tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75341) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 23:43:30 user nova-compute[75341]: DEBUG nova.compute.manager [-] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Deallocating network for instance {{(pid=75341) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 23:43:30 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] deallocate_for_instance() {{(pid=75341) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 23:43:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:30 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:43:30 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b9f0f2c3-c91c-4f08-be17-1baeff15b865 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Acquiring lock "881351d7-31f9-44f4-8571-8f540bbec29c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:43:30 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b9f0f2c3-c91c-4f08-be17-1baeff15b865 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Lock "881351d7-31f9-44f4-8571-8f540bbec29c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:43:30 user nova-compute[75341]: INFO nova.compute.manager [-] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Took 1.26 seconds to deallocate network for instance.
Nov 14 23:43:30 user nova-compute[75341]: DEBUG nova.objects.instance [None req-b9f0f2c3-c91c-4f08-be17-1baeff15b865 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Lazy-loading 'flavor' on Instance uuid 881351d7-31f9-44f4-8571-8f540bbec29c {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:43:30 user nova-compute[75341]: DEBUG nova.compute.manager [req-dd1d16be-17dc-4f6e-8a10-021d628570c5 req-49c8273f-86e7-4ff5-9eeb-76331b508856 service nova] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Received event network-vif-deleted-6f1be2e1-796a-4b73-a56f-2a5286945ea3 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:43:30 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b9f0f2c3-c91c-4f08-be17-1baeff15b865 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Lock "881351d7-31f9-44f4-8571-8f540bbec29c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:43:30 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6ce2b30d-ca25-4379-b9c1-9f183461f689 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:43:30 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6ce2b30d-ca25-4379-b9c1-9f183461f689 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:43:31 user nova-compute[75341]: DEBUG nova.compute.manager [req-9f03d111-813a-4462-9995-6c55c6514d75 req-6a3eb5f1-25ea-4f86-91b3-306cc9278fa4 service nova] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Received event network-vif-plugged-6f1be2e1-796a-4b73-a56f-2a5286945ea3 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:43:31 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-9f03d111-813a-4462-9995-6c55c6514d75 req-6a3eb5f1-25ea-4f86-91b3-306cc9278fa4 service nova] Acquiring lock "0e7a53e9-6982-4c93-a830-a49cf0ce76bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:43:31 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-9f03d111-813a-4462-9995-6c55c6514d75 req-6a3eb5f1-25ea-4f86-91b3-306cc9278fa4 service nova] Lock "0e7a53e9-6982-4c93-a830-a49cf0ce76bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:43:31 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-9f03d111-813a-4462-9995-6c55c6514d75 req-6a3eb5f1-25ea-4f86-91b3-306cc9278fa4 service nova] Lock "0e7a53e9-6982-4c93-a830-a49cf0ce76bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:43:31 user nova-compute[75341]: DEBUG nova.compute.manager [req-9f03d111-813a-4462-9995-6c55c6514d75 req-6a3eb5f1-25ea-4f86-91b3-306cc9278fa4 service nova] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] No waiting events found dispatching network-vif-plugged-6f1be2e1-796a-4b73-a56f-2a5286945ea3 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:43:31 user nova-compute[75341]: WARNING nova.compute.manager [req-9f03d111-813a-4462-9995-6c55c6514d75 req-6a3eb5f1-25ea-4f86-91b3-306cc9278fa4 service nova] [instance: 0e7a53e9-6982-4c93-a830-a49cf0ce76bd] Received unexpected event network-vif-plugged-6f1be2e1-796a-4b73-a56f-2a5286945ea3 for instance with vm_state deleted and task_state None.
Nov 14 23:43:31 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b9f0f2c3-c91c-4f08-be17-1baeff15b865 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Acquiring lock "881351d7-31f9-44f4-8571-8f540bbec29c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:43:31 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b9f0f2c3-c91c-4f08-be17-1baeff15b865 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Lock "881351d7-31f9-44f4-8571-8f540bbec29c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:43:31 user nova-compute[75341]: INFO nova.compute.manager [None req-b9f0f2c3-c91c-4f08-be17-1baeff15b865 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Attaching volume 2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 to /dev/vdb
Nov 14 23:43:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:31 user nova-compute[75341]: DEBUG os_brick.utils [None req-b9f0f2c3-c91c-4f08-be17-1baeff15b865 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:43:31 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:31 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:31 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[475817eb-0e4f-40a1-b996-91768d89d55a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6d1cfca09c9\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:31 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:31 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:31 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d20975a-0426-481e-9a44-f3fdffe17dee]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:31 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:31 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:31 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7b9bae-e1fc-4af4-a94a-dd3210b508c1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:31 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[010319dc-5e97-4bbc-b93a-a08794cfd380]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:31 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-b9f0f2c3-c91c-4f08-be17-1baeff15b865 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Running cmd (subprocess): nvme version {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:31 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-b9f0f2c3-c91c-4f08-be17-1baeff15b865 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] 'nvme version' failed. Not Retrying. {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:43:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:31 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b9f0f2c3-c91c-4f08-be17-1baeff15b865 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] nvme not present on system {{(pid=75341) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 23:43:31 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:31 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-6ce2b30d-ca25-4379-b9c1-9f183461f689 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:43:31 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:43:31 user nova-compute[75341]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 23:43:31 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0300e7-3b12-4cbc-9b03-97c83b6c8886]: (4, '') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:31 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-b9f0f2c3-c91c-4f08-be17-1baeff15b865 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75341) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 23:43:31 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-b9f0f2c3-c91c-4f08-be17-1baeff15b865 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 23:43:31 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-b9f0f2c3-c91c-4f08-be17-1baeff15b865 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] LIGHTOS: no hostnqn found. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 23:43:31 user nova-compute[75341]: DEBUG os_brick.utils [None req-b9f0f2c3-c91c-4f08-be17-1baeff15b865 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6d1cfca09c9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:43:31 user nova-compute[75341]: DEBUG nova.virt.block_device [None req-b9f0f2c3-c91c-4f08-be17-1baeff15b865 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Updating existing volume attachment record: f9c8831c-1db8-40ec-9b45-0df05cab17b6 {{(pid=75341) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 23:43:31 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-6ce2b30d-ca25-4379-b9c1-9f183461f689 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:43:31 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6ce2b30d-ca25-4379-b9c1-9f183461f689 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.451s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:43:31 user nova-compute[75341]: INFO nova.scheduler.client.report [None req-6ce2b30d-ca25-4379-b9c1-9f183461f689 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Deleted allocations for instance 0e7a53e9-6982-4c93-a830-a49cf0ce76bd
Nov 14 23:43:31 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6ce2b30d-ca25-4379-b9c1-9f183461f689 tempest-TestVolumeSwap-1447465409 tempest-TestVolumeSwap-1447465409-project-member] Lock "0e7a53e9-6982-4c93-a830-a49cf0ce76bd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.843s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:43:32 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:43:32 user nova-compute[75341]: INFO nova.compute.manager [-] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Took 1.71 seconds to deallocate network for instance.
Nov 14 23:43:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b248e434-194c-4fba-b4a0-aaf0ca8b98ab tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:43:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b248e434-194c-4fba-b4a0-aaf0ca8b98ab tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:43:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:32 user nova-compute[75341]: DEBUG nova.compute.manager [req-ef91c156-282c-44cf-a9ea-5546eb4a63aa req-4bea4abf-8ec1-4aec-9a05-b874f0ac6a9b service nova] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Received event network-vif-plugged-87b091a7-76a0-46e1-b1fd-fd305d1ce55e {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:43:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ef91c156-282c-44cf-a9ea-5546eb4a63aa req-4bea4abf-8ec1-4aec-9a05-b874f0ac6a9b service nova] Acquiring lock "163c448b-0183-41bb-b6e0-61917f6ad781-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:43:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ef91c156-282c-44cf-a9ea-5546eb4a63aa req-4bea4abf-8ec1-4aec-9a05-b874f0ac6a9b service nova] Lock "163c448b-0183-41bb-b6e0-61917f6ad781-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:43:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ef91c156-282c-44cf-a9ea-5546eb4a63aa req-4bea4abf-8ec1-4aec-9a05-b874f0ac6a9b service nova] Lock "163c448b-0183-41bb-b6e0-61917f6ad781-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:43:32 user nova-compute[75341]: DEBUG nova.compute.manager [req-ef91c156-282c-44cf-a9ea-5546eb4a63aa req-4bea4abf-8ec1-4aec-9a05-b874f0ac6a9b service nova] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] No waiting events found dispatching network-vif-plugged-87b091a7-76a0-46e1-b1fd-fd305d1ce55e {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:43:32 user nova-compute[75341]: WARNING nova.compute.manager [req-ef91c156-282c-44cf-a9ea-5546eb4a63aa req-4bea4abf-8ec1-4aec-9a05-b874f0ac6a9b service nova] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Received unexpected event network-vif-plugged-87b091a7-76a0-46e1-b1fd-fd305d1ce55e for instance with vm_state deleted and task_state None.
Nov 14 23:43:32 user nova-compute[75341]: DEBUG nova.compute.manager [req-ef91c156-282c-44cf-a9ea-5546eb4a63aa req-4bea4abf-8ec1-4aec-9a05-b874f0ac6a9b service nova] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Received event network-vif-plugged-87b091a7-76a0-46e1-b1fd-fd305d1ce55e {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:43:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ef91c156-282c-44cf-a9ea-5546eb4a63aa req-4bea4abf-8ec1-4aec-9a05-b874f0ac6a9b service nova] Acquiring lock "163c448b-0183-41bb-b6e0-61917f6ad781-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:43:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ef91c156-282c-44cf-a9ea-5546eb4a63aa req-4bea4abf-8ec1-4aec-9a05-b874f0ac6a9b service nova] Lock "163c448b-0183-41bb-b6e0-61917f6ad781-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:43:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ef91c156-282c-44cf-a9ea-5546eb4a63aa req-4bea4abf-8ec1-4aec-9a05-b874f0ac6a9b service nova] Lock "163c448b-0183-41bb-b6e0-61917f6ad781-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:43:32 user nova-compute[75341]: DEBUG nova.compute.manager [req-ef91c156-282c-44cf-a9ea-5546eb4a63aa req-4bea4abf-8ec1-4aec-9a05-b874f0ac6a9b service nova] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] No waiting events found dispatching network-vif-plugged-87b091a7-76a0-46e1-b1fd-fd305d1ce55e {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:43:32 user nova-compute[75341]: WARNING nova.compute.manager [req-ef91c156-282c-44cf-a9ea-5546eb4a63aa req-4bea4abf-8ec1-4aec-9a05-b874f0ac6a9b service nova] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Received unexpected event network-vif-plugged-87b091a7-76a0-46e1-b1fd-fd305d1ce55e for instance with vm_state deleted and task_state None.
Nov 14 23:43:32 user nova-compute[75341]: DEBUG nova.compute.manager [req-ef91c156-282c-44cf-a9ea-5546eb4a63aa req-4bea4abf-8ec1-4aec-9a05-b874f0ac6a9b service nova] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Received event network-vif-plugged-87b091a7-76a0-46e1-b1fd-fd305d1ce55e {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:43:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ef91c156-282c-44cf-a9ea-5546eb4a63aa req-4bea4abf-8ec1-4aec-9a05-b874f0ac6a9b service nova] Acquiring lock "163c448b-0183-41bb-b6e0-61917f6ad781-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:43:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ef91c156-282c-44cf-a9ea-5546eb4a63aa req-4bea4abf-8ec1-4aec-9a05-b874f0ac6a9b service nova] Lock "163c448b-0183-41bb-b6e0-61917f6ad781-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:43:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ef91c156-282c-44cf-a9ea-5546eb4a63aa req-4bea4abf-8ec1-4aec-9a05-b874f0ac6a9b service nova] Lock "163c448b-0183-41bb-b6e0-61917f6ad781-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:43:32 user nova-compute[75341]: DEBUG nova.compute.manager [req-ef91c156-282c-44cf-a9ea-5546eb4a63aa req-4bea4abf-8ec1-4aec-9a05-b874f0ac6a9b service nova] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] No waiting events found dispatching network-vif-plugged-87b091a7-76a0-46e1-b1fd-fd305d1ce55e {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:43:32 user nova-compute[75341]: WARNING nova.compute.manager [req-ef91c156-282c-44cf-a9ea-5546eb4a63aa req-4bea4abf-8ec1-4aec-9a05-b874f0ac6a9b service nova] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Received unexpected event network-vif-plugged-87b091a7-76a0-46e1-b1fd-fd305d1ce55e for instance with vm_state deleted and task_state None.
Nov 14 23:43:32 user nova-compute[75341]: DEBUG nova.compute.manager [req-ef91c156-282c-44cf-a9ea-5546eb4a63aa req-4bea4abf-8ec1-4aec-9a05-b874f0ac6a9b service nova] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Received event network-vif-plugged-87b091a7-76a0-46e1-b1fd-fd305d1ce55e {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:43:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ef91c156-282c-44cf-a9ea-5546eb4a63aa req-4bea4abf-8ec1-4aec-9a05-b874f0ac6a9b service nova] Acquiring lock "163c448b-0183-41bb-b6e0-61917f6ad781-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:43:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ef91c156-282c-44cf-a9ea-5546eb4a63aa req-4bea4abf-8ec1-4aec-9a05-b874f0ac6a9b service nova] Lock "163c448b-0183-41bb-b6e0-61917f6ad781-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:43:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ef91c156-282c-44cf-a9ea-5546eb4a63aa req-4bea4abf-8ec1-4aec-9a05-b874f0ac6a9b service nova] Lock "163c448b-0183-41bb-b6e0-61917f6ad781-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:43:32 user nova-compute[75341]: DEBUG nova.compute.manager [req-ef91c156-282c-44cf-a9ea-5546eb4a63aa req-4bea4abf-8ec1-4aec-9a05-b874f0ac6a9b service nova] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] No waiting events found dispatching network-vif-plugged-87b091a7-76a0-46e1-b1fd-fd305d1ce55e {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:43:32 user nova-compute[75341]: WARNING nova.compute.manager [req-ef91c156-282c-44cf-a9ea-5546eb4a63aa req-4bea4abf-8ec1-4aec-9a05-b874f0ac6a9b service nova] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Received unexpected event network-vif-plugged-87b091a7-76a0-46e1-b1fd-fd305d1ce55e for instance with vm_state deleted and task_state None.
Nov 14 23:43:32 user nova-compute[75341]: DEBUG nova.compute.manager [req-ef91c156-282c-44cf-a9ea-5546eb4a63aa req-4bea4abf-8ec1-4aec-9a05-b874f0ac6a9b service nova] [instance: 163c448b-0183-41bb-b6e0-61917f6ad781] Received event network-vif-deleted-87b091a7-76a0-46e1-b1fd-fd305d1ce55e {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:43:32 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-b248e434-194c-4fba-b4a0-aaf0ca8b98ab tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:43:32 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-b248e434-194c-4fba-b4a0-aaf0ca8b98ab tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:43:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b248e434-194c-4fba-b4a0-aaf0ca8b98ab tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.293s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:43:32 user nova-compute[75341]: INFO nova.scheduler.client.report [None req-b248e434-194c-4fba-b4a0-aaf0ca8b98ab tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Deleted allocations for instance 163c448b-0183-41bb-b6e0-61917f6ad781
Nov 14 23:43:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b248e434-194c-4fba-b4a0-aaf0ca8b98ab tempest-TaggedAttachmentsTest-1943224082 tempest-TaggedAttachmentsTest-1943224082-project-member] Lock "163c448b-0183-41bb-b6e0-61917f6ad781" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.231s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:43:34 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:35 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:35 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:35 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:36 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9f0f2c3-c91c-4f08-be17-1baeff15b865 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Calling os-brick to attach iSCSI Volume {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 23:43:36 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f0f2c3-c91c-4f08-be17-1baeff15b865 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pzdvecEm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:43:36 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-b9f0f2c3-c91c-4f08-be17-1baeff15b865 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:43:36 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-b9f0f2c3-c91c-4f08-be17-1baeff15b865 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:43:36 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-b9f0f2c3-c91c-4f08-be17-1baeff15b865 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:43:36 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-b9f0f2c3-c91c-4f08-be17-1baeff15b865 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:43:36 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-b9f0f2c3-c91c-4f08-be17-1baeff15b865 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:43:36 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-b9f0f2c3-c91c-4f08-be17-1baeff15b865 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:43:36 user nova-compute[75341]: INFO os_brick.initiator.connectors.iscsi [None req-b9f0f2c3-c91c-4f08-be17-1baeff15b865 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 23:43:36 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 -p 172.16.0.220:3260 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:36 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:36 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ba8eff-18ad-421e-8da4-736c8dd56987]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:36 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f0f2c3-c91c-4f08-be17-1baeff15b865 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 23:43:36 user nova-compute[75341]:  {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:43:36 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:36 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:36 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb873dd3-0233-48d3-a270-5a4b067b3423]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3] added\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:36 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f0f2c3-c91c-4f08-be17-1baeff15b865 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3] added
Nov 14 23:43:36 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:43:36 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:36 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:36 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4370086-2f99-4c28-a570-fd168dab3f31]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:36 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f0f2c3-c91c-4f08-be17-1baeff15b865 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:43:36 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:36 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:36 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f4dcf6-fdb0-4270-8f23-21d679d05089]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:36 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f0f2c3-c91c-4f08-be17-1baeff15b865 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:43:36 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pzdvecEm {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:36 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pzdvecEm" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:36 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bebdfda-0183-4c4f-b8c3-2763f90d9c52]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:36 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f0f2c3-c91c-4f08-be17-1baeff15b865 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pzdvecEm'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:43:36 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:36 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:36 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8def779-314b-492d-91c3-ebe72a55be3f]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:36 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f0f2c3-c91c-4f08-be17-1baeff15b865 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:43:36 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:36 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:36 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e77c91-a822-4928-8ccc-44b7bb2a29a1]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cc5edd0-ae05-4793-9338-6bc0ffd9255a (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:36 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f0f2c3-c91c-4f08-be17-1baeff15b865 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 (non-flash)
Nov 14 23:43:36 user nova-compute[75341]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)
Nov 14 23:43:36 user nova-compute[75341]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cc5edd0-ae05-4793-9338-6bc0ffd9255a (non-flash)
Nov 14 23:43:36 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:43:36 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f0f2c3-c91c-4f08-be17-1baeff15b865 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 (non-flash)
Nov 14 23:43:36 user nova-compute[75341]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)
Nov 14 23:43:36 user nova-compute[75341]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cc5edd0-ae05-4793-9338-6bc0ffd9255a (non-flash)
Nov 14 23:43:36 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:43:36 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 -p 172.16.0.220:3260 --login {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:36 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:36 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[a679ca3d-fa34-4756-89bf-8250b2c624c0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:36 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f0f2c3-c91c-4f08-be17-1baeff15b865 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3, portal: 172.16.0.220,3260]
Nov 14 23:43:36 user nova-compute[75341]: Login to [iface: default, target: iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3, portal: 172.16.0.220,3260] successful.
Nov 14 23:43:36 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:43:36 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:36 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:36 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb49579-95ce-4beb-95c9-c4fbb2b6f0da]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:36 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f0f2c3-c91c-4f08-be17-1baeff15b865 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:43:36 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:36 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:36 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[633ff898-2736-4659-9491-2b447a5c7b6b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cc5edd0-ae05-4793-9338-6bc0ffd9255a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:36 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f0f2c3-c91c-4f08-be17-1baeff15b865 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 (non-flash)
Nov 14 23:43:36 user nova-compute[75341]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)
Nov 14 23:43:36 user nova-compute[75341]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cc5edd0-ae05-4793-9338-6bc0ffd9255a (non-flash)
Nov 14 23:43:36 user nova-compute[75341]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)
Nov 14 23:43:36 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:43:36 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f0f2c3-c91c-4f08-be17-1baeff15b865 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 (non-flash)
Nov 14 23:43:36 user nova-compute[75341]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)
Nov 14 23:43:36 user nova-compute[75341]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cc5edd0-ae05-4793-9338-6bc0ffd9255a (non-flash)
Nov 14 23:43:36 user nova-compute[75341]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)
Nov 14 23:43:36 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:43:36 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-b9f0f2c3-c91c-4f08-be17-1baeff15b865 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:43:36 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f0f2c3-c91c-4f08-be17-1baeff15b865 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Connected to 172.16.0.220:3260 {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 23:43:36 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-b9f0f2c3-c91c-4f08-be17-1baeff15b865 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] HCTL ('35', '-', '-', 0) found on session 18 with lun 0 {{(pid=75341) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 23:43:36 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-b9f0f2c3-c91c-4f08-be17-1baeff15b865 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75341) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 23:43:36 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:36 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:36 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15067fa-2bc0-4064-a238-ad76b9ca4d2a]: (4, ('- - 0', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:36 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-b9f0f2c3-c91c-4f08-be17-1baeff15b865 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Searching for a device in session 18 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 23:43:36 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f0f2c3-c91c-4f08-be17-1baeff15b865 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pzdvecEm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 23:43:36 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:37 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-b9f0f2c3-c91c-4f08-be17-1baeff15b865 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:43:37 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f0f2c3-c91c-4f08-be17-1baeff15b865 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '26631613763363039', 'path': '/dev/sdd'} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:43:37 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9f0f2c3-c91c-4f08-be17-1baeff15b865 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26631613763363039', 'path': '/dev/sdd'} {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 23:43:37 user nova-compute[75341]: DEBUG nova.objects.instance [None req-b9f0f2c3-c91c-4f08-be17-1baeff15b865 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Lazy-loading 'flavor' on Instance uuid 881351d7-31f9-44f4-8571-8f540bbec29c {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:43:37 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-b9f0f2c3-c91c-4f08-be17-1baeff15b865 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 23:43:37 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:43:37 user nova-compute[75341]:   <source dev="/dev/sdd"/>
Nov 14 23:43:37 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:43:37 user nova-compute[75341]:   <serial>2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3</serial>
Nov 14 23:43:37 user nova-compute[75341]: </disk>
Nov 14 23:43:37 user nova-compute[75341]:  {{(pid=75341) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 23:43:37 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b9f0f2c3-c91c-4f08-be17-1baeff15b865 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:43:37 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b9f0f2c3-c91c-4f08-be17-1baeff15b865 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:43:37 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b9f0f2c3-c91c-4f08-be17-1baeff15b865 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] No VIF found with MAC fa:16:3e:83:5b:7a, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:43:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b9f0f2c3-c91c-4f08-be17-1baeff15b865 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Lock "881351d7-31f9-44f4-8571-8f540bbec29c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.906s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:43:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Acquiring lock "a308a35f-c8d7-482c-a93d-5d9eb473d4e1" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:43:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "a308a35f-c8d7-482c-a93d-5d9eb473d4e1" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:43:38 user nova-compute[75341]: INFO nova.compute.manager [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Unshelving
Nov 14 23:43:39 user nova-compute[75341]: INFO nova.virt.block_device [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Booting with volume f3d90713-27fa-493f-978a-af46e9730265 at /dev/vdc
Nov 14 23:43:39 user nova-compute[75341]: DEBUG os_brick.utils [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:43:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:39 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cad5196-48ba-41f4-a362-4e8c1d88fbe7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6d1cfca09c9\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:39 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7e3253-dc54-448a-8f5a-4a71487674b7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:39 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4e8843-313e-44c9-9297-ac81d2a5b0f0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:39 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[60cf2e87-9453-4ae0-b92d-c1746bbc2dcb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Running cmd (subprocess): nvme version {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] 'nvme version' failed. Not Retrying. {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:43:39 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.nvmeof [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] nvme not present on system {{(pid=75341) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 23:43:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:43:39 user nova-compute[75341]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 23:43:39 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5fb4fe-0494-4ab9-9fc0-3914ce47f49f]: (4, '') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:39 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75341) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 23:43:39 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 23:43:39 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] LIGHTOS: no hostnqn found. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 23:43:39 user nova-compute[75341]: DEBUG os_brick.utils [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6d1cfca09c9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:43:39 user nova-compute[75341]: DEBUG nova.virt.block_device [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Updating existing volume attachment record: bcbf3cd6-29fa-4289-84bc-2a764e30a6a5 {{(pid=75341) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 23:43:39 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-c7c89a04-9a39-489f-8e3a-2fb3c984f218 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d8d3b42b-11b5-477a-afb1-80a1786b693b is timed out.
Nov 14 23:43:39 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-c7c89a04-9a39-489f-8e3a-2fb3c984f218 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Successfully detached device vdb from instance d8d3b42b-11b5-477a-afb1-80a1786b693b from the live domain config.
Nov 14 23:43:39 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7c89a04-9a39-489f-8e3a-2fb3c984f218 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] calling os-brick to detach iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 23:43:39 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c89a04-9a39-489f-8e3a-2fb3c984f218 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, {'target_iqn': 'iqn.2010-10.org.openstack:1cc5edd0-ae05-4793-9338-6bc0ffd9255a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aULxGEXZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:43:39 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-c7c89a04-9a39-489f-8e3a-2fb3c984f218 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:43:39 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-c7c89a04-9a39-489f-8e3a-2fb3c984f218 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:43:39 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-c7c89a04-9a39-489f-8e3a-2fb3c984f218 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:43:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:39 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e23ab85-ac42-4950-b4c3-8cbbd572a0f7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1cc5edd0-ae05-4793-9338-6bc0ffd9255a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:39 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c89a04-9a39-489f-8e3a-2fb3c984f218 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 23:43:39 user nova-compute[75341]: No targets found.
Nov 14 23:43:39 user nova-compute[75341]: iSNS:
Nov 14 23:43:39 user nova-compute[75341]: No targets found.
Nov 14 23:43:39 user nova-compute[75341]: STATIC:
Nov 14 23:43:39 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3
Nov 14 23:43:39 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:43:39 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:43:39 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:1cc5edd0-ae05-4793-9338-6bc0ffd9255a
Nov 14 23:43:39 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:43:39 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:43:39 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c
Nov 14 23:43:39 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:43:39 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:43:39 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23
Nov 14 23:43:39 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:43:39 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:43:39 user nova-compute[75341]: FIRMWARE:
Nov 14 23:43:39 user nova-compute[75341]: No targets found.
Nov 14 23:43:39 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:43:39 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c89a04-9a39-489f-8e3a-2fb3c984f218 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 23:43:39 user nova-compute[75341]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 23:43:39 user nova-compute[75341]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75341) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 23:43:39 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c89a04-9a39-489f-8e3a-2fb3c984f218 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1cc5edd0-ae05-4793-9338-6bc0ffd9255a', 0)] {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 23:43:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:39 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b7b522-114e-458d-adb5-38cc0ed9d57f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1cc5edd0-ae05-4793-9338-6bc0ffd9255a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:39 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[03488be8-685d-4d43-82f1-5de71cafe94c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cc5edd0-ae05-4793-9338-6bc0ffd9255a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:39 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c89a04-9a39-489f-8e3a-2fb3c984f218 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 (non-flash)
Nov 14 23:43:39 user nova-compute[75341]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)
Nov 14 23:43:39 user nova-compute[75341]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cc5edd0-ae05-4793-9338-6bc0ffd9255a (non-flash)
Nov 14 23:43:39 user nova-compute[75341]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)
Nov 14 23:43:39 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:43:39 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c89a04-9a39-489f-8e3a-2fb3c984f218 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 (non-flash)
Nov 14 23:43:39 user nova-compute[75341]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)
Nov 14 23:43:39 user nova-compute[75341]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cc5edd0-ae05-4793-9338-6bc0ffd9255a (non-flash)
Nov 14 23:43:39 user nova-compute[75341]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)
Nov 14 23:43:39 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:43:39 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c89a04-9a39-489f-8e3a-2fb3c984f218 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1870455750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1cc5edd0-ae05-4793-9338-6bc0ffd9255a'): ({'sde'}, set())}) {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 23:43:39 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-c7c89a04-9a39-489f-8e3a-2fb3c984f218 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Removing single pathed devices sde {{(pid=75341) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 23:43:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:39 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[3847baba-542e-4f5f-ae2d-087f47ff1738]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:39 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[3570cae3-99f2-4d6b-8072-8ade68def8a7]: (4, ('ok\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:39 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-c7c89a04-9a39-489f-8e3a-2fb3c984f218 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Flushing IO for device /dev/sde {{(pid=75341) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 23:43:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:39 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa58aac-155e-4141-8476-e2dcf74d211b]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:39 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-c7c89a04-9a39-489f-8e3a-2fb3c984f218 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75341) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 23:43:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:40 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:40 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e36702-6c33-4226-839b-eef2f3bfd689]: (4, ('1', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:40 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-c7c89a04-9a39-489f-8e3a-2fb3c984f218 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 23:43:40 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-c7c89a04-9a39-489f-8e3a-2fb3c984f218 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] SCSI volumes sde have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 23:43:40 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c89a04-9a39-489f-8e3a-2fb3c984f218 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1cc5edd0-ae05-4793-9338-6bc0ffd9255a')] {{(pid=75341) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 23:43:40 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cc5edd0-ae05-4793-9338-6bc0ffd9255a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:40 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cc5edd0-ae05-4793-9338-6bc0ffd9255a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:40 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0ee651-7ea0-42a7-8854-7f1e28bc573a]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:40 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c89a04-9a39-489f-8e3a-2fb3c984f218 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:43:40 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cc5edd0-ae05-4793-9338-6bc0ffd9255a -p 172.16.0.220:3260 --logout {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:40 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cc5edd0-ae05-4793-9338-6bc0ffd9255a -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:40 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d83af2-4011-4cf2-a30c-54a1636b8e76]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:1cc5edd0-ae05-4793-9338-6bc0ffd9255a, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:1cc5edd0-ae05-4793-9338-6bc0ffd9255a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:40 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c89a04-9a39-489f-8e3a-2fb3c984f218 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:1cc5edd0-ae05-4793-9338-6bc0ffd9255a, portal: 172.16.0.220,3260]
Nov 14 23:43:40 user nova-compute[75341]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:1cc5edd0-ae05-4793-9338-6bc0ffd9255a, portal: 172.16.0.220,3260] successful.
Nov 14 23:43:40 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:43:40 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cc5edd0-ae05-4793-9338-6bc0ffd9255a -p 172.16.0.220:3260 --op delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:40 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cc5edd0-ae05-4793-9338-6bc0ffd9255a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:40 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[8efc1a4a-3d37-490d-a431-3fd18c6a9f7d]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:40 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c89a04-9a39-489f-8e3a-2fb3c984f218 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:43:40 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-c7c89a04-9a39-489f-8e3a-2fb3c984f218 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:43:40 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c89a04-9a39-489f-8e3a-2fb3c984f218 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] <== disconnect_volume: return (326ms) None {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:43:40 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7c89a04-9a39-489f-8e3a-2fb3c984f218 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Disconnected iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 23:43:40 user nova-compute[75341]: DEBUG nova.compute.manager [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Stashing vm_state: active {{(pid=75341) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 14 23:43:40 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:43:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:43:40 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75341) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 23:43:40 user nova-compute[75341]: INFO nova.compute.claims [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Claim successful on node user
Nov 14 23:43:40 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:40 user nova-compute[75341]: INFO nova.compute.resource_tracker [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Updating resource usage from migration ce0332b8-78dd-4580-ac96-b62cde301a6b
Nov 14 23:43:40 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:40 user nova-compute[75341]: DEBUG nova.objects.instance [None req-c7c89a04-9a39-489f-8e3a-2fb3c984f218 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Lazy-loading 'flavor' on Instance uuid d8d3b42b-11b5-477a-afb1-80a1786b693b {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:43:41 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c7c89a04-9a39-489f-8e3a-2fb3c984f218 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Lock "d8d3b42b-11b5-477a-afb1-80a1786b693b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.727s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:43:41 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:43:41 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:43:41 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.410s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:43:41 user nova-compute[75341]: INFO nova.compute.manager [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Migrating
Nov 14 23:43:41 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:43:41 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:43:41 user nova-compute[75341]: INFO nova.compute.rpcapi [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 14 23:43:41 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:43:41 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Acquiring lock "refresh_cache-881351d7-31f9-44f4-8571-8f540bbec29c" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:43:41 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Acquired lock "refresh_cache-881351d7-31f9-44f4-8571-8f540bbec29c" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:43:41 user nova-compute[75341]: DEBUG nova.network.neutron [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 23:43:42 user nova-compute[75341]: DEBUG nova.network.neutron [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Updating instance_info_cache with network_info: [{"id": "dcc0edd5-582a-499a-beaf-6de23ff1537c", "address": "fa:16:3e:83:5b:7a", "network": {"id": "139c86e9-e6ea-4307-9f78-7f41ab7a6d8c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-487359378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eff8d64949254c7eb3dd8685ca7447b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc0edd5-58", "ovs_interfaceid": "dcc0edd5-582a-499a-beaf-6de23ff1537c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:43:42 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Releasing lock "refresh_cache-881351d7-31f9-44f4-8571-8f540bbec29c" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:43:42 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Starting migrate_disk_and_power_off {{(pid=75341) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 14 23:43:42 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:42 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:42 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:42 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:42 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:43 user nova-compute[75341]: DEBUG nova.compute.manager [req-eb22feb8-c550-43f8-94f8-a168f853fb1d req-51fe13d3-ca0c-4465-9ff2-29a02c249957 service nova] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Received event network-vif-unplugged-dcc0edd5-582a-499a-beaf-6de23ff1537c {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:43:43 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-eb22feb8-c550-43f8-94f8-a168f853fb1d req-51fe13d3-ca0c-4465-9ff2-29a02c249957 service nova] Acquiring lock "881351d7-31f9-44f4-8571-8f540bbec29c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:43:43 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-eb22feb8-c550-43f8-94f8-a168f853fb1d req-51fe13d3-ca0c-4465-9ff2-29a02c249957 service nova] Lock "881351d7-31f9-44f4-8571-8f540bbec29c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:43:43 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-eb22feb8-c550-43f8-94f8-a168f853fb1d req-51fe13d3-ca0c-4465-9ff2-29a02c249957 service nova] Lock "881351d7-31f9-44f4-8571-8f540bbec29c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:43:43 user nova-compute[75341]: DEBUG nova.compute.manager [req-eb22feb8-c550-43f8-94f8-a168f853fb1d req-51fe13d3-ca0c-4465-9ff2-29a02c249957 service nova] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] No waiting events found dispatching network-vif-unplugged-dcc0edd5-582a-499a-beaf-6de23ff1537c {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:43:43 user nova-compute[75341]: WARNING nova.compute.manager [req-eb22feb8-c550-43f8-94f8-a168f853fb1d req-51fe13d3-ca0c-4465-9ff2-29a02c249957 service nova] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Received unexpected event network-vif-unplugged-dcc0edd5-582a-499a-beaf-6de23ff1537c for instance with vm_state active and task_state resize_migrating.
Nov 14 23:43:43 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:43 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Instance destroyed successfully.
Nov 14 23:43:43 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:39:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1731707158',display_name='tempest-ServerActionsTestOtherB-server-1731707158',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1731707158',id=1,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPcpkEsQSTpmH5o8Wvimru34qoMLk4crSEJeEz6XFBwMyGlgEqVH+eZU8RhCkfXTyDuMId//yiBmA84BMG1N70mUPHjpTANep7Y1Hwo1CNlTldBrdW9Ccxs8yCQLXA8Fw==',key_name='tempest-keypair-500318648',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:40:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='eff8d64949254c7eb3dd8685ca7447b1',ramdisk_id='',reservation_id='r-505keefc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1632747205',owner_user_name='tempest-ServerActionsTestOtherB-1632747205-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:43:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='512d2ce7a01c4ffb924f9476a5c4b946',uuid=881351d7-31f9-44f4-8571-8f540bbec29c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dcc0edd5-582a-499a-beaf-6de23ff1537c", "address": "fa:16:3e:83:5b:7a", "network": {"id": "139c86e9-e6ea-4307-9f78-7f41ab7a6d8c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-487359378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-487359378-network", "vif_mac": "fa:16:3e:83:5b:7a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eff8d64949254c7eb3dd8685ca7447b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc0edd5-58", "ovs_interfaceid": "dcc0edd5-582a-499a-beaf-6de23ff1537c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 23:43:43 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Converting VIF {"id": "dcc0edd5-582a-499a-beaf-6de23ff1537c", "address": "fa:16:3e:83:5b:7a", "network": {"id": "139c86e9-e6ea-4307-9f78-7f41ab7a6d8c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-487359378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-487359378-network", "vif_mac": "fa:16:3e:83:5b:7a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eff8d64949254c7eb3dd8685ca7447b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc0edd5-58", "ovs_interfaceid": "dcc0edd5-582a-499a-beaf-6de23ff1537c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:43:43 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:5b:7a,bridge_name='br-int',has_traffic_filtering=True,id=dcc0edd5-582a-499a-beaf-6de23ff1537c,network=Network(139c86e9-e6ea-4307-9f78-7f41ab7a6d8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcc0edd5-58') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:43:43 user nova-compute[75341]: DEBUG os_vif [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:5b:7a,bridge_name='br-int',has_traffic_filtering=True,id=dcc0edd5-582a-499a-beaf-6de23ff1537c,network=Network(139c86e9-e6ea-4307-9f78-7f41ab7a6d8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcc0edd5-58') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 23:43:43 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:43 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdcc0edd5-58, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:43:43 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:43 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:43:43 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:43 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1230cd6d-9357-44fe-a930-fe18035bf9b3) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:43:43 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:43 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:43 user nova-compute[75341]: INFO os_vif [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:5b:7a,bridge_name='br-int',has_traffic_filtering=True,id=dcc0edd5-582a-499a-beaf-6de23ff1537c,network=Network(139c86e9-e6ea-4307-9f78-7f41ab7a6d8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcc0edd5-58')
Nov 14 23:43:43 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] calling os-brick to detach iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 23:43:43 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, {'target_iqn': 'iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pzdvecEm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:43:43 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:43:43 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:43:43 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:43:43 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:43 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:43 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[b898ff53-6f98-4a3f-894f-e8f0eb90c698]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:43 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 23:43:43 user nova-compute[75341]: No targets found.
Nov 14 23:43:43 user nova-compute[75341]: iSNS:
Nov 14 23:43:43 user nova-compute[75341]: No targets found.
Nov 14 23:43:43 user nova-compute[75341]: STATIC:
Nov 14 23:43:43 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3
Nov 14 23:43:43 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:43:43 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:43:43 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c
Nov 14 23:43:43 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:43:43 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:43:43 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23
Nov 14 23:43:43 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:43:43 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:43:43 user nova-compute[75341]: FIRMWARE:
Nov 14 23:43:43 user nova-compute[75341]: No targets found.
Nov 14 23:43:43 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:43:43 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 23:43:43 user nova-compute[75341]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 23:43:43 user nova-compute[75341]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75341) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 23:43:43 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3', 0)] {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 23:43:43 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:43 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:43 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[32130567-e787-4003-bf03-aae9b13fe233]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:43 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:43 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:43 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[6054feee-446a-4c3b-85f7-f0cf7ad91a42]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:43 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 (non-flash)
Nov 14 23:43:43 user nova-compute[75341]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)
Nov 14 23:43:43 user nova-compute[75341]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)
Nov 14 23:43:43 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:43:43 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 (non-flash)
Nov 14 23:43:43 user nova-compute[75341]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)
Nov 14 23:43:43 user nova-compute[75341]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)
Nov 14 23:43:43 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:43:43 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f185072d630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3'): ({'sdd'}, set())}) {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 23:43:43 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Removing single pathed devices sdd {{(pid=75341) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 23:43:43 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:43 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:43 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[32057ab3-46c1-442e-ad72-1d1e783e0bf3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:43 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:43 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:43 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8cde732-1dad-4c9f-b667-b2ff29ae5cad]: (4, ('ok\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:43 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Flushing IO for device /dev/sdd {{(pid=75341) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 23:43:43 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:43 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:43 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[7deffd5f-671b-4bba-bb6c-7a2ed510a70b]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:43 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75341) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 23:43:43 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:43 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:43 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d01cf2-d2de-4581-a374-f0695e5c082d]: (4, ('1', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:43 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 23:43:43 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] SCSI volumes sdd have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 23:43:43 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3')] {{(pid=75341) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 23:43:43 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:43 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:43 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce06d896-46db-4172-a983-19b2d7c099c1]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:43 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:43:43 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 -p 172.16.0.220:3260 --logout {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:43 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:43 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4699f6-49f9-4760-96f1-6cc03a403203]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:43 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3, portal: 172.16.0.220,3260]
Nov 14 23:43:43 user nova-compute[75341]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3, portal: 172.16.0.220,3260] successful.
Nov 14 23:43:43 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:43:43 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 -p 172.16.0.220:3260 --op delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:43 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:43 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa34c9d-7cce-4cdd-ac78-116e79d9c813]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:43 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:43:43 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:43:43 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] <== disconnect_volume: return (313ms) None {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:43:43 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Disconnected iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 23:43:43 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:44 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:44 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:44 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:43:44 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:43:44 user nova-compute[75341]: DEBUG nova.objects.instance [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lazy-loading 'pci_requests' on Instance uuid a308a35f-c8d7-482c-a93d-5d9eb473d4e1 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:43:44 user nova-compute[75341]: DEBUG nova.objects.instance [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lazy-loading 'numa_topology' on Instance uuid a308a35f-c8d7-482c-a93d-5d9eb473d4e1 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:43:44 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75341) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 23:43:44 user nova-compute[75341]: INFO nova.compute.claims [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Claim successful on node user
Nov 14 23:43:44 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:44 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 23:43:44 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c_resize/disk /opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c/disk {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:44 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:43:44 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:43:44 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.489s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:43:44 user nova-compute[75341]: INFO nova.network.neutron [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Updating port 4f1d8292-7392-4939-9303-437dc108b4a4 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 14 23:43:44 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] CMD "cp -r /opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c_resize/disk /opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c/disk" returned: 0 in 0.469s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:44 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c_resize/disk.info /opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c/disk.info {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:44 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] CMD "cp -r /opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c_resize/disk.info /opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c/disk.info" returned: 0 in 0.032s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:45 user nova-compute[75341]: DEBUG nova.compute.manager [req-2c5d6685-ca04-4c57-8286-ade11e77df5d req-416a4d42-19c9-46cc-857d-04f3f9df7c0b service nova] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Received event network-vif-plugged-dcc0edd5-582a-499a-beaf-6de23ff1537c {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:43:45 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-2c5d6685-ca04-4c57-8286-ade11e77df5d req-416a4d42-19c9-46cc-857d-04f3f9df7c0b service nova] Acquiring lock "881351d7-31f9-44f4-8571-8f540bbec29c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:43:45 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-2c5d6685-ca04-4c57-8286-ade11e77df5d req-416a4d42-19c9-46cc-857d-04f3f9df7c0b service nova] Lock "881351d7-31f9-44f4-8571-8f540bbec29c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:43:45 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-2c5d6685-ca04-4c57-8286-ade11e77df5d req-416a4d42-19c9-46cc-857d-04f3f9df7c0b service nova] Lock "881351d7-31f9-44f4-8571-8f540bbec29c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:43:45 user nova-compute[75341]: DEBUG nova.compute.manager [req-2c5d6685-ca04-4c57-8286-ade11e77df5d req-416a4d42-19c9-46cc-857d-04f3f9df7c0b service nova] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] No waiting events found dispatching network-vif-plugged-dcc0edd5-582a-499a-beaf-6de23ff1537c {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:43:45 user nova-compute[75341]: WARNING nova.compute.manager [req-2c5d6685-ca04-4c57-8286-ade11e77df5d req-416a4d42-19c9-46cc-857d-04f3f9df7c0b service nova] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Received unexpected event network-vif-plugged-dcc0edd5-582a-499a-beaf-6de23ff1537c for instance with vm_state active and task_state resize_migrating.
Nov 14 23:43:45 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:45 user nova-compute[75341]: DEBUG nova.network.neutron [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Port dcc0edd5-582a-499a-beaf-6de23ff1537c binding to destination host user is already ACTIVE {{(pid=75341) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 14 23:43:45 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:45 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Acquiring lock "refresh_cache-a308a35f-c8d7-482c-a93d-5d9eb473d4e1" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:43:45 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Acquired lock "refresh_cache-a308a35f-c8d7-482c-a93d-5d9eb473d4e1" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:43:45 user nova-compute[75341]: DEBUG nova.network.neutron [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 23:43:45 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Acquiring lock "881351d7-31f9-44f4-8571-8f540bbec29c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:43:45 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Lock "881351d7-31f9-44f4-8571-8f540bbec29c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:43:45 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Lock "881351d7-31f9-44f4-8571-8f540bbec29c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:43:45 user nova-compute[75341]: DEBUG nova.compute.manager [req-fccc9aa0-6f01-482a-ac60-11df0ad9fb48 req-6f3b0e23-ca64-49bc-bfe7-25bd553afaaf service nova] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Received event network-changed-4f1d8292-7392-4939-9303-437dc108b4a4 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:43:45 user nova-compute[75341]: DEBUG nova.compute.manager [req-fccc9aa0-6f01-482a-ac60-11df0ad9fb48 req-6f3b0e23-ca64-49bc-bfe7-25bd553afaaf service nova] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Refreshing instance network info cache due to event network-changed-4f1d8292-7392-4939-9303-437dc108b4a4. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:43:45 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-fccc9aa0-6f01-482a-ac60-11df0ad9fb48 req-6f3b0e23-ca64-49bc-bfe7-25bd553afaaf service nova] Acquiring lock "refresh_cache-a308a35f-c8d7-482c-a93d-5d9eb473d4e1" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:43:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Acquiring lock "refresh_cache-881351d7-31f9-44f4-8571-8f540bbec29c" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:43:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Acquired lock "refresh_cache-881351d7-31f9-44f4-8571-8f540bbec29c" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:43:46 user nova-compute[75341]: DEBUG nova.network.neutron [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 23:43:46 user nova-compute[75341]: DEBUG nova.network.neutron [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Updating instance_info_cache with network_info: [{"id": "4f1d8292-7392-4939-9303-437dc108b4a4", "address": "fa:16:3e:be:2c:ef", "network": {"id": "e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-64240219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f27e41f4cc1451291b8aca34544867b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f1d8292-73", "ovs_interfaceid": "4f1d8292-7392-4939-9303-437dc108b4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:43:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Releasing lock "refresh_cache-a308a35f-c8d7-482c-a93d-5d9eb473d4e1" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:43:46 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Creating instance directory {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 23:43:46 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Creating image(s)
Nov 14 23:43:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Acquiring lock "/opt/stack/data/nova/instances/a308a35f-c8d7-482c-a93d-5d9eb473d4e1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:43:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "/opt/stack/data/nova/instances/a308a35f-c8d7-482c-a93d-5d9eb473d4e1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:43:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "/opt/stack/data/nova/instances/a308a35f-c8d7-482c-a93d-5d9eb473d4e1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:43:46 user nova-compute[75341]: DEBUG nova.objects.instance [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lazy-loading 'trusted_certs' on Instance uuid a308a35f-c8d7-482c-a93d-5d9eb473d4e1 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:43:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-fccc9aa0-6f01-482a-ac60-11df0ad9fb48 req-6f3b0e23-ca64-49bc-bfe7-25bd553afaaf service nova] Acquired lock "refresh_cache-a308a35f-c8d7-482c-a93d-5d9eb473d4e1" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:43:46 user nova-compute[75341]: DEBUG nova.network.neutron [req-fccc9aa0-6f01-482a-ac60-11df0ad9fb48 req-6f3b0e23-ca64-49bc-bfe7-25bd553afaaf service nova] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Refreshing network info cache for port 4f1d8292-7392-4939-9303-437dc108b4a4 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:43:46 user nova-compute[75341]: DEBUG nova.objects.base [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Object Instance<a308a35f-c8d7-482c-a93d-5d9eb473d4e1> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75341) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 23:43:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Acquiring lock "abb285b7db1935171570ab92e3f78b91898e244d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:43:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "abb285b7db1935171570ab92e3f78b91898e244d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:43:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/abb285b7db1935171570ab92e3f78b91898e244d.part --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:47 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Acquiring lock "a141d7ee-3f77-4fdc-85ec-2cbd5af17646" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:43:47 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Lock "a141d7ee-3f77-4fdc-85ec-2cbd5af17646" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:43:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/abb285b7db1935171570ab92e3f78b91898e244d.part --force-share --output=json" returned: 0 in 0.173s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:47 user nova-compute[75341]: DEBUG nova.virt.images [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] f171a069-dd12-4efd-bfcb-aa2e28fcb5ee was qcow2, converting to raw {{(pid=75341) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 23:43:47 user nova-compute[75341]: DEBUG nova.privsep.utils [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75341) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 23:43:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/abb285b7db1935171570ab92e3f78b91898e244d.part /opt/stack/data/nova/instances/_base/abb285b7db1935171570ab92e3f78b91898e244d.converted {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:47 user nova-compute[75341]: DEBUG nova.compute.manager [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: a141d7ee-3f77-4fdc-85ec-2cbd5af17646] Starting instance... {{(pid=75341) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 23:43:47 user nova-compute[75341]: DEBUG nova.network.neutron [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Updating instance_info_cache with network_info: [{"id": "dcc0edd5-582a-499a-beaf-6de23ff1537c", "address": "fa:16:3e:83:5b:7a", "network": {"id": "139c86e9-e6ea-4307-9f78-7f41ab7a6d8c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-487359378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eff8d64949254c7eb3dd8685ca7447b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc0edd5-58", "ovs_interfaceid": "dcc0edd5-582a-499a-beaf-6de23ff1537c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:43:47 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Releasing lock "refresh_cache-881351d7-31f9-44f4-8571-8f540bbec29c" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:43:47 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:43:47 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:43:47 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Starting heal instance info cache {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 23:43:47 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:43:47 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:43:47 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75341) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 23:43:47 user nova-compute[75341]: INFO nova.compute.claims [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: a141d7ee-3f77-4fdc-85ec-2cbd5af17646] Claim successful on node user
Nov 14 23:43:47 user nova-compute[75341]: DEBUG nova.network.neutron [req-fccc9aa0-6f01-482a-ac60-11df0ad9fb48 req-6f3b0e23-ca64-49bc-bfe7-25bd553afaaf service nova] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Updated VIF entry in instance network info cache for port 4f1d8292-7392-4939-9303-437dc108b4a4. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:43:47 user nova-compute[75341]: DEBUG nova.network.neutron [req-fccc9aa0-6f01-482a-ac60-11df0ad9fb48 req-6f3b0e23-ca64-49bc-bfe7-25bd553afaaf service nova] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Updating instance_info_cache with network_info: [{"id": "4f1d8292-7392-4939-9303-437dc108b4a4", "address": "fa:16:3e:be:2c:ef", "network": {"id": "e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-64240219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f27e41f4cc1451291b8aca34544867b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f1d8292-73", "ovs_interfaceid": "4f1d8292-7392-4939-9303-437dc108b4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:43:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/abb285b7db1935171570ab92e3f78b91898e244d.part /opt/stack/data/nova/instances/_base/abb285b7db1935171570ab92e3f78b91898e244d.converted" returned: 0 in 0.342s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/abb285b7db1935171570ab92e3f78b91898e244d.converted --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:47 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-fccc9aa0-6f01-482a-ac60-11df0ad9fb48 req-6f3b0e23-ca64-49bc-bfe7-25bd553afaaf service nova] Releasing lock "refresh_cache-a308a35f-c8d7-482c-a93d-5d9eb473d4e1" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:43:47 user nova-compute[75341]: DEBUG os_brick.utils [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:43:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:47 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Didn't find any instances for network info cache update. {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 23:43:47 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:43:47 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:43:47 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:43:47 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:43:47 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:43:47 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:43:47 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75341) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 23:43:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:47 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[15206657-8547-4e53-8868-c328f717c400]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6d1cfca09c9\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:47 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[00fb4f15-745a-4d84-9cba-88a73b6d069b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:47 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03458b7-7890-4a38-ab1d-94563085192d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:47 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[449f4ca0-b366-4f46-bf0e-e8a1ffcddd34]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Running cmd (subprocess): nvme version {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] 'nvme version' failed. Not Retrying. {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:43:47 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] nvme not present on system {{(pid=75341) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 23:43:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/abb285b7db1935171570ab92e3f78b91898e244d.converted --force-share --output=json" returned: 0 in 0.182s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:47 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "abb285b7db1935171570ab92e3f78b91898e244d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.511s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:43:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/abb285b7db1935171570ab92e3f78b91898e244d --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:43:47 user nova-compute[75341]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 23:43:47 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[3546d44a-ebf6-4a2f-aad5-768fe1ee2b95]: (4, '') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:47 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:43:47 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75341) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 23:43:47 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 23:43:47 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] LIGHTOS: no hostnqn found. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 23:43:47 user nova-compute[75341]: DEBUG os_brick.utils [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] <== get_connector_properties: return (178ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6d1cfca09c9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:43:47 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:47 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:43:47 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:43:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/abb285b7db1935171570ab92e3f78b91898e244d --force-share --output=json" returned: 0 in 0.198s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:48 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Acquiring lock "abb285b7db1935171570ab92e3f78b91898e244d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:43:48 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "abb285b7db1935171570ab92e3f78b91898e244d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:43:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/abb285b7db1935171570ab92e3f78b91898e244d --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:48 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:43:48 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:43:48 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.574s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:43:48 user nova-compute[75341]: DEBUG nova.compute.manager [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: a141d7ee-3f77-4fdc-85ec-2cbd5af17646] Start building networks asynchronously for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 23:43:48 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.226s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:43:48 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:43:48 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75341) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 23:43:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/abb285b7db1935171570ab92e3f78b91898e244d --force-share --output=json" returned: 0 in 0.187s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/abb285b7db1935171570ab92e3f78b91898e244d,backing_fmt=raw /opt/stack/data/nova/instances/a308a35f-c8d7-482c-a93d-5d9eb473d4e1/disk 1073741824 {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:48 user nova-compute[75341]: DEBUG nova.compute.manager [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: a141d7ee-3f77-4fdc-85ec-2cbd5af17646] Allocating IP information in the background. {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 23:43:48 user nova-compute[75341]: DEBUG nova.network.neutron [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: a141d7ee-3f77-4fdc-85ec-2cbd5af17646] allocate_for_instance() {{(pid=75341) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 23:43:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/abb285b7db1935171570ab92e3f78b91898e244d,backing_fmt=raw /opt/stack/data/nova/instances/a308a35f-c8d7-482c-a93d-5d9eb473d4e1/disk 1073741824" returned: 0 in 0.078s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:48 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "abb285b7db1935171570ab92e3f78b91898e244d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:43:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/abb285b7db1935171570ab92e3f78b91898e244d --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:48 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: a141d7ee-3f77-4fdc-85ec-2cbd5af17646] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 23:43:48 user nova-compute[75341]: DEBUG nova.policy [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c449c68aafa04accb8f06dbf87371f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86dc7dc1b6b41bf874f1a25d7bca91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75341) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 23:43:48 user nova-compute[75341]: DEBUG nova.compute.manager [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: a141d7ee-3f77-4fdc-85ec-2cbd5af17646] Start building block device mappings for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 23:43:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:48 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/abb285b7db1935171570ab92e3f78b91898e244d --force-share --output=json" returned: 0 in 0.199s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:48 user nova-compute[75341]: DEBUG nova.objects.instance [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lazy-loading 'migration_context' on Instance uuid a308a35f-c8d7-482c-a93d-5d9eb473d4e1 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:43:48 user nova-compute[75341]: DEBUG nova.objects.base [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Object Instance<a308a35f-c8d7-482c-a93d-5d9eb473d4e1> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75341) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 23:43:48 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Rebasing disk image.
Nov 14 23:43:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:48 user nova-compute[75341]: DEBUG nova.compute.manager [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: a141d7ee-3f77-4fdc-85ec-2cbd5af17646] Start spawning the instance on the hypervisor. {{(pid=75341) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 23:43:48 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: a141d7ee-3f77-4fdc-85ec-2cbd5af17646] Creating instance directory {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 23:43:48 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: a141d7ee-3f77-4fdc-85ec-2cbd5af17646] Creating image(s)
Nov 14 23:43:48 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Acquiring lock "/opt/stack/data/nova/instances/a141d7ee-3f77-4fdc-85ec-2cbd5af17646/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:43:48 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Lock "/opt/stack/data/nova/instances/a141d7ee-3f77-4fdc-85ec-2cbd5af17646/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:43:48 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Lock "/opt/stack/data/nova/instances/a141d7ee-3f77-4fdc-85ec-2cbd5af17646/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:43:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.193s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 -F raw /opt/stack/data/nova/instances/a308a35f-c8d7-482c-a93d-5d9eb473d4e1/disk {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.192s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:48 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Acquiring lock "4754efee9a6d73d3647f2add2cfe86c291949740" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:43:48 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:43:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:48 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 23:43:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0cffbac-f552-47bf-bd6c-dabb70e7c867/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.209s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/a141d7ee-3f77-4fdc-85ec-2cbd5af17646/disk 1073741824 {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/a141d7ee-3f77-4fdc-85ec-2cbd5af17646/disk 1073741824" returned: 0 in 0.054s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:43:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0cffbac-f552-47bf-bd6c-dabb70e7c867/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0cffbac-f552-47bf-bd6c-dabb70e7c867/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:49 user nova-compute[75341]: DEBUG nova.network.neutron [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: a141d7ee-3f77-4fdc-85ec-2cbd5af17646] Successfully created port: a64b87d5-7175-42f5-b6d0-09f45ac29e96 {{(pid=75341) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 23:43:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.176s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:49 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a141d7ee-3f77-4fdc-85ec-2cbd5af17646/disk. size=1073741824 {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 23:43:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a141d7ee-3f77-4fdc-85ec-2cbd5af17646/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0cffbac-f552-47bf-bd6c-dabb70e7c867/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44080c0d-56eb-4987-aa4b-59f161dcbc0b/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a141d7ee-3f77-4fdc-85ec-2cbd5af17646/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:49 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Cannot resize image /opt/stack/data/nova/instances/a141d7ee-3f77-4fdc-85ec-2cbd5af17646/disk to a smaller size. {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 23:43:49 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: a141d7ee-3f77-4fdc-85ec-2cbd5af17646] Created local disks {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 23:43:49 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: a141d7ee-3f77-4fdc-85ec-2cbd5af17646] Ensure instance console log exists: /opt/stack/data/nova/instances/a141d7ee-3f77-4fdc-85ec-2cbd5af17646/console.log {{(pid=75341) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 23:43:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:43:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:43:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:43:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44080c0d-56eb-4987-aa4b-59f161dcbc0b/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44080c0d-56eb-4987-aa4b-59f161dcbc0b/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44080c0d-56eb-4987-aa4b-59f161dcbc0b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:49 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 23:43:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c73d0da-fea9-4098-a0e8-c070f22969f4/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:49 user nova-compute[75341]: DEBUG nova.network.neutron [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: a141d7ee-3f77-4fdc-85ec-2cbd5af17646] Successfully updated port: a64b87d5-7175-42f5-b6d0-09f45ac29e96 {{(pid=75341) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 23:43:49 user nova-compute[75341]: DEBUG nova.compute.manager [req-ac04f242-6ae9-4aa0-8651-eb511d244133 req-d30b06c7-18af-4851-bb56-4f94598cbb15 service nova] [instance: a141d7ee-3f77-4fdc-85ec-2cbd5af17646] Received event network-changed-a64b87d5-7175-42f5-b6d0-09f45ac29e96 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:43:49 user nova-compute[75341]: DEBUG nova.compute.manager [req-ac04f242-6ae9-4aa0-8651-eb511d244133 req-d30b06c7-18af-4851-bb56-4f94598cbb15 service nova] [instance: a141d7ee-3f77-4fdc-85ec-2cbd5af17646] Refreshing instance network info cache due to event network-changed-a64b87d5-7175-42f5-b6d0-09f45ac29e96. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:43:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ac04f242-6ae9-4aa0-8651-eb511d244133 req-d30b06c7-18af-4851-bb56-4f94598cbb15 service nova] Acquiring lock "refresh_cache-a141d7ee-3f77-4fdc-85ec-2cbd5af17646" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:43:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ac04f242-6ae9-4aa0-8651-eb511d244133 req-d30b06c7-18af-4851-bb56-4f94598cbb15 service nova] Acquired lock "refresh_cache-a141d7ee-3f77-4fdc-85ec-2cbd5af17646" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:43:49 user nova-compute[75341]: DEBUG nova.network.neutron [req-ac04f242-6ae9-4aa0-8651-eb511d244133 req-d30b06c7-18af-4851-bb56-4f94598cbb15 service nova] [instance: a141d7ee-3f77-4fdc-85ec-2cbd5af17646] Refreshing network info cache for port a64b87d5-7175-42f5-b6d0-09f45ac29e96 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:43:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Acquiring lock "refresh_cache-a141d7ee-3f77-4fdc-85ec-2cbd5af17646" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:43:49 user nova-compute[75341]: DEBUG nova.network.neutron [req-ac04f242-6ae9-4aa0-8651-eb511d244133 req-d30b06c7-18af-4851-bb56-4f94598cbb15 service nova] [instance: a141d7ee-3f77-4fdc-85ec-2cbd5af17646] Instance cache missing network info. {{(pid=75341) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 23:43:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c73d0da-fea9-4098-a0e8-c070f22969f4/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c73d0da-fea9-4098-a0e8-c070f22969f4/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:50 user nova-compute[75341]: DEBUG nova.network.neutron [req-ac04f242-6ae9-4aa0-8651-eb511d244133 req-d30b06c7-18af-4851-bb56-4f94598cbb15 service nova] [instance: a141d7ee-3f77-4fdc-85ec-2cbd5af17646] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:43:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ac04f242-6ae9-4aa0-8651-eb511d244133 req-d30b06c7-18af-4851-bb56-4f94598cbb15 service nova] Releasing lock "refresh_cache-a141d7ee-3f77-4fdc-85ec-2cbd5af17646" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:43:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Acquired lock "refresh_cache-a141d7ee-3f77-4fdc-85ec-2cbd5af17646" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:43:50 user nova-compute[75341]: DEBUG nova.network.neutron [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: a141d7ee-3f77-4fdc-85ec-2cbd5af17646] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 23:43:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c73d0da-fea9-4098-a0e8-c070f22969f4/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:50 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 23:43:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8d3b42b-11b5-477a-afb1-80a1786b693b/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:50 user nova-compute[75341]: DEBUG nova.network.neutron [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: a141d7ee-3f77-4fdc-85ec-2cbd5af17646] Instance cache missing network info. {{(pid=75341) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 23:43:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8d3b42b-11b5-477a-afb1-80a1786b693b/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8d3b42b-11b5-477a-afb1-80a1786b693b/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:50 user nova-compute[75341]: DEBUG nova.network.neutron [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: a141d7ee-3f77-4fdc-85ec-2cbd5af17646] Updating instance_info_cache with network_info: [{"id": "a64b87d5-7175-42f5-b6d0-09f45ac29e96", "address": "fa:16:3e:4c:4c:c2", "network": {"id": "7673016a-86f3-4643-a21f-148adc2a96dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-89785556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d86dc7dc1b6b41bf874f1a25d7bca91d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa64b87d5-71", "ovs_interfaceid": "a64b87d5-7175-42f5-b6d0-09f45ac29e96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:43:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Releasing lock "refresh_cache-a141d7ee-3f77-4fdc-85ec-2cbd5af17646" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:43:50 user nova-compute[75341]: DEBUG nova.compute.manager [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: a141d7ee-3f77-4fdc-85ec-2cbd5af17646] Instance network_info: |[{"id": "a64b87d5-7175-42f5-b6d0-09f45ac29e96", "address": "fa:16:3e:4c:4c:c2", "network": {"id": "7673016a-86f3-4643-a21f-148adc2a96dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-89785556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d86dc7dc1b6b41bf874f1a25d7bca91d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa64b87d5-71", "ovs_interfaceid": "a64b87d5-7175-42f5-b6d0-09f45ac29e96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 23:43:50 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: a141d7ee-3f77-4fdc-85ec-2cbd5af17646] Start _get_guest_xml network_info=[{"id": "a64b87d5-7175-42f5-b6d0-09f45ac29e96", "address": "fa:16:3e:4c:4c:c2", "network": {"id": "7673016a-86f3-4643-a21f-148adc2a96dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-89785556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d86dc7dc1b6b41bf874f1a25d7bca91d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa64b87d5-71", "ovs_interfaceid": "a64b87d5-7175-42f5-b6d0-09f45ac29e96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encrypted': False, 'image_id': 'e46abb82-b810-490e-a8a1-ccdc5fa1a796'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 23:43:50 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:43:50 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:43:50 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 23:43:50 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 23:43:50 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 23:43:50 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 23:43:50 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 23:43:50 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 23:43:50 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 23:43:50 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 23:43:50 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 23:43:50 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 23:43:50 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 23:43:50 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 23:43:50 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 23:43:50 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 23:43:50 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 23:43:50 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 23:43:50 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:43:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-208275026',display_name='tempest-ServersNegativeTestJSON-server-208275026',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-208275026',id=15,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d86dc7dc1b6b41bf874f1a25d7bca91d',ramdisk_id='',reservation_id='r-oih0upz4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2018102579',owner_user_name='tempest-ServersNegativeTestJSON-2018102579-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:43:49Z,user_data=None,user_id='c449c68aafa04accb8f06dbf87371f2d',uuid=a141d7ee-3f77-4fdc-85ec-2cbd5af17646,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a64b87d5-7175-42f5-b6d0-09f45ac29e96", "address": "fa:16:3e:4c:4c:c2", "network": {"id": "7673016a-86f3-4643-a21f-148adc2a96dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-89785556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d86dc7dc1b6b41bf874f1a25d7bca91d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa64b87d5-71", "ovs_interfaceid": "a64b87d5-7175-42f5-b6d0-09f45ac29e96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:43:50 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Converting VIF {"id": "a64b87d5-7175-42f5-b6d0-09f45ac29e96", "address": "fa:16:3e:4c:4c:c2", "network": {"id": "7673016a-86f3-4643-a21f-148adc2a96dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-89785556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d86dc7dc1b6b41bf874f1a25d7bca91d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa64b87d5-71", "ovs_interfaceid": "a64b87d5-7175-42f5-b6d0-09f45ac29e96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:43:50 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:4c:c2,bridge_name='br-int',has_traffic_filtering=True,id=a64b87d5-7175-42f5-b6d0-09f45ac29e96,network=Network(7673016a-86f3-4643-a21f-148adc2a96dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa64b87d5-71') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:43:50 user nova-compute[75341]: DEBUG nova.objects.instance [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Lazy-loading 'pci_devices' on Instance uuid a141d7ee-3f77-4fdc-85ec-2cbd5af17646 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:43:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8d3b42b-11b5-477a-afb1-80a1786b693b/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:50 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: a141d7ee-3f77-4fdc-85ec-2cbd5af17646] End _get_guest_xml xml=<domain type="kvm">
Nov 14 23:43:50 user nova-compute[75341]:   <uuid>a141d7ee-3f77-4fdc-85ec-2cbd5af17646</uuid>
Nov 14 23:43:50 user nova-compute[75341]:   <name>instance-0000000f</name>
Nov 14 23:43:50 user nova-compute[75341]:   <memory>524288</memory>
Nov 14 23:43:50 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 14 23:43:50 user nova-compute[75341]:   <metadata>
Nov 14 23:43:50 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 23:43:50 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 14 23:43:50 user nova-compute[75341]:       <nova:name>tempest-ServersNegativeTestJSON-server-208275026</nova:name>
Nov 14 23:43:50 user nova-compute[75341]:       <nova:creationTime>2023-11-14 23:43:50</nova:creationTime>
Nov 14 23:43:50 user nova-compute[75341]:       <nova:flavor name="m1.tiny">
Nov 14 23:43:50 user nova-compute[75341]:         <nova:memory>512</nova:memory>
Nov 14 23:43:50 user nova-compute[75341]:         <nova:disk>1</nova:disk>
Nov 14 23:43:50 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 14 23:43:50 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 23:43:50 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 14 23:43:50 user nova-compute[75341]:       </nova:flavor>
Nov 14 23:43:50 user nova-compute[75341]:       <nova:owner>
Nov 14 23:43:50 user nova-compute[75341]:         <nova:user uuid="c449c68aafa04accb8f06dbf87371f2d">tempest-ServersNegativeTestJSON-2018102579-project-member</nova:user>
Nov 14 23:43:50 user nova-compute[75341]:         <nova:project uuid="d86dc7dc1b6b41bf874f1a25d7bca91d">tempest-ServersNegativeTestJSON-2018102579</nova:project>
Nov 14 23:43:50 user nova-compute[75341]:       </nova:owner>
Nov 14 23:43:50 user nova-compute[75341]:       <nova:root type="image" uuid="e46abb82-b810-490e-a8a1-ccdc5fa1a796"/>
Nov 14 23:43:50 user nova-compute[75341]:       <nova:ports>
Nov 14 23:43:50 user nova-compute[75341]:         <nova:port uuid="a64b87d5-7175-42f5-b6d0-09f45ac29e96">
Nov 14 23:43:50 user nova-compute[75341]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 23:43:50 user nova-compute[75341]:         </nova:port>
Nov 14 23:43:50 user nova-compute[75341]:       </nova:ports>
Nov 14 23:43:50 user nova-compute[75341]:     </nova:instance>
Nov 14 23:43:50 user nova-compute[75341]:   </metadata>
Nov 14 23:43:50 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 14 23:43:50 user nova-compute[75341]:     <system>
Nov 14 23:43:50 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 23:43:50 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 14 23:43:50 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 14 23:43:50 user nova-compute[75341]:       <entry name="serial">a141d7ee-3f77-4fdc-85ec-2cbd5af17646</entry>
Nov 14 23:43:50 user nova-compute[75341]:       <entry name="uuid">a141d7ee-3f77-4fdc-85ec-2cbd5af17646</entry>
Nov 14 23:43:50 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 14 23:43:50 user nova-compute[75341]:     </system>
Nov 14 23:43:50 user nova-compute[75341]:   </sysinfo>
Nov 14 23:43:50 user nova-compute[75341]:   <os>
Nov 14 23:43:50 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 23:43:50 user nova-compute[75341]:     <boot dev="hd"/>
Nov 14 23:43:50 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 14 23:43:50 user nova-compute[75341]:   </os>
Nov 14 23:43:50 user nova-compute[75341]:   <features>
Nov 14 23:43:50 user nova-compute[75341]:     <acpi/>
Nov 14 23:43:50 user nova-compute[75341]:     <apic/>
Nov 14 23:43:50 user nova-compute[75341]:     <vmcoreinfo/>
Nov 14 23:43:50 user nova-compute[75341]:   </features>
Nov 14 23:43:50 user nova-compute[75341]:   <clock offset="utc">
Nov 14 23:43:50 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 23:43:50 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 23:43:50 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 14 23:43:50 user nova-compute[75341]:   </clock>
Nov 14 23:43:50 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 14 23:43:50 user nova-compute[75341]:     <model>Nehalem</model>
Nov 14 23:43:50 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 23:43:50 user nova-compute[75341]:   </cpu>
Nov 14 23:43:50 user nova-compute[75341]:   <devices>
Nov 14 23:43:50 user nova-compute[75341]:     <disk type="file" device="disk">
Nov 14 23:43:50 user nova-compute[75341]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 23:43:50 user nova-compute[75341]:       <source file="/opt/stack/data/nova/instances/a141d7ee-3f77-4fdc-85ec-2cbd5af17646/disk"/>
Nov 14 23:43:50 user nova-compute[75341]:       <target dev="vda" bus="virtio"/>
Nov 14 23:43:50 user nova-compute[75341]:     </disk>
Nov 14 23:43:50 user nova-compute[75341]:     <interface type="ethernet">
Nov 14 23:43:50 user nova-compute[75341]:       <mac address="fa:16:3e:4c:4c:c2"/>
Nov 14 23:43:50 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:43:50 user nova-compute[75341]:       <mtu size="1442"/>
Nov 14 23:43:50 user nova-compute[75341]:       <target dev="tapa64b87d5-71"/>
Nov 14 23:43:50 user nova-compute[75341]:     </interface>
Nov 14 23:43:50 user nova-compute[75341]:     <serial type="pty">
Nov 14 23:43:50 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/a141d7ee-3f77-4fdc-85ec-2cbd5af17646/console.log" append="off"/>
Nov 14 23:43:50 user nova-compute[75341]:     </serial>
Nov 14 23:43:50 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 23:43:50 user nova-compute[75341]:     <video>
Nov 14 23:43:50 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:43:50 user nova-compute[75341]:     </video>
Nov 14 23:43:50 user nova-compute[75341]:     <rng model="virtio">
Nov 14 23:43:50 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 14 23:43:50 user nova-compute[75341]:     </rng>
Nov 14 23:43:50 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 14 23:43:50 user nova-compute[75341]:     <memballoon model="virtio">
Nov 14 23:43:50 user nova-compute[75341]:       <stats period="10"/>
Nov 14 23:43:50 user nova-compute[75341]:     </memballoon>
Nov 14 23:43:50 user nova-compute[75341]:   </devices>
Nov 14 23:43:50 user nova-compute[75341]: </domain>
Nov 14 23:43:50 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 23:43:50 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:43:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-208275026',display_name='tempest-ServersNegativeTestJSON-server-208275026',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-208275026',id=15,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d86dc7dc1b6b41bf874f1a25d7bca91d',ramdisk_id='',reservation_id='r-oih0upz4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2018102579',owner_user_name='tempest-ServersNegativeTestJSON-2018102579-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:43:49Z,user_data=None,user_id='c449c68aafa04accb8f06dbf87371f2d',uuid=a141d7ee-3f77-4fdc-85ec-2cbd5af17646,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a64b87d5-7175-42f5-b6d0-09f45ac29e96", "address": "fa:16:3e:4c:4c:c2", "network": {"id": "7673016a-86f3-4643-a21f-148adc2a96dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-89785556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d86dc7dc1b6b41bf874f1a25d7bca91d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa64b87d5-71", "ovs_interfaceid": "a64b87d5-7175-42f5-b6d0-09f45ac29e96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 23:43:50 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Converting VIF {"id": "a64b87d5-7175-42f5-b6d0-09f45ac29e96", "address": "fa:16:3e:4c:4c:c2", "network": {"id": "7673016a-86f3-4643-a21f-148adc2a96dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-89785556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d86dc7dc1b6b41bf874f1a25d7bca91d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa64b87d5-71", "ovs_interfaceid": "a64b87d5-7175-42f5-b6d0-09f45ac29e96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:43:50 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:4c:c2,bridge_name='br-int',has_traffic_filtering=True,id=a64b87d5-7175-42f5-b6d0-09f45ac29e96,network=Network(7673016a-86f3-4643-a21f-148adc2a96dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa64b87d5-71') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:43:50 user nova-compute[75341]: DEBUG os_vif [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:4c:c2,bridge_name='br-int',has_traffic_filtering=True,id=a64b87d5-7175-42f5-b6d0-09f45ac29e96,network=Network(7673016a-86f3-4643-a21f-148adc2a96dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa64b87d5-71') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 23:43:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:43:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 23:43:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eacadc6d-6de6-5556-b331-d1964bffdfeb', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:43:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 -F raw /opt/stack/data/nova/instances/a308a35f-c8d7-482c-a93d-5d9eb473d4e1/disk" returned: 0 in 2.347s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Created local disks {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Ensure instance console log exists: /opt/stack/data/nova/instances/a308a35f-c8d7-482c-a93d-5d9eb473d4e1/console.log {{(pid=75341) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Start _get_guest_xml network_info=[{"id": "4f1d8292-7392-4939-9303-437dc108b4a4", "address": "fa:16:3e:be:2c:ef", "network": {"id": "e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-64240219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f27e41f4cc1451291b8aca34544867b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f1d8292-73", "ovs_interfaceid": "4f1d8292-7392-4939-9303-437dc108b4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='8ec6ccacfec9c9d3782159451cafbea6',container_format='bare',created_at=2023-11-14T23:41:46Z,direct_url=<?>,disk_format='qcow2',id=f171a069-dd12-4efd-bfcb-aa2e28fcb5ee,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-173111556-shelved',owner='5f27e41f4cc1451291b8aca34544867b',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-14T23:41:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encrypted': False, 'image_id': 'e46abb82-b810-490e-a8a1-ccdc5fa1a796'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': None, 'attachment_id': 'bcbf3cd6-29fa-4289-84bc-2a764e30a6a5', 'mount_device': '/dev/vdc', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tHcxlgio', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'a308a35f-c8d7-482c-a93d-5d9eb473d4e1', 'attached_at': '', 'detached_at': '', 'volume_id': 'f3d90713-27fa-493f-978a-af46e9730265', 'serial': 'f3d90713-27fa-493f-978a-af46e9730265'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa64b87d5-71, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa64b87d5-71, col_values=(('qos', UUID('b5826ddc-13b6-48f0-b6ab-221a878d3d12')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa64b87d5-71, col_values=(('external_ids', {'iface-id': 'a64b87d5-7175-42f5-b6d0-09f45ac29e96', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:4c:c2', 'vm-uuid': 'a141d7ee-3f77-4fdc-85ec-2cbd5af17646'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:43:51 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:43:51 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:43:51 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Hypervisor/Node resource view: name=user free_ram=7925MB free_disk=25.603717803955078GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75341) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:51 user nova-compute[75341]: INFO os_vif [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:4c:c2,bridge_name='br-int',has_traffic_filtering=True,id=a64b87d5-7175-42f5-b6d0-09f45ac29e96,network=Network(7673016a-86f3-4643-a21f-148adc2a96dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa64b87d5-71')
Nov 14 23:43:51 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:43:51 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:43:51 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='8ec6ccacfec9c9d3782159451cafbea6',container_format='bare',created_at=2023-11-14T23:41:46Z,direct_url=<?>,disk_format='qcow2',id=f171a069-dd12-4efd-bfcb-aa2e28fcb5ee,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-173111556-shelved',owner='5f27e41f4cc1451291b8aca34544867b',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-14T23:41:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG nova.objects.instance [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lazy-loading 'vcpu_model' on Instance uuid a308a35f-c8d7-482c-a93d-5d9eb473d4e1 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG nova.objects.base [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Object Instance<a308a35f-c8d7-482c-a93d-5d9eb473d4e1> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75341) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Calling os-brick to attach iSCSI Volume {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tHcxlgio', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:43:51 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:43:51 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:43:51 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:43:51 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:43:51 user nova-compute[75341]: INFO os_brick.initiator.connectors.iscsi [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 23:43:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 -p 172.16.0.220:3260 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[48864f0c-0516-420f-8503-ae1698f0ce85]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] No VIF found with MAC fa:16:3e:4c:4c:c2, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 23:43:51 user nova-compute[75341]:  {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 -p 172.16.0.220:3260 --interface default --op new {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Applying migration context for instance 881351d7-31f9-44f4-8571-8f540bbec29c as it has an incoming, in-progress migration ce0332b8-78dd-4580-ac96-b62cde301a6b. Migration status is post-migrating {{(pid=75341) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 14 23:43:51 user nova-compute[75341]: INFO nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Updating resource usage from migration ce0332b8-78dd-4580-ac96-b62cde301a6b
Nov 14 23:43:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d69bba-1d30-4a22-a83c-1559c12a4734]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265] added\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265] added
Nov 14 23:43:51 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb47e7ad-31e5-4ef7-85bc-81639ad87556]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance a0cffbac-f552-47bf-bd6c-dabb70e7c867 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 44080c0d-56eb-4987-aa4b-59f161dcbc0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance d8d3b42b-11b5-477a-afb1-80a1786b693b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance cffc86d5-2ac6-4dd1-bdcd-5832c134d179 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 3c73d0da-fea9-4098-a0e8-c070f22969f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (8fa114cc-b541-418f-865c-16c44294e72d): {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Migration ce0332b8-78dd-4580-ac96-b62cde301a6b is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 881351d7-31f9-44f4-8571-8f540bbec29c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance a141d7ee-3f77-4fdc-85ec-2cbd5af17646 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=26GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7c5ef0-dc50-4d1c-b3f7-de9fb5ecf7a0]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tHcxlgio {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tHcxlgio" returned: 0 in 0.025s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a11288-212c-42ce-a958-d18db0d00847]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tHcxlgio'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ef8ee1-02bd-4686-a111-5e6f095fc0bf]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2d21bc-b000-40b2-a8d4-3a6077aec0d5]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 (non-flash)
Nov 14 23:43:51 user nova-compute[75341]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)
Nov 14 23:43:51 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 (non-flash)
Nov 14 23:43:51 user nova-compute[75341]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)
Nov 14 23:43:51 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 -p 172.16.0.220:3260 --login {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[474247a1-0243-4f93-bc41-8ae08e0ccbf7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265, portal: 172.16.0.220,3260]
Nov 14 23:43:51 user nova-compute[75341]: Login to [iface: default, target: iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265, portal: 172.16.0.220,3260] successful.
Nov 14 23:43:51 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[36811eb8-fb02-49ea-bcb9-2097fa43a442]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb372868-d13a-461d-a0d0-1dd8a0db66a8]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 (non-flash)
Nov 14 23:43:51 user nova-compute[75341]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)
Nov 14 23:43:51 user nova-compute[75341]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 (non-flash)
Nov 14 23:43:51 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 (non-flash)
Nov 14 23:43:51 user nova-compute[75341]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)
Nov 14 23:43:51 user nova-compute[75341]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 (non-flash)
Nov 14 23:43:51 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.360s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Connected to 172.16.0.220:3260 {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] HCTL ('35', '-', '-', 0) found on session 19 with lun 0 {{(pid=75341) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75341) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c40ed8-1460-428f-91c2-044678c1c274]: (4, ('- - 0', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Searching for a device in session 19 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tHcxlgio', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Compute_service record updated for user:user {{(pid=75341) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 23:43:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.551s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:43:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:52 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.397s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:43:52 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] <== connect_volume: return (1398ms) {'type': 'block', 'scsi_wwn': '26262363131383665', 'path': '/dev/sdd'} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:43:52 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262363131383665', 'path': '/dev/sdd'} {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 23:43:52 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T23:39:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-173111556',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-173111556',id=3,image_ref='f171a069-dd12-4efd-bfcb-aa2e28fcb5ee',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-2143336801',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:40:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5f27e41f4cc1451291b8aca34544867b',ramdisk_id='',reservation_id='r-w2ae1nv0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-946394493',owner_user_name='tempest-AttachVolumeShelveTestJSON-946394493-project-member',shelved_at='2023-11-14T23:41:51.391628',shelved_host='user',shelved_image_id='f171a069-dd12-4efd-bfcb-aa2e28fcb5ee'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:43:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38acd33ad6754965a53017185f473f8a',uuid=a308a35f-c8d7-482c-a93d-5d9eb473d4e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "4f1d8292-7392-4939-9303-437dc108b4a4", "address": "fa:16:3e:be:2c:ef", "network": {"id": "e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-64240219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f27e41f4cc1451291b8aca34544867b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f1d8292-73", "ovs_interfaceid": "4f1d8292-7392-4939-9303-437dc108b4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:43:52 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Converting VIF {"id": "4f1d8292-7392-4939-9303-437dc108b4a4", "address": "fa:16:3e:be:2c:ef", "network": {"id": "e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-64240219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f27e41f4cc1451291b8aca34544867b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f1d8292-73", "ovs_interfaceid": "4f1d8292-7392-4939-9303-437dc108b4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:43:52 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:2c:ef,bridge_name='br-int',has_traffic_filtering=True,id=4f1d8292-7392-4939-9303-437dc108b4a4,network=Network(e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f1d8292-73') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:43:52 user nova-compute[75341]: DEBUG nova.objects.instance [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lazy-loading 'pci_devices' on Instance uuid a308a35f-c8d7-482c-a93d-5d9eb473d4e1 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:43:52 user nova-compute[75341]: DEBUG nova.objects.base [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Object Instance<a308a35f-c8d7-482c-a93d-5d9eb473d4e1> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75341) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 23:43:52 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] End _get_guest_xml xml=<domain type="kvm">
Nov 14 23:43:52 user nova-compute[75341]:   <uuid>a308a35f-c8d7-482c-a93d-5d9eb473d4e1</uuid>
Nov 14 23:43:52 user nova-compute[75341]:   <name>instance-00000003</name>
Nov 14 23:43:52 user nova-compute[75341]:   <memory>524288</memory>
Nov 14 23:43:52 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 14 23:43:52 user nova-compute[75341]:   <metadata>
Nov 14 23:43:52 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 23:43:52 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 14 23:43:52 user nova-compute[75341]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-173111556</nova:name>
Nov 14 23:43:52 user nova-compute[75341]:       <nova:creationTime>2023-11-14 23:43:51</nova:creationTime>
Nov 14 23:43:52 user nova-compute[75341]:       <nova:flavor name="m1.tiny">
Nov 14 23:43:52 user nova-compute[75341]:         <nova:memory>512</nova:memory>
Nov 14 23:43:52 user nova-compute[75341]:         <nova:disk>1</nova:disk>
Nov 14 23:43:52 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 14 23:43:52 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 23:43:52 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 14 23:43:52 user nova-compute[75341]:       </nova:flavor>
Nov 14 23:43:52 user nova-compute[75341]:       <nova:owner>
Nov 14 23:43:52 user nova-compute[75341]:         <nova:user uuid="38acd33ad6754965a53017185f473f8a">tempest-AttachVolumeShelveTestJSON-946394493-project-member</nova:user>
Nov 14 23:43:52 user nova-compute[75341]:         <nova:project uuid="5f27e41f4cc1451291b8aca34544867b">tempest-AttachVolumeShelveTestJSON-946394493</nova:project>
Nov 14 23:43:52 user nova-compute[75341]:       </nova:owner>
Nov 14 23:43:52 user nova-compute[75341]:       <nova:root type="image" uuid="f171a069-dd12-4efd-bfcb-aa2e28fcb5ee"/>
Nov 14 23:43:52 user nova-compute[75341]:       <nova:ports>
Nov 14 23:43:52 user nova-compute[75341]:         <nova:port uuid="4f1d8292-7392-4939-9303-437dc108b4a4">
Nov 14 23:43:52 user nova-compute[75341]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 23:43:52 user nova-compute[75341]:         </nova:port>
Nov 14 23:43:52 user nova-compute[75341]:       </nova:ports>
Nov 14 23:43:52 user nova-compute[75341]:     </nova:instance>
Nov 14 23:43:52 user nova-compute[75341]:   </metadata>
Nov 14 23:43:52 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 14 23:43:52 user nova-compute[75341]:     <system>
Nov 14 23:43:52 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 23:43:52 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 14 23:43:52 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 14 23:43:52 user nova-compute[75341]:       <entry name="serial">a308a35f-c8d7-482c-a93d-5d9eb473d4e1</entry>
Nov 14 23:43:52 user nova-compute[75341]:       <entry name="uuid">a308a35f-c8d7-482c-a93d-5d9eb473d4e1</entry>
Nov 14 23:43:52 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 14 23:43:52 user nova-compute[75341]:     </system>
Nov 14 23:43:52 user nova-compute[75341]:   </sysinfo>
Nov 14 23:43:52 user nova-compute[75341]:   <os>
Nov 14 23:43:52 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 23:43:52 user nova-compute[75341]:     <boot dev="hd"/>
Nov 14 23:43:52 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 14 23:43:52 user nova-compute[75341]:   </os>
Nov 14 23:43:52 user nova-compute[75341]:   <features>
Nov 14 23:43:52 user nova-compute[75341]:     <acpi/>
Nov 14 23:43:52 user nova-compute[75341]:     <apic/>
Nov 14 23:43:52 user nova-compute[75341]:     <vmcoreinfo/>
Nov 14 23:43:52 user nova-compute[75341]:   </features>
Nov 14 23:43:52 user nova-compute[75341]:   <clock offset="utc">
Nov 14 23:43:52 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 23:43:52 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 23:43:52 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 14 23:43:52 user nova-compute[75341]:   </clock>
Nov 14 23:43:52 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 14 23:43:52 user nova-compute[75341]:     <model>Nehalem</model>
Nov 14 23:43:52 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 23:43:52 user nova-compute[75341]:   </cpu>
Nov 14 23:43:52 user nova-compute[75341]:   <devices>
Nov 14 23:43:52 user nova-compute[75341]:     <disk type="file" device="disk">
Nov 14 23:43:52 user nova-compute[75341]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 23:43:52 user nova-compute[75341]:       <source file="/opt/stack/data/nova/instances/a308a35f-c8d7-482c-a93d-5d9eb473d4e1/disk"/>
Nov 14 23:43:52 user nova-compute[75341]:       <target dev="vda" bus="virtio"/>
Nov 14 23:43:52 user nova-compute[75341]:     </disk>
Nov 14 23:43:52 user nova-compute[75341]:     <disk type="block" device="disk">
Nov 14 23:43:52 user nova-compute[75341]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:43:52 user nova-compute[75341]:       <source dev="/dev/sdd"/>
Nov 14 23:43:52 user nova-compute[75341]:       <target dev="vdc" bus="virtio"/>
Nov 14 23:43:52 user nova-compute[75341]:       <serial>f3d90713-27fa-493f-978a-af46e9730265</serial>
Nov 14 23:43:52 user nova-compute[75341]:     </disk>
Nov 14 23:43:52 user nova-compute[75341]:     <interface type="ethernet">
Nov 14 23:43:52 user nova-compute[75341]:       <mac address="fa:16:3e:be:2c:ef"/>
Nov 14 23:43:52 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:43:52 user nova-compute[75341]:       <mtu size="1442"/>
Nov 14 23:43:52 user nova-compute[75341]:       <target dev="tap4f1d8292-73"/>
Nov 14 23:43:52 user nova-compute[75341]:     </interface>
Nov 14 23:43:52 user nova-compute[75341]:     <serial type="pty">
Nov 14 23:43:52 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/a308a35f-c8d7-482c-a93d-5d9eb473d4e1/console.log" append="off"/>
Nov 14 23:43:52 user nova-compute[75341]:     </serial>
Nov 14 23:43:52 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 23:43:52 user nova-compute[75341]:     <video>
Nov 14 23:43:52 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:43:52 user nova-compute[75341]:     </video>
Nov 14 23:43:52 user nova-compute[75341]:     <rng model="virtio">
Nov 14 23:43:52 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 14 23:43:52 user nova-compute[75341]:     </rng>
Nov 14 23:43:52 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 14 23:43:52 user nova-compute[75341]:     <memballoon model="virtio">
Nov 14 23:43:52 user nova-compute[75341]:       <stats period="10"/>
Nov 14 23:43:52 user nova-compute[75341]:     </memballoon>
Nov 14 23:43:52 user nova-compute[75341]:   </devices>
Nov 14 23:43:52 user nova-compute[75341]: </domain>
Nov 14 23:43:52 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 23:43:52 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T23:39:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-173111556',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-173111556',id=3,image_ref='f171a069-dd12-4efd-bfcb-aa2e28fcb5ee',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-2143336801',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:40:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5f27e41f4cc1451291b8aca34544867b',ramdisk_id='',reservation_id='r-w2ae1nv0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-946394493',owner_user_name='tempest-AttachVolumeShelveTestJSON-946394493-project-member',shelved_at='2023-11-14T23:41:51.391628',shelved_host='user',shelved_image_id='f171a069-dd12-4efd-bfcb-aa2e28fcb5ee'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:43:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38acd33ad6754965a53017185f473f8a',uuid=a308a35f-c8d7-482c-a93d-5d9eb473d4e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "4f1d8292-7392-4939-9303-437dc108b4a4", "address": "fa:16:3e:be:2c:ef", "network": {"id": "e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-64240219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f27e41f4cc1451291b8aca34544867b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f1d8292-73", "ovs_interfaceid": "4f1d8292-7392-4939-9303-437dc108b4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 23:43:52 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Converting VIF {"id": "4f1d8292-7392-4939-9303-437dc108b4a4", "address": "fa:16:3e:be:2c:ef", "network": {"id": "e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-64240219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f27e41f4cc1451291b8aca34544867b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f1d8292-73", "ovs_interfaceid": "4f1d8292-7392-4939-9303-437dc108b4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:43:52 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:2c:ef,bridge_name='br-int',has_traffic_filtering=True,id=4f1d8292-7392-4939-9303-437dc108b4a4,network=Network(e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f1d8292-73') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:43:52 user nova-compute[75341]: DEBUG os_vif [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:2c:ef,bridge_name='br-int',has_traffic_filtering=True,id=4f1d8292-7392-4939-9303-437dc108b4a4,network=Network(e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f1d8292-73') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 23:43:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:43:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 23:43:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '68a4f024-b740-56af-8435-95df2b2dd82d', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:43:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:43:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4f1d8292-73, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:43:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4f1d8292-73, col_values=(('qos', UUID('c629b9c7-00bd-43f9-ba40-7b85a7f08f4e')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:43:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4f1d8292-73, col_values=(('external_ids', {'iface-id': '4f1d8292-7392-4939-9303-437dc108b4a4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:2c:ef', 'vm-uuid': 'a308a35f-c8d7-482c-a93d-5d9eb473d4e1'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:43:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:43:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:52 user nova-compute[75341]: INFO os_vif [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:2c:ef,bridge_name='br-int',has_traffic_filtering=True,id=4f1d8292-7392-4939-9303-437dc108b4a4,network=Network(e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f1d8292-73')
Nov 14 23:43:52 user nova-compute[75341]: DEBUG nova.compute.manager [req-1a6c0cd5-55e2-4632-b858-6ef12252eab7 req-f750a038-32a0-4db7-be01-8d67e5986f7c service nova] [instance: a141d7ee-3f77-4fdc-85ec-2cbd5af17646] Received event network-vif-plugged-a64b87d5-7175-42f5-b6d0-09f45ac29e96 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:43:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-1a6c0cd5-55e2-4632-b858-6ef12252eab7 req-f750a038-32a0-4db7-be01-8d67e5986f7c service nova] Acquiring lock "a141d7ee-3f77-4fdc-85ec-2cbd5af17646-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:43:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-1a6c0cd5-55e2-4632-b858-6ef12252eab7 req-f750a038-32a0-4db7-be01-8d67e5986f7c service nova] Lock "a141d7ee-3f77-4fdc-85ec-2cbd5af17646-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:43:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-1a6c0cd5-55e2-4632-b858-6ef12252eab7 req-f750a038-32a0-4db7-be01-8d67e5986f7c service nova] Lock "a141d7ee-3f77-4fdc-85ec-2cbd5af17646-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:43:52 user nova-compute[75341]: DEBUG nova.compute.manager [req-1a6c0cd5-55e2-4632-b858-6ef12252eab7 req-f750a038-32a0-4db7-be01-8d67e5986f7c service nova] [instance: a141d7ee-3f77-4fdc-85ec-2cbd5af17646] No waiting events found dispatching network-vif-plugged-a64b87d5-7175-42f5-b6d0-09f45ac29e96 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:43:52 user nova-compute[75341]: WARNING nova.compute.manager [req-1a6c0cd5-55e2-4632-b858-6ef12252eab7 req-f750a038-32a0-4db7-be01-8d67e5986f7c service nova] [instance: a141d7ee-3f77-4fdc-85ec-2cbd5af17646] Received unexpected event network-vif-plugged-a64b87d5-7175-42f5-b6d0-09f45ac29e96 for instance with vm_state building and task_state spawning.
Nov 14 23:43:52 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:43:52 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:43:52 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] No VIF found with MAC fa:16:3e:be:2c:ef, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:43:53 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:53 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:53 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:53 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:53 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:53 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Starting finish_migration {{(pid=75341) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 14 23:43:53 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Instance directory exists: not creating {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 23:43:53 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Creating image(s)
Nov 14 23:43:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.185s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:53 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Checking if we can resize image /opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c/disk. size=21474836480 {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 23:43:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c/disk 21474836480 {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c/disk 21474836480" returned: 0 in 0.044s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:53 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Did not create local disks {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 23:43:53 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Ensure instance console log exists: /opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c/console.log {{(pid=75341) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 23:43:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:43:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:43:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:43:53 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Start _get_guest_xml network_info=[{"id": "dcc0edd5-582a-499a-beaf-6de23ff1537c", "address": "fa:16:3e:83:5b:7a", "network": {"id": "139c86e9-e6ea-4307-9f78-7f41ab7a6d8c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-487359378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-487359378-network", "vif_mac": "fa:16:3e:83:5b:7a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eff8d64949254c7eb3dd8685ca7447b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc0edd5-58", "ovs_interfaceid": "dcc0edd5-582a-499a-beaf-6de23ff1537c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encrypted': False, 'image_id': 'e46abb82-b810-490e-a8a1-ccdc5fa1a796'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': None, 'attachment_id': '77b0e3a7-0ed0-4c0f-96da-9ce8a1f99e4d', 'mount_device': '/dev/vdb', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pzdvecEm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '881351d7-31f9-44f4-8571-8f540bbec29c', 'attached_at': '2023-11-14T23:43:53.000000', 'detached_at': '', 'volume_id': '2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3', 'serial': '2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 23:43:53 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:43:53 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:43:53 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 23:43:53 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 23:43:53 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 23:43:53 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 23:43:53 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Calling os-brick to attach iSCSI Volume {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pzdvecEm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:43:54 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:43:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:43:54 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:43:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:43:54 user nova-compute[75341]: INFO os_brick.initiator.connectors.iscsi [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 23:43:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 -p 172.16.0.220:3260 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[a804692f-3265-4581-9246-94f40a3c0f6a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 23:43:54 user nova-compute[75341]:  {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a37984-a331-4ec7-9642-be3401f4b1fb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3] added\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3] added
Nov 14 23:43:54 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[461e5573-ed97-41d4-a011-3fb16c7e80b9]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ddd1e8-b8fb-4ada-9d1d-96dcb44ee915]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pzdvecEm {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pzdvecEm" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[de05dd30-5fe1-4a75-a5e3-c36d824f0310]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pzdvecEm'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3c1043-6424-4999-8760-20004466559b]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9954e3-a7e5-4a44-8e07-80b9f349c071]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 (non-flash)
Nov 14 23:43:54 user nova-compute[75341]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)
Nov 14 23:43:54 user nova-compute[75341]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 (non-flash)
Nov 14 23:43:54 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 (non-flash)
Nov 14 23:43:54 user nova-compute[75341]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)
Nov 14 23:43:54 user nova-compute[75341]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 (non-flash)
Nov 14 23:43:54 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 -p 172.16.0.220:3260 --login {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e25f81-13cb-46d0-ac26-6ef34f39d46c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3, portal: 172.16.0.220,3260]
Nov 14 23:43:54 user nova-compute[75341]: Login to [iface: default, target: iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3, portal: 172.16.0.220,3260] successful.
Nov 14 23:43:54 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.081s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f288f5-a66b-49ee-90cf-99c8e34e4e4a]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe63dd05-2e84-43ea-be76-f65107356a51]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 (non-flash)
Nov 14 23:43:54 user nova-compute[75341]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)
Nov 14 23:43:54 user nova-compute[75341]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 (non-flash)
Nov 14 23:43:54 user nova-compute[75341]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)
Nov 14 23:43:54 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 (non-flash)
Nov 14 23:43:54 user nova-compute[75341]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)
Nov 14 23:43:54 user nova-compute[75341]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 (non-flash)
Nov 14 23:43:54 user nova-compute[75341]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)
Nov 14 23:43:54 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Connected to 172.16.0.220:3260 {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] HCTL ('36', '-', '-', 0) found on session 20 with lun 0 {{(pid=75341) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75341) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb1af11-44f3-4db1-8f8f-7c19f3b49c63]: (4, ('- - 0', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Searching for a device in session 20 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pzdvecEm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG nova.compute.manager [req-ccec4c48-5ebd-4d54-9005-0ff5571a87a6 req-14522600-0bf7-4722-bf1c-6fe1c4673124 service nova] [instance: a141d7ee-3f77-4fdc-85ec-2cbd5af17646] Received event network-vif-plugged-a64b87d5-7175-42f5-b6d0-09f45ac29e96 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ccec4c48-5ebd-4d54-9005-0ff5571a87a6 req-14522600-0bf7-4722-bf1c-6fe1c4673124 service nova] Acquiring lock "a141d7ee-3f77-4fdc-85ec-2cbd5af17646-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ccec4c48-5ebd-4d54-9005-0ff5571a87a6 req-14522600-0bf7-4722-bf1c-6fe1c4673124 service nova] Lock "a141d7ee-3f77-4fdc-85ec-2cbd5af17646-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ccec4c48-5ebd-4d54-9005-0ff5571a87a6 req-14522600-0bf7-4722-bf1c-6fe1c4673124 service nova] Lock "a141d7ee-3f77-4fdc-85ec-2cbd5af17646-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG nova.compute.manager [req-ccec4c48-5ebd-4d54-9005-0ff5571a87a6 req-14522600-0bf7-4722-bf1c-6fe1c4673124 service nova] [instance: a141d7ee-3f77-4fdc-85ec-2cbd5af17646] No waiting events found dispatching network-vif-plugged-a64b87d5-7175-42f5-b6d0-09f45ac29e96 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:43:54 user nova-compute[75341]: WARNING nova.compute.manager [req-ccec4c48-5ebd-4d54-9005-0ff5571a87a6 req-14522600-0bf7-4722-bf1c-6fe1c4673124 service nova] [instance: a141d7ee-3f77-4fdc-85ec-2cbd5af17646] Received unexpected event network-vif-plugged-a64b87d5-7175-42f5-b6d0-09f45ac29e96 for instance with vm_state building and task_state spawning.
Nov 14 23:43:54 user nova-compute[75341]: DEBUG nova.compute.manager [req-ccec4c48-5ebd-4d54-9005-0ff5571a87a6 req-14522600-0bf7-4722-bf1c-6fe1c4673124 service nova] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Received event network-vif-plugged-4f1d8292-7392-4939-9303-437dc108b4a4 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ccec4c48-5ebd-4d54-9005-0ff5571a87a6 req-14522600-0bf7-4722-bf1c-6fe1c4673124 service nova] Acquiring lock "a308a35f-c8d7-482c-a93d-5d9eb473d4e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ccec4c48-5ebd-4d54-9005-0ff5571a87a6 req-14522600-0bf7-4722-bf1c-6fe1c4673124 service nova] Lock "a308a35f-c8d7-482c-a93d-5d9eb473d4e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ccec4c48-5ebd-4d54-9005-0ff5571a87a6 req-14522600-0bf7-4722-bf1c-6fe1c4673124 service nova] Lock "a308a35f-c8d7-482c-a93d-5d9eb473d4e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:43:54 user nova-compute[75341]: DEBUG nova.compute.manager [req-ccec4c48-5ebd-4d54-9005-0ff5571a87a6 req-14522600-0bf7-4722-bf1c-6fe1c4673124 service nova] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] No waiting events found dispatching network-vif-plugged-4f1d8292-7392-4939-9303-437dc108b4a4 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:43:54 user nova-compute[75341]: WARNING nova.compute.manager [req-ccec4c48-5ebd-4d54-9005-0ff5571a87a6 req-14522600-0bf7-4722-bf1c-6fe1c4673124 service nova] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Received unexpected event network-vif-plugged-4f1d8292-7392-4939-9303-437dc108b4a4 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 23:43:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:55 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:43:55 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] <== connect_volume: return (1371ms) {'type': 'block', 'scsi_wwn': '26631613763363039', 'path': '/dev/sde'} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:43:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26631613763363039', 'path': '/dev/sde'} {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 23:43:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:39:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1731707158',display_name='tempest-ServerActionsTestOtherB-server-1731707158',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1731707158',id=1,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPcpkEsQSTpmH5o8Wvimru34qoMLk4crSEJeEz6XFBwMyGlgEqVH+eZU8RhCkfXTyDuMId//yiBmA84BMG1N70mUPHjpTANep7Y1Hwo1CNlTldBrdW9Ccxs8yCQLXA8Fw==',key_name='tempest-keypair-500318648',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:40:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='eff8d64949254c7eb3dd8685ca7447b1',ramdisk_id='',reservation_id='r-505keefc',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1632747205',owner_user_name='tempest-ServerActionsTestOtherB-1632747205-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:43:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='512d2ce7a01c4ffb924f9476a5c4b946',uuid=881351d7-31f9-44f4-8571-8f540bbec29c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dcc0edd5-582a-499a-beaf-6de23ff1537c", "address": "fa:16:3e:83:5b:7a", "network": {"id": "139c86e9-e6ea-4307-9f78-7f41ab7a6d8c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-487359378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-487359378-network", "vif_mac": "fa:16:3e:83:5b:7a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eff8d64949254c7eb3dd8685ca7447b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc0edd5-58", "ovs_interfaceid": "dcc0edd5-582a-499a-beaf-6de23ff1537c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:43:55 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Converting VIF {"id": "dcc0edd5-582a-499a-beaf-6de23ff1537c", "address": "fa:16:3e:83:5b:7a", "network": {"id": "139c86e9-e6ea-4307-9f78-7f41ab7a6d8c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-487359378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-487359378-network", "vif_mac": "fa:16:3e:83:5b:7a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eff8d64949254c7eb3dd8685ca7447b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc0edd5-58", "ovs_interfaceid": "dcc0edd5-582a-499a-beaf-6de23ff1537c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:43:55 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:5b:7a,bridge_name='br-int',has_traffic_filtering=True,id=dcc0edd5-582a-499a-beaf-6de23ff1537c,network=Network(139c86e9-e6ea-4307-9f78-7f41ab7a6d8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcc0edd5-58') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:43:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] End _get_guest_xml xml=<domain type="kvm">
Nov 14 23:43:55 user nova-compute[75341]:   <uuid>881351d7-31f9-44f4-8571-8f540bbec29c</uuid>
Nov 14 23:43:55 user nova-compute[75341]:   <name>instance-00000001</name>
Nov 14 23:43:55 user nova-compute[75341]:   <memory>2097152</memory>
Nov 14 23:43:55 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 14 23:43:55 user nova-compute[75341]:   <metadata>
Nov 14 23:43:55 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 23:43:55 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 14 23:43:55 user nova-compute[75341]:       <nova:name>tempest-ServerActionsTestOtherB-server-1731707158</nova:name>
Nov 14 23:43:55 user nova-compute[75341]:       <nova:creationTime>2023-11-14 23:43:53</nova:creationTime>
Nov 14 23:43:55 user nova-compute[75341]:       <nova:flavor name="m1.small">
Nov 14 23:43:55 user nova-compute[75341]:         <nova:memory>2048</nova:memory>
Nov 14 23:43:55 user nova-compute[75341]:         <nova:disk>20</nova:disk>
Nov 14 23:43:55 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 14 23:43:55 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 23:43:55 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 14 23:43:55 user nova-compute[75341]:       </nova:flavor>
Nov 14 23:43:55 user nova-compute[75341]:       <nova:owner>
Nov 14 23:43:55 user nova-compute[75341]:         <nova:user uuid="512d2ce7a01c4ffb924f9476a5c4b946">tempest-ServerActionsTestOtherB-1632747205-project-member</nova:user>
Nov 14 23:43:55 user nova-compute[75341]:         <nova:project uuid="eff8d64949254c7eb3dd8685ca7447b1">tempest-ServerActionsTestOtherB-1632747205</nova:project>
Nov 14 23:43:55 user nova-compute[75341]:       </nova:owner>
Nov 14 23:43:55 user nova-compute[75341]:       <nova:root type="image" uuid="e46abb82-b810-490e-a8a1-ccdc5fa1a796"/>
Nov 14 23:43:55 user nova-compute[75341]:       <nova:ports>
Nov 14 23:43:55 user nova-compute[75341]:         <nova:port uuid="dcc0edd5-582a-499a-beaf-6de23ff1537c">
Nov 14 23:43:55 user nova-compute[75341]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 23:43:55 user nova-compute[75341]:         </nova:port>
Nov 14 23:43:55 user nova-compute[75341]:       </nova:ports>
Nov 14 23:43:55 user nova-compute[75341]:     </nova:instance>
Nov 14 23:43:55 user nova-compute[75341]:   </metadata>
Nov 14 23:43:55 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 14 23:43:55 user nova-compute[75341]:     <system>
Nov 14 23:43:55 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 23:43:55 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 14 23:43:55 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 14 23:43:55 user nova-compute[75341]:       <entry name="serial">881351d7-31f9-44f4-8571-8f540bbec29c</entry>
Nov 14 23:43:55 user nova-compute[75341]:       <entry name="uuid">881351d7-31f9-44f4-8571-8f540bbec29c</entry>
Nov 14 23:43:55 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 14 23:43:55 user nova-compute[75341]:     </system>
Nov 14 23:43:55 user nova-compute[75341]:   </sysinfo>
Nov 14 23:43:55 user nova-compute[75341]:   <os>
Nov 14 23:43:55 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 23:43:55 user nova-compute[75341]:     <boot dev="hd"/>
Nov 14 23:43:55 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 14 23:43:55 user nova-compute[75341]:   </os>
Nov 14 23:43:55 user nova-compute[75341]:   <features>
Nov 14 23:43:55 user nova-compute[75341]:     <acpi/>
Nov 14 23:43:55 user nova-compute[75341]:     <apic/>
Nov 14 23:43:55 user nova-compute[75341]:     <vmcoreinfo/>
Nov 14 23:43:55 user nova-compute[75341]:   </features>
Nov 14 23:43:55 user nova-compute[75341]:   <clock offset="utc">
Nov 14 23:43:55 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 23:43:55 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 23:43:55 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 14 23:43:55 user nova-compute[75341]:   </clock>
Nov 14 23:43:55 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 14 23:43:55 user nova-compute[75341]:     <model>Nehalem</model>
Nov 14 23:43:55 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 23:43:55 user nova-compute[75341]:   </cpu>
Nov 14 23:43:55 user nova-compute[75341]:   <devices>
Nov 14 23:43:55 user nova-compute[75341]:     <disk type="file" device="disk">
Nov 14 23:43:55 user nova-compute[75341]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 23:43:55 user nova-compute[75341]:       <source file="/opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c/disk"/>
Nov 14 23:43:55 user nova-compute[75341]:       <target dev="vda" bus="virtio"/>
Nov 14 23:43:55 user nova-compute[75341]:     </disk>
Nov 14 23:43:55 user nova-compute[75341]:     <disk type="block" device="disk">
Nov 14 23:43:55 user nova-compute[75341]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:43:55 user nova-compute[75341]:       <source dev="/dev/sde"/>
Nov 14 23:43:55 user nova-compute[75341]:       <target dev="vdb" bus="virtio"/>
Nov 14 23:43:55 user nova-compute[75341]:       <serial>2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3</serial>
Nov 14 23:43:55 user nova-compute[75341]:     </disk>
Nov 14 23:43:55 user nova-compute[75341]:     <interface type="ethernet">
Nov 14 23:43:55 user nova-compute[75341]:       <mac address="fa:16:3e:83:5b:7a"/>
Nov 14 23:43:55 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:43:55 user nova-compute[75341]:       <mtu size="1442"/>
Nov 14 23:43:55 user nova-compute[75341]:       <target dev="tapdcc0edd5-58"/>
Nov 14 23:43:55 user nova-compute[75341]:     </interface>
Nov 14 23:43:55 user nova-compute[75341]:     <serial type="pty">
Nov 14 23:43:55 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c/console.log" append="off"/>
Nov 14 23:43:55 user nova-compute[75341]:     </serial>
Nov 14 23:43:55 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 23:43:55 user nova-compute[75341]:     <video>
Nov 14 23:43:55 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:43:55 user nova-compute[75341]:     </video>
Nov 14 23:43:55 user nova-compute[75341]:     <rng model="virtio">
Nov 14 23:43:55 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 14 23:43:55 user nova-compute[75341]:     </rng>
Nov 14 23:43:55 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 14 23:43:55 user nova-compute[75341]:     <memballoon model="virtio">
Nov 14 23:43:55 user nova-compute[75341]:       <stats period="10"/>
Nov 14 23:43:55 user nova-compute[75341]:     </memballoon>
Nov 14 23:43:55 user nova-compute[75341]:   </devices>
Nov 14 23:43:55 user nova-compute[75341]: </domain>
Nov 14 23:43:55 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 23:43:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:39:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1731707158',display_name='tempest-ServerActionsTestOtherB-server-1731707158',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1731707158',id=1,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPcpkEsQSTpmH5o8Wvimru34qoMLk4crSEJeEz6XFBwMyGlgEqVH+eZU8RhCkfXTyDuMId//yiBmA84BMG1N70mUPHjpTANep7Y1Hwo1CNlTldBrdW9Ccxs8yCQLXA8Fw==',key_name='tempest-keypair-500318648',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:40:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='eff8d64949254c7eb3dd8685ca7447b1',ramdisk_id='',reservation_id='r-505keefc',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1632747205',owner_user_name='tempest-ServerActionsTestOtherB-1632747205-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:43:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='512d2ce7a01c4ffb924f9476a5c4b946',uuid=881351d7-31f9-44f4-8571-8f540bbec29c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dcc0edd5-582a-499a-beaf-6de23ff1537c", "address": "fa:16:3e:83:5b:7a", "network": {"id": "139c86e9-e6ea-4307-9f78-7f41ab7a6d8c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-487359378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-487359378-network", "vif_mac": "fa:16:3e:83:5b:7a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eff8d64949254c7eb3dd8685ca7447b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc0edd5-58", "ovs_interfaceid": "dcc0edd5-582a-499a-beaf-6de23ff1537c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 23:43:55 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Converting VIF {"id": "dcc0edd5-582a-499a-beaf-6de23ff1537c", "address": "fa:16:3e:83:5b:7a", "network": {"id": "139c86e9-e6ea-4307-9f78-7f41ab7a6d8c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-487359378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-487359378-network", "vif_mac": "fa:16:3e:83:5b:7a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eff8d64949254c7eb3dd8685ca7447b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc0edd5-58", "ovs_interfaceid": "dcc0edd5-582a-499a-beaf-6de23ff1537c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:43:55 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:5b:7a,bridge_name='br-int',has_traffic_filtering=True,id=dcc0edd5-582a-499a-beaf-6de23ff1537c,network=Network(139c86e9-e6ea-4307-9f78-7f41ab7a6d8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcc0edd5-58') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:43:55 user nova-compute[75341]: DEBUG os_vif [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:5b:7a,bridge_name='br-int',has_traffic_filtering=True,id=dcc0edd5-582a-499a-beaf-6de23ff1537c,network=Network(139c86e9-e6ea-4307-9f78-7f41ab7a6d8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcc0edd5-58') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 23:43:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:43:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 23:43:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '50b635b7-e3cc-5480-a54f-4b5bf0d82bcd', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:43:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:43:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdcc0edd5-58, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:43:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdcc0edd5-58, col_values=(('qos', UUID('25a0593a-4aba-470d-8094-a4e02f485ee8')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:43:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdcc0edd5-58, col_values=(('external_ids', {'iface-id': 'dcc0edd5-582a-499a-beaf-6de23ff1537c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:5b:7a', 'vm-uuid': '881351d7-31f9-44f4-8571-8f540bbec29c'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:43:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:43:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:55 user nova-compute[75341]: INFO os_vif [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:5b:7a,bridge_name='br-int',has_traffic_filtering=True,id=dcc0edd5-582a-499a-beaf-6de23ff1537c,network=Network(139c86e9-e6ea-4307-9f78-7f41ab7a6d8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcc0edd5-58')
Nov 14 23:43:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:43:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:43:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] No VIF found with MAC fa:16:3e:83:5b:7a, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:43:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:56 user nova-compute[75341]: DEBUG nova.compute.manager [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: a141d7ee-3f77-4fdc-85ec-2cbd5af17646] Instance event wait completed in 0 seconds for  {{(pid=75341) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 23:43:56 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: a141d7ee-3f77-4fdc-85ec-2cbd5af17646] Guest created on hypervisor {{(pid=75341) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 23:43:56 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: a141d7ee-3f77-4fdc-85ec-2cbd5af17646] Instance spawned successfully.
Nov 14 23:43:56 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: a141d7ee-3f77-4fdc-85ec-2cbd5af17646] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 23:43:56 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: a141d7ee-3f77-4fdc-85ec-2cbd5af17646] Found default for hw_cdrom_bus of ide {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:43:56 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: a141d7ee-3f77-4fdc-85ec-2cbd5af17646] Found default for hw_disk_bus of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:43:56 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: a141d7ee-3f77-4fdc-85ec-2cbd5af17646] Found default for hw_input_bus of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:43:56 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: a141d7ee-3f77-4fdc-85ec-2cbd5af17646] Found default for hw_pointer_model of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:43:56 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: a141d7ee-3f77-4fdc-85ec-2cbd5af17646] Found default for hw_video_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:43:56 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: a141d7ee-3f77-4fdc-85ec-2cbd5af17646] Found default for hw_vif_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:43:56 user nova-compute[75341]: INFO nova.compute.manager [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: a141d7ee-3f77-4fdc-85ec-2cbd5af17646] Took 7.70 seconds to spawn the instance on the hypervisor.
Nov 14 23:43:56 user nova-compute[75341]: DEBUG nova.compute.manager [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: a141d7ee-3f77-4fdc-85ec-2cbd5af17646] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 23:43:56 user nova-compute[75341]: INFO nova.compute.manager [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: a141d7ee-3f77-4fdc-85ec-2cbd5af17646] Took 8.83 seconds to build instance.
Nov 14 23:43:56 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-dda34051-4b23-4c29-b036-f7ebf229f483 tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Lock "a141d7ee-3f77-4fdc-85ec-2cbd5af17646" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.226s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:43:56 user nova-compute[75341]: DEBUG nova.compute.manager [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Instance event wait completed in 0 seconds for  {{(pid=75341) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 23:43:56 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Guest created on hypervisor {{(pid=75341) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 23:43:56 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Instance spawned successfully.
Nov 14 23:43:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:56 user nova-compute[75341]: DEBUG nova.compute.manager [req-146df3fe-8755-4169-9632-a2085490ed4d req-10197d30-4d5b-4c10-8962-4c7d617966f4 service nova] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Received event network-vif-plugged-4f1d8292-7392-4939-9303-437dc108b4a4 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:43:56 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-146df3fe-8755-4169-9632-a2085490ed4d req-10197d30-4d5b-4c10-8962-4c7d617966f4 service nova] Acquiring lock "a308a35f-c8d7-482c-a93d-5d9eb473d4e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:43:56 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-146df3fe-8755-4169-9632-a2085490ed4d req-10197d30-4d5b-4c10-8962-4c7d617966f4 service nova] Lock "a308a35f-c8d7-482c-a93d-5d9eb473d4e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:43:56 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-146df3fe-8755-4169-9632-a2085490ed4d req-10197d30-4d5b-4c10-8962-4c7d617966f4 service nova] Lock "a308a35f-c8d7-482c-a93d-5d9eb473d4e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:43:56 user nova-compute[75341]: DEBUG nova.compute.manager [req-146df3fe-8755-4169-9632-a2085490ed4d req-10197d30-4d5b-4c10-8962-4c7d617966f4 service nova] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] No waiting events found dispatching network-vif-plugged-4f1d8292-7392-4939-9303-437dc108b4a4 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:43:56 user nova-compute[75341]: WARNING nova.compute.manager [req-146df3fe-8755-4169-9632-a2085490ed4d req-10197d30-4d5b-4c10-8962-4c7d617966f4 service nova] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Received unexpected event network-vif-plugged-4f1d8292-7392-4939-9303-437dc108b4a4 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 23:43:57 user nova-compute[75341]: DEBUG nova.compute.manager [req-2c0a99d5-044f-43cf-805c-1adc52dfd9f9 req-3a458d25-6b6b-400c-b85d-4c2aadc82180 service nova] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Received event network-vif-plugged-dcc0edd5-582a-499a-beaf-6de23ff1537c {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:43:57 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-2c0a99d5-044f-43cf-805c-1adc52dfd9f9 req-3a458d25-6b6b-400c-b85d-4c2aadc82180 service nova] Acquiring lock "881351d7-31f9-44f4-8571-8f540bbec29c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:43:57 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-2c0a99d5-044f-43cf-805c-1adc52dfd9f9 req-3a458d25-6b6b-400c-b85d-4c2aadc82180 service nova] Lock "881351d7-31f9-44f4-8571-8f540bbec29c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:43:57 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-2c0a99d5-044f-43cf-805c-1adc52dfd9f9 req-3a458d25-6b6b-400c-b85d-4c2aadc82180 service nova] Lock "881351d7-31f9-44f4-8571-8f540bbec29c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:43:57 user nova-compute[75341]: DEBUG nova.compute.manager [req-2c0a99d5-044f-43cf-805c-1adc52dfd9f9 req-3a458d25-6b6b-400c-b85d-4c2aadc82180 service nova] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] No waiting events found dispatching network-vif-plugged-dcc0edd5-582a-499a-beaf-6de23ff1537c {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:43:57 user nova-compute[75341]: WARNING nova.compute.manager [req-2c0a99d5-044f-43cf-805c-1adc52dfd9f9 req-3a458d25-6b6b-400c-b85d-4c2aadc82180 service nova] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Received unexpected event network-vif-plugged-dcc0edd5-582a-499a-beaf-6de23ff1537c for instance with vm_state active and task_state resize_finish.
Nov 14 23:43:57 user nova-compute[75341]: DEBUG nova.compute.manager [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 23:43:57 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-654373a5-b1fd-4abb-82d6-fe2239b32973 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "a308a35f-c8d7-482c-a93d-5d9eb473d4e1" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 18.526s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:43:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:43:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-dba335c6-bf51-4ccd-8b9b-57623513b525 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Acquiring lock "44080c0d-56eb-4987-aa4b-59f161dcbc0b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:43:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-dba335c6-bf51-4ccd-8b9b-57623513b525 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Lock "44080c0d-56eb-4987-aa4b-59f161dcbc0b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:43:59 user nova-compute[75341]: INFO nova.compute.manager [None req-dba335c6-bf51-4ccd-8b9b-57623513b525 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Detaching volume 84172a25-a3fe-442b-940c-3e6dbc7a1a23
Nov 14 23:43:59 user nova-compute[75341]: INFO nova.virt.block_device [None req-dba335c6-bf51-4ccd-8b9b-57623513b525 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Attempting to driver detach volume 84172a25-a3fe-442b-940c-3e6dbc7a1a23 from mountpoint /dev/vdb
Nov 14 23:43:59 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-dba335c6-bf51-4ccd-8b9b-57623513b525 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Attempting to detach device vdb from instance 44080c0d-56eb-4987-aa4b-59f161dcbc0b from the persistent domain config. {{(pid=75341) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 23:43:59 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-dba335c6-bf51-4ccd-8b9b-57623513b525 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 23:43:59 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:43:59 user nova-compute[75341]:   <source dev="/dev/sdb"/>
Nov 14 23:43:59 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:43:59 user nova-compute[75341]:   <serial>84172a25-a3fe-442b-940c-3e6dbc7a1a23</serial>
Nov 14 23:43:59 user nova-compute[75341]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 23:43:59 user nova-compute[75341]: </disk>
Nov 14 23:43:59 user nova-compute[75341]:  {{(pid=75341) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 23:43:59 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-dba335c6-bf51-4ccd-8b9b-57623513b525 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Successfully detached device vdb from instance 44080c0d-56eb-4987-aa4b-59f161dcbc0b from the persistent domain config.
Nov 14 23:43:59 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-dba335c6-bf51-4ccd-8b9b-57623513b525 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 44080c0d-56eb-4987-aa4b-59f161dcbc0b from the live domain config. {{(pid=75341) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 23:43:59 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-dba335c6-bf51-4ccd-8b9b-57623513b525 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 23:43:59 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:43:59 user nova-compute[75341]:   <source dev="/dev/sdb"/>
Nov 14 23:43:59 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:43:59 user nova-compute[75341]:   <serial>84172a25-a3fe-442b-940c-3e6dbc7a1a23</serial>
Nov 14 23:43:59 user nova-compute[75341]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 23:43:59 user nova-compute[75341]: </disk>
Nov 14 23:43:59 user nova-compute[75341]:  {{(pid=75341) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 23:43:59 user nova-compute[75341]: DEBUG nova.compute.manager [req-2a9478a0-ec4f-4801-bb8d-2dacbfcb737c req-9b13b1be-0745-41b7-8035-fd4395cda351 service nova] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Received event network-vif-plugged-dcc0edd5-582a-499a-beaf-6de23ff1537c {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:43:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-2a9478a0-ec4f-4801-bb8d-2dacbfcb737c req-9b13b1be-0745-41b7-8035-fd4395cda351 service nova] Acquiring lock "881351d7-31f9-44f4-8571-8f540bbec29c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:43:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-2a9478a0-ec4f-4801-bb8d-2dacbfcb737c req-9b13b1be-0745-41b7-8035-fd4395cda351 service nova] Lock "881351d7-31f9-44f4-8571-8f540bbec29c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:43:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-2a9478a0-ec4f-4801-bb8d-2dacbfcb737c req-9b13b1be-0745-41b7-8035-fd4395cda351 service nova] Lock "881351d7-31f9-44f4-8571-8f540bbec29c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:43:59 user nova-compute[75341]: DEBUG nova.compute.manager [req-2a9478a0-ec4f-4801-bb8d-2dacbfcb737c req-9b13b1be-0745-41b7-8035-fd4395cda351 service nova] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] No waiting events found dispatching network-vif-plugged-dcc0edd5-582a-499a-beaf-6de23ff1537c {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:43:59 user nova-compute[75341]: WARNING nova.compute.manager [req-2a9478a0-ec4f-4801-bb8d-2dacbfcb737c req-9b13b1be-0745-41b7-8035-fd4395cda351 service nova] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Received unexpected event network-vif-plugged-dcc0edd5-582a-499a-beaf-6de23ff1537c for instance with vm_state active and task_state resize_finish.
Nov 14 23:43:59 user nova-compute[75341]: DEBUG nova.compute.manager [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Instance event wait completed in 0 seconds for  {{(pid=75341) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 23:43:59 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Instance running successfully.
Nov 14 23:43:59 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Failed to set time: agent not configured {{(pid=75341) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 14 23:43:59 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-2bd11cdf-8899-439c-8939-2fec03abde09 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] finish_migration finished successfully. {{(pid=75341) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 14 23:43:59 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-dba335c6-bf51-4ccd-8b9b-57623513b525 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 44080c0d-56eb-4987-aa4b-59f161dcbc0b {{(pid=75341) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 23:44:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:05 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:05 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:05 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Acquiring lock "dbc9a6db-b536-426a-91fd-691a44c66528" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:44:05 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Lock "dbc9a6db-b536-426a-91fd-691a44c66528" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:44:05 user nova-compute[75341]: DEBUG nova.compute.manager [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Starting instance... {{(pid=75341) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 23:44:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:44:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:44:06 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75341) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 23:44:06 user nova-compute[75341]: INFO nova.compute.claims [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Claim successful on node user
Nov 14 23:44:06 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:44:06 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:44:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.581s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:44:06 user nova-compute[75341]: DEBUG nova.compute.manager [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Start building networks asynchronously for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 23:44:06 user nova-compute[75341]: DEBUG nova.compute.manager [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Allocating IP information in the background. {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 23:44:06 user nova-compute[75341]: DEBUG nova.network.neutron [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] allocate_for_instance() {{(pid=75341) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 23:44:06 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 23:44:06 user nova-compute[75341]: DEBUG nova.compute.manager [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Start building block device mappings for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 23:44:06 user nova-compute[75341]: INFO nova.virt.block_device [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Booting with volume 98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 at /dev/vda
Nov 14 23:44:06 user nova-compute[75341]: DEBUG nova.policy [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cfcd7dc4048345cca7a8facabde9e209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c40c4897cbbd4ac8b3192eb149adcb41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75341) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 23:44:06 user nova-compute[75341]: DEBUG os_brick.utils [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:44:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:06 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a601097-75e3-450a-b96b-ebd4b4be8703]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6d1cfca09c9\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:06 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad198ce2-613b-4410-908f-06db45fac9e3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:06 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5ef72b-51f3-423b-abc6-fe3598f7f0f7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:06 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ad3af1-e820-4989-8552-7ae9034546a1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Running cmd (subprocess): nvme version {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] 'nvme version' failed. Not Retrying. {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:44:07 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] nvme not present on system {{(pid=75341) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 23:44:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:44:07 user nova-compute[75341]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 23:44:07 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[424eb2a5-033b-4704-ad0a-f77abe187082]: (4, '') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:07 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75341) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 23:44:07 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 23:44:07 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] LIGHTOS: no hostnqn found. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 23:44:07 user nova-compute[75341]: DEBUG os_brick.utils [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6d1cfca09c9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:44:07 user nova-compute[75341]: DEBUG nova.virt.block_device [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Updating existing volume attachment record: 6fa86059-2242-47d7-91bc-d852003a2524 {{(pid=75341) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 23:44:07 user nova-compute[75341]: DEBUG nova.network.neutron [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Successfully created port: 1ad25d31-80fa-41ba-8a1c-73f01ac1c832 {{(pid=75341) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 23:44:08 user nova-compute[75341]: DEBUG nova.network.neutron [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Successfully created port: f4b96195-ecba-4530-aa46-47e368eb294d {{(pid=75341) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 23:44:08 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:08 user nova-compute[75341]: DEBUG nova.network.neutron [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Successfully created port: 52e41618-df29-407f-8843-3e1c55fb2a18 {{(pid=75341) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 23:44:09 user nova-compute[75341]: DEBUG nova.network.neutron [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Successfully created port: 6368ff99-db9d-4a3e-b940-afc0300d7aa0 {{(pid=75341) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 23:44:10 user nova-compute[75341]: DEBUG nova.network.neutron [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Successfully created port: 4f71d722-661a-44d6-81fa-cd588c0d6f4b {{(pid=75341) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 23:44:10 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:10 user nova-compute[75341]: DEBUG nova.network.neutron [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Successfully updated port: 1ad25d31-80fa-41ba-8a1c-73f01ac1c832 {{(pid=75341) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 23:44:11 user nova-compute[75341]: DEBUG nova.compute.manager [req-9ad5de15-66ae-4f40-9347-d8882e1e4b3d req-fcc580a1-3a12-4dab-82d3-fd701969719b service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received event network-changed-1ad25d31-80fa-41ba-8a1c-73f01ac1c832 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:44:11 user nova-compute[75341]: DEBUG nova.compute.manager [req-9ad5de15-66ae-4f40-9347-d8882e1e4b3d req-fcc580a1-3a12-4dab-82d3-fd701969719b service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Refreshing instance network info cache due to event network-changed-1ad25d31-80fa-41ba-8a1c-73f01ac1c832. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:44:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-9ad5de15-66ae-4f40-9347-d8882e1e4b3d req-fcc580a1-3a12-4dab-82d3-fd701969719b service nova] Acquiring lock "refresh_cache-dbc9a6db-b536-426a-91fd-691a44c66528" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:44:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-9ad5de15-66ae-4f40-9347-d8882e1e4b3d req-fcc580a1-3a12-4dab-82d3-fd701969719b service nova] Acquired lock "refresh_cache-dbc9a6db-b536-426a-91fd-691a44c66528" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:44:11 user nova-compute[75341]: DEBUG nova.network.neutron [req-9ad5de15-66ae-4f40-9347-d8882e1e4b3d req-fcc580a1-3a12-4dab-82d3-fd701969719b service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Refreshing network info cache for port 1ad25d31-80fa-41ba-8a1c-73f01ac1c832 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:44:11 user nova-compute[75341]: DEBUG nova.network.neutron [req-9ad5de15-66ae-4f40-9347-d8882e1e4b3d req-fcc580a1-3a12-4dab-82d3-fd701969719b service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Instance cache missing network info. {{(pid=75341) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 23:44:11 user nova-compute[75341]: DEBUG nova.network.neutron [req-9ad5de15-66ae-4f40-9347-d8882e1e4b3d req-fcc580a1-3a12-4dab-82d3-fd701969719b service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:44:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-9ad5de15-66ae-4f40-9347-d8882e1e4b3d req-fcc580a1-3a12-4dab-82d3-fd701969719b service nova] Releasing lock "refresh_cache-dbc9a6db-b536-426a-91fd-691a44c66528" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:44:11 user nova-compute[75341]: DEBUG nova.network.neutron [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Successfully updated port: 7b7251c7-1a54-46d9-9a9b-4103a659502c {{(pid=75341) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 23:44:12 user nova-compute[75341]: INFO nova.virt.block_device [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Booting with volume 042bfbcb-fb28-4378-9754-8ecf4641438a at /dev/vdb
Nov 14 23:44:12 user nova-compute[75341]: DEBUG nova.network.neutron [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Successfully updated port: 0f140fc0-2078-47c4-985f-28a4ee8b2824 {{(pid=75341) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 23:44:12 user nova-compute[75341]: DEBUG os_brick.utils [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:44:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:12 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[af803241-68ee-45e5-b265-26f18670b4c2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6d1cfca09c9\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:12 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf5081b9-9a45-4d68-a58d-f7568587f958]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:12 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a0e3b3-8c99-41fc-8033-363d872c187e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:12 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53ba539-f7f7-47be-87c5-38bed1cda8f1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Running cmd (subprocess): nvme version {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] 'nvme version' failed. Not Retrying. {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:44:12 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] nvme not present on system {{(pid=75341) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 23:44:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:44:12 user nova-compute[75341]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 23:44:12 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bec550c-eb87-4592-b478-6a09434b5f74]: (4, '') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:12 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75341) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 23:44:12 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 23:44:12 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] LIGHTOS: no hostnqn found. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 23:44:12 user nova-compute[75341]: DEBUG os_brick.utils [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] <== get_connector_properties: return (166ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6d1cfca09c9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:44:12 user nova-compute[75341]: DEBUG nova.virt.block_device [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Updating existing volume attachment record: 67a6a194-f7eb-4fd7-a35e-8ade5e37c2d4 {{(pid=75341) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 23:44:13 user nova-compute[75341]: DEBUG nova.compute.manager [req-e04c867c-7ab9-44b6-b242-d2a51f45ba89 req-56adc817-d509-4828-992a-d345a10572ad service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received event network-changed-7b7251c7-1a54-46d9-9a9b-4103a659502c {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:44:13 user nova-compute[75341]: DEBUG nova.compute.manager [req-e04c867c-7ab9-44b6-b242-d2a51f45ba89 req-56adc817-d509-4828-992a-d345a10572ad service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Refreshing instance network info cache due to event network-changed-7b7251c7-1a54-46d9-9a9b-4103a659502c. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:44:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-e04c867c-7ab9-44b6-b242-d2a51f45ba89 req-56adc817-d509-4828-992a-d345a10572ad service nova] Acquiring lock "refresh_cache-dbc9a6db-b536-426a-91fd-691a44c66528" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:44:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-e04c867c-7ab9-44b6-b242-d2a51f45ba89 req-56adc817-d509-4828-992a-d345a10572ad service nova] Acquired lock "refresh_cache-dbc9a6db-b536-426a-91fd-691a44c66528" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:44:13 user nova-compute[75341]: DEBUG nova.network.neutron [req-e04c867c-7ab9-44b6-b242-d2a51f45ba89 req-56adc817-d509-4828-992a-d345a10572ad service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Refreshing network info cache for port 7b7251c7-1a54-46d9-9a9b-4103a659502c {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:44:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cc806a5d-8b54-4c7e-b271-f794bd232351 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Acquiring lock "d8d3b42b-11b5-477a-afb1-80a1786b693b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:44:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cc806a5d-8b54-4c7e-b271-f794bd232351 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Lock "d8d3b42b-11b5-477a-afb1-80a1786b693b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:44:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cc806a5d-8b54-4c7e-b271-f794bd232351 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Acquiring lock "d8d3b42b-11b5-477a-afb1-80a1786b693b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:44:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cc806a5d-8b54-4c7e-b271-f794bd232351 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Lock "d8d3b42b-11b5-477a-afb1-80a1786b693b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:44:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cc806a5d-8b54-4c7e-b271-f794bd232351 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Lock "d8d3b42b-11b5-477a-afb1-80a1786b693b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:44:13 user nova-compute[75341]: INFO nova.compute.manager [None req-cc806a5d-8b54-4c7e-b271-f794bd232351 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Terminating instance
Nov 14 23:44:13 user nova-compute[75341]: DEBUG nova.network.neutron [req-e04c867c-7ab9-44b6-b242-d2a51f45ba89 req-56adc817-d509-4828-992a-d345a10572ad service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Instance cache missing network info. {{(pid=75341) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 23:44:13 user nova-compute[75341]: DEBUG nova.compute.manager [None req-cc806a5d-8b54-4c7e-b271-f794bd232351 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Start destroying the instance on the hypervisor. {{(pid=75341) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 23:44:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:13 user nova-compute[75341]: DEBUG nova.network.neutron [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Successfully updated port: f4b96195-ecba-4530-aa46-47e368eb294d {{(pid=75341) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 23:44:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:13 user nova-compute[75341]: DEBUG nova.network.neutron [req-e04c867c-7ab9-44b6-b242-d2a51f45ba89 req-56adc817-d509-4828-992a-d345a10572ad service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:44:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-e04c867c-7ab9-44b6-b242-d2a51f45ba89 req-56adc817-d509-4828-992a-d345a10572ad service nova] Releasing lock "refresh_cache-dbc9a6db-b536-426a-91fd-691a44c66528" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:44:13 user nova-compute[75341]: DEBUG nova.compute.manager [req-e04c867c-7ab9-44b6-b242-d2a51f45ba89 req-56adc817-d509-4828-992a-d345a10572ad service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received event network-changed-0f140fc0-2078-47c4-985f-28a4ee8b2824 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:44:13 user nova-compute[75341]: DEBUG nova.compute.manager [req-e04c867c-7ab9-44b6-b242-d2a51f45ba89 req-56adc817-d509-4828-992a-d345a10572ad service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Refreshing instance network info cache due to event network-changed-0f140fc0-2078-47c4-985f-28a4ee8b2824. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:44:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-e04c867c-7ab9-44b6-b242-d2a51f45ba89 req-56adc817-d509-4828-992a-d345a10572ad service nova] Acquiring lock "refresh_cache-dbc9a6db-b536-426a-91fd-691a44c66528" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:44:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-e04c867c-7ab9-44b6-b242-d2a51f45ba89 req-56adc817-d509-4828-992a-d345a10572ad service nova] Acquired lock "refresh_cache-dbc9a6db-b536-426a-91fd-691a44c66528" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:44:13 user nova-compute[75341]: DEBUG nova.network.neutron [req-e04c867c-7ab9-44b6-b242-d2a51f45ba89 req-56adc817-d509-4828-992a-d345a10572ad service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Refreshing network info cache for port 0f140fc0-2078-47c4-985f-28a4ee8b2824 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:44:13 user nova-compute[75341]: DEBUG nova.network.neutron [req-e04c867c-7ab9-44b6-b242-d2a51f45ba89 req-56adc817-d509-4828-992a-d345a10572ad service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Instance cache missing network info. {{(pid=75341) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 23:44:13 user nova-compute[75341]: DEBUG nova.network.neutron [req-e04c867c-7ab9-44b6-b242-d2a51f45ba89 req-56adc817-d509-4828-992a-d345a10572ad service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:44:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-e04c867c-7ab9-44b6-b242-d2a51f45ba89 req-56adc817-d509-4828-992a-d345a10572ad service nova] Releasing lock "refresh_cache-dbc9a6db-b536-426a-91fd-691a44c66528" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:44:14 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Instance destroyed successfully.
Nov 14 23:44:14 user nova-compute[75341]: DEBUG nova.objects.instance [None req-cc806a5d-8b54-4c7e-b271-f794bd232351 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Lazy-loading 'resources' on Instance uuid d8d3b42b-11b5-477a-afb1-80a1786b693b {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:44:14 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-cc806a5d-8b54-4c7e-b271-f794bd232351 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:41:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1435042738',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1435042738',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1435042',id=12,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB1F00Ytu5Y0L/OJ1o5i4l+4O3ClnPU6hzM4C8RcLmSekHy346t23JOvPGwNdgnmAmapvF7xbChAIvUz9DgqpjY8vcPLOmqgIm/ZfhZQUqpU1q0BxQy58cVXtE+EysBAiQ==',key_name='tempest-keypair-45478595',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:41:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6bff46be1f8b45bc95a7924ef327bf46',ramdisk_id='',reservation_id='r-b96bltmj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1020299484',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:41:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='092cd31b946d422995dc1afedf49ba51',uuid=d8d3b42b-11b5-477a-afb1-80a1786b693b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9032b49d-13a3-4049-bada-48eb30ea932a", "address": "fa:16:3e:12:b9:0d", "network": {"id": "3a83bb9c-6349-46b4-a0ee-a1bd8530b4df", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-310072341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bff46be1f8b45bc95a7924ef327bf46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9032b49d-13", "ovs_interfaceid": "9032b49d-13a3-4049-bada-48eb30ea932a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 23:44:14 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-cc806a5d-8b54-4c7e-b271-f794bd232351 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Converting VIF {"id": "9032b49d-13a3-4049-bada-48eb30ea932a", "address": "fa:16:3e:12:b9:0d", "network": {"id": "3a83bb9c-6349-46b4-a0ee-a1bd8530b4df", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-310072341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bff46be1f8b45bc95a7924ef327bf46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9032b49d-13", "ovs_interfaceid": "9032b49d-13a3-4049-bada-48eb30ea932a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:44:14 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-cc806a5d-8b54-4c7e-b271-f794bd232351 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:b9:0d,bridge_name='br-int',has_traffic_filtering=True,id=9032b49d-13a3-4049-bada-48eb30ea932a,network=Network(3a83bb9c-6349-46b4-a0ee-a1bd8530b4df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9032b49d-13') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:44:14 user nova-compute[75341]: DEBUG os_vif [None req-cc806a5d-8b54-4c7e-b271-f794bd232351 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:b9:0d,bridge_name='br-int',has_traffic_filtering=True,id=9032b49d-13a3-4049-bada-48eb30ea932a,network=Network(3a83bb9c-6349-46b4-a0ee-a1bd8530b4df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9032b49d-13') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 23:44:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9032b49d-13, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:44:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:44:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=523bbb0e-2c88-4427-8afb-0a96ee4cc11b) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:44:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:14 user nova-compute[75341]: INFO os_vif [None req-cc806a5d-8b54-4c7e-b271-f794bd232351 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:b9:0d,bridge_name='br-int',has_traffic_filtering=True,id=9032b49d-13a3-4049-bada-48eb30ea932a,network=Network(3a83bb9c-6349-46b4-a0ee-a1bd8530b4df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9032b49d-13')
Nov 14 23:44:14 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-cc806a5d-8b54-4c7e-b271-f794bd232351 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Deleting instance files /opt/stack/data/nova/instances/d8d3b42b-11b5-477a-afb1-80a1786b693b_del
Nov 14 23:44:14 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-cc806a5d-8b54-4c7e-b271-f794bd232351 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Deletion of /opt/stack/data/nova/instances/d8d3b42b-11b5-477a-afb1-80a1786b693b_del complete
Nov 14 23:44:14 user nova-compute[75341]: INFO nova.compute.manager [None req-cc806a5d-8b54-4c7e-b271-f794bd232351 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 14 23:44:14 user nova-compute[75341]: DEBUG oslo.service.loopingcall [None req-cc806a5d-8b54-4c7e-b271-f794bd232351 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75341) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 23:44:14 user nova-compute[75341]: DEBUG nova.compute.manager [-] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Deallocating network for instance {{(pid=75341) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 23:44:14 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] deallocate_for_instance() {{(pid=75341) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 23:44:14 user nova-compute[75341]: DEBUG nova.network.neutron [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Successfully updated port: 52e41618-df29-407f-8843-3e1c55fb2a18 {{(pid=75341) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 23:44:14 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:44:14 user nova-compute[75341]: DEBUG nova.compute.manager [req-c95862a8-e674-492c-8efa-c9575a411541 req-799f5618-f9c6-4c1b-bfe8-cdc41bd7da77 service nova] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Received event network-vif-deleted-9032b49d-13a3-4049-bada-48eb30ea932a {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:44:14 user nova-compute[75341]: INFO nova.compute.manager [req-c95862a8-e674-492c-8efa-c9575a411541 req-799f5618-f9c6-4c1b-bfe8-cdc41bd7da77 service nova] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Neutron deleted interface 9032b49d-13a3-4049-bada-48eb30ea932a; detaching it from the instance and deleting it from the info cache
Nov 14 23:44:14 user nova-compute[75341]: DEBUG nova.network.neutron [req-c95862a8-e674-492c-8efa-c9575a411541 req-799f5618-f9c6-4c1b-bfe8-cdc41bd7da77 service nova] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:44:15 user nova-compute[75341]: INFO nova.compute.manager [-] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Took 0.83 seconds to deallocate network for instance.
Nov 14 23:44:15 user nova-compute[75341]: DEBUG nova.compute.manager [req-c95862a8-e674-492c-8efa-c9575a411541 req-799f5618-f9c6-4c1b-bfe8-cdc41bd7da77 service nova] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Detach interface failed, port_id=9032b49d-13a3-4049-bada-48eb30ea932a, reason: Instance d8d3b42b-11b5-477a-afb1-80a1786b693b could not be found. {{(pid=75341) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 23:44:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cc806a5d-8b54-4c7e-b271-f794bd232351 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:44:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cc806a5d-8b54-4c7e-b271-f794bd232351 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:44:15 user nova-compute[75341]: DEBUG nova.compute.manager [req-bf673c59-00c1-4261-80cc-3cd19cd55901 req-34427a30-f29f-4b7b-bf8a-772e3368f25b service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received event network-changed-f4b96195-ecba-4530-aa46-47e368eb294d {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:44:15 user nova-compute[75341]: DEBUG nova.compute.manager [req-bf673c59-00c1-4261-80cc-3cd19cd55901 req-34427a30-f29f-4b7b-bf8a-772e3368f25b service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Refreshing instance network info cache due to event network-changed-f4b96195-ecba-4530-aa46-47e368eb294d. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:44:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-bf673c59-00c1-4261-80cc-3cd19cd55901 req-34427a30-f29f-4b7b-bf8a-772e3368f25b service nova] Acquiring lock "refresh_cache-dbc9a6db-b536-426a-91fd-691a44c66528" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:44:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-bf673c59-00c1-4261-80cc-3cd19cd55901 req-34427a30-f29f-4b7b-bf8a-772e3368f25b service nova] Acquired lock "refresh_cache-dbc9a6db-b536-426a-91fd-691a44c66528" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:44:15 user nova-compute[75341]: DEBUG nova.network.neutron [req-bf673c59-00c1-4261-80cc-3cd19cd55901 req-34427a30-f29f-4b7b-bf8a-772e3368f25b service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Refreshing network info cache for port f4b96195-ecba-4530-aa46-47e368eb294d {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:44:15 user nova-compute[75341]: DEBUG nova.network.neutron [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Successfully updated port: 6368ff99-db9d-4a3e-b940-afc0300d7aa0 {{(pid=75341) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 23:44:15 user nova-compute[75341]: DEBUG nova.network.neutron [req-bf673c59-00c1-4261-80cc-3cd19cd55901 req-34427a30-f29f-4b7b-bf8a-772e3368f25b service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Instance cache missing network info. {{(pid=75341) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 23:44:15 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-cc806a5d-8b54-4c7e-b271-f794bd232351 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:44:15 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-cc806a5d-8b54-4c7e-b271-f794bd232351 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:44:15 user nova-compute[75341]: DEBUG nova.network.neutron [req-bf673c59-00c1-4261-80cc-3cd19cd55901 req-34427a30-f29f-4b7b-bf8a-772e3368f25b service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:44:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-bf673c59-00c1-4261-80cc-3cd19cd55901 req-34427a30-f29f-4b7b-bf8a-772e3368f25b service nova] Releasing lock "refresh_cache-dbc9a6db-b536-426a-91fd-691a44c66528" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:44:15 user nova-compute[75341]: DEBUG nova.compute.manager [req-bf673c59-00c1-4261-80cc-3cd19cd55901 req-34427a30-f29f-4b7b-bf8a-772e3368f25b service nova] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Received event network-vif-unplugged-9032b49d-13a3-4049-bada-48eb30ea932a {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:44:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-bf673c59-00c1-4261-80cc-3cd19cd55901 req-34427a30-f29f-4b7b-bf8a-772e3368f25b service nova] Acquiring lock "d8d3b42b-11b5-477a-afb1-80a1786b693b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:44:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-bf673c59-00c1-4261-80cc-3cd19cd55901 req-34427a30-f29f-4b7b-bf8a-772e3368f25b service nova] Lock "d8d3b42b-11b5-477a-afb1-80a1786b693b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:44:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-bf673c59-00c1-4261-80cc-3cd19cd55901 req-34427a30-f29f-4b7b-bf8a-772e3368f25b service nova] Lock "d8d3b42b-11b5-477a-afb1-80a1786b693b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:44:15 user nova-compute[75341]: DEBUG nova.compute.manager [req-bf673c59-00c1-4261-80cc-3cd19cd55901 req-34427a30-f29f-4b7b-bf8a-772e3368f25b service nova] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] No waiting events found dispatching network-vif-unplugged-9032b49d-13a3-4049-bada-48eb30ea932a {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:44:15 user nova-compute[75341]: WARNING nova.compute.manager [req-bf673c59-00c1-4261-80cc-3cd19cd55901 req-34427a30-f29f-4b7b-bf8a-772e3368f25b service nova] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Received unexpected event network-vif-unplugged-9032b49d-13a3-4049-bada-48eb30ea932a for instance with vm_state deleted and task_state None.
Nov 14 23:44:15 user nova-compute[75341]: DEBUG nova.compute.manager [req-bf673c59-00c1-4261-80cc-3cd19cd55901 req-34427a30-f29f-4b7b-bf8a-772e3368f25b service nova] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Received event network-vif-plugged-9032b49d-13a3-4049-bada-48eb30ea932a {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:44:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-bf673c59-00c1-4261-80cc-3cd19cd55901 req-34427a30-f29f-4b7b-bf8a-772e3368f25b service nova] Acquiring lock "d8d3b42b-11b5-477a-afb1-80a1786b693b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:44:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-bf673c59-00c1-4261-80cc-3cd19cd55901 req-34427a30-f29f-4b7b-bf8a-772e3368f25b service nova] Lock "d8d3b42b-11b5-477a-afb1-80a1786b693b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:44:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-bf673c59-00c1-4261-80cc-3cd19cd55901 req-34427a30-f29f-4b7b-bf8a-772e3368f25b service nova] Lock "d8d3b42b-11b5-477a-afb1-80a1786b693b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:44:15 user nova-compute[75341]: DEBUG nova.compute.manager [req-bf673c59-00c1-4261-80cc-3cd19cd55901 req-34427a30-f29f-4b7b-bf8a-772e3368f25b service nova] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] No waiting events found dispatching network-vif-plugged-9032b49d-13a3-4049-bada-48eb30ea932a {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:44:15 user nova-compute[75341]: WARNING nova.compute.manager [req-bf673c59-00c1-4261-80cc-3cd19cd55901 req-34427a30-f29f-4b7b-bf8a-772e3368f25b service nova] [instance: d8d3b42b-11b5-477a-afb1-80a1786b693b] Received unexpected event network-vif-plugged-9032b49d-13a3-4049-bada-48eb30ea932a for instance with vm_state deleted and task_state None.
Nov 14 23:44:15 user nova-compute[75341]: DEBUG nova.compute.manager [req-bf673c59-00c1-4261-80cc-3cd19cd55901 req-34427a30-f29f-4b7b-bf8a-772e3368f25b service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received event network-changed-52e41618-df29-407f-8843-3e1c55fb2a18 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:44:15 user nova-compute[75341]: DEBUG nova.compute.manager [req-bf673c59-00c1-4261-80cc-3cd19cd55901 req-34427a30-f29f-4b7b-bf8a-772e3368f25b service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Refreshing instance network info cache due to event network-changed-52e41618-df29-407f-8843-3e1c55fb2a18. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:44:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-bf673c59-00c1-4261-80cc-3cd19cd55901 req-34427a30-f29f-4b7b-bf8a-772e3368f25b service nova] Acquiring lock "refresh_cache-dbc9a6db-b536-426a-91fd-691a44c66528" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:44:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-bf673c59-00c1-4261-80cc-3cd19cd55901 req-34427a30-f29f-4b7b-bf8a-772e3368f25b service nova] Acquired lock "refresh_cache-dbc9a6db-b536-426a-91fd-691a44c66528" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:44:15 user nova-compute[75341]: DEBUG nova.network.neutron [req-bf673c59-00c1-4261-80cc-3cd19cd55901 req-34427a30-f29f-4b7b-bf8a-772e3368f25b service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Refreshing network info cache for port 52e41618-df29-407f-8843-3e1c55fb2a18 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:44:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cc806a5d-8b54-4c7e-b271-f794bd232351 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.371s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:44:15 user nova-compute[75341]: INFO nova.scheduler.client.report [None req-cc806a5d-8b54-4c7e-b271-f794bd232351 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Deleted allocations for instance d8d3b42b-11b5-477a-afb1-80a1786b693b
Nov 14 23:44:15 user nova-compute[75341]: DEBUG nova.network.neutron [req-bf673c59-00c1-4261-80cc-3cd19cd55901 req-34427a30-f29f-4b7b-bf8a-772e3368f25b service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Instance cache missing network info. {{(pid=75341) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 23:44:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cc806a5d-8b54-4c7e-b271-f794bd232351 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484 tempest-TestServerVolumeAttachScenarioOldVersion-1020299484-project-member] Lock "d8d3b42b-11b5-477a-afb1-80a1786b693b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.348s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:44:15 user nova-compute[75341]: DEBUG nova.network.neutron [req-bf673c59-00c1-4261-80cc-3cd19cd55901 req-34427a30-f29f-4b7b-bf8a-772e3368f25b service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:44:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-bf673c59-00c1-4261-80cc-3cd19cd55901 req-34427a30-f29f-4b7b-bf8a-772e3368f25b service nova] Releasing lock "refresh_cache-dbc9a6db-b536-426a-91fd-691a44c66528" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:44:15 user nova-compute[75341]: DEBUG nova.network.neutron [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Successfully updated port: 4f71d722-661a-44d6-81fa-cd588c0d6f4b {{(pid=75341) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 23:44:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Acquiring lock "refresh_cache-dbc9a6db-b536-426a-91fd-691a44c66528" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:44:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Acquired lock "refresh_cache-dbc9a6db-b536-426a-91fd-691a44c66528" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:44:15 user nova-compute[75341]: DEBUG nova.network.neutron [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 23:44:15 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:15 user nova-compute[75341]: DEBUG nova.network.neutron [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Instance cache missing network info. {{(pid=75341) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 23:44:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:17 user nova-compute[75341]: DEBUG nova.compute.manager [req-e2e5e17e-ef2d-459b-bd41-aa1103c1a70f req-29825f33-d770-4dbb-86b5-a9c18c90d9c5 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received event network-changed-6368ff99-db9d-4a3e-b940-afc0300d7aa0 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:44:17 user nova-compute[75341]: DEBUG nova.compute.manager [req-e2e5e17e-ef2d-459b-bd41-aa1103c1a70f req-29825f33-d770-4dbb-86b5-a9c18c90d9c5 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Refreshing instance network info cache due to event network-changed-6368ff99-db9d-4a3e-b940-afc0300d7aa0. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:44:17 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-e2e5e17e-ef2d-459b-bd41-aa1103c1a70f req-29825f33-d770-4dbb-86b5-a9c18c90d9c5 service nova] Acquiring lock "refresh_cache-dbc9a6db-b536-426a-91fd-691a44c66528" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:44:17 user nova-compute[75341]: DEBUG nova.network.neutron [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Updating instance_info_cache with network_info: [{"id": "1ad25d31-80fa-41ba-8a1c-73f01ac1c832", "address": "fa:16:3e:70:63:49", "network": {"id": "304d198c-016a-470b-9504-145a5823966a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2033085667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad25d31-80", "ovs_interfaceid": "1ad25d31-80fa-41ba-8a1c-73f01ac1c832", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7b7251c7-1a54-46d9-9a9b-4103a659502c", "address": "fa:16:3e:b4:1d:7d", "network": {"id": "66be3b1a-ec5a-4c25-86fb-8350b80ce72d", "bridge": "br-int", "label": "tempest-device-tagging-net1-719453354", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b7251c7-1a", "ovs_interfaceid": "7b7251c7-1a54-46d9-9a9b-4103a659502c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0f140fc0-2078-47c4-985f-28a4ee8b2824", "address": "fa:16:3e:c6:94:07", "network": {"id": "66be3b1a-ec5a-4c25-86fb-8350b80ce72d", "bridge": "br-int", "label": "tempest-device-tagging-net1-719453354", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f140fc0-20", "ovs_interfaceid": "0f140fc0-2078-47c4-985f-28a4ee8b2824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f4b96195-ecba-4530-aa46-47e368eb294d", "address": "fa:16:3e:c1:9e:73", "network": {"id": "66be3b1a-ec5a-4c25-86fb-8350b80ce72d", "bridge": "br-int", "label": "tempest-device-tagging-net1-719453354", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4b96195-ec", "ovs_interfaceid": "f4b96195-ecba-4530-aa46-47e368eb294d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "52e41618-df29-407f-8843-3e1c55fb2a18", "address": "fa:16:3e:f9:73:7b", "network": {"id": "66be3b1a-ec5a-4c25-86fb-8350b80ce72d", "bridge": "br-int", "label": "tempest-device-tagging-net1-719453354", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e41618-df", "ovs_interfaceid": "52e41618-df29-407f-8843-3e1c55fb2a18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6368ff99-db9d-4a3e-b940-afc0300d7aa0", "address": "fa:16:3e:8a:4f:bb", "network": {"id": "21622931-8859-4310-85b4-e6c88ea4fd26", "bridge": "br-int", "label": "tempest-device-tagging-net2-1204896773", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6368ff99-db", "ovs_interfaceid": "6368ff99-db9d-4a3e-b940-afc0300d7aa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4f71d722-661a-44d6-81fa-cd588c0d6f4b", "address": "fa:16:3e:fe:bb:e6", "network": {"id": "21622931-8859-4310-85b4-e6c88ea4fd26", "bridge": "br-int", "label": "tempest-device-tagging-net2-1204896773", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f71d722-66", "ovs_interfaceid": "4f71d722-661a-44d6-81fa-cd588c0d6f4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:44:17 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Releasing lock "refresh_cache-dbc9a6db-b536-426a-91fd-691a44c66528" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:44:17 user nova-compute[75341]: DEBUG nova.compute.manager [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Instance network_info: |[{"id": "1ad25d31-80fa-41ba-8a1c-73f01ac1c832", "address": "fa:16:3e:70:63:49", "network": {"id": "304d198c-016a-470b-9504-145a5823966a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2033085667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad25d31-80", "ovs_interfaceid": "1ad25d31-80fa-41ba-8a1c-73f01ac1c832", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7b7251c7-1a54-46d9-9a9b-4103a659502c", "address": "fa:16:3e:b4:1d:7d", "network": {"id": "66be3b1a-ec5a-4c25-86fb-8350b80ce72d", "bridge": "br-int", "label": "tempest-device-tagging-net1-719453354", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b7251c7-1a", "ovs_interfaceid": "7b7251c7-1a54-46d9-9a9b-4103a659502c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0f140fc0-2078-47c4-985f-28a4ee8b2824", "address": "fa:16:3e:c6:94:07", "network": {"id": "66be3b1a-ec5a-4c25-86fb-8350b80ce72d", "bridge": "br-int", "label": "tempest-device-tagging-net1-719453354", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f140fc0-20", "ovs_interfaceid": "0f140fc0-2078-47c4-985f-28a4ee8b2824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f4b96195-ecba-4530-aa46-47e368eb294d", "address": "fa:16:3e:c1:9e:73", "network": {"id": "66be3b1a-ec5a-4c25-86fb-8350b80ce72d", "bridge": "br-int", "label": "tempest-device-tagging-net1-719453354", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4b96195-ec", "ovs_interfaceid": "f4b96195-ecba-4530-aa46-47e368eb294d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "52e41618-df29-407f-8843-3e1c55fb2a18", "address": "fa:16:3e:f9:73:7b", "network": {"id": "66be3b1a-ec5a-4c25-86fb-8350b80ce72d", "bridge": "br-int", "label": "tempest-device-tagging-net1-719453354", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e41618-df", "ovs_interfaceid": "52e41618-df29-407f-8843-3e1c55fb2a18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6368ff99-db9d-4a3e-b940-afc0300d7aa0", "address": "fa:16:3e:8a:4f:bb", "network": {"id": "21622931-8859-4310-85b4-e6c88ea4fd26", "bridge": "br-int", "label": "tempest-device-tagging-net2-1204896773", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6368ff99-db", "ovs_interfaceid": "6368ff99-db9d-4a3e-b940-afc0300d7aa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4f71d722-661a-44d6-81fa-cd588c0d6f4b", "address": "fa:16:3e:fe:bb:e6", "network": {"id": "21622931-8859-4310-85b4-e6c88ea4fd26", "bridge": "br-int", "label": "tempest-device-tagging-net2-1204896773", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f71d722-66", "ovs_interfaceid": "4f71d722-661a-44d6-81fa-cd588c0d6f4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 23:44:17 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-e2e5e17e-ef2d-459b-bd41-aa1103c1a70f req-29825f33-d770-4dbb-86b5-a9c18c90d9c5 service nova] Acquired lock "refresh_cache-dbc9a6db-b536-426a-91fd-691a44c66528" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:44:17 user nova-compute[75341]: DEBUG nova.network.neutron [req-e2e5e17e-ef2d-459b-bd41-aa1103c1a70f req-29825f33-d770-4dbb-86b5-a9c18c90d9c5 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Refreshing network info cache for port 6368ff99-db9d-4a3e-b940-afc0300d7aa0 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:44:17 user nova-compute[75341]: INFO nova.virt.block_device [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Booting with volume 3762dcbb-d796-4b60-a654-ae1973ad2912 at /dev/vdc
Nov 14 23:44:17 user nova-compute[75341]: DEBUG os_brick.utils [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:44:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:17 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f37b89e-bc65-4e1a-92a3-9091efa15d0b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6d1cfca09c9\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:17 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c69665-13b1-484b-ba0b-36e060a457cd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:17 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[700e2935-7409-4b71-ac92-fbd88ef81cb5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:17 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[53cbd356-5464-43b6-8660-5054ef2bb414]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Running cmd (subprocess): nvme version {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] 'nvme version' failed. Not Retrying. {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:44:17 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] nvme not present on system {{(pid=75341) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 23:44:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:44:17 user nova-compute[75341]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 23:44:17 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a286be0-9771-4912-b069-82ce26310a24]: (4, '') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:17 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75341) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 23:44:17 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 23:44:17 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] LIGHTOS: no hostnqn found. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 23:44:17 user nova-compute[75341]: DEBUG os_brick.utils [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6d1cfca09c9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:44:17 user nova-compute[75341]: DEBUG nova.virt.block_device [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Updating existing volume attachment record: 772362f5-79df-4729-8ea6-5144701e3db1 {{(pid=75341) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 23:44:18 user nova-compute[75341]: DEBUG nova.network.neutron [req-e2e5e17e-ef2d-459b-bd41-aa1103c1a70f req-29825f33-d770-4dbb-86b5-a9c18c90d9c5 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Updated VIF entry in instance network info cache for port 6368ff99-db9d-4a3e-b940-afc0300d7aa0. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:44:18 user nova-compute[75341]: DEBUG nova.network.neutron [req-e2e5e17e-ef2d-459b-bd41-aa1103c1a70f req-29825f33-d770-4dbb-86b5-a9c18c90d9c5 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Updating instance_info_cache with network_info: [{"id": "1ad25d31-80fa-41ba-8a1c-73f01ac1c832", "address": "fa:16:3e:70:63:49", "network": {"id": "304d198c-016a-470b-9504-145a5823966a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2033085667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad25d31-80", "ovs_interfaceid": "1ad25d31-80fa-41ba-8a1c-73f01ac1c832", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7b7251c7-1a54-46d9-9a9b-4103a659502c", "address": "fa:16:3e:b4:1d:7d", "network": {"id": "66be3b1a-ec5a-4c25-86fb-8350b80ce72d", "bridge": "br-int", "label": "tempest-device-tagging-net1-719453354", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b7251c7-1a", "ovs_interfaceid": "7b7251c7-1a54-46d9-9a9b-4103a659502c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0f140fc0-2078-47c4-985f-28a4ee8b2824", "address": "fa:16:3e:c6:94:07", "network": {"id": "66be3b1a-ec5a-4c25-86fb-8350b80ce72d", "bridge": "br-int", "label": "tempest-device-tagging-net1-719453354", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f140fc0-20", "ovs_interfaceid": "0f140fc0-2078-47c4-985f-28a4ee8b2824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f4b96195-ecba-4530-aa46-47e368eb294d", "address": "fa:16:3e:c1:9e:73", "network": {"id": "66be3b1a-ec5a-4c25-86fb-8350b80ce72d", "bridge": "br-int", "label": "tempest-device-tagging-net1-719453354", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4b96195-ec", "ovs_interfaceid": "f4b96195-ecba-4530-aa46-47e368eb294d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "52e41618-df29-407f-8843-3e1c55fb2a18", "address": "fa:16:3e:f9:73:7b", "network": {"id": "66be3b1a-ec5a-4c25-86fb-8350b80ce72d", "bridge": "br-int", "label": "tempest-device-tagging-net1-719453354", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e41618-df", "ovs_interfaceid": "52e41618-df29-407f-8843-3e1c55fb2a18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6368ff99-db9d-4a3e-b940-afc0300d7aa0", "address": "fa:16:3e:8a:4f:bb", "network": {"id": "21622931-8859-4310-85b4-e6c88ea4fd26", "bridge": "br-int", "label": "tempest-device-tagging-net2-1204896773", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6368ff99-db", "ovs_interfaceid": "6368ff99-db9d-4a3e-b940-afc0300d7aa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4f71d722-661a-44d6-81fa-cd588c0d6f4b", "address": "fa:16:3e:fe:bb:e6", "network": {"id": "21622931-8859-4310-85b4-e6c88ea4fd26", "bridge": "br-int", "label": "tempest-device-tagging-net2-1204896773", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f71d722-66", "ovs_interfaceid": "4f71d722-661a-44d6-81fa-cd588c0d6f4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:44:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-e2e5e17e-ef2d-459b-bd41-aa1103c1a70f req-29825f33-d770-4dbb-86b5-a9c18c90d9c5 service nova] Releasing lock "refresh_cache-dbc9a6db-b536-426a-91fd-691a44c66528" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:44:18 user nova-compute[75341]: DEBUG nova.compute.manager [req-e2e5e17e-ef2d-459b-bd41-aa1103c1a70f req-29825f33-d770-4dbb-86b5-a9c18c90d9c5 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received event network-changed-4f71d722-661a-44d6-81fa-cd588c0d6f4b {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:44:18 user nova-compute[75341]: DEBUG nova.compute.manager [req-e2e5e17e-ef2d-459b-bd41-aa1103c1a70f req-29825f33-d770-4dbb-86b5-a9c18c90d9c5 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Refreshing instance network info cache due to event network-changed-4f71d722-661a-44d6-81fa-cd588c0d6f4b. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:44:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-e2e5e17e-ef2d-459b-bd41-aa1103c1a70f req-29825f33-d770-4dbb-86b5-a9c18c90d9c5 service nova] Acquiring lock "refresh_cache-dbc9a6db-b536-426a-91fd-691a44c66528" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:44:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-e2e5e17e-ef2d-459b-bd41-aa1103c1a70f req-29825f33-d770-4dbb-86b5-a9c18c90d9c5 service nova] Acquired lock "refresh_cache-dbc9a6db-b536-426a-91fd-691a44c66528" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:44:18 user nova-compute[75341]: DEBUG nova.network.neutron [req-e2e5e17e-ef2d-459b-bd41-aa1103c1a70f req-29825f33-d770-4dbb-86b5-a9c18c90d9c5 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Refreshing network info cache for port 4f71d722-661a-44d6-81fa-cd588c0d6f4b {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:44:18 user nova-compute[75341]: DEBUG nova.network.neutron [req-e2e5e17e-ef2d-459b-bd41-aa1103c1a70f req-29825f33-d770-4dbb-86b5-a9c18c90d9c5 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Updated VIF entry in instance network info cache for port 4f71d722-661a-44d6-81fa-cd588c0d6f4b. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:44:18 user nova-compute[75341]: DEBUG nova.network.neutron [req-e2e5e17e-ef2d-459b-bd41-aa1103c1a70f req-29825f33-d770-4dbb-86b5-a9c18c90d9c5 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Updating instance_info_cache with network_info: [{"id": "1ad25d31-80fa-41ba-8a1c-73f01ac1c832", "address": "fa:16:3e:70:63:49", "network": {"id": "304d198c-016a-470b-9504-145a5823966a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2033085667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad25d31-80", "ovs_interfaceid": "1ad25d31-80fa-41ba-8a1c-73f01ac1c832", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7b7251c7-1a54-46d9-9a9b-4103a659502c", "address": "fa:16:3e:b4:1d:7d", "network": {"id": "66be3b1a-ec5a-4c25-86fb-8350b80ce72d", "bridge": "br-int", "label": "tempest-device-tagging-net1-719453354", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b7251c7-1a", "ovs_interfaceid": "7b7251c7-1a54-46d9-9a9b-4103a659502c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0f140fc0-2078-47c4-985f-28a4ee8b2824", "address": "fa:16:3e:c6:94:07", "network": {"id": "66be3b1a-ec5a-4c25-86fb-8350b80ce72d", "bridge": "br-int", "label": "tempest-device-tagging-net1-719453354", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f140fc0-20", "ovs_interfaceid": "0f140fc0-2078-47c4-985f-28a4ee8b2824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f4b96195-ecba-4530-aa46-47e368eb294d", "address": "fa:16:3e:c1:9e:73", "network": {"id": "66be3b1a-ec5a-4c25-86fb-8350b80ce72d", "bridge": "br-int", "label": "tempest-device-tagging-net1-719453354", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4b96195-ec", "ovs_interfaceid": "f4b96195-ecba-4530-aa46-47e368eb294d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "52e41618-df29-407f-8843-3e1c55fb2a18", "address": "fa:16:3e:f9:73:7b", "network": {"id": "66be3b1a-ec5a-4c25-86fb-8350b80ce72d", "bridge": "br-int", "label": "tempest-device-tagging-net1-719453354", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e41618-df", "ovs_interfaceid": "52e41618-df29-407f-8843-3e1c55fb2a18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6368ff99-db9d-4a3e-b940-afc0300d7aa0", "address": "fa:16:3e:8a:4f:bb", "network": {"id": "21622931-8859-4310-85b4-e6c88ea4fd26", "bridge": "br-int", "label": "tempest-device-tagging-net2-1204896773", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6368ff99-db", "ovs_interfaceid": "6368ff99-db9d-4a3e-b940-afc0300d7aa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4f71d722-661a-44d6-81fa-cd588c0d6f4b", "address": "fa:16:3e:fe:bb:e6", "network": {"id": "21622931-8859-4310-85b4-e6c88ea4fd26", "bridge": "br-int", "label": "tempest-device-tagging-net2-1204896773", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f71d722-66", "ovs_interfaceid": "4f71d722-661a-44d6-81fa-cd588c0d6f4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:44:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-e2e5e17e-ef2d-459b-bd41-aa1103c1a70f req-29825f33-d770-4dbb-86b5-a9c18c90d9c5 service nova] Releasing lock "refresh_cache-dbc9a6db-b536-426a-91fd-691a44c66528" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:44:19 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:19 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:19 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-dba335c6-bf51-4ccd-8b9b-57623513b525 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 44080c0d-56eb-4987-aa4b-59f161dcbc0b is timed out.
Nov 14 23:44:19 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-dba335c6-bf51-4ccd-8b9b-57623513b525 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Successfully detached device vdb from instance 44080c0d-56eb-4987-aa4b-59f161dcbc0b from the live domain config.
Nov 14 23:44:19 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dba335c6-bf51-4ccd-8b9b-57623513b525 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] calling os-brick to detach iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 23:44:19 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba335c6-bf51-4ccd-8b9b-57623513b525 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, {'target_iqn': 'iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MtLTdblJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:44:19 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-dba335c6-bf51-4ccd-8b9b-57623513b525 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:44:19 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-dba335c6-bf51-4ccd-8b9b-57623513b525 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:44:19 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-dba335c6-bf51-4ccd-8b9b-57623513b525 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:44:19 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:19 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:19 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[a36c9381-ddfc-4f9d-a840-f5744228d759]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:19 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba335c6-bf51-4ccd-8b9b-57623513b525 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 23:44:19 user nova-compute[75341]: No targets found.
Nov 14 23:44:19 user nova-compute[75341]: iSNS:
Nov 14 23:44:19 user nova-compute[75341]: No targets found.
Nov 14 23:44:19 user nova-compute[75341]: STATIC:
Nov 14 23:44:19 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265
Nov 14 23:44:19 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:44:19 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:44:19 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3
Nov 14 23:44:19 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:44:19 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:44:19 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c
Nov 14 23:44:19 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:44:19 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:44:19 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23
Nov 14 23:44:19 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:44:19 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:44:19 user nova-compute[75341]: FIRMWARE:
Nov 14 23:44:19 user nova-compute[75341]: No targets found.
Nov 14 23:44:19 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:44:19 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba335c6-bf51-4ccd-8b9b-57623513b525 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 23:44:19 user nova-compute[75341]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 23:44:19 user nova-compute[75341]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75341) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 23:44:19 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba335c6-bf51-4ccd-8b9b-57623513b525 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23', 0)] {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 23:44:19 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:19 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:19 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb98fdb6-4726-43bd-9f33-e13dfbdba1f1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:19 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:19 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:19 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c181b6-4c1b-4854-8ddf-342186daa177]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:19 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba335c6-bf51-4ccd-8b9b-57623513b525 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 (non-flash)
Nov 14 23:44:19 user nova-compute[75341]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)
Nov 14 23:44:19 user nova-compute[75341]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 (non-flash)
Nov 14 23:44:19 user nova-compute[75341]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)
Nov 14 23:44:19 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:44:19 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba335c6-bf51-4ccd-8b9b-57623513b525 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 (non-flash)
Nov 14 23:44:19 user nova-compute[75341]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)
Nov 14 23:44:19 user nova-compute[75341]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 (non-flash)
Nov 14 23:44:19 user nova-compute[75341]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)
Nov 14 23:44:19 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:44:19 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba335c6-bf51-4ccd-8b9b-57623513b525 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f187027eb90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23'): ({'sdb'}, set())}) {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 23:44:19 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-dba335c6-bf51-4ccd-8b9b-57623513b525 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Removing single pathed devices sdb {{(pid=75341) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 23:44:19 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:19 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:19 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e349677-96fb-4850-a625-ee2ecd6c4cef]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:19 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:19 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:19 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ddff39-30cb-4bdd-bfef-a3dc96ccb34b]: (4, ('ok\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:19 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-dba335c6-bf51-4ccd-8b9b-57623513b525 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Flushing IO for device /dev/sdb {{(pid=75341) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 23:44:19 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:19 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:19 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13283ed-7dbd-4525-a56e-4d0296f7ff49]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:19 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-dba335c6-bf51-4ccd-8b9b-57623513b525 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75341) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 23:44:19 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:19 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.059s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:19 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[920b5a26-14e2-4639-83f7-611078724540]: (4, ('1', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:19 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-dba335c6-bf51-4ccd-8b9b-57623513b525 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 23:44:19 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-dba335c6-bf51-4ccd-8b9b-57623513b525 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] SCSI volumes sdb have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 23:44:19 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba335c6-bf51-4ccd-8b9b-57623513b525 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23')] {{(pid=75341) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 23:44:19 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:19 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:19 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[3944ceca-8603-4578-bb55-537072810a01]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:19 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba335c6-bf51-4ccd-8b9b-57623513b525 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:44:19 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 -p 172.16.0.220:3260 --logout {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:19 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:19 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d326325-3472-4fbe-833b-62f44d49f546]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:19 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba335c6-bf51-4ccd-8b9b-57623513b525 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23, portal: 172.16.0.220,3260]
Nov 14 23:44:19 user nova-compute[75341]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23, portal: 172.16.0.220,3260] successful.
Nov 14 23:44:19 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:44:19 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 -p 172.16.0.220:3260 --op delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:20 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84172a25-a3fe-442b-940c-3e6dbc7a1a23 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:20 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[520e6395-12ca-4719-9dff-6375e767f45c]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:20 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba335c6-bf51-4ccd-8b9b-57623513b525 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:44:20 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-dba335c6-bf51-4ccd-8b9b-57623513b525 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:44:20 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba335c6-bf51-4ccd-8b9b-57623513b525 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] <== disconnect_volume: return (346ms) None {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:44:20 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dba335c6-bf51-4ccd-8b9b-57623513b525 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Disconnected iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 23:44:20 user nova-compute[75341]: DEBUG nova.objects.instance [None req-dba335c6-bf51-4ccd-8b9b-57623513b525 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Lazy-loading 'flavor' on Instance uuid 44080c0d-56eb-4987-aa4b-59f161dcbc0b {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:44:20 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-dba335c6-bf51-4ccd-8b9b-57623513b525 tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Lock "44080c0d-56eb-4987-aa4b-59f161dcbc0b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.808s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:44:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Acquiring lock "51045050-c7c6-49c5-acd4-2a76be0f466f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:44:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "51045050-c7c6-49c5-acd4-2a76be0f466f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:44:21 user nova-compute[75341]: DEBUG nova.compute.manager [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Starting instance... {{(pid=75341) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 23:44:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:44:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:44:21 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75341) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 23:44:21 user nova-compute[75341]: INFO nova.compute.claims [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Claim successful on node user
Nov 14 23:44:21 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:44:21 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:44:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.507s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:44:21 user nova-compute[75341]: DEBUG nova.compute.manager [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Start building networks asynchronously for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 23:44:21 user nova-compute[75341]: DEBUG nova.compute.manager [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Allocating IP information in the background. {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 23:44:21 user nova-compute[75341]: DEBUG nova.network.neutron [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] allocate_for_instance() {{(pid=75341) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 23:44:21 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 23:44:21 user nova-compute[75341]: DEBUG nova.compute.manager [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Start building block device mappings for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 23:44:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Acquiring lock "6382e432-838f-4d89-a743-cbaa37f50ab5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:44:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "6382e432-838f-4d89-a743-cbaa37f50ab5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:44:21 user nova-compute[75341]: DEBUG nova.compute.manager [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Starting instance... {{(pid=75341) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 23:44:21 user nova-compute[75341]: DEBUG nova.policy [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3c49a358e2f942f3a9777910ee755575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bb8b1415c14bb59c4c35cc2b830875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75341) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 23:44:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:44:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:44:21 user nova-compute[75341]: DEBUG nova.compute.manager [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Start spawning the instance on the hypervisor. {{(pid=75341) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 23:44:21 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Creating instance directory {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 23:44:21 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Creating image(s)
Nov 14 23:44:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Acquiring lock "/opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:44:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "/opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:44:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "/opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:44:21 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:21 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75341) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 23:44:21 user nova-compute[75341]: INFO nova.compute.claims [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Claim successful on node user
Nov 14 23:44:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.306s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:22 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Acquiring lock "4754efee9a6d73d3647f2add2cfe86c291949740" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:44:22 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:44:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.195s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk 1073741824 {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk 1073741824" returned: 0 in 0.062s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:22 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:44:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:22 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:44:22 user nova-compute[75341]: DEBUG nova.network.neutron [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Successfully created port: 64ebe5e6-0c81-41fd-b49e-75bed11e40df {{(pid=75341) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 23:44:22 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:44:22 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.708s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:44:22 user nova-compute[75341]: DEBUG nova.compute.manager [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Start building networks asynchronously for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 23:44:22 user nova-compute[75341]: DEBUG nova.compute.manager [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Allocating IP information in the background. {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 23:44:22 user nova-compute[75341]: DEBUG nova.network.neutron [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] allocate_for_instance() {{(pid=75341) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 23:44:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.205s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:22 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Checking if we can resize image /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk. size=1073741824 {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 23:44:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:22 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 23:44:22 user nova-compute[75341]: DEBUG nova.compute.manager [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Start building block device mappings for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 23:44:22 user nova-compute[75341]: DEBUG nova.policy [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3c49a358e2f942f3a9777910ee755575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bb8b1415c14bb59c4c35cc2b830875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75341) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 23:44:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:22 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Cannot resize image /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk to a smaller size. {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 23:44:22 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Created local disks {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 23:44:22 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Ensure instance console log exists: /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/console.log {{(pid=75341) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 23:44:22 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:44:22 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:44:22 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG nova.compute.manager [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Start spawning the instance on the hypervisor. {{(pid=75341) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Creating instance directory {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 23:44:23 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Creating image(s)
Nov 14 23:44:23 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Did not create local disks {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Ensure instance console log exists: /opt/stack/data/nova/instances/dbc9a6db-b536-426a-91fd-691a44c66528/console.log {{(pid=75341) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Start _get_guest_xml network_info=[{"id": "1ad25d31-80fa-41ba-8a1c-73f01ac1c832", "address": "fa:16:3e:70:63:49", "network": {"id": "304d198c-016a-470b-9504-145a5823966a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2033085667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad25d31-80", "ovs_interfaceid": "1ad25d31-80fa-41ba-8a1c-73f01ac1c832", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7b7251c7-1a54-46d9-9a9b-4103a659502c", "address": "fa:16:3e:b4:1d:7d", "network": {"id": "66be3b1a-ec5a-4c25-86fb-8350b80ce72d", "bridge": "br-int", "label": "tempest-device-tagging-net1-719453354", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b7251c7-1a", "ovs_interfaceid": "7b7251c7-1a54-46d9-9a9b-4103a659502c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0f140fc0-2078-47c4-985f-28a4ee8b2824", "address": "fa:16:3e:c6:94:07", "network": {"id": "66be3b1a-ec5a-4c25-86fb-8350b80ce72d", "bridge": "br-int", "label": "tempest-device-tagging-net1-719453354", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f140fc0-20", "ovs_interfaceid": "0f140fc0-2078-47c4-985f-28a4ee8b2824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f4b96195-ecba-4530-aa46-47e368eb294d", "address": "fa:16:3e:c1:9e:73", "network": {"id": "66be3b1a-ec5a-4c25-86fb-8350b80ce72d", "bridge": "br-int", "label": "tempest-device-tagging-net1-719453354", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4b96195-ec", "ovs_interfaceid": "f4b96195-ecba-4530-aa46-47e368eb294d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "52e41618-df29-407f-8843-3e1c55fb2a18", "address": "fa:16:3e:f9:73:7b", "network": {"id": "66be3b1a-ec5a-4c25-86fb-8350b80ce72d", "bridge": "br-int", "label": "tempest-device-tagging-net1-719453354", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e41618-df", "ovs_interfaceid": "52e41618-df29-407f-8843-3e1c55fb2a18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6368ff99-db9d-4a3e-b940-afc0300d7aa0", "address": "fa:16:3e:8a:4f:bb", "network": {"id": "21622931-8859-4310-85b4-e6c88ea4fd26", "bridge": "br-int", "label": "tempest-device-tagging-net2-1204896773", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6368ff99-db", "ovs_interfaceid": "6368ff99-db9d-4a3e-b940-afc0300d7aa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4f71d722-661a-44d6-81fa-cd588c0d6f4b", "address": "fa:16:3e:fe:bb:e6", "network": {"id": "21622931-8859-4310-85b4-e6c88ea4fd26", "bridge": "br-int", "label": "tempest-device-tagging-net2-1204896773", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f71d722-66", "ovs_interfaceid": "4f71d722-661a-44d6-81fa-cd588c0d6f4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '6fa86059-2242-47d7-91bc-d852003a2524', 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'poTPrwdx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dbc9a6db-b536-426a-91fd-691a44c66528', 'attached_at': '', 'detached_at': '', 'volume_id': '98ea7106-6e3b-4aa5-9d18-051e15cc3ac7', 'serial': '98ea7106-6e3b-4aa5-9d18-051e15cc3ac7'}, 'delete_on_termination': False, 'volume_type': None}, {'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 1, 'attachment_id': '67a6a194-f7eb-4fd7-a35e-8ade5e37c2d4', 'mount_device': '/dev/vdb', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xpTSQODc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dbc9a6db-b536-426a-91fd-691a44c66528', 'attached_at': '', 'detached_at': '', 'volume_id': '042bfbcb-fb28-4378-9754-8ecf4641438a', 'serial': '042bfbcb-fb28-4378-9754-8ecf4641438a'}, 'delete_on_termination': False, 'volume_type': None}, {'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 2, 'attachment_id': '772362f5-79df-4729-8ea6-5144701e3db1', 'mount_device': '/dev/vdc', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RNtFXsiP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dbc9a6db-b536-426a-91fd-691a44c66528', 'attached_at': '', 'detached_at': '', 'volume_id': '3762dcbb-d796-4b60-a654-ae1973ad2912', 'serial': '3762dcbb-d796-4b60-a654-ae1973ad2912'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG nova.compute.manager [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Start spawning the instance on the hypervisor. {{(pid=75341) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Creating instance directory {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 23:44:23 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Creating image(s)
Nov 14 23:44:23 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Acquiring lock "/opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "/opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "/opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:23 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:44:23 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:44:23 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Calling os-brick to attach iSCSI Volume {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'poTPrwdx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:44:23 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:44:23 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:44:23 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:44:23 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:44:23 user nova-compute[75341]: INFO os_brick.initiator.connectors.iscsi [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 23:44:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 -p 172.16.0.220:3260 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[afbd6d9d-5fbc-413d-9b3c-5ad1b1222390]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 23:44:23 user nova-compute[75341]:  {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aed9ddc-4a90-4606-89ed-8d57cd92311b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7] added\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7] added
Nov 14 23:44:23 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.218s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Acquiring lock "4754efee9a6d73d3647f2add2cfe86c291949740" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.064s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1eb4d71-4dd1-43e3-a1c7-b9c197e0710b]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8678a30-ffe8-4158-918d-79a4cc07193a]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v poTPrwdx {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v poTPrwdx" returned: 0 in 0.023s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d24e702-8fd2-48ed-bdb3-8568bbdb136c]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'poTPrwdx'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d584e38-2a5b-485c-b207-3f2b059b0f30]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[061dbd4c-0f6f-475f-82bd-ad1ba9ba5b4b]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)
Nov 14 23:44:23 user nova-compute[75341]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 (non-flash)
Nov 14 23:44:23 user nova-compute[75341]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)
Nov 14 23:44:23 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)
Nov 14 23:44:23 user nova-compute[75341]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 (non-flash)
Nov 14 23:44:23 user nova-compute[75341]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)
Nov 14 23:44:23 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 -p 172.16.0.220:3260 --login {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.210s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk 1073741824 {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cdcaa5e-a294-4c78-9c3a-a5f577de5ba1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7, portal: 172.16.0.220,3260]
Nov 14 23:44:23 user nova-compute[75341]: Login to [iface: default, target: iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7, portal: 172.16.0.220,3260] successful.
Nov 14 23:44:23 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk 1073741824" returned: 0 in 0.076s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.291s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d300250-caa5-483f-8178-a5491dfd0376]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[5439af3f-dd92-430a-aad2-540af7055846]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)
Nov 14 23:44:23 user nova-compute[75341]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 (non-flash)
Nov 14 23:44:23 user nova-compute[75341]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)
Nov 14 23:44:23 user nova-compute[75341]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 (non-flash)
Nov 14 23:44:23 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)
Nov 14 23:44:23 user nova-compute[75341]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 (non-flash)
Nov 14 23:44:23 user nova-compute[75341]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)
Nov 14 23:44:23 user nova-compute[75341]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 (non-flash)
Nov 14 23:44:23 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.453s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Connected to 172.16.0.220:3260 {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=75341) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75341) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.034s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9fb909-ef1c-40f4-a2a7-82f65dde9b01]: (4, ('- - 0', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'poTPrwdx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG nova.network.neutron [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Successfully created port: 61a9a4a7-170b-4ed9-8d52-8cb4defd1cae {{(pid=75341) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.224s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk. size=1073741824 {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG nova.network.neutron [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Successfully updated port: 64ebe5e6-0c81-41fd-b49e-75bed11e40df {{(pid=75341) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG nova.compute.manager [req-034a7ce4-ae59-4bdb-80bc-b112eafa9033 req-4053c95a-85bb-4ae4-8cb0-42035a82504a service nova] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Received event network-changed-64ebe5e6-0c81-41fd-b49e-75bed11e40df {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG nova.compute.manager [req-034a7ce4-ae59-4bdb-80bc-b112eafa9033 req-4053c95a-85bb-4ae4-8cb0-42035a82504a service nova] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Refreshing instance network info cache due to event network-changed-64ebe5e6-0c81-41fd-b49e-75bed11e40df. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-034a7ce4-ae59-4bdb-80bc-b112eafa9033 req-4053c95a-85bb-4ae4-8cb0-42035a82504a service nova] Acquiring lock "refresh_cache-51045050-c7c6-49c5-acd4-2a76be0f466f" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-034a7ce4-ae59-4bdb-80bc-b112eafa9033 req-4053c95a-85bb-4ae4-8cb0-42035a82504a service nova] Acquired lock "refresh_cache-51045050-c7c6-49c5-acd4-2a76be0f466f" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG nova.network.neutron [req-034a7ce4-ae59-4bdb-80bc-b112eafa9033 req-4053c95a-85bb-4ae4-8cb0-42035a82504a service nova] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Refreshing network info cache for port 64ebe5e6-0c81-41fd-b49e-75bed11e40df {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Acquiring lock "refresh_cache-51045050-c7c6-49c5-acd4-2a76be0f466f" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:44:23 user nova-compute[75341]: DEBUG nova.network.neutron [req-034a7ce4-ae59-4bdb-80bc-b112eafa9033 req-4053c95a-85bb-4ae4-8cb0-42035a82504a service nova] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Instance cache missing network info. {{(pid=75341) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Cannot resize image /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk to a smaller size. {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Created local disks {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Ensure instance console log exists: /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/console.log {{(pid=75341) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG nova.network.neutron [req-034a7ce4-ae59-4bdb-80bc-b112eafa9033 req-4053c95a-85bb-4ae4-8cb0-42035a82504a service nova] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-034a7ce4-ae59-4bdb-80bc-b112eafa9033 req-4053c95a-85bb-4ae4-8cb0-42035a82504a service nova] Releasing lock "refresh_cache-51045050-c7c6-49c5-acd4-2a76be0f466f" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Acquired lock "refresh_cache-51045050-c7c6-49c5-acd4-2a76be0f466f" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG nova.network.neutron [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG nova.network.neutron [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Instance cache missing network info. {{(pid=75341) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG nova.network.neutron [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Successfully updated port: 61a9a4a7-170b-4ed9-8d52-8cb4defd1cae {{(pid=75341) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Acquiring lock "refresh_cache-6382e432-838f-4d89-a743-cbaa37f50ab5" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Acquired lock "refresh_cache-6382e432-838f-4d89-a743-cbaa37f50ab5" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG nova.network.neutron [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG nova.compute.manager [req-f9fd6905-425e-4fa5-869b-1ff8f3f25429 req-be5b479e-85fe-4e08-9fb2-51d8cc794e0a service nova] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Received event network-changed-61a9a4a7-170b-4ed9-8d52-8cb4defd1cae {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG nova.compute.manager [req-f9fd6905-425e-4fa5-869b-1ff8f3f25429 req-be5b479e-85fe-4e08-9fb2-51d8cc794e0a service nova] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Refreshing instance network info cache due to event network-changed-61a9a4a7-170b-4ed9-8d52-8cb4defd1cae. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-f9fd6905-425e-4fa5-869b-1ff8f3f25429 req-be5b479e-85fe-4e08-9fb2-51d8cc794e0a service nova] Acquiring lock "refresh_cache-6382e432-838f-4d89-a743-cbaa37f50ab5" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG nova.network.neutron [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Instance cache missing network info. {{(pid=75341) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG nova.network.neutron [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Updating instance_info_cache with network_info: [{"id": "64ebe5e6-0c81-41fd-b49e-75bed11e40df", "address": "fa:16:3e:44:63:f2", "network": {"id": "fcd22da6-016e-4872-a84c-4d82601c48d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-550677181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44bb8b1415c14bb59c4c35cc2b830875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ebe5e6-0c", "ovs_interfaceid": "64ebe5e6-0c81-41fd-b49e-75bed11e40df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Releasing lock "refresh_cache-51045050-c7c6-49c5-acd4-2a76be0f466f" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG nova.compute.manager [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Instance network_info: |[{"id": "64ebe5e6-0c81-41fd-b49e-75bed11e40df", "address": "fa:16:3e:44:63:f2", "network": {"id": "fcd22da6-016e-4872-a84c-4d82601c48d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-550677181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44bb8b1415c14bb59c4c35cc2b830875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ebe5e6-0c", "ovs_interfaceid": "64ebe5e6-0c81-41fd-b49e-75bed11e40df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Start _get_guest_xml network_info=[{"id": "64ebe5e6-0c81-41fd-b49e-75bed11e40df", "address": "fa:16:3e:44:63:f2", "network": {"id": "fcd22da6-016e-4872-a84c-4d82601c48d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-550677181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44bb8b1415c14bb59c4c35cc2b830875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ebe5e6-0c", "ovs_interfaceid": "64ebe5e6-0c81-41fd-b49e-75bed11e40df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encrypted': False, 'image_id': 'e46abb82-b810-490e-a8a1-ccdc5fa1a796'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 23:44:24 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:44:24 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:44:24 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:44:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-498055834',display_name='tempest-ServerRescueNegativeTestJSON-server-498055834',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-498055834',id=17,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44bb8b1415c14bb59c4c35cc2b830875',ramdisk_id='',reservation_id='r-jta0uzo0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1956631656',owner_user_name='tempest-ServerRescueNegativeTestJSON-1956631656-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:44:22Z,user_data=None,user_id='3c49a358e2f942f3a9777910ee755575',uuid=51045050-c7c6-49c5-acd4-2a76be0f466f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64ebe5e6-0c81-41fd-b49e-75bed11e40df", "address": "fa:16:3e:44:63:f2", "network": {"id": "fcd22da6-016e-4872-a84c-4d82601c48d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-550677181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44bb8b1415c14bb59c4c35cc2b830875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ebe5e6-0c", "ovs_interfaceid": "64ebe5e6-0c81-41fd-b49e-75bed11e40df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Converting VIF {"id": "64ebe5e6-0c81-41fd-b49e-75bed11e40df", "address": "fa:16:3e:44:63:f2", "network": {"id": "fcd22da6-016e-4872-a84c-4d82601c48d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-550677181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44bb8b1415c14bb59c4c35cc2b830875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ebe5e6-0c", "ovs_interfaceid": "64ebe5e6-0c81-41fd-b49e-75bed11e40df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:63:f2,bridge_name='br-int',has_traffic_filtering=True,id=64ebe5e6-0c81-41fd-b49e-75bed11e40df,network=Network(fcd22da6-016e-4872-a84c-4d82601c48d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64ebe5e6-0c') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG nova.objects.instance [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lazy-loading 'pci_devices' on Instance uuid 51045050-c7c6-49c5-acd4-2a76be0f466f {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] End _get_guest_xml xml=<domain type="kvm">
Nov 14 23:44:24 user nova-compute[75341]:   <uuid>51045050-c7c6-49c5-acd4-2a76be0f466f</uuid>
Nov 14 23:44:24 user nova-compute[75341]:   <name>instance-00000011</name>
Nov 14 23:44:24 user nova-compute[75341]:   <memory>524288</memory>
Nov 14 23:44:24 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 14 23:44:24 user nova-compute[75341]:   <metadata>
Nov 14 23:44:24 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 23:44:24 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 14 23:44:24 user nova-compute[75341]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-498055834</nova:name>
Nov 14 23:44:24 user nova-compute[75341]:       <nova:creationTime>2023-11-14 23:44:24</nova:creationTime>
Nov 14 23:44:24 user nova-compute[75341]:       <nova:flavor name="m1.tiny">
Nov 14 23:44:24 user nova-compute[75341]:         <nova:memory>512</nova:memory>
Nov 14 23:44:24 user nova-compute[75341]:         <nova:disk>1</nova:disk>
Nov 14 23:44:24 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 14 23:44:24 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 23:44:24 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 14 23:44:24 user nova-compute[75341]:       </nova:flavor>
Nov 14 23:44:24 user nova-compute[75341]:       <nova:owner>
Nov 14 23:44:24 user nova-compute[75341]:         <nova:user uuid="3c49a358e2f942f3a9777910ee755575">tempest-ServerRescueNegativeTestJSON-1956631656-project-member</nova:user>
Nov 14 23:44:24 user nova-compute[75341]:         <nova:project uuid="44bb8b1415c14bb59c4c35cc2b830875">tempest-ServerRescueNegativeTestJSON-1956631656</nova:project>
Nov 14 23:44:24 user nova-compute[75341]:       </nova:owner>
Nov 14 23:44:24 user nova-compute[75341]:       <nova:root type="image" uuid="e46abb82-b810-490e-a8a1-ccdc5fa1a796"/>
Nov 14 23:44:24 user nova-compute[75341]:       <nova:ports>
Nov 14 23:44:24 user nova-compute[75341]:         <nova:port uuid="64ebe5e6-0c81-41fd-b49e-75bed11e40df">
Nov 14 23:44:24 user nova-compute[75341]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 23:44:24 user nova-compute[75341]:         </nova:port>
Nov 14 23:44:24 user nova-compute[75341]:       </nova:ports>
Nov 14 23:44:24 user nova-compute[75341]:     </nova:instance>
Nov 14 23:44:24 user nova-compute[75341]:   </metadata>
Nov 14 23:44:24 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 14 23:44:24 user nova-compute[75341]:     <system>
Nov 14 23:44:24 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 23:44:24 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 14 23:44:24 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 14 23:44:24 user nova-compute[75341]:       <entry name="serial">51045050-c7c6-49c5-acd4-2a76be0f466f</entry>
Nov 14 23:44:24 user nova-compute[75341]:       <entry name="uuid">51045050-c7c6-49c5-acd4-2a76be0f466f</entry>
Nov 14 23:44:24 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 14 23:44:24 user nova-compute[75341]:     </system>
Nov 14 23:44:24 user nova-compute[75341]:   </sysinfo>
Nov 14 23:44:24 user nova-compute[75341]:   <os>
Nov 14 23:44:24 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 23:44:24 user nova-compute[75341]:     <boot dev="hd"/>
Nov 14 23:44:24 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 14 23:44:24 user nova-compute[75341]:   </os>
Nov 14 23:44:24 user nova-compute[75341]:   <features>
Nov 14 23:44:24 user nova-compute[75341]:     <acpi/>
Nov 14 23:44:24 user nova-compute[75341]:     <apic/>
Nov 14 23:44:24 user nova-compute[75341]:     <vmcoreinfo/>
Nov 14 23:44:24 user nova-compute[75341]:   </features>
Nov 14 23:44:24 user nova-compute[75341]:   <clock offset="utc">
Nov 14 23:44:24 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 23:44:24 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 23:44:24 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 14 23:44:24 user nova-compute[75341]:   </clock>
Nov 14 23:44:24 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 14 23:44:24 user nova-compute[75341]:     <model>Nehalem</model>
Nov 14 23:44:24 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 23:44:24 user nova-compute[75341]:   </cpu>
Nov 14 23:44:24 user nova-compute[75341]:   <devices>
Nov 14 23:44:24 user nova-compute[75341]:     <disk type="file" device="disk">
Nov 14 23:44:24 user nova-compute[75341]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 23:44:24 user nova-compute[75341]:       <source file="/opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk"/>
Nov 14 23:44:24 user nova-compute[75341]:       <target dev="vda" bus="virtio"/>
Nov 14 23:44:24 user nova-compute[75341]:     </disk>
Nov 14 23:44:24 user nova-compute[75341]:     <interface type="ethernet">
Nov 14 23:44:24 user nova-compute[75341]:       <mac address="fa:16:3e:44:63:f2"/>
Nov 14 23:44:24 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:44:24 user nova-compute[75341]:       <mtu size="1442"/>
Nov 14 23:44:24 user nova-compute[75341]:       <target dev="tap64ebe5e6-0c"/>
Nov 14 23:44:24 user nova-compute[75341]:     </interface>
Nov 14 23:44:24 user nova-compute[75341]:     <serial type="pty">
Nov 14 23:44:24 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/console.log" append="off"/>
Nov 14 23:44:24 user nova-compute[75341]:     </serial>
Nov 14 23:44:24 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 23:44:24 user nova-compute[75341]:     <video>
Nov 14 23:44:24 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:44:24 user nova-compute[75341]:     </video>
Nov 14 23:44:24 user nova-compute[75341]:     <rng model="virtio">
Nov 14 23:44:24 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 14 23:44:24 user nova-compute[75341]:     </rng>
Nov 14 23:44:24 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 14 23:44:24 user nova-compute[75341]:     <memballoon model="virtio">
Nov 14 23:44:24 user nova-compute[75341]:       <stats period="10"/>
Nov 14 23:44:24 user nova-compute[75341]:     </memballoon>
Nov 14 23:44:24 user nova-compute[75341]:   </devices>
Nov 14 23:44:24 user nova-compute[75341]: </domain>
Nov 14 23:44:24 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:44:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-498055834',display_name='tempest-ServerRescueNegativeTestJSON-server-498055834',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-498055834',id=17,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44bb8b1415c14bb59c4c35cc2b830875',ramdisk_id='',reservation_id='r-jta0uzo0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1956631656',owner_user_name='tempest-ServerRescueNegativeTestJSON-1956631656-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:44:22Z,user_data=None,user_id='3c49a358e2f942f3a9777910ee755575',uuid=51045050-c7c6-49c5-acd4-2a76be0f466f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64ebe5e6-0c81-41fd-b49e-75bed11e40df", "address": "fa:16:3e:44:63:f2", "network": {"id": "fcd22da6-016e-4872-a84c-4d82601c48d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-550677181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44bb8b1415c14bb59c4c35cc2b830875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ebe5e6-0c", "ovs_interfaceid": "64ebe5e6-0c81-41fd-b49e-75bed11e40df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Converting VIF {"id": "64ebe5e6-0c81-41fd-b49e-75bed11e40df", "address": "fa:16:3e:44:63:f2", "network": {"id": "fcd22da6-016e-4872-a84c-4d82601c48d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-550677181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44bb8b1415c14bb59c4c35cc2b830875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ebe5e6-0c", "ovs_interfaceid": "64ebe5e6-0c81-41fd-b49e-75bed11e40df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:63:f2,bridge_name='br-int',has_traffic_filtering=True,id=64ebe5e6-0c81-41fd-b49e-75bed11e40df,network=Network(fcd22da6-016e-4872-a84c-4d82601c48d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64ebe5e6-0c') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG os_vif [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:63:f2,bridge_name='br-int',has_traffic_filtering=True,id=64ebe5e6-0c81-41fd-b49e-75bed11e40df,network=Network(fcd22da6-016e-4872-a84c-4d82601c48d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64ebe5e6-0c') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.521s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] <== connect_volume: return (1523ms) {'type': 'block', 'scsi_wwn': '26633336363653339', 'path': '/dev/sdb'} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633336363653339', 'path': '/dev/sdb'} {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '373ba2f6-9b78-520f-9532-f9d8bf3d42b5', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap64ebe5e6-0c, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap64ebe5e6-0c, col_values=(('qos', UUID('01024928-4177-4085-8dd4-98c19571652c')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap64ebe5e6-0c, col_values=(('external_ids', {'iface-id': '64ebe5e6-0c81-41fd-b49e-75bed11e40df', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:63:f2', 'vm-uuid': '51045050-c7c6-49c5-acd4-2a76be0f466f'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:24 user nova-compute[75341]: INFO os_vif [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:63:f2,bridge_name='br-int',has_traffic_filtering=True,id=64ebe5e6-0c81-41fd-b49e-75bed11e40df,network=Network(fcd22da6-016e-4872-a84c-4d82601c48d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64ebe5e6-0c')
Nov 14 23:44:24 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Calling os-brick to attach iSCSI Volume {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xpTSQODc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:44:24 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:44:24 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:44:24 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:44:24 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:44:24 user nova-compute[75341]: INFO os_brick.initiator.connectors.iscsi [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 23:44:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a -p 172.16.0.220:3260 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1a6c12-d77a-4c67-8443-c30e7814ed19]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 23:44:24 user nova-compute[75341]:  {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a -p 172.16.0.220:3260 --interface default --op new {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[7195a3ab-ac9c-4c5b-8e51-3db0fbbbef6a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a] added\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a] added
Nov 14 23:44:24 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] No VIF found with MAC fa:16:3e:44:63:f2, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d5d2e1-c0b9-4c2f-8ce2-5fefd363db49]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG nova.network.neutron [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Updating instance_info_cache with network_info: [{"id": "61a9a4a7-170b-4ed9-8d52-8cb4defd1cae", "address": "fa:16:3e:0c:42:07", "network": {"id": "fcd22da6-016e-4872-a84c-4d82601c48d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-550677181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44bb8b1415c14bb59c4c35cc2b830875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61a9a4a7-17", "ovs_interfaceid": "61a9a4a7-170b-4ed9-8d52-8cb4defd1cae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4057cf2-0d40-4128-97ef-8918616d348b]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xpTSQODc {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Releasing lock "refresh_cache-6382e432-838f-4d89-a743-cbaa37f50ab5" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG nova.compute.manager [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Instance network_info: |[{"id": "61a9a4a7-170b-4ed9-8d52-8cb4defd1cae", "address": "fa:16:3e:0c:42:07", "network": {"id": "fcd22da6-016e-4872-a84c-4d82601c48d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-550677181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44bb8b1415c14bb59c4c35cc2b830875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61a9a4a7-17", "ovs_interfaceid": "61a9a4a7-170b-4ed9-8d52-8cb4defd1cae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-f9fd6905-425e-4fa5-869b-1ff8f3f25429 req-be5b479e-85fe-4e08-9fb2-51d8cc794e0a service nova] Acquired lock "refresh_cache-6382e432-838f-4d89-a743-cbaa37f50ab5" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG nova.network.neutron [req-f9fd6905-425e-4fa5-869b-1ff8f3f25429 req-be5b479e-85fe-4e08-9fb2-51d8cc794e0a service nova] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Refreshing network info cache for port 61a9a4a7-170b-4ed9-8d52-8cb4defd1cae {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Start _get_guest_xml network_info=[{"id": "61a9a4a7-170b-4ed9-8d52-8cb4defd1cae", "address": "fa:16:3e:0c:42:07", "network": {"id": "fcd22da6-016e-4872-a84c-4d82601c48d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-550677181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44bb8b1415c14bb59c4c35cc2b830875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61a9a4a7-17", "ovs_interfaceid": "61a9a4a7-170b-4ed9-8d52-8cb4defd1cae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encrypted': False, 'image_id': 'e46abb82-b810-490e-a8a1-ccdc5fa1a796'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 23:44:24 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:44:24 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:44:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xpTSQODc" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0e05d6-ee43-42aa-a40c-694233237fbe]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xpTSQODc'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:44:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-774340686',display_name='tempest-ServerRescueNegativeTestJSON-server-774340686',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-774340686',id=18,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44bb8b1415c14bb59c4c35cc2b830875',ramdisk_id='',reservation_id='r-je794ae3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1956631656',owner_user_name='tempest-ServerRescueNegativeTestJSON-1956631656-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:44:23Z,user_data=None,user_id='3c49a358e2f942f3a9777910ee755575',uuid=6382e432-838f-4d89-a743-cbaa37f50ab5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61a9a4a7-170b-4ed9-8d52-8cb4defd1cae", "address": "fa:16:3e:0c:42:07", "network": {"id": "fcd22da6-016e-4872-a84c-4d82601c48d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-550677181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44bb8b1415c14bb59c4c35cc2b830875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61a9a4a7-17", "ovs_interfaceid": "61a9a4a7-170b-4ed9-8d52-8cb4defd1cae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Converting VIF {"id": "61a9a4a7-170b-4ed9-8d52-8cb4defd1cae", "address": "fa:16:3e:0c:42:07", "network": {"id": "fcd22da6-016e-4872-a84c-4d82601c48d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-550677181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44bb8b1415c14bb59c4c35cc2b830875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61a9a4a7-17", "ovs_interfaceid": "61a9a4a7-170b-4ed9-8d52-8cb4defd1cae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:42:07,bridge_name='br-int',has_traffic_filtering=True,id=61a9a4a7-170b-4ed9-8d52-8cb4defd1cae,network=Network(fcd22da6-016e-4872-a84c-4d82601c48d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61a9a4a7-17') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG nova.objects.instance [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lazy-loading 'pci_devices' on Instance uuid 6382e432-838f-4d89-a743-cbaa37f50ab5 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[957acf75-5aad-445f-96cd-3e4cca601f2e]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:44:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:25 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] End _get_guest_xml xml=<domain type="kvm">
Nov 14 23:44:25 user nova-compute[75341]:   <uuid>6382e432-838f-4d89-a743-cbaa37f50ab5</uuid>
Nov 14 23:44:25 user nova-compute[75341]:   <name>instance-00000012</name>
Nov 14 23:44:25 user nova-compute[75341]:   <memory>524288</memory>
Nov 14 23:44:25 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 14 23:44:25 user nova-compute[75341]:   <metadata>
Nov 14 23:44:25 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 23:44:25 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 14 23:44:25 user nova-compute[75341]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-774340686</nova:name>
Nov 14 23:44:25 user nova-compute[75341]:       <nova:creationTime>2023-11-14 23:44:24</nova:creationTime>
Nov 14 23:44:25 user nova-compute[75341]:       <nova:flavor name="m1.tiny">
Nov 14 23:44:25 user nova-compute[75341]:         <nova:memory>512</nova:memory>
Nov 14 23:44:25 user nova-compute[75341]:         <nova:disk>1</nova:disk>
Nov 14 23:44:25 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 14 23:44:25 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 23:44:25 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 14 23:44:25 user nova-compute[75341]:       </nova:flavor>
Nov 14 23:44:25 user nova-compute[75341]:       <nova:owner>
Nov 14 23:44:25 user nova-compute[75341]:         <nova:user uuid="3c49a358e2f942f3a9777910ee755575">tempest-ServerRescueNegativeTestJSON-1956631656-project-member</nova:user>
Nov 14 23:44:25 user nova-compute[75341]:         <nova:project uuid="44bb8b1415c14bb59c4c35cc2b830875">tempest-ServerRescueNegativeTestJSON-1956631656</nova:project>
Nov 14 23:44:25 user nova-compute[75341]:       </nova:owner>
Nov 14 23:44:25 user nova-compute[75341]:       <nova:root type="image" uuid="e46abb82-b810-490e-a8a1-ccdc5fa1a796"/>
Nov 14 23:44:25 user nova-compute[75341]:       <nova:ports>
Nov 14 23:44:25 user nova-compute[75341]:         <nova:port uuid="61a9a4a7-170b-4ed9-8d52-8cb4defd1cae">
Nov 14 23:44:25 user nova-compute[75341]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 23:44:25 user nova-compute[75341]:         </nova:port>
Nov 14 23:44:25 user nova-compute[75341]:       </nova:ports>
Nov 14 23:44:25 user nova-compute[75341]:     </nova:instance>
Nov 14 23:44:25 user nova-compute[75341]:   </metadata>
Nov 14 23:44:25 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 14 23:44:25 user nova-compute[75341]:     <system>
Nov 14 23:44:25 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 23:44:25 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 14 23:44:25 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 14 23:44:25 user nova-compute[75341]:       <entry name="serial">6382e432-838f-4d89-a743-cbaa37f50ab5</entry>
Nov 14 23:44:25 user nova-compute[75341]:       <entry name="uuid">6382e432-838f-4d89-a743-cbaa37f50ab5</entry>
Nov 14 23:44:25 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 14 23:44:25 user nova-compute[75341]:     </system>
Nov 14 23:44:25 user nova-compute[75341]:   </sysinfo>
Nov 14 23:44:25 user nova-compute[75341]:   <os>
Nov 14 23:44:25 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 23:44:25 user nova-compute[75341]:     <boot dev="hd"/>
Nov 14 23:44:25 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 14 23:44:25 user nova-compute[75341]:   </os>
Nov 14 23:44:25 user nova-compute[75341]:   <features>
Nov 14 23:44:25 user nova-compute[75341]:     <acpi/>
Nov 14 23:44:25 user nova-compute[75341]:     <apic/>
Nov 14 23:44:25 user nova-compute[75341]:     <vmcoreinfo/>
Nov 14 23:44:25 user nova-compute[75341]:   </features>
Nov 14 23:44:25 user nova-compute[75341]:   <clock offset="utc">
Nov 14 23:44:25 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 23:44:25 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 23:44:25 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 14 23:44:25 user nova-compute[75341]:   </clock>
Nov 14 23:44:25 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 14 23:44:25 user nova-compute[75341]:     <model>Nehalem</model>
Nov 14 23:44:25 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 23:44:25 user nova-compute[75341]:   </cpu>
Nov 14 23:44:25 user nova-compute[75341]:   <devices>
Nov 14 23:44:25 user nova-compute[75341]:     <disk type="file" device="disk">
Nov 14 23:44:25 user nova-compute[75341]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 23:44:25 user nova-compute[75341]:       <source file="/opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk"/>
Nov 14 23:44:25 user nova-compute[75341]:       <target dev="vda" bus="virtio"/>
Nov 14 23:44:25 user nova-compute[75341]:     </disk>
Nov 14 23:44:25 user nova-compute[75341]:     <interface type="ethernet">
Nov 14 23:44:25 user nova-compute[75341]:       <mac address="fa:16:3e:0c:42:07"/>
Nov 14 23:44:25 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:44:25 user nova-compute[75341]:       <mtu size="1442"/>
Nov 14 23:44:25 user nova-compute[75341]:       <target dev="tap61a9a4a7-17"/>
Nov 14 23:44:25 user nova-compute[75341]:     </interface>
Nov 14 23:44:25 user nova-compute[75341]:     <serial type="pty">
Nov 14 23:44:25 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/console.log" append="off"/>
Nov 14 23:44:25 user nova-compute[75341]:     </serial>
Nov 14 23:44:25 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 23:44:25 user nova-compute[75341]:     <video>
Nov 14 23:44:25 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:44:25 user nova-compute[75341]:     </video>
Nov 14 23:44:25 user nova-compute[75341]:     <rng model="virtio">
Nov 14 23:44:25 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 14 23:44:25 user nova-compute[75341]:     </rng>
Nov 14 23:44:25 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 14 23:44:25 user nova-compute[75341]:     <memballoon model="virtio">
Nov 14 23:44:25 user nova-compute[75341]:       <stats period="10"/>
Nov 14 23:44:25 user nova-compute[75341]:     </memballoon>
Nov 14 23:44:25 user nova-compute[75341]:   </devices>
Nov 14 23:44:25 user nova-compute[75341]: </domain>
Nov 14 23:44:25 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 23:44:25 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:44:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-774340686',display_name='tempest-ServerRescueNegativeTestJSON-server-774340686',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-774340686',id=18,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44bb8b1415c14bb59c4c35cc2b830875',ramdisk_id='',reservation_id='r-je794ae3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1956631656',owner_user_name='tempest-ServerRescueNegativeTestJSON-1956631656-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:44:23Z,user_data=None,user_id='3c49a358e2f942f3a9777910ee755575',uuid=6382e432-838f-4d89-a743-cbaa37f50ab5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61a9a4a7-170b-4ed9-8d52-8cb4defd1cae", "address": "fa:16:3e:0c:42:07", "network": {"id": "fcd22da6-016e-4872-a84c-4d82601c48d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-550677181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44bb8b1415c14bb59c4c35cc2b830875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61a9a4a7-17", "ovs_interfaceid": "61a9a4a7-170b-4ed9-8d52-8cb4defd1cae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 23:44:25 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Converting VIF {"id": "61a9a4a7-170b-4ed9-8d52-8cb4defd1cae", "address": "fa:16:3e:0c:42:07", "network": {"id": "fcd22da6-016e-4872-a84c-4d82601c48d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-550677181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44bb8b1415c14bb59c4c35cc2b830875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61a9a4a7-17", "ovs_interfaceid": "61a9a4a7-170b-4ed9-8d52-8cb4defd1cae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:44:25 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:42:07,bridge_name='br-int',has_traffic_filtering=True,id=61a9a4a7-170b-4ed9-8d52-8cb4defd1cae,network=Network(fcd22da6-016e-4872-a84c-4d82601c48d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61a9a4a7-17') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:44:25 user nova-compute[75341]: DEBUG os_vif [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:42:07,bridge_name='br-int',has_traffic_filtering=True,id=61a9a4a7-170b-4ed9-8d52-8cb4defd1cae,network=Network(fcd22da6-016e-4872-a84c-4d82601c48d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61a9a4a7-17') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 23:44:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:44:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 23:44:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '55823661-421b-5a35-bc12-c66bbde72bce', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:44:25 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:25 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed08ce6-1471-4c24-a0cf-9e940ad1fae0]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:25 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)
Nov 14 23:44:25 user nova-compute[75341]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 (non-flash)
Nov 14 23:44:25 user nova-compute[75341]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)
Nov 14 23:44:25 user nova-compute[75341]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 (non-flash)
Nov 14 23:44:25 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:44:25 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)
Nov 14 23:44:25 user nova-compute[75341]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 (non-flash)
Nov 14 23:44:25 user nova-compute[75341]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)
Nov 14 23:44:25 user nova-compute[75341]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 (non-flash)
Nov 14 23:44:25 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:44:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:25 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a -p 172.16.0.220:3260 --login {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:44:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap61a9a4a7-17, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:44:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap61a9a4a7-17, col_values=(('qos', UUID('d7b13b24-e638-42b1-a14c-c141e0d05653')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:44:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap61a9a4a7-17, col_values=(('external_ids', {'iface-id': '61a9a4a7-170b-4ed9-8d52-8cb4defd1cae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:42:07', 'vm-uuid': '6382e432-838f-4d89-a743-cbaa37f50ab5'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:44:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:44:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:25 user nova-compute[75341]: INFO os_vif [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:42:07,bridge_name='br-int',has_traffic_filtering=True,id=61a9a4a7-170b-4ed9-8d52-8cb4defd1cae,network=Network(fcd22da6-016e-4872-a84c-4d82601c48d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61a9a4a7-17')
Nov 14 23:44:25 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:25 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e5fe660-fd6b-44d6-8771-eebb409e83d2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:25 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a, portal: 172.16.0.220,3260]
Nov 14 23:44:25 user nova-compute[75341]: Login to [iface: default, target: iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a, portal: 172.16.0.220,3260] successful.
Nov 14 23:44:25 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:44:25 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:25 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:25 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c464cd-9e78-43db-b0cf-efd8268e7433]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:25 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:44:25 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:25 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:44:25 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] No VIF found with MAC fa:16:3e:0c:42:07, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:44:25 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:25 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d4c475-b220-406b-84a2-54b537ff22b8]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:25 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)
Nov 14 23:44:25 user nova-compute[75341]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 (non-flash)
Nov 14 23:44:25 user nova-compute[75341]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)
Nov 14 23:44:25 user nova-compute[75341]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 (non-flash)
Nov 14 23:44:25 user nova-compute[75341]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a (non-flash)
Nov 14 23:44:25 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:44:25 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)
Nov 14 23:44:25 user nova-compute[75341]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 (non-flash)
Nov 14 23:44:25 user nova-compute[75341]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)
Nov 14 23:44:25 user nova-compute[75341]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 (non-flash)
Nov 14 23:44:25 user nova-compute[75341]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a (non-flash)
Nov 14 23:44:25 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:44:25 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.387s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:44:25 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Connected to 172.16.0.220:3260 {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 23:44:25 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] HCTL ('37', '-', '-', 0) found on session 22 with lun 0 {{(pid=75341) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 23:44:25 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75341) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 23:44:25 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:25 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:25 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e01ab16-50ee-4cf1-b982-f755f68fce8b]: (4, ('- - 0', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:25 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Searching for a device in session 22 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 23:44:25 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xpTSQODc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 23:44:25 user nova-compute[75341]: DEBUG nova.network.neutron [req-f9fd6905-425e-4fa5-869b-1ff8f3f25429 req-be5b479e-85fe-4e08-9fb2-51d8cc794e0a service nova] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Updated VIF entry in instance network info cache for port 61a9a4a7-170b-4ed9-8d52-8cb4defd1cae. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:44:25 user nova-compute[75341]: DEBUG nova.network.neutron [req-f9fd6905-425e-4fa5-869b-1ff8f3f25429 req-be5b479e-85fe-4e08-9fb2-51d8cc794e0a service nova] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Updating instance_info_cache with network_info: [{"id": "61a9a4a7-170b-4ed9-8d52-8cb4defd1cae", "address": "fa:16:3e:0c:42:07", "network": {"id": "fcd22da6-016e-4872-a84c-4d82601c48d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-550677181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44bb8b1415c14bb59c4c35cc2b830875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61a9a4a7-17", "ovs_interfaceid": "61a9a4a7-170b-4ed9-8d52-8cb4defd1cae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:44:25 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-f9fd6905-425e-4fa5-869b-1ff8f3f25429 req-be5b479e-85fe-4e08-9fb2-51d8cc794e0a service nova] Releasing lock "refresh_cache-6382e432-838f-4d89-a743-cbaa37f50ab5" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:44:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:26 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.429s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:44:26 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] <== connect_volume: return (1431ms) {'type': 'block', 'scsi_wwn': '23063323733383165', 'path': '/dev/sdf'} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:44:26 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23063323733383165', 'path': '/dev/sdf'} {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 23:44:26 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Calling os-brick to attach iSCSI Volume {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 23:44:26 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RNtFXsiP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:44:26 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:44:26 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:44:26 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:44:26 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:44:26 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:44:26 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:44:26 user nova-compute[75341]: INFO os_brick.initiator.connectors.iscsi [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 23:44:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 -p 172.16.0.220:3260 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:26 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc19bb4-18a2-42ad-a07e-4dde4e49a7b1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:26 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 23:44:26 user nova-compute[75341]:  {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:44:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 -p 172.16.0.220:3260 --interface default --op new {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:26 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[3865ef08-4024-4b4f-be75-70c4ef7a574c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912] added\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:26 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912] added
Nov 14 23:44:26 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:44:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:26 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[b704ca53-4e58-4ea6-a1b6-809703f8f2bf]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:26 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:44:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:26 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe296fde-3e26-4a67-af61-adde1edd7704]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:26 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:44:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RNtFXsiP {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RNtFXsiP" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:26 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68c5054-a10c-4e8a-9a54-81b2ac8ccf02]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:26 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RNtFXsiP'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:44:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:26 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ffbce78-859b-41d4-86c2-7042b2af3401]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:26 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:44:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:26 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f40d829-de74-450d-a1f3-54bd85620f02]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:26 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)
Nov 14 23:44:26 user nova-compute[75341]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 (non-flash)
Nov 14 23:44:26 user nova-compute[75341]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)
Nov 14 23:44:26 user nova-compute[75341]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 (non-flash)
Nov 14 23:44:26 user nova-compute[75341]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a (non-flash)
Nov 14 23:44:26 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:44:26 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)
Nov 14 23:44:26 user nova-compute[75341]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 (non-flash)
Nov 14 23:44:26 user nova-compute[75341]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)
Nov 14 23:44:26 user nova-compute[75341]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 (non-flash)
Nov 14 23:44:26 user nova-compute[75341]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a (non-flash)
Nov 14 23:44:26 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:44:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 -p 172.16.0.220:3260 --login {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:26 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2c68c1-10f4-4f14-8a19-7295b4429c3e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:26 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912, portal: 172.16.0.220,3260]
Nov 14 23:44:26 user nova-compute[75341]: Login to [iface: default, target: iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912, portal: 172.16.0.220,3260] successful.
Nov 14 23:44:26 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:44:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:26 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34bd2f1-4a0a-4d96-a261-8826209ce2fa]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:26 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:44:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:26 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[92eb56ca-d05c-414c-918a-cca0fbdbe41e]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:26 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)
Nov 14 23:44:26 user nova-compute[75341]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 (non-flash)
Nov 14 23:44:26 user nova-compute[75341]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)
Nov 14 23:44:26 user nova-compute[75341]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 (non-flash)
Nov 14 23:44:26 user nova-compute[75341]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a (non-flash)
Nov 14 23:44:26 user nova-compute[75341]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 (non-flash)
Nov 14 23:44:26 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:44:26 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)
Nov 14 23:44:26 user nova-compute[75341]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 (non-flash)
Nov 14 23:44:26 user nova-compute[75341]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)
Nov 14 23:44:26 user nova-compute[75341]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 (non-flash)
Nov 14 23:44:26 user nova-compute[75341]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a (non-flash)
Nov 14 23:44:26 user nova-compute[75341]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 (non-flash)
Nov 14 23:44:26 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:44:26 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:44:26 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Connected to 172.16.0.220:3260 {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 23:44:26 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] HCTL ('38', '-', '-', 0) found on session 23 with lun 0 {{(pid=75341) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 23:44:26 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75341) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 23:44:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:26 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b74ca3a-f5b4-4bb3-ab9a-57d45ddd087d]: (4, ('- - 0', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:26 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Searching for a device in session 23 and hctl ['38', '*', '*', 0] yield: None {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Searching for a device in session 23 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RNtFXsiP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '26538666435653236', 'path': '/dev/sdg'} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26538666435653236', 'path': '/dev/sdg'} {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T23:44:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1597759010',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1597759010',id=16,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGnRmDUcLksc+OQYrjq9UG1KiJjjVMGQYkKKfVFXltSoFebOxmwKjrBwKmhCWBLgc7pjoNkrWhgcNR0z6ZvOVHzUrRBlskAqkoIwov2bgQawttj1nxc2fiDvWmCs0aFTzg==',key_name='tempest-keypair-633489156',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c40c4897cbbd4ac8b3192eb149adcb41',ramdisk_id='',reservation_id='r-rsnxw87s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1944630985',owner_user_name='tempest-TaggedBootDevicesTest_v242-1944630985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:44:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfcd7dc4048345cca7a8facabde9e209',uuid=dbc9a6db-b536-426a-91fd-691a44c66528,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ad25d31-80fa-41ba-8a1c-73f01ac1c832", "address": "fa:16:3e:70:63:49", "network": {"id": "304d198c-016a-470b-9504-145a5823966a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2033085667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad25d31-80", "ovs_interfaceid": "1ad25d31-80fa-41ba-8a1c-73f01ac1c832", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Converting VIF {"id": "1ad25d31-80fa-41ba-8a1c-73f01ac1c832", "address": "fa:16:3e:70:63:49", "network": {"id": "304d198c-016a-470b-9504-145a5823966a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2033085667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad25d31-80", "ovs_interfaceid": "1ad25d31-80fa-41ba-8a1c-73f01ac1c832", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:63:49,bridge_name='br-int',has_traffic_filtering=True,id=1ad25d31-80fa-41ba-8a1c-73f01ac1c832,network=Network(304d198c-016a-470b-9504-145a5823966a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ad25d31-80') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T23:44:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1597759010',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1597759010',id=16,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGnRmDUcLksc+OQYrjq9UG1KiJjjVMGQYkKKfVFXltSoFebOxmwKjrBwKmhCWBLgc7pjoNkrWhgcNR0z6ZvOVHzUrRBlskAqkoIwov2bgQawttj1nxc2fiDvWmCs0aFTzg==',key_name='tempest-keypair-633489156',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c40c4897cbbd4ac8b3192eb149adcb41',ramdisk_id='',reservation_id='r-rsnxw87s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1944630985',owner_user_name='tempest-TaggedBootDevicesTest_v242-1944630985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:44:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfcd7dc4048345cca7a8facabde9e209',uuid=dbc9a6db-b536-426a-91fd-691a44c66528,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b7251c7-1a54-46d9-9a9b-4103a659502c", "address": "fa:16:3e:b4:1d:7d", "network": {"id": "66be3b1a-ec5a-4c25-86fb-8350b80ce72d", "bridge": "br-int", "label": "tempest-device-tagging-net1-719453354", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b7251c7-1a", "ovs_interfaceid": "7b7251c7-1a54-46d9-9a9b-4103a659502c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Converting VIF {"id": "7b7251c7-1a54-46d9-9a9b-4103a659502c", "address": "fa:16:3e:b4:1d:7d", "network": {"id": "66be3b1a-ec5a-4c25-86fb-8350b80ce72d", "bridge": "br-int", "label": "tempest-device-tagging-net1-719453354", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b7251c7-1a", "ovs_interfaceid": "7b7251c7-1a54-46d9-9a9b-4103a659502c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:1d:7d,bridge_name='br-int',has_traffic_filtering=True,id=7b7251c7-1a54-46d9-9a9b-4103a659502c,network=Network(66be3b1a-ec5a-4c25-86fb-8350b80ce72d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7b7251c7-1a') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T23:44:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1597759010',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1597759010',id=16,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGnRmDUcLksc+OQYrjq9UG1KiJjjVMGQYkKKfVFXltSoFebOxmwKjrBwKmhCWBLgc7pjoNkrWhgcNR0z6ZvOVHzUrRBlskAqkoIwov2bgQawttj1nxc2fiDvWmCs0aFTzg==',key_name='tempest-keypair-633489156',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c40c4897cbbd4ac8b3192eb149adcb41',ramdisk_id='',reservation_id='r-rsnxw87s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1944630985',owner_user_name='tempest-TaggedBootDevicesTest_v242-1944630985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:44:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfcd7dc4048345cca7a8facabde9e209',uuid=dbc9a6db-b536-426a-91fd-691a44c66528,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f140fc0-2078-47c4-985f-28a4ee8b2824", "address": "fa:16:3e:c6:94:07", "network": {"id": "66be3b1a-ec5a-4c25-86fb-8350b80ce72d", "bridge": "br-int", "label": "tempest-device-tagging-net1-719453354", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f140fc0-20", "ovs_interfaceid": "0f140fc0-2078-47c4-985f-28a4ee8b2824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Converting VIF {"id": "0f140fc0-2078-47c4-985f-28a4ee8b2824", "address": "fa:16:3e:c6:94:07", "network": {"id": "66be3b1a-ec5a-4c25-86fb-8350b80ce72d", "bridge": "br-int", "label": "tempest-device-tagging-net1-719453354", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f140fc0-20", "ovs_interfaceid": "0f140fc0-2078-47c4-985f-28a4ee8b2824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:94:07,bridge_name='br-int',has_traffic_filtering=True,id=0f140fc0-2078-47c4-985f-28a4ee8b2824,network=Network(66be3b1a-ec5a-4c25-86fb-8350b80ce72d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0f140fc0-20') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T23:44:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1597759010',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1597759010',id=16,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGnRmDUcLksc+OQYrjq9UG1KiJjjVMGQYkKKfVFXltSoFebOxmwKjrBwKmhCWBLgc7pjoNkrWhgcNR0z6ZvOVHzUrRBlskAqkoIwov2bgQawttj1nxc2fiDvWmCs0aFTzg==',key_name='tempest-keypair-633489156',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c40c4897cbbd4ac8b3192eb149adcb41',ramdisk_id='',reservation_id='r-rsnxw87s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1944630985',owner_user_name='tempest-TaggedBootDevicesTest_v242-1944630985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:44:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfcd7dc4048345cca7a8facabde9e209',uuid=dbc9a6db-b536-426a-91fd-691a44c66528,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4b96195-ecba-4530-aa46-47e368eb294d", "address": "fa:16:3e:c1:9e:73", "network": {"id": "66be3b1a-ec5a-4c25-86fb-8350b80ce72d", "bridge": "br-int", "label": "tempest-device-tagging-net1-719453354", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4b96195-ec", "ovs_interfaceid": "f4b96195-ecba-4530-aa46-47e368eb294d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Converting VIF {"id": "f4b96195-ecba-4530-aa46-47e368eb294d", "address": "fa:16:3e:c1:9e:73", "network": {"id": "66be3b1a-ec5a-4c25-86fb-8350b80ce72d", "bridge": "br-int", "label": "tempest-device-tagging-net1-719453354", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4b96195-ec", "ovs_interfaceid": "f4b96195-ecba-4530-aa46-47e368eb294d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:9e:73,bridge_name='br-int',has_traffic_filtering=True,id=f4b96195-ecba-4530-aa46-47e368eb294d,network=Network(66be3b1a-ec5a-4c25-86fb-8350b80ce72d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4b96195-ec') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T23:44:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1597759010',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1597759010',id=16,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGnRmDUcLksc+OQYrjq9UG1KiJjjVMGQYkKKfVFXltSoFebOxmwKjrBwKmhCWBLgc7pjoNkrWhgcNR0z6ZvOVHzUrRBlskAqkoIwov2bgQawttj1nxc2fiDvWmCs0aFTzg==',key_name='tempest-keypair-633489156',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c40c4897cbbd4ac8b3192eb149adcb41',ramdisk_id='',reservation_id='r-rsnxw87s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1944630985',owner_user_name='tempest-TaggedBootDevicesTest_v242-1944630985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:44:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfcd7dc4048345cca7a8facabde9e209',uuid=dbc9a6db-b536-426a-91fd-691a44c66528,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "52e41618-df29-407f-8843-3e1c55fb2a18", "address": "fa:16:3e:f9:73:7b", "network": {"id": "66be3b1a-ec5a-4c25-86fb-8350b80ce72d", "bridge": "br-int", "label": "tempest-device-tagging-net1-719453354", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e41618-df", "ovs_interfaceid": "52e41618-df29-407f-8843-3e1c55fb2a18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Converting VIF {"id": "52e41618-df29-407f-8843-3e1c55fb2a18", "address": "fa:16:3e:f9:73:7b", "network": {"id": "66be3b1a-ec5a-4c25-86fb-8350b80ce72d", "bridge": "br-int", "label": "tempest-device-tagging-net1-719453354", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e41618-df", "ovs_interfaceid": "52e41618-df29-407f-8843-3e1c55fb2a18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:73:7b,bridge_name='br-int',has_traffic_filtering=True,id=52e41618-df29-407f-8843-3e1c55fb2a18,network=Network(66be3b1a-ec5a-4c25-86fb-8350b80ce72d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52e41618-df') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T23:44:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1597759010',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1597759010',id=16,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGnRmDUcLksc+OQYrjq9UG1KiJjjVMGQYkKKfVFXltSoFebOxmwKjrBwKmhCWBLgc7pjoNkrWhgcNR0z6ZvOVHzUrRBlskAqkoIwov2bgQawttj1nxc2fiDvWmCs0aFTzg==',key_name='tempest-keypair-633489156',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c40c4897cbbd4ac8b3192eb149adcb41',ramdisk_id='',reservation_id='r-rsnxw87s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1944630985',owner_user_name='tempest-TaggedBootDevicesTest_v242-1944630985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:44:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfcd7dc4048345cca7a8facabde9e209',uuid=dbc9a6db-b536-426a-91fd-691a44c66528,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6368ff99-db9d-4a3e-b940-afc0300d7aa0", "address": "fa:16:3e:8a:4f:bb", "network": {"id": "21622931-8859-4310-85b4-e6c88ea4fd26", "bridge": "br-int", "label": "tempest-device-tagging-net2-1204896773", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6368ff99-db", "ovs_interfaceid": "6368ff99-db9d-4a3e-b940-afc0300d7aa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Converting VIF {"id": "6368ff99-db9d-4a3e-b940-afc0300d7aa0", "address": "fa:16:3e:8a:4f:bb", "network": {"id": "21622931-8859-4310-85b4-e6c88ea4fd26", "bridge": "br-int", "label": "tempest-device-tagging-net2-1204896773", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6368ff99-db", "ovs_interfaceid": "6368ff99-db9d-4a3e-b940-afc0300d7aa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:4f:bb,bridge_name='br-int',has_traffic_filtering=True,id=6368ff99-db9d-4a3e-b940-afc0300d7aa0,network=Network(21622931-8859-4310-85b4-e6c88ea4fd26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6368ff99-db') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T23:44:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1597759010',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1597759010',id=16,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGnRmDUcLksc+OQYrjq9UG1KiJjjVMGQYkKKfVFXltSoFebOxmwKjrBwKmhCWBLgc7pjoNkrWhgcNR0z6ZvOVHzUrRBlskAqkoIwov2bgQawttj1nxc2fiDvWmCs0aFTzg==',key_name='tempest-keypair-633489156',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c40c4897cbbd4ac8b3192eb149adcb41',ramdisk_id='',reservation_id='r-rsnxw87s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1944630985',owner_user_name='tempest-TaggedBootDevicesTest_v242-1944630985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:44:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfcd7dc4048345cca7a8facabde9e209',uuid=dbc9a6db-b536-426a-91fd-691a44c66528,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f71d722-661a-44d6-81fa-cd588c0d6f4b", "address": "fa:16:3e:fe:bb:e6", "network": {"id": "21622931-8859-4310-85b4-e6c88ea4fd26", "bridge": "br-int", "label": "tempest-device-tagging-net2-1204896773", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f71d722-66", "ovs_interfaceid": "4f71d722-661a-44d6-81fa-cd588c0d6f4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Converting VIF {"id": "4f71d722-661a-44d6-81fa-cd588c0d6f4b", "address": "fa:16:3e:fe:bb:e6", "network": {"id": "21622931-8859-4310-85b4-e6c88ea4fd26", "bridge": "br-int", "label": "tempest-device-tagging-net2-1204896773", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f71d722-66", "ovs_interfaceid": "4f71d722-661a-44d6-81fa-cd588c0d6f4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:bb:e6,bridge_name='br-int',has_traffic_filtering=True,id=4f71d722-661a-44d6-81fa-cd588c0d6f4b,network=Network(21622931-8859-4310-85b4-e6c88ea4fd26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f71d722-66') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG nova.objects.instance [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Lazy-loading 'pci_devices' on Instance uuid dbc9a6db-b536-426a-91fd-691a44c66528 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] End _get_guest_xml xml=<domain type="kvm">
Nov 14 23:44:27 user nova-compute[75341]:   <uuid>dbc9a6db-b536-426a-91fd-691a44c66528</uuid>
Nov 14 23:44:27 user nova-compute[75341]:   <name>instance-00000010</name>
Nov 14 23:44:27 user nova-compute[75341]:   <memory>524288</memory>
Nov 14 23:44:27 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 14 23:44:27 user nova-compute[75341]:   <metadata>
Nov 14 23:44:27 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 23:44:27 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 14 23:44:27 user nova-compute[75341]:       <nova:name>tempest-device-tagging-server-1597759010</nova:name>
Nov 14 23:44:27 user nova-compute[75341]:       <nova:creationTime>2023-11-14 23:44:23</nova:creationTime>
Nov 14 23:44:27 user nova-compute[75341]:       <nova:flavor name="m1.tiny">
Nov 14 23:44:27 user nova-compute[75341]:         <nova:memory>512</nova:memory>
Nov 14 23:44:27 user nova-compute[75341]:         <nova:disk>1</nova:disk>
Nov 14 23:44:27 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 14 23:44:27 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 23:44:27 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 14 23:44:27 user nova-compute[75341]:       </nova:flavor>
Nov 14 23:44:27 user nova-compute[75341]:       <nova:owner>
Nov 14 23:44:27 user nova-compute[75341]:         <nova:user uuid="cfcd7dc4048345cca7a8facabde9e209">tempest-TaggedBootDevicesTest_v242-1944630985-project-member</nova:user>
Nov 14 23:44:27 user nova-compute[75341]:         <nova:project uuid="c40c4897cbbd4ac8b3192eb149adcb41">tempest-TaggedBootDevicesTest_v242-1944630985</nova:project>
Nov 14 23:44:27 user nova-compute[75341]:       </nova:owner>
Nov 14 23:44:27 user nova-compute[75341]:       <nova:root type="image" uuid="e46abb82-b810-490e-a8a1-ccdc5fa1a796"/>
Nov 14 23:44:27 user nova-compute[75341]:       <nova:ports>
Nov 14 23:44:27 user nova-compute[75341]:         <nova:port uuid="1ad25d31-80fa-41ba-8a1c-73f01ac1c832">
Nov 14 23:44:27 user nova-compute[75341]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 23:44:27 user nova-compute[75341]:         </nova:port>
Nov 14 23:44:27 user nova-compute[75341]:         <nova:port uuid="7b7251c7-1a54-46d9-9a9b-4103a659502c">
Nov 14 23:44:27 user nova-compute[75341]:           <nova:ip type="fixed" address="10.1.1.130" ipVersion="4"/>
Nov 14 23:44:27 user nova-compute[75341]:         </nova:port>
Nov 14 23:44:27 user nova-compute[75341]:         <nova:port uuid="0f140fc0-2078-47c4-985f-28a4ee8b2824">
Nov 14 23:44:27 user nova-compute[75341]:           <nova:ip type="fixed" address="10.1.1.177" ipVersion="4"/>
Nov 14 23:44:27 user nova-compute[75341]:         </nova:port>
Nov 14 23:44:27 user nova-compute[75341]:         <nova:port uuid="f4b96195-ecba-4530-aa46-47e368eb294d">
Nov 14 23:44:27 user nova-compute[75341]:           <nova:ip type="fixed" address="10.1.1.252" ipVersion="4"/>
Nov 14 23:44:27 user nova-compute[75341]:         </nova:port>
Nov 14 23:44:27 user nova-compute[75341]:         <nova:port uuid="52e41618-df29-407f-8843-3e1c55fb2a18">
Nov 14 23:44:27 user nova-compute[75341]:           <nova:ip type="fixed" address="10.1.1.145" ipVersion="4"/>
Nov 14 23:44:27 user nova-compute[75341]:         </nova:port>
Nov 14 23:44:27 user nova-compute[75341]:         <nova:port uuid="6368ff99-db9d-4a3e-b940-afc0300d7aa0">
Nov 14 23:44:27 user nova-compute[75341]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 14 23:44:27 user nova-compute[75341]:         </nova:port>
Nov 14 23:44:27 user nova-compute[75341]:         <nova:port uuid="4f71d722-661a-44d6-81fa-cd588c0d6f4b">
Nov 14 23:44:27 user nova-compute[75341]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 14 23:44:27 user nova-compute[75341]:         </nova:port>
Nov 14 23:44:27 user nova-compute[75341]:       </nova:ports>
Nov 14 23:44:27 user nova-compute[75341]:     </nova:instance>
Nov 14 23:44:27 user nova-compute[75341]:   </metadata>
Nov 14 23:44:27 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 14 23:44:27 user nova-compute[75341]:     <system>
Nov 14 23:44:27 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 23:44:27 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 14 23:44:27 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 14 23:44:27 user nova-compute[75341]:       <entry name="serial">dbc9a6db-b536-426a-91fd-691a44c66528</entry>
Nov 14 23:44:27 user nova-compute[75341]:       <entry name="uuid">dbc9a6db-b536-426a-91fd-691a44c66528</entry>
Nov 14 23:44:27 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 14 23:44:27 user nova-compute[75341]:     </system>
Nov 14 23:44:27 user nova-compute[75341]:   </sysinfo>
Nov 14 23:44:27 user nova-compute[75341]:   <os>
Nov 14 23:44:27 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 23:44:27 user nova-compute[75341]:     <boot dev="hd"/>
Nov 14 23:44:27 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 14 23:44:27 user nova-compute[75341]:   </os>
Nov 14 23:44:27 user nova-compute[75341]:   <features>
Nov 14 23:44:27 user nova-compute[75341]:     <acpi/>
Nov 14 23:44:27 user nova-compute[75341]:     <apic/>
Nov 14 23:44:27 user nova-compute[75341]:     <vmcoreinfo/>
Nov 14 23:44:27 user nova-compute[75341]:   </features>
Nov 14 23:44:27 user nova-compute[75341]:   <clock offset="utc">
Nov 14 23:44:27 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 23:44:27 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 23:44:27 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 14 23:44:27 user nova-compute[75341]:   </clock>
Nov 14 23:44:27 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 14 23:44:27 user nova-compute[75341]:     <model>Nehalem</model>
Nov 14 23:44:27 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 23:44:27 user nova-compute[75341]:   </cpu>
Nov 14 23:44:27 user nova-compute[75341]:   <devices>
Nov 14 23:44:27 user nova-compute[75341]:     <disk type="file" device="cdrom">
Nov 14 23:44:27 user nova-compute[75341]:       <driver name="qemu" type="raw" cache="none"/>
Nov 14 23:44:27 user nova-compute[75341]:       <source file="/opt/stack/data/nova/instances/dbc9a6db-b536-426a-91fd-691a44c66528/disk.config"/>
Nov 14 23:44:27 user nova-compute[75341]:       <target dev="hda" bus="ide"/>
Nov 14 23:44:27 user nova-compute[75341]:     </disk>
Nov 14 23:44:27 user nova-compute[75341]:     <disk type="block" device="disk">
Nov 14 23:44:27 user nova-compute[75341]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:44:27 user nova-compute[75341]:       <source dev="/dev/sdb"/>
Nov 14 23:44:27 user nova-compute[75341]:       <target dev="vda" bus="virtio"/>
Nov 14 23:44:27 user nova-compute[75341]:       <serial>98ea7106-6e3b-4aa5-9d18-051e15cc3ac7</serial>
Nov 14 23:44:27 user nova-compute[75341]:     </disk>
Nov 14 23:44:27 user nova-compute[75341]:     <disk type="block" device="disk">
Nov 14 23:44:27 user nova-compute[75341]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:44:27 user nova-compute[75341]:       <source dev="/dev/sdf"/>
Nov 14 23:44:27 user nova-compute[75341]:       <target dev="vdb" bus="virtio"/>
Nov 14 23:44:27 user nova-compute[75341]:       <serial>042bfbcb-fb28-4378-9754-8ecf4641438a</serial>
Nov 14 23:44:27 user nova-compute[75341]:     </disk>
Nov 14 23:44:27 user nova-compute[75341]:     <disk type="block" device="disk">
Nov 14 23:44:27 user nova-compute[75341]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:44:27 user nova-compute[75341]:       <source dev="/dev/sdg"/>
Nov 14 23:44:27 user nova-compute[75341]:       <target dev="vdc" bus="virtio"/>
Nov 14 23:44:27 user nova-compute[75341]:       <serial>3762dcbb-d796-4b60-a654-ae1973ad2912</serial>
Nov 14 23:44:27 user nova-compute[75341]:     </disk>
Nov 14 23:44:27 user nova-compute[75341]:     <interface type="ethernet">
Nov 14 23:44:27 user nova-compute[75341]:       <mac address="fa:16:3e:70:63:49"/>
Nov 14 23:44:27 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:44:27 user nova-compute[75341]:       <mtu size="1442"/>
Nov 14 23:44:27 user nova-compute[75341]:       <target dev="tap1ad25d31-80"/>
Nov 14 23:44:27 user nova-compute[75341]:     </interface>
Nov 14 23:44:27 user nova-compute[75341]:     <interface type="ethernet">
Nov 14 23:44:27 user nova-compute[75341]:       <mac address="fa:16:3e:b4:1d:7d"/>
Nov 14 23:44:27 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:44:27 user nova-compute[75341]:       <mtu size="1442"/>
Nov 14 23:44:27 user nova-compute[75341]:       <target dev="tap7b7251c7-1a"/>
Nov 14 23:44:27 user nova-compute[75341]:     </interface>
Nov 14 23:44:27 user nova-compute[75341]:     <interface type="ethernet">
Nov 14 23:44:27 user nova-compute[75341]:       <mac address="fa:16:3e:c6:94:07"/>
Nov 14 23:44:27 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:44:27 user nova-compute[75341]:       <mtu size="1442"/>
Nov 14 23:44:27 user nova-compute[75341]:       <target dev="tap0f140fc0-20"/>
Nov 14 23:44:27 user nova-compute[75341]:     </interface>
Nov 14 23:44:27 user nova-compute[75341]:     <interface type="ethernet">
Nov 14 23:44:27 user nova-compute[75341]:       <mac address="fa:16:3e:c1:9e:73"/>
Nov 14 23:44:27 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:44:27 user nova-compute[75341]:       <mtu size="1442"/>
Nov 14 23:44:27 user nova-compute[75341]:       <target dev="tapf4b96195-ec"/>
Nov 14 23:44:27 user nova-compute[75341]:     </interface>
Nov 14 23:44:27 user nova-compute[75341]:     <interface type="ethernet">
Nov 14 23:44:27 user nova-compute[75341]:       <mac address="fa:16:3e:f9:73:7b"/>
Nov 14 23:44:27 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:44:27 user nova-compute[75341]:       <mtu size="1442"/>
Nov 14 23:44:27 user nova-compute[75341]:       <target dev="tap52e41618-df"/>
Nov 14 23:44:27 user nova-compute[75341]:     </interface>
Nov 14 23:44:27 user nova-compute[75341]:     <interface type="ethernet">
Nov 14 23:44:27 user nova-compute[75341]:       <mac address="fa:16:3e:8a:4f:bb"/>
Nov 14 23:44:27 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:44:27 user nova-compute[75341]:       <mtu size="1442"/>
Nov 14 23:44:27 user nova-compute[75341]:       <target dev="tap6368ff99-db"/>
Nov 14 23:44:27 user nova-compute[75341]:     </interface>
Nov 14 23:44:27 user nova-compute[75341]:     <interface type="ethernet">
Nov 14 23:44:27 user nova-compute[75341]:       <mac address="fa:16:3e:fe:bb:e6"/>
Nov 14 23:44:27 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:44:27 user nova-compute[75341]:       <mtu size="1442"/>
Nov 14 23:44:27 user nova-compute[75341]:       <target dev="tap4f71d722-66"/>
Nov 14 23:44:27 user nova-compute[75341]:     </interface>
Nov 14 23:44:27 user nova-compute[75341]:     <serial type="pty">
Nov 14 23:44:27 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/dbc9a6db-b536-426a-91fd-691a44c66528/console.log" append="off"/>
Nov 14 23:44:27 user nova-compute[75341]:     </serial>
Nov 14 23:44:27 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 23:44:27 user nova-compute[75341]:     <video>
Nov 14 23:44:27 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:44:27 user nova-compute[75341]:     </video>
Nov 14 23:44:27 user nova-compute[75341]:     <rng model="virtio">
Nov 14 23:44:27 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 14 23:44:27 user nova-compute[75341]:     </rng>
Nov 14 23:44:27 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 14 23:44:27 user nova-compute[75341]:     <memballoon model="virtio">
Nov 14 23:44:27 user nova-compute[75341]:       <stats period="10"/>
Nov 14 23:44:27 user nova-compute[75341]:     </memballoon>
Nov 14 23:44:27 user nova-compute[75341]:   </devices>
Nov 14 23:44:27 user nova-compute[75341]: </domain>
Nov 14 23:44:27 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T23:44:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1597759010',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1597759010',id=16,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGnRmDUcLksc+OQYrjq9UG1KiJjjVMGQYkKKfVFXltSoFebOxmwKjrBwKmhCWBLgc7pjoNkrWhgcNR0z6ZvOVHzUrRBlskAqkoIwov2bgQawttj1nxc2fiDvWmCs0aFTzg==',key_name='tempest-keypair-633489156',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c40c4897cbbd4ac8b3192eb149adcb41',ramdisk_id='',reservation_id='r-rsnxw87s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1944630985',owner_user_name='tempest-TaggedBootDevicesTest_v242-1944630985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:44:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfcd7dc4048345cca7a8facabde9e209',uuid=dbc9a6db-b536-426a-91fd-691a44c66528,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ad25d31-80fa-41ba-8a1c-73f01ac1c832", "address": "fa:16:3e:70:63:49", "network": {"id": "304d198c-016a-470b-9504-145a5823966a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2033085667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad25d31-80", "ovs_interfaceid": "1ad25d31-80fa-41ba-8a1c-73f01ac1c832", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Converting VIF {"id": "1ad25d31-80fa-41ba-8a1c-73f01ac1c832", "address": "fa:16:3e:70:63:49", "network": {"id": "304d198c-016a-470b-9504-145a5823966a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2033085667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad25d31-80", "ovs_interfaceid": "1ad25d31-80fa-41ba-8a1c-73f01ac1c832", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:63:49,bridge_name='br-int',has_traffic_filtering=True,id=1ad25d31-80fa-41ba-8a1c-73f01ac1c832,network=Network(304d198c-016a-470b-9504-145a5823966a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ad25d31-80') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG os_vif [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:63:49,bridge_name='br-int',has_traffic_filtering=True,id=1ad25d31-80fa-41ba-8a1c-73f01ac1c832,network=Network(304d198c-016a-470b-9504-145a5823966a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ad25d31-80') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '857966d2-6b4e-590c-a9b1-a59a399680a4', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1ad25d31-80, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1ad25d31-80, col_values=(('qos', UUID('f90e0909-54a6-4b6c-8641-9c2d5bb661b5')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1ad25d31-80, col_values=(('external_ids', {'iface-id': '1ad25d31-80fa-41ba-8a1c-73f01ac1c832', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:63:49', 'vm-uuid': 'dbc9a6db-b536-426a-91fd-691a44c66528'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG nova.compute.manager [req-cfab6932-5ac6-495a-8e03-e65fd115f3ec req-2ff8b55e-336a-4b18-a1ca-4d89e4533bf4 service nova] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Received event network-vif-plugged-64ebe5e6-0c81-41fd-b49e-75bed11e40df {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-cfab6932-5ac6-495a-8e03-e65fd115f3ec req-2ff8b55e-336a-4b18-a1ca-4d89e4533bf4 service nova] Acquiring lock "51045050-c7c6-49c5-acd4-2a76be0f466f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-cfab6932-5ac6-495a-8e03-e65fd115f3ec req-2ff8b55e-336a-4b18-a1ca-4d89e4533bf4 service nova] Lock "51045050-c7c6-49c5-acd4-2a76be0f466f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-cfab6932-5ac6-495a-8e03-e65fd115f3ec req-2ff8b55e-336a-4b18-a1ca-4d89e4533bf4 service nova] Lock "51045050-c7c6-49c5-acd4-2a76be0f466f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG nova.compute.manager [req-cfab6932-5ac6-495a-8e03-e65fd115f3ec req-2ff8b55e-336a-4b18-a1ca-4d89e4533bf4 service nova] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] No waiting events found dispatching network-vif-plugged-64ebe5e6-0c81-41fd-b49e-75bed11e40df {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:44:27 user nova-compute[75341]: WARNING nova.compute.manager [req-cfab6932-5ac6-495a-8e03-e65fd115f3ec req-2ff8b55e-336a-4b18-a1ca-4d89e4533bf4 service nova] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Received unexpected event network-vif-plugged-64ebe5e6-0c81-41fd-b49e-75bed11e40df for instance with vm_state building and task_state spawning.
Nov 14 23:44:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:27 user nova-compute[75341]: INFO os_vif [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:63:49,bridge_name='br-int',has_traffic_filtering=True,id=1ad25d31-80fa-41ba-8a1c-73f01ac1c832,network=Network(304d198c-016a-470b-9504-145a5823966a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ad25d31-80')
Nov 14 23:44:27 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T23:44:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1597759010',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1597759010',id=16,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGnRmDUcLksc+OQYrjq9UG1KiJjjVMGQYkKKfVFXltSoFebOxmwKjrBwKmhCWBLgc7pjoNkrWhgcNR0z6ZvOVHzUrRBlskAqkoIwov2bgQawttj1nxc2fiDvWmCs0aFTzg==',key_name='tempest-keypair-633489156',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c40c4897cbbd4ac8b3192eb149adcb41',ramdisk_id='',reservation_id='r-rsnxw87s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1944630985',owner_user_name='tempest-TaggedBootDevicesTest_v242-1944630985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:44:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfcd7dc4048345cca7a8facabde9e209',uuid=dbc9a6db-b536-426a-91fd-691a44c66528,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b7251c7-1a54-46d9-9a9b-4103a659502c", "address": "fa:16:3e:b4:1d:7d", "network": {"id": "66be3b1a-ec5a-4c25-86fb-8350b80ce72d", "bridge": "br-int", "label": "tempest-device-tagging-net1-719453354", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b7251c7-1a", "ovs_interfaceid": "7b7251c7-1a54-46d9-9a9b-4103a659502c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Converting VIF {"id": "7b7251c7-1a54-46d9-9a9b-4103a659502c", "address": "fa:16:3e:b4:1d:7d", "network": {"id": "66be3b1a-ec5a-4c25-86fb-8350b80ce72d", "bridge": "br-int", "label": "tempest-device-tagging-net1-719453354", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b7251c7-1a", "ovs_interfaceid": "7b7251c7-1a54-46d9-9a9b-4103a659502c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:1d:7d,bridge_name='br-int',has_traffic_filtering=True,id=7b7251c7-1a54-46d9-9a9b-4103a659502c,network=Network(66be3b1a-ec5a-4c25-86fb-8350b80ce72d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7b7251c7-1a') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG os_vif [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:1d:7d,bridge_name='br-int',has_traffic_filtering=True,id=7b7251c7-1a54-46d9-9a9b-4103a659502c,network=Network(66be3b1a-ec5a-4c25-86fb-8350b80ce72d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7b7251c7-1a') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2fb38eb2-2ef0-5564-a6b3-b5779ca0352e', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7b7251c7-1a, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7b7251c7-1a, col_values=(('qos', UUID('7720bd12-ea76-4464-b2fa-69dde93ebc24')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7b7251c7-1a, col_values=(('external_ids', {'iface-id': '7b7251c7-1a54-46d9-9a9b-4103a659502c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:1d:7d', 'vm-uuid': 'dbc9a6db-b536-426a-91fd-691a44c66528'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:27 user nova-compute[75341]: INFO os_vif [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:1d:7d,bridge_name='br-int',has_traffic_filtering=True,id=7b7251c7-1a54-46d9-9a9b-4103a659502c,network=Network(66be3b1a-ec5a-4c25-86fb-8350b80ce72d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7b7251c7-1a')
Nov 14 23:44:27 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T23:44:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1597759010',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1597759010',id=16,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGnRmDUcLksc+OQYrjq9UG1KiJjjVMGQYkKKfVFXltSoFebOxmwKjrBwKmhCWBLgc7pjoNkrWhgcNR0z6ZvOVHzUrRBlskAqkoIwov2bgQawttj1nxc2fiDvWmCs0aFTzg==',key_name='tempest-keypair-633489156',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c40c4897cbbd4ac8b3192eb149adcb41',ramdisk_id='',reservation_id='r-rsnxw87s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1944630985',owner_user_name='tempest-TaggedBootDevicesTest_v242-1944630985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:44:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfcd7dc4048345cca7a8facabde9e209',uuid=dbc9a6db-b536-426a-91fd-691a44c66528,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f140fc0-2078-47c4-985f-28a4ee8b2824", "address": "fa:16:3e:c6:94:07", "network": {"id": "66be3b1a-ec5a-4c25-86fb-8350b80ce72d", "bridge": "br-int", "label": "tempest-device-tagging-net1-719453354", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f140fc0-20", "ovs_interfaceid": "0f140fc0-2078-47c4-985f-28a4ee8b2824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Converting VIF {"id": "0f140fc0-2078-47c4-985f-28a4ee8b2824", "address": "fa:16:3e:c6:94:07", "network": {"id": "66be3b1a-ec5a-4c25-86fb-8350b80ce72d", "bridge": "br-int", "label": "tempest-device-tagging-net1-719453354", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f140fc0-20", "ovs_interfaceid": "0f140fc0-2078-47c4-985f-28a4ee8b2824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:94:07,bridge_name='br-int',has_traffic_filtering=True,id=0f140fc0-2078-47c4-985f-28a4ee8b2824,network=Network(66be3b1a-ec5a-4c25-86fb-8350b80ce72d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0f140fc0-20') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG os_vif [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:94:07,bridge_name='br-int',has_traffic_filtering=True,id=0f140fc0-2078-47c4-985f-28a4ee8b2824,network=Network(66be3b1a-ec5a-4c25-86fb-8350b80ce72d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0f140fc0-20') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '76e5033d-c53d-5483-a999-d771b5a0e17b', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0f140fc0-20, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0f140fc0-20, col_values=(('qos', UUID('a91ab0f0-42cf-489f-a000-75f7b790be98')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0f140fc0-20, col_values=(('external_ids', {'iface-id': '0f140fc0-2078-47c4-985f-28a4ee8b2824', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:94:07', 'vm-uuid': 'dbc9a6db-b536-426a-91fd-691a44c66528'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:27 user nova-compute[75341]: INFO os_vif [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:94:07,bridge_name='br-int',has_traffic_filtering=True,id=0f140fc0-2078-47c4-985f-28a4ee8b2824,network=Network(66be3b1a-ec5a-4c25-86fb-8350b80ce72d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0f140fc0-20')
Nov 14 23:44:27 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T23:44:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1597759010',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1597759010',id=16,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGnRmDUcLksc+OQYrjq9UG1KiJjjVMGQYkKKfVFXltSoFebOxmwKjrBwKmhCWBLgc7pjoNkrWhgcNR0z6ZvOVHzUrRBlskAqkoIwov2bgQawttj1nxc2fiDvWmCs0aFTzg==',key_name='tempest-keypair-633489156',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c40c4897cbbd4ac8b3192eb149adcb41',ramdisk_id='',reservation_id='r-rsnxw87s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1944630985',owner_user_name='tempest-TaggedBootDevicesTest_v242-1944630985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:44:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfcd7dc4048345cca7a8facabde9e209',uuid=dbc9a6db-b536-426a-91fd-691a44c66528,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4b96195-ecba-4530-aa46-47e368eb294d", "address": "fa:16:3e:c1:9e:73", "network": {"id": "66be3b1a-ec5a-4c25-86fb-8350b80ce72d", "bridge": "br-int", "label": "tempest-device-tagging-net1-719453354", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4b96195-ec", "ovs_interfaceid": "f4b96195-ecba-4530-aa46-47e368eb294d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Converting VIF {"id": "f4b96195-ecba-4530-aa46-47e368eb294d", "address": "fa:16:3e:c1:9e:73", "network": {"id": "66be3b1a-ec5a-4c25-86fb-8350b80ce72d", "bridge": "br-int", "label": "tempest-device-tagging-net1-719453354", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4b96195-ec", "ovs_interfaceid": "f4b96195-ecba-4530-aa46-47e368eb294d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:9e:73,bridge_name='br-int',has_traffic_filtering=True,id=f4b96195-ecba-4530-aa46-47e368eb294d,network=Network(66be3b1a-ec5a-4c25-86fb-8350b80ce72d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4b96195-ec') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG os_vif [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:9e:73,bridge_name='br-int',has_traffic_filtering=True,id=f4b96195-ecba-4530-aa46-47e368eb294d,network=Network(66be3b1a-ec5a-4c25-86fb-8350b80ce72d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4b96195-ec') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5d18acf7-839a-57ad-8df2-afc92ae4ff86', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:44:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4b96195-ec, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf4b96195-ec, col_values=(('qos', UUID('a0c8ba5d-8bcd-4835-a770-99187cbef13d')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf4b96195-ec, col_values=(('external_ids', {'iface-id': 'f4b96195-ecba-4530-aa46-47e368eb294d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:9e:73', 'vm-uuid': 'dbc9a6db-b536-426a-91fd-691a44c66528'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:28 user nova-compute[75341]: INFO os_vif [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:9e:73,bridge_name='br-int',has_traffic_filtering=True,id=f4b96195-ecba-4530-aa46-47e368eb294d,network=Network(66be3b1a-ec5a-4c25-86fb-8350b80ce72d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4b96195-ec')
Nov 14 23:44:28 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T23:44:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1597759010',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1597759010',id=16,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGnRmDUcLksc+OQYrjq9UG1KiJjjVMGQYkKKfVFXltSoFebOxmwKjrBwKmhCWBLgc7pjoNkrWhgcNR0z6ZvOVHzUrRBlskAqkoIwov2bgQawttj1nxc2fiDvWmCs0aFTzg==',key_name='tempest-keypair-633489156',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c40c4897cbbd4ac8b3192eb149adcb41',ramdisk_id='',reservation_id='r-rsnxw87s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1944630985',owner_user_name='tempest-TaggedBootDevicesTest_v242-1944630985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:44:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfcd7dc4048345cca7a8facabde9e209',uuid=dbc9a6db-b536-426a-91fd-691a44c66528,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "52e41618-df29-407f-8843-3e1c55fb2a18", "address": "fa:16:3e:f9:73:7b", "network": {"id": "66be3b1a-ec5a-4c25-86fb-8350b80ce72d", "bridge": "br-int", "label": "tempest-device-tagging-net1-719453354", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e41618-df", "ovs_interfaceid": "52e41618-df29-407f-8843-3e1c55fb2a18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Converting VIF {"id": "52e41618-df29-407f-8843-3e1c55fb2a18", "address": "fa:16:3e:f9:73:7b", "network": {"id": "66be3b1a-ec5a-4c25-86fb-8350b80ce72d", "bridge": "br-int", "label": "tempest-device-tagging-net1-719453354", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e41618-df", "ovs_interfaceid": "52e41618-df29-407f-8843-3e1c55fb2a18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:73:7b,bridge_name='br-int',has_traffic_filtering=True,id=52e41618-df29-407f-8843-3e1c55fb2a18,network=Network(66be3b1a-ec5a-4c25-86fb-8350b80ce72d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52e41618-df') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG os_vif [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:73:7b,bridge_name='br-int',has_traffic_filtering=True,id=52e41618-df29-407f-8843-3e1c55fb2a18,network=Network(66be3b1a-ec5a-4c25-86fb-8350b80ce72d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52e41618-df') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0f35c86d-fa86-5f21-9fe3-b351eeaa6d51', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap52e41618-df, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap52e41618-df, col_values=(('qos', UUID('7e08412c-2c5d-42f5-834e-2b38c41a40d5')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap52e41618-df, col_values=(('external_ids', {'iface-id': '52e41618-df29-407f-8843-3e1c55fb2a18', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:73:7b', 'vm-uuid': 'dbc9a6db-b536-426a-91fd-691a44c66528'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:28 user nova-compute[75341]: INFO os_vif [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:73:7b,bridge_name='br-int',has_traffic_filtering=True,id=52e41618-df29-407f-8843-3e1c55fb2a18,network=Network(66be3b1a-ec5a-4c25-86fb-8350b80ce72d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52e41618-df')
Nov 14 23:44:28 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T23:44:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1597759010',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1597759010',id=16,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGnRmDUcLksc+OQYrjq9UG1KiJjjVMGQYkKKfVFXltSoFebOxmwKjrBwKmhCWBLgc7pjoNkrWhgcNR0z6ZvOVHzUrRBlskAqkoIwov2bgQawttj1nxc2fiDvWmCs0aFTzg==',key_name='tempest-keypair-633489156',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c40c4897cbbd4ac8b3192eb149adcb41',ramdisk_id='',reservation_id='r-rsnxw87s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1944630985',owner_user_name='tempest-TaggedBootDevicesTest_v242-1944630985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:44:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfcd7dc4048345cca7a8facabde9e209',uuid=dbc9a6db-b536-426a-91fd-691a44c66528,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6368ff99-db9d-4a3e-b940-afc0300d7aa0", "address": "fa:16:3e:8a:4f:bb", "network": {"id": "21622931-8859-4310-85b4-e6c88ea4fd26", "bridge": "br-int", "label": "tempest-device-tagging-net2-1204896773", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6368ff99-db", "ovs_interfaceid": "6368ff99-db9d-4a3e-b940-afc0300d7aa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Converting VIF {"id": "6368ff99-db9d-4a3e-b940-afc0300d7aa0", "address": "fa:16:3e:8a:4f:bb", "network": {"id": "21622931-8859-4310-85b4-e6c88ea4fd26", "bridge": "br-int", "label": "tempest-device-tagging-net2-1204896773", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6368ff99-db", "ovs_interfaceid": "6368ff99-db9d-4a3e-b940-afc0300d7aa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:4f:bb,bridge_name='br-int',has_traffic_filtering=True,id=6368ff99-db9d-4a3e-b940-afc0300d7aa0,network=Network(21622931-8859-4310-85b4-e6c88ea4fd26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6368ff99-db') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG os_vif [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:4f:bb,bridge_name='br-int',has_traffic_filtering=True,id=6368ff99-db9d-4a3e-b940-afc0300d7aa0,network=Network(21622931-8859-4310-85b4-e6c88ea4fd26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6368ff99-db') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e0637efe-5907-5e79-a164-168b45f1d803', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6368ff99-db, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6368ff99-db, col_values=(('qos', UUID('32144cea-d791-4304-b6e7-ffe123a3ea4f')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6368ff99-db, col_values=(('external_ids', {'iface-id': '6368ff99-db9d-4a3e-b940-afc0300d7aa0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:4f:bb', 'vm-uuid': 'dbc9a6db-b536-426a-91fd-691a44c66528'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:28 user nova-compute[75341]: INFO os_vif [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:4f:bb,bridge_name='br-int',has_traffic_filtering=True,id=6368ff99-db9d-4a3e-b940-afc0300d7aa0,network=Network(21622931-8859-4310-85b4-e6c88ea4fd26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6368ff99-db')
Nov 14 23:44:28 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T23:44:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1597759010',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1597759010',id=16,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGnRmDUcLksc+OQYrjq9UG1KiJjjVMGQYkKKfVFXltSoFebOxmwKjrBwKmhCWBLgc7pjoNkrWhgcNR0z6ZvOVHzUrRBlskAqkoIwov2bgQawttj1nxc2fiDvWmCs0aFTzg==',key_name='tempest-keypair-633489156',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c40c4897cbbd4ac8b3192eb149adcb41',ramdisk_id='',reservation_id='r-rsnxw87s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1944630985',owner_user_name='tempest-TaggedBootDevicesTest_v242-1944630985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:44:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfcd7dc4048345cca7a8facabde9e209',uuid=dbc9a6db-b536-426a-91fd-691a44c66528,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f71d722-661a-44d6-81fa-cd588c0d6f4b", "address": "fa:16:3e:fe:bb:e6", "network": {"id": "21622931-8859-4310-85b4-e6c88ea4fd26", "bridge": "br-int", "label": "tempest-device-tagging-net2-1204896773", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f71d722-66", "ovs_interfaceid": "4f71d722-661a-44d6-81fa-cd588c0d6f4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Converting VIF {"id": "4f71d722-661a-44d6-81fa-cd588c0d6f4b", "address": "fa:16:3e:fe:bb:e6", "network": {"id": "21622931-8859-4310-85b4-e6c88ea4fd26", "bridge": "br-int", "label": "tempest-device-tagging-net2-1204896773", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f71d722-66", "ovs_interfaceid": "4f71d722-661a-44d6-81fa-cd588c0d6f4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:bb:e6,bridge_name='br-int',has_traffic_filtering=True,id=4f71d722-661a-44d6-81fa-cd588c0d6f4b,network=Network(21622931-8859-4310-85b4-e6c88ea4fd26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f71d722-66') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG os_vif [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:bb:e6,bridge_name='br-int',has_traffic_filtering=True,id=4f71d722-661a-44d6-81fa-cd588c0d6f4b,network=Network(21622931-8859-4310-85b4-e6c88ea4fd26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f71d722-66') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8389da54-decd-509a-87c0-4060277f2668', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4f71d722-66, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4f71d722-66, col_values=(('qos', UUID('5053a5b1-a5b1-423f-b2b3-a3f2811c11ad')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4f71d722-66, col_values=(('external_ids', {'iface-id': '4f71d722-661a-44d6-81fa-cd588c0d6f4b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:bb:e6', 'vm-uuid': 'dbc9a6db-b536-426a-91fd-691a44c66528'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:28 user nova-compute[75341]: INFO os_vif [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:bb:e6,bridge_name='br-int',has_traffic_filtering=True,id=4f71d722-661a-44d6-81fa-cd588c0d6f4b,network=Network(21622931-8859-4310-85b4-e6c88ea4fd26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f71d722-66')
Nov 14 23:44:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] No BDM found with device name hda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] No VIF found with MAC fa:16:3e:70:63:49, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:44:28 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] No VIF found with MAC fa:16:3e:f9:73:7b, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:44:28 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Using config drive
Nov 14 23:44:29 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Creating config drive at /opt/stack/data/nova/instances/dbc9a6db-b536-426a-91fd-691a44c66528/disk.config
Nov 14 23:44:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/dbc9a6db-b536-426a-91fd-691a44c66528/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp1c0ylfft {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/dbc9a6db-b536-426a-91fd-691a44c66528/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp1c0ylfft" returned: 0 in 0.075s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:29 user nova-compute[75341]: DEBUG nova.compute.manager [req-0f4dc14d-90ff-46dd-9cd8-7bff9dd722e8 req-c899ed37-d5e3-4a31-8cf5-34b3bc76d13d service nova] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Received event network-vif-plugged-64ebe5e6-0c81-41fd-b49e-75bed11e40df {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:44:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-0f4dc14d-90ff-46dd-9cd8-7bff9dd722e8 req-c899ed37-d5e3-4a31-8cf5-34b3bc76d13d service nova] Acquiring lock "51045050-c7c6-49c5-acd4-2a76be0f466f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:44:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-0f4dc14d-90ff-46dd-9cd8-7bff9dd722e8 req-c899ed37-d5e3-4a31-8cf5-34b3bc76d13d service nova] Lock "51045050-c7c6-49c5-acd4-2a76be0f466f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:44:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-0f4dc14d-90ff-46dd-9cd8-7bff9dd722e8 req-c899ed37-d5e3-4a31-8cf5-34b3bc76d13d service nova] Lock "51045050-c7c6-49c5-acd4-2a76be0f466f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:44:29 user nova-compute[75341]: DEBUG nova.compute.manager [req-0f4dc14d-90ff-46dd-9cd8-7bff9dd722e8 req-c899ed37-d5e3-4a31-8cf5-34b3bc76d13d service nova] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] No waiting events found dispatching network-vif-plugged-64ebe5e6-0c81-41fd-b49e-75bed11e40df {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:44:29 user nova-compute[75341]: WARNING nova.compute.manager [req-0f4dc14d-90ff-46dd-9cd8-7bff9dd722e8 req-c899ed37-d5e3-4a31-8cf5-34b3bc76d13d service nova] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Received unexpected event network-vif-plugged-64ebe5e6-0c81-41fd-b49e-75bed11e40df for instance with vm_state building and task_state spawning.
Nov 14 23:44:29 user nova-compute[75341]: DEBUG nova.compute.manager [req-0f4dc14d-90ff-46dd-9cd8-7bff9dd722e8 req-c899ed37-d5e3-4a31-8cf5-34b3bc76d13d service nova] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Received event network-vif-plugged-61a9a4a7-170b-4ed9-8d52-8cb4defd1cae {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:44:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-0f4dc14d-90ff-46dd-9cd8-7bff9dd722e8 req-c899ed37-d5e3-4a31-8cf5-34b3bc76d13d service nova] Acquiring lock "6382e432-838f-4d89-a743-cbaa37f50ab5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:44:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-0f4dc14d-90ff-46dd-9cd8-7bff9dd722e8 req-c899ed37-d5e3-4a31-8cf5-34b3bc76d13d service nova] Lock "6382e432-838f-4d89-a743-cbaa37f50ab5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:44:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-0f4dc14d-90ff-46dd-9cd8-7bff9dd722e8 req-c899ed37-d5e3-4a31-8cf5-34b3bc76d13d service nova] Lock "6382e432-838f-4d89-a743-cbaa37f50ab5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:44:29 user nova-compute[75341]: DEBUG nova.compute.manager [req-0f4dc14d-90ff-46dd-9cd8-7bff9dd722e8 req-c899ed37-d5e3-4a31-8cf5-34b3bc76d13d service nova] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] No waiting events found dispatching network-vif-plugged-61a9a4a7-170b-4ed9-8d52-8cb4defd1cae {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:44:29 user nova-compute[75341]: WARNING nova.compute.manager [req-0f4dc14d-90ff-46dd-9cd8-7bff9dd722e8 req-c899ed37-d5e3-4a31-8cf5-34b3bc76d13d service nova] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Received unexpected event network-vif-plugged-61a9a4a7-170b-4ed9-8d52-8cb4defd1cae for instance with vm_state building and task_state spawning.
Nov 14 23:44:29 user nova-compute[75341]: DEBUG nova.compute.manager [req-0f4dc14d-90ff-46dd-9cd8-7bff9dd722e8 req-c899ed37-d5e3-4a31-8cf5-34b3bc76d13d service nova] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Received event network-vif-plugged-61a9a4a7-170b-4ed9-8d52-8cb4defd1cae {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:44:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-0f4dc14d-90ff-46dd-9cd8-7bff9dd722e8 req-c899ed37-d5e3-4a31-8cf5-34b3bc76d13d service nova] Acquiring lock "6382e432-838f-4d89-a743-cbaa37f50ab5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:44:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-0f4dc14d-90ff-46dd-9cd8-7bff9dd722e8 req-c899ed37-d5e3-4a31-8cf5-34b3bc76d13d service nova] Lock "6382e432-838f-4d89-a743-cbaa37f50ab5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:44:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-0f4dc14d-90ff-46dd-9cd8-7bff9dd722e8 req-c899ed37-d5e3-4a31-8cf5-34b3bc76d13d service nova] Lock "6382e432-838f-4d89-a743-cbaa37f50ab5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:44:29 user nova-compute[75341]: DEBUG nova.compute.manager [req-0f4dc14d-90ff-46dd-9cd8-7bff9dd722e8 req-c899ed37-d5e3-4a31-8cf5-34b3bc76d13d service nova] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] No waiting events found dispatching network-vif-plugged-61a9a4a7-170b-4ed9-8d52-8cb4defd1cae {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:44:29 user nova-compute[75341]: WARNING nova.compute.manager [req-0f4dc14d-90ff-46dd-9cd8-7bff9dd722e8 req-c899ed37-d5e3-4a31-8cf5-34b3bc76d13d service nova] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Received unexpected event network-vif-plugged-61a9a4a7-170b-4ed9-8d52-8cb4defd1cae for instance with vm_state building and task_state spawning.
Nov 14 23:44:30 user nova-compute[75341]: DEBUG nova.compute.manager [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Instance event wait completed in 0 seconds for  {{(pid=75341) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 23:44:30 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Guest created on hypervisor {{(pid=75341) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 23:44:30 user nova-compute[75341]: DEBUG nova.compute.manager [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Instance event wait completed in 0 seconds for  {{(pid=75341) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 23:44:30 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Guest created on hypervisor {{(pid=75341) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 23:44:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:30 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Instance spawned successfully.
Nov 14 23:44:30 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 23:44:30 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Instance spawned successfully.
Nov 14 23:44:30 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 23:44:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:30 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Found default for hw_cdrom_bus of ide {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:44:30 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Found default for hw_disk_bus of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:44:30 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Found default for hw_input_bus of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:44:30 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Found default for hw_pointer_model of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:44:30 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Found default for hw_video_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:44:30 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Found default for hw_vif_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:44:30 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Found default for hw_cdrom_bus of ide {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:44:30 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Found default for hw_disk_bus of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:44:30 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Found default for hw_input_bus of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:44:30 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Found default for hw_pointer_model of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:44:30 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Found default for hw_video_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:44:30 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Found default for hw_vif_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:44:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:30 user nova-compute[75341]: INFO nova.compute.manager [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Took 8.99 seconds to spawn the instance on the hypervisor.
Nov 14 23:44:30 user nova-compute[75341]: DEBUG nova.compute.manager [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 23:44:30 user nova-compute[75341]: INFO nova.compute.manager [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Took 7.88 seconds to spawn the instance on the hypervisor.
Nov 14 23:44:30 user nova-compute[75341]: DEBUG nova.compute.manager [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 23:44:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:31 user nova-compute[75341]: INFO nova.compute.manager [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Took 9.94 seconds to build instance.
Nov 14 23:44:31 user nova-compute[75341]: INFO nova.compute.manager [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Took 9.20 seconds to build instance.
Nov 14 23:44:31 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-54eb5d5f-9b2a-4d10-8185-17ff26fe159c tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "51045050-c7c6-49c5-acd4-2a76be0f466f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.068s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:44:31 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-728614a4-2839-4429-ba5b-877e85228142 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "6382e432-838f-4d89-a743-cbaa37f50ab5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.314s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:44:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:31 user nova-compute[75341]: DEBUG nova.compute.manager [req-f9d8e0d1-abe2-495c-a8e3-602b13c863f6 req-f92789a3-7396-43bd-bcbc-c6d804230aa1 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received event network-vif-plugged-1ad25d31-80fa-41ba-8a1c-73f01ac1c832 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:44:31 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-f9d8e0d1-abe2-495c-a8e3-602b13c863f6 req-f92789a3-7396-43bd-bcbc-c6d804230aa1 service nova] Acquiring lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:44:31 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-f9d8e0d1-abe2-495c-a8e3-602b13c863f6 req-f92789a3-7396-43bd-bcbc-c6d804230aa1 service nova] Lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:44:31 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-f9d8e0d1-abe2-495c-a8e3-602b13c863f6 req-f92789a3-7396-43bd-bcbc-c6d804230aa1 service nova] Lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:44:31 user nova-compute[75341]: DEBUG nova.compute.manager [req-f9d8e0d1-abe2-495c-a8e3-602b13c863f6 req-f92789a3-7396-43bd-bcbc-c6d804230aa1 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] No waiting events found dispatching network-vif-plugged-1ad25d31-80fa-41ba-8a1c-73f01ac1c832 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:44:31 user nova-compute[75341]: WARNING nova.compute.manager [req-f9d8e0d1-abe2-495c-a8e3-602b13c863f6 req-f92789a3-7396-43bd-bcbc-c6d804230aa1 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received unexpected event network-vif-plugged-1ad25d31-80fa-41ba-8a1c-73f01ac1c832 for instance with vm_state building and task_state spawning.
Nov 14 23:44:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:32 user nova-compute[75341]: DEBUG nova.compute.manager [req-ed785dc2-7749-432a-b013-d6ba63c4a042 req-4fdcf84d-5b84-419a-bafb-1b0b6f628c4f service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received event network-vif-plugged-0f140fc0-2078-47c4-985f-28a4ee8b2824 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:44:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ed785dc2-7749-432a-b013-d6ba63c4a042 req-4fdcf84d-5b84-419a-bafb-1b0b6f628c4f service nova] Acquiring lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:44:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ed785dc2-7749-432a-b013-d6ba63c4a042 req-4fdcf84d-5b84-419a-bafb-1b0b6f628c4f service nova] Lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:44:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ed785dc2-7749-432a-b013-d6ba63c4a042 req-4fdcf84d-5b84-419a-bafb-1b0b6f628c4f service nova] Lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:44:32 user nova-compute[75341]: DEBUG nova.compute.manager [req-ed785dc2-7749-432a-b013-d6ba63c4a042 req-4fdcf84d-5b84-419a-bafb-1b0b6f628c4f service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] No waiting events found dispatching network-vif-plugged-0f140fc0-2078-47c4-985f-28a4ee8b2824 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:44:32 user nova-compute[75341]: WARNING nova.compute.manager [req-ed785dc2-7749-432a-b013-d6ba63c4a042 req-4fdcf84d-5b84-419a-bafb-1b0b6f628c4f service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received unexpected event network-vif-plugged-0f140fc0-2078-47c4-985f-28a4ee8b2824 for instance with vm_state building and task_state spawning.
Nov 14 23:44:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:32 user nova-compute[75341]: DEBUG nova.compute.manager [req-ba7b12b1-c94d-4e89-86d8-7d47add8127b req-6753ef7e-aaef-4b87-a19c-31abefbfafbe service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received event network-vif-plugged-52e41618-df29-407f-8843-3e1c55fb2a18 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:44:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ba7b12b1-c94d-4e89-86d8-7d47add8127b req-6753ef7e-aaef-4b87-a19c-31abefbfafbe service nova] Acquiring lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:44:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ba7b12b1-c94d-4e89-86d8-7d47add8127b req-6753ef7e-aaef-4b87-a19c-31abefbfafbe service nova] Lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:44:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ba7b12b1-c94d-4e89-86d8-7d47add8127b req-6753ef7e-aaef-4b87-a19c-31abefbfafbe service nova] Lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:44:32 user nova-compute[75341]: DEBUG nova.compute.manager [req-ba7b12b1-c94d-4e89-86d8-7d47add8127b req-6753ef7e-aaef-4b87-a19c-31abefbfafbe service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] No waiting events found dispatching network-vif-plugged-52e41618-df29-407f-8843-3e1c55fb2a18 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:44:32 user nova-compute[75341]: WARNING nova.compute.manager [req-ba7b12b1-c94d-4e89-86d8-7d47add8127b req-6753ef7e-aaef-4b87-a19c-31abefbfafbe service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received unexpected event network-vif-plugged-52e41618-df29-407f-8843-3e1c55fb2a18 for instance with vm_state building and task_state spawning.
Nov 14 23:44:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:33 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:33 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:33 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:33 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:33 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:33 user nova-compute[75341]: DEBUG nova.compute.manager [req-f5425754-9753-46a9-96f0-ade1186a15e6 req-bc787342-15c0-4a97-9c85-6799eb638300 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received event network-vif-plugged-1ad25d31-80fa-41ba-8a1c-73f01ac1c832 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:44:33 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-f5425754-9753-46a9-96f0-ade1186a15e6 req-bc787342-15c0-4a97-9c85-6799eb638300 service nova] Acquiring lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:44:33 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-f5425754-9753-46a9-96f0-ade1186a15e6 req-bc787342-15c0-4a97-9c85-6799eb638300 service nova] Lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:44:33 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-f5425754-9753-46a9-96f0-ade1186a15e6 req-bc787342-15c0-4a97-9c85-6799eb638300 service nova] Lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:44:33 user nova-compute[75341]: DEBUG nova.compute.manager [req-f5425754-9753-46a9-96f0-ade1186a15e6 req-bc787342-15c0-4a97-9c85-6799eb638300 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] No waiting events found dispatching network-vif-plugged-1ad25d31-80fa-41ba-8a1c-73f01ac1c832 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:44:33 user nova-compute[75341]: WARNING nova.compute.manager [req-f5425754-9753-46a9-96f0-ade1186a15e6 req-bc787342-15c0-4a97-9c85-6799eb638300 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received unexpected event network-vif-plugged-1ad25d31-80fa-41ba-8a1c-73f01ac1c832 for instance with vm_state building and task_state spawning.
Nov 14 23:44:33 user nova-compute[75341]: DEBUG nova.compute.manager [req-f5425754-9753-46a9-96f0-ade1186a15e6 req-bc787342-15c0-4a97-9c85-6799eb638300 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received event network-vif-plugged-7b7251c7-1a54-46d9-9a9b-4103a659502c {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:44:33 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-f5425754-9753-46a9-96f0-ade1186a15e6 req-bc787342-15c0-4a97-9c85-6799eb638300 service nova] Acquiring lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:44:33 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-f5425754-9753-46a9-96f0-ade1186a15e6 req-bc787342-15c0-4a97-9c85-6799eb638300 service nova] Lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:44:33 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-f5425754-9753-46a9-96f0-ade1186a15e6 req-bc787342-15c0-4a97-9c85-6799eb638300 service nova] Lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:44:33 user nova-compute[75341]: DEBUG nova.compute.manager [req-f5425754-9753-46a9-96f0-ade1186a15e6 req-bc787342-15c0-4a97-9c85-6799eb638300 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] No waiting events found dispatching network-vif-plugged-7b7251c7-1a54-46d9-9a9b-4103a659502c {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:44:33 user nova-compute[75341]: WARNING nova.compute.manager [req-f5425754-9753-46a9-96f0-ade1186a15e6 req-bc787342-15c0-4a97-9c85-6799eb638300 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received unexpected event network-vif-plugged-7b7251c7-1a54-46d9-9a9b-4103a659502c for instance with vm_state building and task_state spawning.
Nov 14 23:44:33 user nova-compute[75341]: DEBUG nova.compute.manager [req-f5425754-9753-46a9-96f0-ade1186a15e6 req-bc787342-15c0-4a97-9c85-6799eb638300 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received event network-vif-plugged-7b7251c7-1a54-46d9-9a9b-4103a659502c {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:44:33 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-f5425754-9753-46a9-96f0-ade1186a15e6 req-bc787342-15c0-4a97-9c85-6799eb638300 service nova] Acquiring lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:44:33 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-f5425754-9753-46a9-96f0-ade1186a15e6 req-bc787342-15c0-4a97-9c85-6799eb638300 service nova] Lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:44:33 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-f5425754-9753-46a9-96f0-ade1186a15e6 req-bc787342-15c0-4a97-9c85-6799eb638300 service nova] Lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:44:33 user nova-compute[75341]: DEBUG nova.compute.manager [req-f5425754-9753-46a9-96f0-ade1186a15e6 req-bc787342-15c0-4a97-9c85-6799eb638300 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] No waiting events found dispatching network-vif-plugged-7b7251c7-1a54-46d9-9a9b-4103a659502c {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:44:33 user nova-compute[75341]: WARNING nova.compute.manager [req-f5425754-9753-46a9-96f0-ade1186a15e6 req-bc787342-15c0-4a97-9c85-6799eb638300 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received unexpected event network-vif-plugged-7b7251c7-1a54-46d9-9a9b-4103a659502c for instance with vm_state building and task_state spawning.
Nov 14 23:44:33 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:33 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:33 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:34 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:34 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:34 user nova-compute[75341]: DEBUG nova.compute.manager [req-fc77b0d4-a6fc-48da-9034-6eccf2540ebf req-f53a8fec-c94d-490f-9715-135401119a46 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received event network-vif-plugged-0f140fc0-2078-47c4-985f-28a4ee8b2824 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:44:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-fc77b0d4-a6fc-48da-9034-6eccf2540ebf req-f53a8fec-c94d-490f-9715-135401119a46 service nova] Acquiring lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:44:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-fc77b0d4-a6fc-48da-9034-6eccf2540ebf req-f53a8fec-c94d-490f-9715-135401119a46 service nova] Lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:44:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-fc77b0d4-a6fc-48da-9034-6eccf2540ebf req-f53a8fec-c94d-490f-9715-135401119a46 service nova] Lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:44:34 user nova-compute[75341]: DEBUG nova.compute.manager [req-fc77b0d4-a6fc-48da-9034-6eccf2540ebf req-f53a8fec-c94d-490f-9715-135401119a46 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] No waiting events found dispatching network-vif-plugged-0f140fc0-2078-47c4-985f-28a4ee8b2824 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:44:34 user nova-compute[75341]: WARNING nova.compute.manager [req-fc77b0d4-a6fc-48da-9034-6eccf2540ebf req-f53a8fec-c94d-490f-9715-135401119a46 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received unexpected event network-vif-plugged-0f140fc0-2078-47c4-985f-28a4ee8b2824 for instance with vm_state building and task_state spawning.
Nov 14 23:44:34 user nova-compute[75341]: DEBUG nova.compute.manager [req-fc77b0d4-a6fc-48da-9034-6eccf2540ebf req-f53a8fec-c94d-490f-9715-135401119a46 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received event network-vif-plugged-f4b96195-ecba-4530-aa46-47e368eb294d {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:44:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-fc77b0d4-a6fc-48da-9034-6eccf2540ebf req-f53a8fec-c94d-490f-9715-135401119a46 service nova] Acquiring lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:44:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-fc77b0d4-a6fc-48da-9034-6eccf2540ebf req-f53a8fec-c94d-490f-9715-135401119a46 service nova] Lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:44:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-fc77b0d4-a6fc-48da-9034-6eccf2540ebf req-f53a8fec-c94d-490f-9715-135401119a46 service nova] Lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:44:34 user nova-compute[75341]: DEBUG nova.compute.manager [req-fc77b0d4-a6fc-48da-9034-6eccf2540ebf req-f53a8fec-c94d-490f-9715-135401119a46 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] No waiting events found dispatching network-vif-plugged-f4b96195-ecba-4530-aa46-47e368eb294d {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:44:34 user nova-compute[75341]: WARNING nova.compute.manager [req-fc77b0d4-a6fc-48da-9034-6eccf2540ebf req-f53a8fec-c94d-490f-9715-135401119a46 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received unexpected event network-vif-plugged-f4b96195-ecba-4530-aa46-47e368eb294d for instance with vm_state building and task_state spawning.
Nov 14 23:44:34 user nova-compute[75341]: DEBUG nova.compute.manager [req-fc77b0d4-a6fc-48da-9034-6eccf2540ebf req-f53a8fec-c94d-490f-9715-135401119a46 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received event network-vif-plugged-f4b96195-ecba-4530-aa46-47e368eb294d {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:44:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-fc77b0d4-a6fc-48da-9034-6eccf2540ebf req-f53a8fec-c94d-490f-9715-135401119a46 service nova] Acquiring lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:44:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-fc77b0d4-a6fc-48da-9034-6eccf2540ebf req-f53a8fec-c94d-490f-9715-135401119a46 service nova] Lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:44:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-fc77b0d4-a6fc-48da-9034-6eccf2540ebf req-f53a8fec-c94d-490f-9715-135401119a46 service nova] Lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:44:34 user nova-compute[75341]: DEBUG nova.compute.manager [req-fc77b0d4-a6fc-48da-9034-6eccf2540ebf req-f53a8fec-c94d-490f-9715-135401119a46 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] No waiting events found dispatching network-vif-plugged-f4b96195-ecba-4530-aa46-47e368eb294d {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:44:34 user nova-compute[75341]: WARNING nova.compute.manager [req-fc77b0d4-a6fc-48da-9034-6eccf2540ebf req-f53a8fec-c94d-490f-9715-135401119a46 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received unexpected event network-vif-plugged-f4b96195-ecba-4530-aa46-47e368eb294d for instance with vm_state building and task_state spawning.
Nov 14 23:44:34 user nova-compute[75341]: DEBUG nova.compute.manager [req-fc77b0d4-a6fc-48da-9034-6eccf2540ebf req-f53a8fec-c94d-490f-9715-135401119a46 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received event network-vif-plugged-4f71d722-661a-44d6-81fa-cd588c0d6f4b {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:44:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-fc77b0d4-a6fc-48da-9034-6eccf2540ebf req-f53a8fec-c94d-490f-9715-135401119a46 service nova] Acquiring lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:44:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-fc77b0d4-a6fc-48da-9034-6eccf2540ebf req-f53a8fec-c94d-490f-9715-135401119a46 service nova] Lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:44:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-fc77b0d4-a6fc-48da-9034-6eccf2540ebf req-f53a8fec-c94d-490f-9715-135401119a46 service nova] Lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:44:34 user nova-compute[75341]: DEBUG nova.compute.manager [req-fc77b0d4-a6fc-48da-9034-6eccf2540ebf req-f53a8fec-c94d-490f-9715-135401119a46 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] No waiting events found dispatching network-vif-plugged-4f71d722-661a-44d6-81fa-cd588c0d6f4b {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:44:34 user nova-compute[75341]: WARNING nova.compute.manager [req-fc77b0d4-a6fc-48da-9034-6eccf2540ebf req-f53a8fec-c94d-490f-9715-135401119a46 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received unexpected event network-vif-plugged-4f71d722-661a-44d6-81fa-cd588c0d6f4b for instance with vm_state building and task_state spawning.
Nov 14 23:44:34 user nova-compute[75341]: DEBUG nova.compute.manager [req-6c400176-8a59-4754-97fc-8dbd3b58c1d3 req-18724dbf-23e1-41e0-9727-4c22e294e688 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received event network-vif-plugged-52e41618-df29-407f-8843-3e1c55fb2a18 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:44:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6c400176-8a59-4754-97fc-8dbd3b58c1d3 req-18724dbf-23e1-41e0-9727-4c22e294e688 service nova] Acquiring lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:44:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6c400176-8a59-4754-97fc-8dbd3b58c1d3 req-18724dbf-23e1-41e0-9727-4c22e294e688 service nova] Lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:44:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6c400176-8a59-4754-97fc-8dbd3b58c1d3 req-18724dbf-23e1-41e0-9727-4c22e294e688 service nova] Lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:44:34 user nova-compute[75341]: DEBUG nova.compute.manager [req-6c400176-8a59-4754-97fc-8dbd3b58c1d3 req-18724dbf-23e1-41e0-9727-4c22e294e688 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] No waiting events found dispatching network-vif-plugged-52e41618-df29-407f-8843-3e1c55fb2a18 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:44:34 user nova-compute[75341]: WARNING nova.compute.manager [req-6c400176-8a59-4754-97fc-8dbd3b58c1d3 req-18724dbf-23e1-41e0-9727-4c22e294e688 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received unexpected event network-vif-plugged-52e41618-df29-407f-8843-3e1c55fb2a18 for instance with vm_state building and task_state spawning.
Nov 14 23:44:34 user nova-compute[75341]: DEBUG nova.compute.manager [req-6c400176-8a59-4754-97fc-8dbd3b58c1d3 req-18724dbf-23e1-41e0-9727-4c22e294e688 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received event network-vif-plugged-6368ff99-db9d-4a3e-b940-afc0300d7aa0 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:44:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6c400176-8a59-4754-97fc-8dbd3b58c1d3 req-18724dbf-23e1-41e0-9727-4c22e294e688 service nova] Acquiring lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:44:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6c400176-8a59-4754-97fc-8dbd3b58c1d3 req-18724dbf-23e1-41e0-9727-4c22e294e688 service nova] Lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:44:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6c400176-8a59-4754-97fc-8dbd3b58c1d3 req-18724dbf-23e1-41e0-9727-4c22e294e688 service nova] Lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:44:34 user nova-compute[75341]: DEBUG nova.compute.manager [req-6c400176-8a59-4754-97fc-8dbd3b58c1d3 req-18724dbf-23e1-41e0-9727-4c22e294e688 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] No waiting events found dispatching network-vif-plugged-6368ff99-db9d-4a3e-b940-afc0300d7aa0 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:44:34 user nova-compute[75341]: WARNING nova.compute.manager [req-6c400176-8a59-4754-97fc-8dbd3b58c1d3 req-18724dbf-23e1-41e0-9727-4c22e294e688 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received unexpected event network-vif-plugged-6368ff99-db9d-4a3e-b940-afc0300d7aa0 for instance with vm_state building and task_state spawning.
Nov 14 23:44:34 user nova-compute[75341]: DEBUG nova.compute.manager [req-6c400176-8a59-4754-97fc-8dbd3b58c1d3 req-18724dbf-23e1-41e0-9727-4c22e294e688 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received event network-vif-plugged-6368ff99-db9d-4a3e-b940-afc0300d7aa0 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:44:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6c400176-8a59-4754-97fc-8dbd3b58c1d3 req-18724dbf-23e1-41e0-9727-4c22e294e688 service nova] Acquiring lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:44:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6c400176-8a59-4754-97fc-8dbd3b58c1d3 req-18724dbf-23e1-41e0-9727-4c22e294e688 service nova] Lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:44:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6c400176-8a59-4754-97fc-8dbd3b58c1d3 req-18724dbf-23e1-41e0-9727-4c22e294e688 service nova] Lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:44:34 user nova-compute[75341]: DEBUG nova.compute.manager [req-6c400176-8a59-4754-97fc-8dbd3b58c1d3 req-18724dbf-23e1-41e0-9727-4c22e294e688 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] No waiting events found dispatching network-vif-plugged-6368ff99-db9d-4a3e-b940-afc0300d7aa0 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:44:34 user nova-compute[75341]: WARNING nova.compute.manager [req-6c400176-8a59-4754-97fc-8dbd3b58c1d3 req-18724dbf-23e1-41e0-9727-4c22e294e688 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received unexpected event network-vif-plugged-6368ff99-db9d-4a3e-b940-afc0300d7aa0 for instance with vm_state building and task_state spawning.
Nov 14 23:44:34 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:34 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:35 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:35 user nova-compute[75341]: DEBUG nova.compute.manager [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Instance event wait completed in 0 seconds for  {{(pid=75341) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 23:44:35 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Guest created on hypervisor {{(pid=75341) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 23:44:35 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Instance spawned successfully.
Nov 14 23:44:35 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 23:44:35 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Found default for hw_cdrom_bus of ide {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:44:35 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Found default for hw_disk_bus of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:44:35 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Found default for hw_input_bus of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:44:35 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Found default for hw_pointer_model of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:44:35 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Found default for hw_video_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:44:35 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Found default for hw_vif_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:44:35 user nova-compute[75341]: INFO nova.compute.manager [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Took 12.89 seconds to spawn the instance on the hypervisor.
Nov 14 23:44:35 user nova-compute[75341]: DEBUG nova.compute.manager [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 23:44:35 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:36 user nova-compute[75341]: INFO nova.compute.manager [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Took 30.04 seconds to build instance.
Nov 14 23:44:36 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b32bc775-0336-42f9-a28a-809e21881379 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Lock "dbc9a6db-b536-426a-91fd-691a44c66528" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.155s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:44:36 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:36 user nova-compute[75341]: DEBUG nova.compute.manager [req-9c0cb9f8-dc87-408f-8a9b-3eb138901bcd req-74c60b6a-66fc-4327-87f8-c33650469f49 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received event network-vif-plugged-4f71d722-661a-44d6-81fa-cd588c0d6f4b {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:44:36 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-9c0cb9f8-dc87-408f-8a9b-3eb138901bcd req-74c60b6a-66fc-4327-87f8-c33650469f49 service nova] Acquiring lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:44:36 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-9c0cb9f8-dc87-408f-8a9b-3eb138901bcd req-74c60b6a-66fc-4327-87f8-c33650469f49 service nova] Lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:44:36 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-9c0cb9f8-dc87-408f-8a9b-3eb138901bcd req-74c60b6a-66fc-4327-87f8-c33650469f49 service nova] Lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:44:36 user nova-compute[75341]: DEBUG nova.compute.manager [req-9c0cb9f8-dc87-408f-8a9b-3eb138901bcd req-74c60b6a-66fc-4327-87f8-c33650469f49 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] No waiting events found dispatching network-vif-plugged-4f71d722-661a-44d6-81fa-cd588c0d6f4b {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:44:36 user nova-compute[75341]: WARNING nova.compute.manager [req-9c0cb9f8-dc87-408f-8a9b-3eb138901bcd req-74c60b6a-66fc-4327-87f8-c33650469f49 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received unexpected event network-vif-plugged-4f71d722-661a-44d6-81fa-cd588c0d6f4b for instance with vm_state active and task_state None.
Nov 14 23:44:38 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:42 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:43 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:46 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:47 user nova-compute[75341]: DEBUG nova.compute.manager [req-120bcb93-9a6c-47a7-bc3b-d7887992433f req-baea47cb-2da8-4180-89df-f58a300e0453 service nova] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Received event network-changed-cdc268e0-0a9a-44cf-87ef-0baca1547f68 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:44:47 user nova-compute[75341]: DEBUG nova.compute.manager [req-120bcb93-9a6c-47a7-bc3b-d7887992433f req-baea47cb-2da8-4180-89df-f58a300e0453 service nova] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Refreshing instance network info cache due to event network-changed-cdc268e0-0a9a-44cf-87ef-0baca1547f68. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:44:47 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-120bcb93-9a6c-47a7-bc3b-d7887992433f req-baea47cb-2da8-4180-89df-f58a300e0453 service nova] Acquiring lock "refresh_cache-cffc86d5-2ac6-4dd1-bdcd-5832c134d179" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:44:47 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-120bcb93-9a6c-47a7-bc3b-d7887992433f req-baea47cb-2da8-4180-89df-f58a300e0453 service nova] Acquired lock "refresh_cache-cffc86d5-2ac6-4dd1-bdcd-5832c134d179" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:44:47 user nova-compute[75341]: DEBUG nova.network.neutron [req-120bcb93-9a6c-47a7-bc3b-d7887992433f req-baea47cb-2da8-4180-89df-f58a300e0453 service nova] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Refreshing network info cache for port cdc268e0-0a9a-44cf-87ef-0baca1547f68 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:44:48 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Acquiring lock "d92ba9df-c739-414d-a701-ddba04563427" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:44:48 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "d92ba9df-c739-414d-a701-ddba04563427" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:44:48 user nova-compute[75341]: DEBUG nova.compute.manager [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d92ba9df-c739-414d-a701-ddba04563427] Starting instance... {{(pid=75341) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 23:44:48 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:44:48 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:44:48 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75341) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 23:44:48 user nova-compute[75341]: INFO nova.compute.claims [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d92ba9df-c739-414d-a701-ddba04563427] Claim successful on node user
Nov 14 23:44:48 user nova-compute[75341]: DEBUG nova.network.neutron [req-120bcb93-9a6c-47a7-bc3b-d7887992433f req-baea47cb-2da8-4180-89df-f58a300e0453 service nova] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Updated VIF entry in instance network info cache for port cdc268e0-0a9a-44cf-87ef-0baca1547f68. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:44:48 user nova-compute[75341]: DEBUG nova.network.neutron [req-120bcb93-9a6c-47a7-bc3b-d7887992433f req-baea47cb-2da8-4180-89df-f58a300e0453 service nova] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Updating instance_info_cache with network_info: [{"id": "cdc268e0-0a9a-44cf-87ef-0baca1547f68", "address": "fa:16:3e:10:94:5a", "network": {"id": "c832523e-13e4-44da-9e4b-a4f3e5a276fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1155631271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e4a2efc0fc47a482755f1c375aff46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdc268e0-0a", "ovs_interfaceid": "cdc268e0-0a9a-44cf-87ef-0baca1547f68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:44:48 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-120bcb93-9a6c-47a7-bc3b-d7887992433f req-baea47cb-2da8-4180-89df-f58a300e0453 service nova] Releasing lock "refresh_cache-cffc86d5-2ac6-4dd1-bdcd-5832c134d179" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:44:48 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:44:48 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Starting heal instance info cache {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 23:44:48 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Rebuilding the list of instances to heal {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 23:44:48 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: d92ba9df-c739-414d-a701-ddba04563427] Skipping network cache update for instance because it is Building. {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 14 23:44:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:49 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:44:49 user nova-compute[75341]: INFO nova.compute.manager [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Rebuilding instance
Nov 14 23:44:49 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:44:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "refresh_cache-881351d7-31f9-44f4-8571-8f540bbec29c" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:44:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquired lock "refresh_cache-881351d7-31f9-44f4-8571-8f540bbec29c" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:44:49 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Forcefully refreshing network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 23:44:49 user nova-compute[75341]: DEBUG nova.objects.instance [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lazy-loading 'info_cache' on Instance uuid 881351d7-31f9-44f4-8571-8f540bbec29c {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:44:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.820s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:44:49 user nova-compute[75341]: DEBUG nova.compute.manager [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d92ba9df-c739-414d-a701-ddba04563427] Start building networks asynchronously for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 23:44:49 user nova-compute[75341]: DEBUG nova.compute.manager [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 23:44:49 user nova-compute[75341]: DEBUG nova.compute.manager [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d92ba9df-c739-414d-a701-ddba04563427] Allocating IP information in the background. {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 23:44:49 user nova-compute[75341]: DEBUG nova.network.neutron [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d92ba9df-c739-414d-a701-ddba04563427] allocate_for_instance() {{(pid=75341) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 23:44:49 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d92ba9df-c739-414d-a701-ddba04563427] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 23:44:49 user nova-compute[75341]: DEBUG nova.compute.manager [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d92ba9df-c739-414d-a701-ddba04563427] Start building block device mappings for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 23:44:49 user nova-compute[75341]: DEBUG nova.policy [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd0b6eae0d3124f70982781555ccc7ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542a85b3a6d14c77872f1957120ba655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75341) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 23:44:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:49 user nova-compute[75341]: DEBUG nova.compute.manager [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d92ba9df-c739-414d-a701-ddba04563427] Start spawning the instance on the hypervisor. {{(pid=75341) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 23:44:49 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d92ba9df-c739-414d-a701-ddba04563427] Creating instance directory {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 23:44:49 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d92ba9df-c739-414d-a701-ddba04563427] Creating image(s)
Nov 14 23:44:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Acquiring lock "/opt/stack/data/nova/instances/d92ba9df-c739-414d-a701-ddba04563427/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:44:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "/opt/stack/data/nova/instances/d92ba9df-c739-414d-a701-ddba04563427/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:44:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "/opt/stack/data/nova/instances/d92ba9df-c739-414d-a701-ddba04563427/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:44:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ddf8f5d2-3009-4112-80e7-e787796f61ac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Acquiring lock "44080c0d-56eb-4987-aa4b-59f161dcbc0b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:44:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ddf8f5d2-3009-4112-80e7-e787796f61ac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Lock "44080c0d-56eb-4987-aa4b-59f161dcbc0b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:44:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ddf8f5d2-3009-4112-80e7-e787796f61ac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Acquiring lock "44080c0d-56eb-4987-aa4b-59f161dcbc0b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:44:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ddf8f5d2-3009-4112-80e7-e787796f61ac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Lock "44080c0d-56eb-4987-aa4b-59f161dcbc0b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:44:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ddf8f5d2-3009-4112-80e7-e787796f61ac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Lock "44080c0d-56eb-4987-aa4b-59f161dcbc0b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:44:49 user nova-compute[75341]: INFO nova.compute.manager [None req-ddf8f5d2-3009-4112-80e7-e787796f61ac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Terminating instance
Nov 14 23:44:49 user nova-compute[75341]: DEBUG nova.compute.manager [None req-ddf8f5d2-3009-4112-80e7-e787796f61ac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Start destroying the instance on the hypervisor. {{(pid=75341) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 23:44:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.213s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Acquiring lock "4754efee9a6d73d3647f2add2cfe86c291949740" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:44:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:44:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.207s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/d92ba9df-c739-414d-a701-ddba04563427/disk 1073741824 {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/d92ba9df-c739-414d-a701-ddba04563427/disk 1073741824" returned: 0 in 0.062s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:44:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.191s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d92ba9df-c739-414d-a701-ddba04563427/disk. size=1073741824 {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d92ba9df-c739-414d-a701-ddba04563427/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG nova.compute.manager [req-c9534689-12eb-402f-ad8c-91eaaa58d644 req-dfe3daed-592a-44e9-b2f0-e5a65a860737 service nova] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Received event network-vif-unplugged-cdc268e0-0a9a-44cf-87ef-0baca1547f68 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-c9534689-12eb-402f-ad8c-91eaaa58d644 req-dfe3daed-592a-44e9-b2f0-e5a65a860737 service nova] Acquiring lock "cffc86d5-2ac6-4dd1-bdcd-5832c134d179-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-c9534689-12eb-402f-ad8c-91eaaa58d644 req-dfe3daed-592a-44e9-b2f0-e5a65a860737 service nova] Lock "cffc86d5-2ac6-4dd1-bdcd-5832c134d179-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-c9534689-12eb-402f-ad8c-91eaaa58d644 req-dfe3daed-592a-44e9-b2f0-e5a65a860737 service nova] Lock "cffc86d5-2ac6-4dd1-bdcd-5832c134d179-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG nova.compute.manager [req-c9534689-12eb-402f-ad8c-91eaaa58d644 req-dfe3daed-592a-44e9-b2f0-e5a65a860737 service nova] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] No waiting events found dispatching network-vif-unplugged-cdc268e0-0a9a-44cf-87ef-0baca1547f68 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:44:50 user nova-compute[75341]: WARNING nova.compute.manager [req-c9534689-12eb-402f-ad8c-91eaaa58d644 req-dfe3daed-592a-44e9-b2f0-e5a65a860737 service nova] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Received unexpected event network-vif-unplugged-cdc268e0-0a9a-44cf-87ef-0baca1547f68 for instance with vm_state active and task_state rebuilding.
Nov 14 23:44:50 user nova-compute[75341]: DEBUG nova.network.neutron [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d92ba9df-c739-414d-a701-ddba04563427] Successfully created port: 5d23fcc8-0277-4900-b524-398ad1f6f27a {{(pid=75341) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG nova.compute.manager [req-ac2e07e4-7488-40e0-861e-c6a448b9bd6d req-3c2bf040-3643-45ed-855b-5382837ec3ef service nova] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Received event network-vif-unplugged-611fe585-b169-4ec5-97cf-8ebdf5060502 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ac2e07e4-7488-40e0-861e-c6a448b9bd6d req-3c2bf040-3643-45ed-855b-5382837ec3ef service nova] Acquiring lock "44080c0d-56eb-4987-aa4b-59f161dcbc0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ac2e07e4-7488-40e0-861e-c6a448b9bd6d req-3c2bf040-3643-45ed-855b-5382837ec3ef service nova] Lock "44080c0d-56eb-4987-aa4b-59f161dcbc0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ac2e07e4-7488-40e0-861e-c6a448b9bd6d req-3c2bf040-3643-45ed-855b-5382837ec3ef service nova] Lock "44080c0d-56eb-4987-aa4b-59f161dcbc0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG nova.compute.manager [req-ac2e07e4-7488-40e0-861e-c6a448b9bd6d req-3c2bf040-3643-45ed-855b-5382837ec3ef service nova] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] No waiting events found dispatching network-vif-unplugged-611fe585-b169-4ec5-97cf-8ebdf5060502 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG nova.compute.manager [req-ac2e07e4-7488-40e0-861e-c6a448b9bd6d req-3c2bf040-3643-45ed-855b-5382837ec3ef service nova] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Received event network-vif-unplugged-611fe585-b169-4ec5-97cf-8ebdf5060502 for instance with task_state deleting. {{(pid=75341) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d92ba9df-c739-414d-a701-ddba04563427/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Cannot resize image /opt/stack/data/nova/instances/d92ba9df-c739-414d-a701-ddba04563427/disk to a smaller size. {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d92ba9df-c739-414d-a701-ddba04563427] Created local disks {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d92ba9df-c739-414d-a701-ddba04563427] Ensure instance console log exists: /opt/stack/data/nova/instances/d92ba9df-c739-414d-a701-ddba04563427/console.log {{(pid=75341) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:44:50 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Instance destroyed successfully.
Nov 14 23:44:50 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Instance destroyed successfully.
Nov 14 23:44:50 user nova-compute[75341]: DEBUG nova.objects.instance [None req-ddf8f5d2-3009-4112-80e7-e787796f61ac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Lazy-loading 'resources' on Instance uuid 44080c0d-56eb-4987-aa4b-59f161dcbc0b {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:44:50 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Instance destroyed successfully.
Nov 14 23:44:50 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:42:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1298649458',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1214898251',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC6p7TTrcora+tA8J6m0Z8kOp9lfGZbeJCVFa4lV20FoOtQs2zaUuehWyGMh3Ev7R8XPb9IKUQhdgHH/8HhowDTVW2MDgUCdP9iYWVYcDyU1L7qQlvAFOYXZMtN51fblTQ==',key_name='tempest-keypair-849876031',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:43:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b7e4a2efc0fc47a482755f1c375aff46',ramdisk_id='',reservation_id='r-p3kv7sbi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-863325357',owner_user_name='tempest-ServerActionsV293TestJSON-863325357-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:44:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2440829d0b0e4d4d8f8266c4e8162223',uuid=cffc86d5-2ac6-4dd1-bdcd-5832c134d179,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cdc268e0-0a9a-44cf-87ef-0baca1547f68", "address": "fa:16:3e:10:94:5a", "network": {"id": "c832523e-13e4-44da-9e4b-a4f3e5a276fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1155631271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e4a2efc0fc47a482755f1c375aff46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdc268e0-0a", "ovs_interfaceid": "cdc268e0-0a9a-44cf-87ef-0baca1547f68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Converting VIF {"id": "cdc268e0-0a9a-44cf-87ef-0baca1547f68", "address": "fa:16:3e:10:94:5a", "network": {"id": "c832523e-13e4-44da-9e4b-a4f3e5a276fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1155631271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e4a2efc0fc47a482755f1c375aff46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdc268e0-0a", "ovs_interfaceid": "cdc268e0-0a9a-44cf-87ef-0baca1547f68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:10:94:5a,bridge_name='br-int',has_traffic_filtering=True,id=cdc268e0-0a9a-44cf-87ef-0baca1547f68,network=Network(c832523e-13e4-44da-9e4b-a4f3e5a276fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdc268e0-0a') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG os_vif [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:94:5a,bridge_name='br-int',has_traffic_filtering=True,id=cdc268e0-0a9a-44cf-87ef-0baca1547f68,network=Network(c832523e-13e4-44da-9e4b-a4f3e5a276fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdc268e0-0a') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-ddf8f5d2-3009-4112-80e7-e787796f61ac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:40:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1556249137',display_name='tempest-TestServerVolumeAttachmentScenario-server-1556249137',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1556249137',id=10,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNWifuLHXazlxDoi4AYx90fm7TlMoPQJnyF2x+kn+tGXxVh0bmxBLQKJ+ppXsLB1CnME6rpa/np27IMhonxQ1aAjdvZYcl9oY5YdJSwKjr85od5Te4CRWYL3SMc1ZXrLCw==',key_name='tempest-keypair-1454530888',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:41:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a263dc99759446c9a226892c0d81a0d8',ramdisk_id='',reservation_id='r-tq7zbkgh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-394165190',owner_user_name='tempest-TestServerVolumeAttachmentScenario-394165190-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:41:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='983c2908d300475db1560f09020eb4fe',uuid=44080c0d-56eb-4987-aa4b-59f161dcbc0b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "611fe585-b169-4ec5-97cf-8ebdf5060502", "address": "fa:16:3e:ce:7e:2b", "network": {"id": "4b25a4f0-0f86-4f96-9228-c8e9a60b401d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1630866661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a263dc99759446c9a226892c0d81a0d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap611fe585-b1", "ovs_interfaceid": "611fe585-b169-4ec5-97cf-8ebdf5060502", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-ddf8f5d2-3009-4112-80e7-e787796f61ac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Converting VIF {"id": "611fe585-b169-4ec5-97cf-8ebdf5060502", "address": "fa:16:3e:ce:7e:2b", "network": {"id": "4b25a4f0-0f86-4f96-9228-c8e9a60b401d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1630866661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a263dc99759446c9a226892c0d81a0d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap611fe585-b1", "ovs_interfaceid": "611fe585-b169-4ec5-97cf-8ebdf5060502", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-ddf8f5d2-3009-4112-80e7-e787796f61ac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ce:7e:2b,bridge_name='br-int',has_traffic_filtering=True,id=611fe585-b169-4ec5-97cf-8ebdf5060502,network=Network(4b25a4f0-0f86-4f96-9228-c8e9a60b401d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap611fe585-b1') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG os_vif [None req-ddf8f5d2-3009-4112-80e7-e787796f61ac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:7e:2b,bridge_name='br-int',has_traffic_filtering=True,id=611fe585-b169-4ec5-97cf-8ebdf5060502,network=Network(4b25a4f0-0f86-4f96-9228-c8e9a60b401d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap611fe585-b1') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcdc268e0-0a, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap611fe585-b1, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b3af2308-d92b-48f7-87ca-d7efe0f263ab) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=00bbc16a-a7a8-489d-a544-ffa3a00346d7) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:44:50 user nova-compute[75341]: INFO os_vif [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:94:5a,bridge_name='br-int',has_traffic_filtering=True,id=cdc268e0-0a9a-44cf-87ef-0baca1547f68,network=Network(c832523e-13e4-44da-9e4b-a4f3e5a276fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdc268e0-0a')
Nov 14 23:44:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] calling os-brick to detach iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, {'target_iqn': 'iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cDKCeEGM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:44:50 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 23:44:50 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:44:50 user nova-compute[75341]: INFO os_vif [None req-ddf8f5d2-3009-4112-80e7-e787796f61ac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:7e:2b,bridge_name='br-int',has_traffic_filtering=True,id=611fe585-b169-4ec5-97cf-8ebdf5060502,network=Network(4b25a4f0-0f86-4f96-9228-c8e9a60b401d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap611fe585-b1')
Nov 14 23:44:50 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-ddf8f5d2-3009-4112-80e7-e787796f61ac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Deleting instance files /opt/stack/data/nova/instances/44080c0d-56eb-4987-aa4b-59f161dcbc0b_del
Nov 14 23:44:50 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-ddf8f5d2-3009-4112-80e7-e787796f61ac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Deletion of /opt/stack/data/nova/instances/44080c0d-56eb-4987-aa4b-59f161dcbc0b_del complete
Nov 14 23:44:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0d8f1a-7392-4c3b-a2f0-c163b0786b5c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 23:44:50 user nova-compute[75341]: No targets found.
Nov 14 23:44:50 user nova-compute[75341]: iSNS:
Nov 14 23:44:50 user nova-compute[75341]: No targets found.
Nov 14 23:44:50 user nova-compute[75341]: STATIC:
Nov 14 23:44:50 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265
Nov 14 23:44:50 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:44:50 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:44:50 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3
Nov 14 23:44:50 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:44:50 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:44:50 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a
Nov 14 23:44:50 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:44:50 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:44:50 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7
Nov 14 23:44:50 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:44:50 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:44:50 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c
Nov 14 23:44:50 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:44:50 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:44:50 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912
Nov 14 23:44:50 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:44:50 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:44:50 user nova-compute[75341]: FIRMWARE:
Nov 14 23:44:50 user nova-compute[75341]: No targets found.
Nov 14 23:44:50 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 23:44:50 user nova-compute[75341]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 23:44:50 user nova-compute[75341]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75341) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c', 0)] {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b5d287-ae63-4992-bde7-a4e997bbb555]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:50 user nova-compute[75341]: INFO nova.compute.manager [None req-ddf8f5d2-3009-4112-80e7-e787796f61ac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 14 23:44:50 user nova-compute[75341]: DEBUG oslo.service.loopingcall [None req-ddf8f5d2-3009-4112-80e7-e787796f61ac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75341) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG nova.compute.manager [-] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Deallocating network for instance {{(pid=75341) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] deallocate_for_instance() {{(pid=75341) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2609e1-aa1d-4c54-94ab-2930f2ee48c2]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)
Nov 14 23:44:50 user nova-compute[75341]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 (non-flash)
Nov 14 23:44:50 user nova-compute[75341]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)
Nov 14 23:44:50 user nova-compute[75341]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 (non-flash)
Nov 14 23:44:50 user nova-compute[75341]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a (non-flash)
Nov 14 23:44:50 user nova-compute[75341]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 (non-flash)
Nov 14 23:44:50 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)
Nov 14 23:44:50 user nova-compute[75341]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 (non-flash)
Nov 14 23:44:50 user nova-compute[75341]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)
Nov 14 23:44:50 user nova-compute[75341]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 (non-flash)
Nov 14 23:44:50 user nova-compute[75341]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a (non-flash)
Nov 14 23:44:50 user nova-compute[75341]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 (non-flash)
Nov 14 23:44:50 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1850717d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c'): ({'sdc'}, set())}) {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Removing single pathed devices sdc {{(pid=75341) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[266eaaa0-3132-4e04-add5-34ee7220c83d]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b97030-03d7-45e6-a15f-0fdad696a1fd]: (4, ('ok\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Flushing IO for device /dev/sdc {{(pid=75341) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[382c42ae-0a16-4357-ba43-b56754f09ebb]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75341) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.056s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a581ad9-85c8-47ea-bd74-63aadbc1c761]: (4, ('1', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] SCSI volumes sdc have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c')] {{(pid=75341) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2fd9584-cd35-41c4-9475-ad90c831ebc8]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c -p 172.16.0.220:3260 --logout {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9025a24-b106-4490-bb03-2311adbb91ec]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c, portal: 172.16.0.220,3260]
Nov 14 23:44:50 user nova-compute[75341]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c, portal: 172.16.0.220,3260] successful.
Nov 14 23:44:50 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c -p 172.16.0.220:3260 --op delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b6ca6d-01d7-4940-b7b3-e5f929375287]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] <== disconnect_volume: return (349ms) None {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Disconnected iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 23:44:50 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Deleting instance files /opt/stack/data/nova/instances/cffc86d5-2ac6-4dd1-bdcd-5832c134d179_del
Nov 14 23:44:50 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Deletion of /opt/stack/data/nova/instances/cffc86d5-2ac6-4dd1-bdcd-5832c134d179_del complete
Nov 14 23:44:50 user nova-compute[75341]: DEBUG nova.network.neutron [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d92ba9df-c739-414d-a701-ddba04563427] Successfully updated port: 5d23fcc8-0277-4900-b524-398ad1f6f27a {{(pid=75341) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Acquiring lock "refresh_cache-d92ba9df-c739-414d-a701-ddba04563427" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Acquired lock "refresh_cache-d92ba9df-c739-414d-a701-ddba04563427" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG nova.network.neutron [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d92ba9df-c739-414d-a701-ddba04563427] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG nova.compute.manager [req-33549e83-4a0d-48c4-be6d-b925fb3370cf req-cae55fed-a4d5-45d9-a547-2280a7f1b9c9 service nova] [instance: d92ba9df-c739-414d-a701-ddba04563427] Received event network-changed-5d23fcc8-0277-4900-b524-398ad1f6f27a {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG nova.compute.manager [req-33549e83-4a0d-48c4-be6d-b925fb3370cf req-cae55fed-a4d5-45d9-a547-2280a7f1b9c9 service nova] [instance: d92ba9df-c739-414d-a701-ddba04563427] Refreshing instance network info cache due to event network-changed-5d23fcc8-0277-4900-b524-398ad1f6f27a. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-33549e83-4a0d-48c4-be6d-b925fb3370cf req-cae55fed-a4d5-45d9-a547-2280a7f1b9c9 service nova] Acquiring lock "refresh_cache-d92ba9df-c739-414d-a701-ddba04563427" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG nova.network.neutron [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d92ba9df-c739-414d-a701-ddba04563427] Instance cache missing network info. {{(pid=75341) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 23:44:50 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance cffc86d5-2ac6-4dd1-bdcd-5832c134d179 could not be found.
Nov 14 23:44:50 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] calling os-brick to detach iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, {'target_iqn': 'iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cDKCeEGM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:44:50 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 23:44:50 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:44:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Updating instance_info_cache with network_info: [{"id": "dcc0edd5-582a-499a-beaf-6de23ff1537c", "address": "fa:16:3e:83:5b:7a", "network": {"id": "139c86e9-e6ea-4307-9f78-7f41ab7a6d8c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-487359378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eff8d64949254c7eb3dd8685ca7447b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc0edd5-58", "ovs_interfaceid": "dcc0edd5-582a-499a-beaf-6de23ff1537c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc4ec34-c463-4040-b0bb-011869fcc354]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 23:44:51 user nova-compute[75341]: No targets found.
Nov 14 23:44:51 user nova-compute[75341]: iSNS:
Nov 14 23:44:51 user nova-compute[75341]: No targets found.
Nov 14 23:44:51 user nova-compute[75341]: STATIC:
Nov 14 23:44:51 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265
Nov 14 23:44:51 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:44:51 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:44:51 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3
Nov 14 23:44:51 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:44:51 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:44:51 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a
Nov 14 23:44:51 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:44:51 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:44:51 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7
Nov 14 23:44:51 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:44:51 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:44:51 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912
Nov 14 23:44:51 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:44:51 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:44:51 user nova-compute[75341]: FIRMWARE:
Nov 14 23:44:51 user nova-compute[75341]: No targets found.
Nov 14 23:44:51 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 23:44:51 user nova-compute[75341]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 23:44:51 user nova-compute[75341]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75341) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c', 0)] {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Releasing lock "refresh_cache-881351d7-31f9-44f4-8571-8f540bbec29c" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Updated the network info_cache for instance {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75341) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[74bba979-39b6-4dd8-a4ed-355d6fb3afad]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75341) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ac81a7-af83-4c60-b318-2569db637822]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 (non-flash)
Nov 14 23:44:51 user nova-compute[75341]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)
Nov 14 23:44:51 user nova-compute[75341]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 (non-flash)
Nov 14 23:44:51 user nova-compute[75341]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a (non-flash)
Nov 14 23:44:51 user nova-compute[75341]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 (non-flash)
Nov 14 23:44:51 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 (non-flash)
Nov 14 23:44:51 user nova-compute[75341]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)
Nov 14 23:44:51 user nova-compute[75341]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 (non-flash)
Nov 14 23:44:51 user nova-compute[75341]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a (non-flash)
Nov 14 23:44:51 user nova-compute[75341]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 (non-flash)
Nov 14 23:44:51 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18507f41f0>, {}) {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Disconnecting from: [] {{(pid=75341) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.089s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] <== disconnect_volume: return (90ms) None {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Disconnected iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG nova.network.neutron [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d92ba9df-c739-414d-a701-ddba04563427] Updating instance_info_cache with network_info: [{"id": "5d23fcc8-0277-4900-b524-398ad1f6f27a", "address": "fa:16:3e:0d:0a:ad", "network": {"id": "9ad7204e-07f5-4676-b2de-09e036a92e61", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-718201239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542a85b3a6d14c77872f1957120ba655", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d23fcc8-02", "ovs_interfaceid": "5d23fcc8-0277-4900-b524-398ad1f6f27a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Releasing lock "refresh_cache-d92ba9df-c739-414d-a701-ddba04563427" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG nova.compute.manager [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d92ba9df-c739-414d-a701-ddba04563427] Instance network_info: |[{"id": "5d23fcc8-0277-4900-b524-398ad1f6f27a", "address": "fa:16:3e:0d:0a:ad", "network": {"id": "9ad7204e-07f5-4676-b2de-09e036a92e61", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-718201239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542a85b3a6d14c77872f1957120ba655", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d23fcc8-02", "ovs_interfaceid": "5d23fcc8-0277-4900-b524-398ad1f6f27a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-33549e83-4a0d-48c4-be6d-b925fb3370cf req-cae55fed-a4d5-45d9-a547-2280a7f1b9c9 service nova] Acquired lock "refresh_cache-d92ba9df-c739-414d-a701-ddba04563427" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG nova.network.neutron [req-33549e83-4a0d-48c4-be6d-b925fb3370cf req-cae55fed-a4d5-45d9-a547-2280a7f1b9c9 service nova] [instance: d92ba9df-c739-414d-a701-ddba04563427] Refreshing network info cache for port 5d23fcc8-0277-4900-b524-398ad1f6f27a {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d92ba9df-c739-414d-a701-ddba04563427] Start _get_guest_xml network_info=[{"id": "5d23fcc8-0277-4900-b524-398ad1f6f27a", "address": "fa:16:3e:0d:0a:ad", "network": {"id": "9ad7204e-07f5-4676-b2de-09e036a92e61", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-718201239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542a85b3a6d14c77872f1957120ba655", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d23fcc8-02", "ovs_interfaceid": "5d23fcc8-0277-4900-b524-398ad1f6f27a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encrypted': False, 'image_id': 'e46abb82-b810-490e-a8a1-ccdc5fa1a796'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:51 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:44:51 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:44:51 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:44:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1097690889',display_name='tempest-AttachVolumeNegativeTest-server-1097690889',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1097690889',id=19,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/+ymLiRQc0q1R+iJDn58zOn+lVhcGJlNDcnS9pKUI011JCvy6OoeB8hXhnmWcRKyNmxbD128fs9Twdc4hXLWgfOZO6Ubnrr3zL0hmUik0rrNEa4ehFeMt2nMglkXME3A==',key_name='tempest-keypair-119997497',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='542a85b3a6d14c77872f1957120ba655',ramdisk_id='',reservation_id='r-k4peuaea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-802469934',owner_user_name='tempest-AttachVolumeNegativeTest-802469934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:44:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d0b6eae0d3124f70982781555ccc7ec0',uuid=d92ba9df-c739-414d-a701-ddba04563427,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d23fcc8-0277-4900-b524-398ad1f6f27a", "address": "fa:16:3e:0d:0a:ad", "network": {"id": "9ad7204e-07f5-4676-b2de-09e036a92e61", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-718201239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542a85b3a6d14c77872f1957120ba655", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d23fcc8-02", "ovs_interfaceid": "5d23fcc8-0277-4900-b524-398ad1f6f27a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Converting VIF {"id": "5d23fcc8-0277-4900-b524-398ad1f6f27a", "address": "fa:16:3e:0d:0a:ad", "network": {"id": "9ad7204e-07f5-4676-b2de-09e036a92e61", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-718201239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542a85b3a6d14c77872f1957120ba655", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d23fcc8-02", "ovs_interfaceid": "5d23fcc8-0277-4900-b524-398ad1f6f27a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:0a:ad,bridge_name='br-int',has_traffic_filtering=True,id=5d23fcc8-0277-4900-b524-398ad1f6f27a,network=Network(9ad7204e-07f5-4676-b2de-09e036a92e61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d23fcc8-02') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG nova.objects.instance [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lazy-loading 'pci_devices' on Instance uuid d92ba9df-c739-414d-a701-ddba04563427 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d92ba9df-c739-414d-a701-ddba04563427] End _get_guest_xml xml=<domain type="kvm">
Nov 14 23:44:51 user nova-compute[75341]:   <uuid>d92ba9df-c739-414d-a701-ddba04563427</uuid>
Nov 14 23:44:51 user nova-compute[75341]:   <name>instance-00000013</name>
Nov 14 23:44:51 user nova-compute[75341]:   <memory>524288</memory>
Nov 14 23:44:51 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 14 23:44:51 user nova-compute[75341]:   <metadata>
Nov 14 23:44:51 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 23:44:51 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 14 23:44:51 user nova-compute[75341]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1097690889</nova:name>
Nov 14 23:44:51 user nova-compute[75341]:       <nova:creationTime>2023-11-14 23:44:51</nova:creationTime>
Nov 14 23:44:51 user nova-compute[75341]:       <nova:flavor name="m1.tiny">
Nov 14 23:44:51 user nova-compute[75341]:         <nova:memory>512</nova:memory>
Nov 14 23:44:51 user nova-compute[75341]:         <nova:disk>1</nova:disk>
Nov 14 23:44:51 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 14 23:44:51 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 23:44:51 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 14 23:44:51 user nova-compute[75341]:       </nova:flavor>
Nov 14 23:44:51 user nova-compute[75341]:       <nova:owner>
Nov 14 23:44:51 user nova-compute[75341]:         <nova:user uuid="d0b6eae0d3124f70982781555ccc7ec0">tempest-AttachVolumeNegativeTest-802469934-project-member</nova:user>
Nov 14 23:44:51 user nova-compute[75341]:         <nova:project uuid="542a85b3a6d14c77872f1957120ba655">tempest-AttachVolumeNegativeTest-802469934</nova:project>
Nov 14 23:44:51 user nova-compute[75341]:       </nova:owner>
Nov 14 23:44:51 user nova-compute[75341]:       <nova:root type="image" uuid="e46abb82-b810-490e-a8a1-ccdc5fa1a796"/>
Nov 14 23:44:51 user nova-compute[75341]:       <nova:ports>
Nov 14 23:44:51 user nova-compute[75341]:         <nova:port uuid="5d23fcc8-0277-4900-b524-398ad1f6f27a">
Nov 14 23:44:51 user nova-compute[75341]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 23:44:51 user nova-compute[75341]:         </nova:port>
Nov 14 23:44:51 user nova-compute[75341]:       </nova:ports>
Nov 14 23:44:51 user nova-compute[75341]:     </nova:instance>
Nov 14 23:44:51 user nova-compute[75341]:   </metadata>
Nov 14 23:44:51 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 14 23:44:51 user nova-compute[75341]:     <system>
Nov 14 23:44:51 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 23:44:51 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 14 23:44:51 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 14 23:44:51 user nova-compute[75341]:       <entry name="serial">d92ba9df-c739-414d-a701-ddba04563427</entry>
Nov 14 23:44:51 user nova-compute[75341]:       <entry name="uuid">d92ba9df-c739-414d-a701-ddba04563427</entry>
Nov 14 23:44:51 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 14 23:44:51 user nova-compute[75341]:     </system>
Nov 14 23:44:51 user nova-compute[75341]:   </sysinfo>
Nov 14 23:44:51 user nova-compute[75341]:   <os>
Nov 14 23:44:51 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 23:44:51 user nova-compute[75341]:     <boot dev="hd"/>
Nov 14 23:44:51 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 14 23:44:51 user nova-compute[75341]:   </os>
Nov 14 23:44:51 user nova-compute[75341]:   <features>
Nov 14 23:44:51 user nova-compute[75341]:     <acpi/>
Nov 14 23:44:51 user nova-compute[75341]:     <apic/>
Nov 14 23:44:51 user nova-compute[75341]:     <vmcoreinfo/>
Nov 14 23:44:51 user nova-compute[75341]:   </features>
Nov 14 23:44:51 user nova-compute[75341]:   <clock offset="utc">
Nov 14 23:44:51 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 23:44:51 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 23:44:51 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 14 23:44:51 user nova-compute[75341]:   </clock>
Nov 14 23:44:51 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 14 23:44:51 user nova-compute[75341]:     <model>Nehalem</model>
Nov 14 23:44:51 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 23:44:51 user nova-compute[75341]:   </cpu>
Nov 14 23:44:51 user nova-compute[75341]:   <devices>
Nov 14 23:44:51 user nova-compute[75341]:     <disk type="file" device="disk">
Nov 14 23:44:51 user nova-compute[75341]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 23:44:51 user nova-compute[75341]:       <source file="/opt/stack/data/nova/instances/d92ba9df-c739-414d-a701-ddba04563427/disk"/>
Nov 14 23:44:51 user nova-compute[75341]:       <target dev="vda" bus="virtio"/>
Nov 14 23:44:51 user nova-compute[75341]:     </disk>
Nov 14 23:44:51 user nova-compute[75341]:     <interface type="ethernet">
Nov 14 23:44:51 user nova-compute[75341]:       <mac address="fa:16:3e:0d:0a:ad"/>
Nov 14 23:44:51 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:44:51 user nova-compute[75341]:       <mtu size="1442"/>
Nov 14 23:44:51 user nova-compute[75341]:       <target dev="tap5d23fcc8-02"/>
Nov 14 23:44:51 user nova-compute[75341]:     </interface>
Nov 14 23:44:51 user nova-compute[75341]:     <serial type="pty">
Nov 14 23:44:51 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/d92ba9df-c739-414d-a701-ddba04563427/console.log" append="off"/>
Nov 14 23:44:51 user nova-compute[75341]:     </serial>
Nov 14 23:44:51 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 23:44:51 user nova-compute[75341]:     <video>
Nov 14 23:44:51 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:44:51 user nova-compute[75341]:     </video>
Nov 14 23:44:51 user nova-compute[75341]:     <rng model="virtio">
Nov 14 23:44:51 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 14 23:44:51 user nova-compute[75341]:     </rng>
Nov 14 23:44:51 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 14 23:44:51 user nova-compute[75341]:     <memballoon model="virtio">
Nov 14 23:44:51 user nova-compute[75341]:       <stats period="10"/>
Nov 14 23:44:51 user nova-compute[75341]:     </memballoon>
Nov 14 23:44:51 user nova-compute[75341]:   </devices>
Nov 14 23:44:51 user nova-compute[75341]: </domain>
Nov 14 23:44:51 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:44:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1097690889',display_name='tempest-AttachVolumeNegativeTest-server-1097690889',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1097690889',id=19,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/+ymLiRQc0q1R+iJDn58zOn+lVhcGJlNDcnS9pKUI011JCvy6OoeB8hXhnmWcRKyNmxbD128fs9Twdc4hXLWgfOZO6Ubnrr3zL0hmUik0rrNEa4ehFeMt2nMglkXME3A==',key_name='tempest-keypair-119997497',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='542a85b3a6d14c77872f1957120ba655',ramdisk_id='',reservation_id='r-k4peuaea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-802469934',owner_user_name='tempest-AttachVolumeNegativeTest-802469934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:44:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d0b6eae0d3124f70982781555ccc7ec0',uuid=d92ba9df-c739-414d-a701-ddba04563427,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d23fcc8-0277-4900-b524-398ad1f6f27a", "address": "fa:16:3e:0d:0a:ad", "network": {"id": "9ad7204e-07f5-4676-b2de-09e036a92e61", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-718201239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542a85b3a6d14c77872f1957120ba655", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d23fcc8-02", "ovs_interfaceid": "5d23fcc8-0277-4900-b524-398ad1f6f27a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Converting VIF {"id": "5d23fcc8-0277-4900-b524-398ad1f6f27a", "address": "fa:16:3e:0d:0a:ad", "network": {"id": "9ad7204e-07f5-4676-b2de-09e036a92e61", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-718201239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542a85b3a6d14c77872f1957120ba655", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d23fcc8-02", "ovs_interfaceid": "5d23fcc8-0277-4900-b524-398ad1f6f27a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:0a:ad,bridge_name='br-int',has_traffic_filtering=True,id=5d23fcc8-0277-4900-b524-398ad1f6f27a,network=Network(9ad7204e-07f5-4676-b2de-09e036a92e61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d23fcc8-02') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG os_vif [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:0a:ad,bridge_name='br-int',has_traffic_filtering=True,id=5d23fcc8-0277-4900-b524-398ad1f6f27a,network=Network(9ad7204e-07f5-4676-b2de-09e036a92e61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d23fcc8-02') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '83a73a6a-36fd-55c4-a8f4-838d354918b4', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5d23fcc8-02, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5d23fcc8-02, col_values=(('qos', UUID('cd9be1cf-a0b9-476c-a90f-70fb7c280d8f')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5d23fcc8-02, col_values=(('external_ids', {'iface-id': '5d23fcc8-0277-4900-b524-398ad1f6f27a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:0a:ad', 'vm-uuid': 'd92ba9df-c739-414d-a701-ddba04563427'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:51 user nova-compute[75341]: INFO os_vif [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:0a:ad,bridge_name='br-int',has_traffic_filtering=True,id=5d23fcc8-0277-4900-b524-398ad1f6f27a,network=Network(9ad7204e-07f5-4676-b2de-09e036a92e61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d23fcc8-02')
Nov 14 23:44:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] No VIF found with MAC fa:16:3e:0d:0a:ad, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:52 user nova-compute[75341]: DEBUG nova.compute.manager [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Preparing to wait for external event volume-reimaged-b7af2f07-212b-4210-b473-6e1da973682c {{(pid=75341) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 14 23:44:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Acquiring lock "cffc86d5-2ac6-4dd1-bdcd-5832c134d179-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:44:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Lock "cffc86d5-2ac6-4dd1-bdcd-5832c134d179-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:44:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Lock "cffc86d5-2ac6-4dd1-bdcd-5832c134d179-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:44:52 user nova-compute[75341]: DEBUG nova.network.neutron [req-33549e83-4a0d-48c4-be6d-b925fb3370cf req-cae55fed-a4d5-45d9-a547-2280a7f1b9c9 service nova] [instance: d92ba9df-c739-414d-a701-ddba04563427] Updated VIF entry in instance network info cache for port 5d23fcc8-0277-4900-b524-398ad1f6f27a. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:44:52 user nova-compute[75341]: DEBUG nova.network.neutron [req-33549e83-4a0d-48c4-be6d-b925fb3370cf req-cae55fed-a4d5-45d9-a547-2280a7f1b9c9 service nova] [instance: d92ba9df-c739-414d-a701-ddba04563427] Updating instance_info_cache with network_info: [{"id": "5d23fcc8-0277-4900-b524-398ad1f6f27a", "address": "fa:16:3e:0d:0a:ad", "network": {"id": "9ad7204e-07f5-4676-b2de-09e036a92e61", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-718201239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542a85b3a6d14c77872f1957120ba655", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d23fcc8-02", "ovs_interfaceid": "5d23fcc8-0277-4900-b524-398ad1f6f27a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:44:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-33549e83-4a0d-48c4-be6d-b925fb3370cf req-cae55fed-a4d5-45d9-a547-2280a7f1b9c9 service nova] Releasing lock "refresh_cache-d92ba9df-c739-414d-a701-ddba04563427" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:44:52 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:52 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 23:44:52 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0cffbac-f552-47bf-bd6c-dabb70e7c867/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:52 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:44:52 user nova-compute[75341]: INFO nova.compute.manager [-] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Took 1.73 seconds to deallocate network for instance.
Nov 14 23:44:52 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0cffbac-f552-47bf-bd6c-dabb70e7c867/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:52 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0cffbac-f552-47bf-bd6c-dabb70e7c867/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:52 user nova-compute[75341]: DEBUG nova.compute.manager [req-0d9efec1-e782-40c1-ade5-35e0d9025331 req-04036fdd-d3cf-4d0f-b0b0-a9adc2ab49fa service nova] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Received event network-vif-plugged-611fe585-b169-4ec5-97cf-8ebdf5060502 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:44:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-0d9efec1-e782-40c1-ade5-35e0d9025331 req-04036fdd-d3cf-4d0f-b0b0-a9adc2ab49fa service nova] Acquiring lock "44080c0d-56eb-4987-aa4b-59f161dcbc0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:44:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-0d9efec1-e782-40c1-ade5-35e0d9025331 req-04036fdd-d3cf-4d0f-b0b0-a9adc2ab49fa service nova] Lock "44080c0d-56eb-4987-aa4b-59f161dcbc0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.007s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:44:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-0d9efec1-e782-40c1-ade5-35e0d9025331 req-04036fdd-d3cf-4d0f-b0b0-a9adc2ab49fa service nova] Lock "44080c0d-56eb-4987-aa4b-59f161dcbc0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:44:52 user nova-compute[75341]: DEBUG nova.compute.manager [req-0d9efec1-e782-40c1-ade5-35e0d9025331 req-04036fdd-d3cf-4d0f-b0b0-a9adc2ab49fa service nova] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] No waiting events found dispatching network-vif-plugged-611fe585-b169-4ec5-97cf-8ebdf5060502 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:44:52 user nova-compute[75341]: WARNING nova.compute.manager [req-0d9efec1-e782-40c1-ade5-35e0d9025331 req-04036fdd-d3cf-4d0f-b0b0-a9adc2ab49fa service nova] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Received unexpected event network-vif-plugged-611fe585-b169-4ec5-97cf-8ebdf5060502 for instance with vm_state active and task_state deleting.
Nov 14 23:44:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ddf8f5d2-3009-4112-80e7-e787796f61ac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:44:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ddf8f5d2-3009-4112-80e7-e787796f61ac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:44:52 user nova-compute[75341]: DEBUG nova.compute.manager [req-a75c1093-4a77-4fbc-a15d-cc94cfb55a9b req-7aa85cbd-aee1-40e3-9158-bf0c7ff70278 service nova] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Received event network-vif-plugged-cdc268e0-0a9a-44cf-87ef-0baca1547f68 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:44:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a75c1093-4a77-4fbc-a15d-cc94cfb55a9b req-7aa85cbd-aee1-40e3-9158-bf0c7ff70278 service nova] Acquiring lock "cffc86d5-2ac6-4dd1-bdcd-5832c134d179-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:44:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a75c1093-4a77-4fbc-a15d-cc94cfb55a9b req-7aa85cbd-aee1-40e3-9158-bf0c7ff70278 service nova] Lock "cffc86d5-2ac6-4dd1-bdcd-5832c134d179-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:44:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a75c1093-4a77-4fbc-a15d-cc94cfb55a9b req-7aa85cbd-aee1-40e3-9158-bf0c7ff70278 service nova] Lock "cffc86d5-2ac6-4dd1-bdcd-5832c134d179-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:44:52 user nova-compute[75341]: DEBUG nova.compute.manager [req-a75c1093-4a77-4fbc-a15d-cc94cfb55a9b req-7aa85cbd-aee1-40e3-9158-bf0c7ff70278 service nova] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] No event matching network-vif-plugged-cdc268e0-0a9a-44cf-87ef-0baca1547f68 in dict_keys([('volume-reimaged', 'b7af2f07-212b-4210-b473-6e1da973682c')]) {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:325}}
Nov 14 23:44:52 user nova-compute[75341]: WARNING nova.compute.manager [req-a75c1093-4a77-4fbc-a15d-cc94cfb55a9b req-7aa85cbd-aee1-40e3-9158-bf0c7ff70278 service nova] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Received unexpected event network-vif-plugged-cdc268e0-0a9a-44cf-87ef-0baca1547f68 for instance with vm_state active and task_state rebuilding.
Nov 14 23:44:52 user nova-compute[75341]: DEBUG nova.compute.manager [req-a75c1093-4a77-4fbc-a15d-cc94cfb55a9b req-7aa85cbd-aee1-40e3-9158-bf0c7ff70278 service nova] [instance: 44080c0d-56eb-4987-aa4b-59f161dcbc0b] Received event network-vif-deleted-611fe585-b169-4ec5-97cf-8ebdf5060502 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:44:52 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0cffbac-f552-47bf-bd6c-dabb70e7c867/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:52 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a141d7ee-3f77-4fdc-85ec-2cbd5af17646/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:52 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a141d7ee-3f77-4fdc-85ec-2cbd5af17646/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:52 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a141d7ee-3f77-4fdc-85ec-2cbd5af17646/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:52 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-ddf8f5d2-3009-4112-80e7-e787796f61ac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:44:52 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-ddf8f5d2-3009-4112-80e7-e787796f61ac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:44:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ddf8f5d2-3009-4112-80e7-e787796f61ac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.499s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:44:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:52 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a141d7ee-3f77-4fdc-85ec-2cbd5af17646/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:52 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c73d0da-fea9-4098-a0e8-c070f22969f4/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:53 user nova-compute[75341]: INFO nova.scheduler.client.report [None req-ddf8f5d2-3009-4112-80e7-e787796f61ac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Deleted allocations for instance 44080c0d-56eb-4987-aa4b-59f161dcbc0b
Nov 14 23:44:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c73d0da-fea9-4098-a0e8-c070f22969f4/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c73d0da-fea9-4098-a0e8-c070f22969f4/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ddf8f5d2-3009-4112-80e7-e787796f61ac tempest-TestServerVolumeAttachmentScenario-394165190 tempest-TestServerVolumeAttachmentScenario-394165190-project-member] Lock "44080c0d-56eb-4987-aa4b-59f161dcbc0b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.700s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:44:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c73d0da-fea9-4098-a0e8-c070f22969f4/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:53 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:53 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a308a35f-c8d7-482c-a93d-5d9eb473d4e1/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a308a35f-c8d7-482c-a93d-5d9eb473d4e1/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a308a35f-c8d7-482c-a93d-5d9eb473d4e1/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a308a35f-c8d7-482c-a93d-5d9eb473d4e1/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:54 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 23:44:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:57 user nova-compute[75341]: DEBUG nova.compute.manager [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d92ba9df-c739-414d-a701-ddba04563427] Instance event wait completed in 0 seconds for  {{(pid=75341) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 23:44:57 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d92ba9df-c739-414d-a701-ddba04563427] Guest created on hypervisor {{(pid=75341) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 23:44:57 user nova-compute[75341]: DEBUG nova.compute.manager [req-ad88d92e-90c3-463d-8c3f-fa37107e221c req-38383e5e-b6e4-4091-ba9a-3ec318487bfb service nova] [instance: d92ba9df-c739-414d-a701-ddba04563427] Received event network-vif-plugged-5d23fcc8-0277-4900-b524-398ad1f6f27a {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:44:57 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ad88d92e-90c3-463d-8c3f-fa37107e221c req-38383e5e-b6e4-4091-ba9a-3ec318487bfb service nova] Acquiring lock "d92ba9df-c739-414d-a701-ddba04563427-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:44:57 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ad88d92e-90c3-463d-8c3f-fa37107e221c req-38383e5e-b6e4-4091-ba9a-3ec318487bfb service nova] Lock "d92ba9df-c739-414d-a701-ddba04563427-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:44:57 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ad88d92e-90c3-463d-8c3f-fa37107e221c req-38383e5e-b6e4-4091-ba9a-3ec318487bfb service nova] Lock "d92ba9df-c739-414d-a701-ddba04563427-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:44:57 user nova-compute[75341]: DEBUG nova.compute.manager [req-ad88d92e-90c3-463d-8c3f-fa37107e221c req-38383e5e-b6e4-4091-ba9a-3ec318487bfb service nova] [instance: d92ba9df-c739-414d-a701-ddba04563427] No waiting events found dispatching network-vif-plugged-5d23fcc8-0277-4900-b524-398ad1f6f27a {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:44:57 user nova-compute[75341]: WARNING nova.compute.manager [req-ad88d92e-90c3-463d-8c3f-fa37107e221c req-38383e5e-b6e4-4091-ba9a-3ec318487bfb service nova] [instance: d92ba9df-c739-414d-a701-ddba04563427] Received unexpected event network-vif-plugged-5d23fcc8-0277-4900-b524-398ad1f6f27a for instance with vm_state building and task_state spawning.
Nov 14 23:44:57 user nova-compute[75341]: DEBUG nova.compute.manager [req-ad88d92e-90c3-463d-8c3f-fa37107e221c req-38383e5e-b6e4-4091-ba9a-3ec318487bfb service nova] [instance: d92ba9df-c739-414d-a701-ddba04563427] Received event network-vif-plugged-5d23fcc8-0277-4900-b524-398ad1f6f27a {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:44:57 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ad88d92e-90c3-463d-8c3f-fa37107e221c req-38383e5e-b6e4-4091-ba9a-3ec318487bfb service nova] Acquiring lock "d92ba9df-c739-414d-a701-ddba04563427-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:44:57 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ad88d92e-90c3-463d-8c3f-fa37107e221c req-38383e5e-b6e4-4091-ba9a-3ec318487bfb service nova] Lock "d92ba9df-c739-414d-a701-ddba04563427-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:44:57 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ad88d92e-90c3-463d-8c3f-fa37107e221c req-38383e5e-b6e4-4091-ba9a-3ec318487bfb service nova] Lock "d92ba9df-c739-414d-a701-ddba04563427-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:44:57 user nova-compute[75341]: DEBUG nova.compute.manager [req-ad88d92e-90c3-463d-8c3f-fa37107e221c req-38383e5e-b6e4-4091-ba9a-3ec318487bfb service nova] [instance: d92ba9df-c739-414d-a701-ddba04563427] No waiting events found dispatching network-vif-plugged-5d23fcc8-0277-4900-b524-398ad1f6f27a {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:44:57 user nova-compute[75341]: WARNING nova.compute.manager [req-ad88d92e-90c3-463d-8c3f-fa37107e221c req-38383e5e-b6e4-4091-ba9a-3ec318487bfb service nova] [instance: d92ba9df-c739-414d-a701-ddba04563427] Received unexpected event network-vif-plugged-5d23fcc8-0277-4900-b524-398ad1f6f27a for instance with vm_state building and task_state spawning.
Nov 14 23:44:57 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:44:57 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:44:57 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Hypervisor/Node resource view: name=user free_ram=7272MB free_disk=25.62697982788086GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75341) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 23:44:57 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:44:57 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:44:57 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: d92ba9df-c739-414d-a701-ddba04563427] Instance spawned successfully.
Nov 14 23:44:57 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d92ba9df-c739-414d-a701-ddba04563427] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 23:44:57 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d92ba9df-c739-414d-a701-ddba04563427] Found default for hw_cdrom_bus of ide {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:44:57 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d92ba9df-c739-414d-a701-ddba04563427] Found default for hw_disk_bus of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:44:57 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d92ba9df-c739-414d-a701-ddba04563427] Found default for hw_input_bus of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:44:57 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d92ba9df-c739-414d-a701-ddba04563427] Found default for hw_pointer_model of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:44:57 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d92ba9df-c739-414d-a701-ddba04563427] Found default for hw_video_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:44:57 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d92ba9df-c739-414d-a701-ddba04563427] Found default for hw_vif_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:44:57 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Applying migration context for instance 881351d7-31f9-44f4-8571-8f540bbec29c as it has an incoming, in-progress migration ce0332b8-78dd-4580-ac96-b62cde301a6b. Migration status is finished {{(pid=75341) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 14 23:44:57 user nova-compute[75341]: INFO nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Updating resource usage from migration ce0332b8-78dd-4580-ac96-b62cde301a6b
Nov 14 23:44:57 user nova-compute[75341]: INFO nova.compute.manager [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d92ba9df-c739-414d-a701-ddba04563427] Took 7.86 seconds to spawn the instance on the hypervisor.
Nov 14 23:44:57 user nova-compute[75341]: DEBUG nova.compute.manager [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d92ba9df-c739-414d-a701-ddba04563427] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 23:44:57 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance a0cffbac-f552-47bf-bd6c-dabb70e7c867 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:44:57 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance cffc86d5-2ac6-4dd1-bdcd-5832c134d179 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:44:57 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 3c73d0da-fea9-4098-a0e8-c070f22969f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:44:57 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance a308a35f-c8d7-482c-a93d-5d9eb473d4e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:44:57 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Migration ce0332b8-78dd-4580-ac96-b62cde301a6b is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 14 23:44:57 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 881351d7-31f9-44f4-8571-8f540bbec29c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:44:57 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance a141d7ee-3f77-4fdc-85ec-2cbd5af17646 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:44:57 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance dbc9a6db-b536-426a-91fd-691a44c66528 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:44:57 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 51045050-c7c6-49c5-acd4-2a76be0f466f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:44:57 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 6382e432-838f-4d89-a743-cbaa37f50ab5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:44:57 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance d92ba9df-c739-414d-a701-ddba04563427 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:44:57 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 23:44:57 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 23:44:57 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-33afdc77-07b4-4d20-b1e8-4d48a3d84402 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Acquiring lock "3c73d0da-fea9-4098-a0e8-c070f22969f4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:44:57 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-33afdc77-07b4-4d20-b1e8-4d48a3d84402 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Lock "3c73d0da-fea9-4098-a0e8-c070f22969f4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:44:57 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-33afdc77-07b4-4d20-b1e8-4d48a3d84402 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Acquiring lock "3c73d0da-fea9-4098-a0e8-c070f22969f4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:44:57 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-33afdc77-07b4-4d20-b1e8-4d48a3d84402 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Lock "3c73d0da-fea9-4098-a0e8-c070f22969f4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:44:57 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-33afdc77-07b4-4d20-b1e8-4d48a3d84402 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Lock "3c73d0da-fea9-4098-a0e8-c070f22969f4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:44:57 user nova-compute[75341]: INFO nova.compute.manager [None req-33afdc77-07b4-4d20-b1e8-4d48a3d84402 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: 3c73d0da-fea9-4098-a0e8-c070f22969f4] Terminating instance
Nov 14 23:44:57 user nova-compute[75341]: DEBUG nova.compute.manager [None req-33afdc77-07b4-4d20-b1e8-4d48a3d84402 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: 3c73d0da-fea9-4098-a0e8-c070f22969f4] Start destroying the instance on the hypervisor. {{(pid=75341) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 23:44:57 user nova-compute[75341]: INFO nova.compute.manager [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d92ba9df-c739-414d-a701-ddba04563427] Took 9.22 seconds to build instance.
Nov 14 23:44:57 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8f15439c-4fa9-448c-a5a2-4476ee94b66f tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "d92ba9df-c739-414d-a701-ddba04563427" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.321s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:44:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:57 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:44:57 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:44:57 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Compute_service record updated for user:user {{(pid=75341) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 23:44:57 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.702s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:44:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:58 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:44:58 user nova-compute[75341]: DEBUG nova.compute.manager [req-b7659664-f9b8-4f48-b1b3-0dede3472583 req-7af2e58b-01cb-49d7-b914-d4bdc12e03eb service nova] [instance: 3c73d0da-fea9-4098-a0e8-c070f22969f4] Received event network-vif-unplugged-2d5bc584-626d-49ee-874b-2d5028226ba1 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:44:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-b7659664-f9b8-4f48-b1b3-0dede3472583 req-7af2e58b-01cb-49d7-b914-d4bdc12e03eb service nova] Acquiring lock "3c73d0da-fea9-4098-a0e8-c070f22969f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:44:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-b7659664-f9b8-4f48-b1b3-0dede3472583 req-7af2e58b-01cb-49d7-b914-d4bdc12e03eb service nova] Lock "3c73d0da-fea9-4098-a0e8-c070f22969f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:44:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-b7659664-f9b8-4f48-b1b3-0dede3472583 req-7af2e58b-01cb-49d7-b914-d4bdc12e03eb service nova] Lock "3c73d0da-fea9-4098-a0e8-c070f22969f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:44:58 user nova-compute[75341]: DEBUG nova.compute.manager [req-b7659664-f9b8-4f48-b1b3-0dede3472583 req-7af2e58b-01cb-49d7-b914-d4bdc12e03eb service nova] [instance: 3c73d0da-fea9-4098-a0e8-c070f22969f4] No waiting events found dispatching network-vif-unplugged-2d5bc584-626d-49ee-874b-2d5028226ba1 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:44:58 user nova-compute[75341]: DEBUG nova.compute.manager [req-b7659664-f9b8-4f48-b1b3-0dede3472583 req-7af2e58b-01cb-49d7-b914-d4bdc12e03eb service nova] [instance: 3c73d0da-fea9-4098-a0e8-c070f22969f4] Received event network-vif-unplugged-2d5bc584-626d-49ee-874b-2d5028226ba1 for instance with task_state deleting. {{(pid=75341) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 23:44:58 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 3c73d0da-fea9-4098-a0e8-c070f22969f4] Instance destroyed successfully.
Nov 14 23:44:58 user nova-compute[75341]: DEBUG nova.objects.instance [None req-33afdc77-07b4-4d20-b1e8-4d48a3d84402 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Lazy-loading 'resources' on Instance uuid 3c73d0da-fea9-4098-a0e8-c070f22969f4 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:44:58 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-33afdc77-07b4-4d20-b1e8-4d48a3d84402 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:43:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1632014469',display_name='tempest-VolumesAdminNegativeTest-server-1632014469',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1632014469',id=14,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:43:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7c8a897400c74100ad6c115397bc84ff',ramdisk_id='',reservation_id='r-trozxw8g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-2087255478',owner_user_name='tempest-VolumesAdminNegativeTest-2087255478-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:43:10Z,user_data=None,user_id='7cc85fb2b1a141578ba9558bc79ccc02',uuid=3c73d0da-fea9-4098-a0e8-c070f22969f4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d5bc584-626d-49ee-874b-2d5028226ba1", "address": "fa:16:3e:b8:ab:7b", "network": {"id": "a59b651e-81c5-4a68-b694-1e84de25e915", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1023462603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8a897400c74100ad6c115397bc84ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d5bc584-62", "ovs_interfaceid": "2d5bc584-626d-49ee-874b-2d5028226ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 23:44:58 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-33afdc77-07b4-4d20-b1e8-4d48a3d84402 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Converting VIF {"id": "2d5bc584-626d-49ee-874b-2d5028226ba1", "address": "fa:16:3e:b8:ab:7b", "network": {"id": "a59b651e-81c5-4a68-b694-1e84de25e915", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1023462603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8a897400c74100ad6c115397bc84ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d5bc584-62", "ovs_interfaceid": "2d5bc584-626d-49ee-874b-2d5028226ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:44:58 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-33afdc77-07b4-4d20-b1e8-4d48a3d84402 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:ab:7b,bridge_name='br-int',has_traffic_filtering=True,id=2d5bc584-626d-49ee-874b-2d5028226ba1,network=Network(a59b651e-81c5-4a68-b694-1e84de25e915),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d5bc584-62') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:44:58 user nova-compute[75341]: DEBUG os_vif [None req-33afdc77-07b4-4d20-b1e8-4d48a3d84402 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:ab:7b,bridge_name='br-int',has_traffic_filtering=True,id=2d5bc584-626d-49ee-874b-2d5028226ba1,network=Network(a59b651e-81c5-4a68-b694-1e84de25e915),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d5bc584-62') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 23:44:58 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:58 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2d5bc584-62, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:44:58 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:58 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:58 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:58 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e45ad624-772b-4321-a2a7-d8bc4e65759b) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:44:58 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:44:58 user nova-compute[75341]: INFO os_vif [None req-33afdc77-07b4-4d20-b1e8-4d48a3d84402 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:ab:7b,bridge_name='br-int',has_traffic_filtering=True,id=2d5bc584-626d-49ee-874b-2d5028226ba1,network=Network(a59b651e-81c5-4a68-b694-1e84de25e915),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d5bc584-62')
Nov 14 23:44:58 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-33afdc77-07b4-4d20-b1e8-4d48a3d84402 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: 3c73d0da-fea9-4098-a0e8-c070f22969f4] Deleting instance files /opt/stack/data/nova/instances/3c73d0da-fea9-4098-a0e8-c070f22969f4_del
Nov 14 23:44:58 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-33afdc77-07b4-4d20-b1e8-4d48a3d84402 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: 3c73d0da-fea9-4098-a0e8-c070f22969f4] Deletion of /opt/stack/data/nova/instances/3c73d0da-fea9-4098-a0e8-c070f22969f4_del complete
Nov 14 23:44:58 user nova-compute[75341]: INFO nova.compute.manager [None req-33afdc77-07b4-4d20-b1e8-4d48a3d84402 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: 3c73d0da-fea9-4098-a0e8-c070f22969f4] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 14 23:44:58 user nova-compute[75341]: DEBUG oslo.service.loopingcall [None req-33afdc77-07b4-4d20-b1e8-4d48a3d84402 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75341) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 23:44:58 user nova-compute[75341]: DEBUG nova.compute.manager [-] [instance: 3c73d0da-fea9-4098-a0e8-c070f22969f4] Deallocating network for instance {{(pid=75341) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 23:44:58 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: 3c73d0da-fea9-4098-a0e8-c070f22969f4] deallocate_for_instance() {{(pid=75341) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 23:44:58 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: 3c73d0da-fea9-4098-a0e8-c070f22969f4] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:44:58 user nova-compute[75341]: INFO nova.compute.manager [-] [instance: 3c73d0da-fea9-4098-a0e8-c070f22969f4] Took 0.49 seconds to deallocate network for instance.
Nov 14 23:44:58 user nova-compute[75341]: DEBUG nova.compute.manager [req-bdf4419c-2edb-4216-a018-d36ebe99c2d8 req-bd9a2b6c-451f-4fd3-bb91-6d75a1b267d7 service nova] [instance: 3c73d0da-fea9-4098-a0e8-c070f22969f4] Received event network-vif-deleted-2d5bc584-626d-49ee-874b-2d5028226ba1 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:44:58 user nova-compute[75341]: INFO nova.compute.manager [req-bdf4419c-2edb-4216-a018-d36ebe99c2d8 req-bd9a2b6c-451f-4fd3-bb91-6d75a1b267d7 service nova] [instance: 3c73d0da-fea9-4098-a0e8-c070f22969f4] Neutron deleted interface 2d5bc584-626d-49ee-874b-2d5028226ba1; detaching it from the instance and deleting it from the info cache
Nov 14 23:44:58 user nova-compute[75341]: DEBUG nova.network.neutron [req-bdf4419c-2edb-4216-a018-d36ebe99c2d8 req-bd9a2b6c-451f-4fd3-bb91-6d75a1b267d7 service nova] [instance: 3c73d0da-fea9-4098-a0e8-c070f22969f4] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:44:58 user nova-compute[75341]: DEBUG nova.compute.manager [req-bdf4419c-2edb-4216-a018-d36ebe99c2d8 req-bd9a2b6c-451f-4fd3-bb91-6d75a1b267d7 service nova] [instance: 3c73d0da-fea9-4098-a0e8-c070f22969f4] Detach interface failed, port_id=2d5bc584-626d-49ee-874b-2d5028226ba1, reason: Instance 3c73d0da-fea9-4098-a0e8-c070f22969f4 could not be found. {{(pid=75341) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 23:44:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-33afdc77-07b4-4d20-b1e8-4d48a3d84402 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:44:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-33afdc77-07b4-4d20-b1e8-4d48a3d84402 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:44:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Acquiring lock "0223a98e-e08f-4a0f-a707-3770c7a99b00" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:44:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Lock "0223a98e-e08f-4a0f-a707-3770c7a99b00" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:44:58 user nova-compute[75341]: INFO nova.compute.manager [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Unshelving
Nov 14 23:44:59 user nova-compute[75341]: INFO nova.virt.block_device [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Booting with volume 3d4927ae-8df9-41e3-97e6-2eef950500f7 at /dev/vda
Nov 14 23:44:59 user nova-compute[75341]: DEBUG os_brick.utils [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:44:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:59 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd24ba2-bd70-4e6f-856f-ecaaa9b9bb02]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6d1cfca09c9\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:59 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5faf3d0-aac7-4104-845e-b2721c93005a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Acquiring lock "6a0e67fc-942b-4f05-a6ee-0987944f17da" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:44:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Lock "6a0e67fc-942b-4f05-a6ee-0987944f17da" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:44:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:44:59 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f02238-b7e2-4e4c-a540-c9930c8022b7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:59 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca164a4-d2d2-4a33-96ab-3410ce893ab8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Running cmd (subprocess): nvme version {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] 'nvme version' failed. Not Retrying. {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:44:59 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] nvme not present on system {{(pid=75341) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 23:44:59 user nova-compute[75341]: DEBUG nova.compute.manager [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 6a0e67fc-942b-4f05-a6ee-0987944f17da] Starting instance... {{(pid=75341) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 23:44:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:44:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:44:59 user nova-compute[75341]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 23:44:59 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[772e9301-92bb-472e-8527-79c71441e296]: (4, '') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:44:59 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75341) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 23:44:59 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 23:44:59 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] LIGHTOS: no hostnqn found. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 23:44:59 user nova-compute[75341]: DEBUG os_brick.utils [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6d1cfca09c9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:44:59 user nova-compute[75341]: DEBUG nova.virt.block_device [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Updating existing volume attachment record: f387f63b-2cfa-4aeb-9688-e035c69e56bb {{(pid=75341) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 23:44:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:44:59 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-33afdc77-07b4-4d20-b1e8-4d48a3d84402 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:44:59 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-33afdc77-07b4-4d20-b1e8-4d48a3d84402 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:44:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-33afdc77-07b4-4d20-b1e8-4d48a3d84402 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.530s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:44:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.121s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:44:59 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75341) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 23:44:59 user nova-compute[75341]: INFO nova.compute.claims [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 6a0e67fc-942b-4f05-a6ee-0987944f17da] Claim successful on node user
Nov 14 23:44:59 user nova-compute[75341]: INFO nova.scheduler.client.report [None req-33afdc77-07b4-4d20-b1e8-4d48a3d84402 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Deleted allocations for instance 3c73d0da-fea9-4098-a0e8-c070f22969f4
Nov 14 23:44:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-33afdc77-07b4-4d20-b1e8-4d48a3d84402 tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Lock "3c73d0da-fea9-4098-a0e8-c070f22969f4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.242s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:45:00 user nova-compute[75341]: DEBUG nova.compute.manager [req-e1d62c8d-1bdc-4540-a35b-362ea1b5acb9 req-412626a3-a44e-45d3-adee-be36b1f4a2fa service nova] [instance: 3c73d0da-fea9-4098-a0e8-c070f22969f4] Received event network-vif-plugged-2d5bc584-626d-49ee-874b-2d5028226ba1 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:45:00 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-e1d62c8d-1bdc-4540-a35b-362ea1b5acb9 req-412626a3-a44e-45d3-adee-be36b1f4a2fa service nova] Acquiring lock "3c73d0da-fea9-4098-a0e8-c070f22969f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:45:00 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-e1d62c8d-1bdc-4540-a35b-362ea1b5acb9 req-412626a3-a44e-45d3-adee-be36b1f4a2fa service nova] Lock "3c73d0da-fea9-4098-a0e8-c070f22969f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:45:00 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-e1d62c8d-1bdc-4540-a35b-362ea1b5acb9 req-412626a3-a44e-45d3-adee-be36b1f4a2fa service nova] Lock "3c73d0da-fea9-4098-a0e8-c070f22969f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:45:00 user nova-compute[75341]: DEBUG nova.compute.manager [req-e1d62c8d-1bdc-4540-a35b-362ea1b5acb9 req-412626a3-a44e-45d3-adee-be36b1f4a2fa service nova] [instance: 3c73d0da-fea9-4098-a0e8-c070f22969f4] No waiting events found dispatching network-vif-plugged-2d5bc584-626d-49ee-874b-2d5028226ba1 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:45:00 user nova-compute[75341]: WARNING nova.compute.manager [req-e1d62c8d-1bdc-4540-a35b-362ea1b5acb9 req-412626a3-a44e-45d3-adee-be36b1f4a2fa service nova] [instance: 3c73d0da-fea9-4098-a0e8-c070f22969f4] Received unexpected event network-vif-plugged-2d5bc584-626d-49ee-874b-2d5028226ba1 for instance with vm_state deleted and task_state None.
Nov 14 23:45:00 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:45:00 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:45:00 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.687s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:45:00 user nova-compute[75341]: DEBUG nova.compute.manager [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 6a0e67fc-942b-4f05-a6ee-0987944f17da] Start building networks asynchronously for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 23:45:00 user nova-compute[75341]: DEBUG nova.compute.manager [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 6a0e67fc-942b-4f05-a6ee-0987944f17da] Allocating IP information in the background. {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 23:45:00 user nova-compute[75341]: DEBUG nova.network.neutron [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 6a0e67fc-942b-4f05-a6ee-0987944f17da] allocate_for_instance() {{(pid=75341) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 23:45:00 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 6a0e67fc-942b-4f05-a6ee-0987944f17da] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 23:45:00 user nova-compute[75341]: DEBUG nova.compute.manager [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 6a0e67fc-942b-4f05-a6ee-0987944f17da] Start building block device mappings for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 23:45:00 user nova-compute[75341]: DEBUG nova.policy [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aff47f00e24e461787b1224fa6e697fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24aa6f705262457e95f2f3f47c0ee709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75341) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 23:45:00 user nova-compute[75341]: DEBUG nova.compute.manager [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 6a0e67fc-942b-4f05-a6ee-0987944f17da] Start spawning the instance on the hypervisor. {{(pid=75341) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 23:45:00 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 6a0e67fc-942b-4f05-a6ee-0987944f17da] Creating instance directory {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 23:45:00 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 6a0e67fc-942b-4f05-a6ee-0987944f17da] Creating image(s)
Nov 14 23:45:00 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Acquiring lock "/opt/stack/data/nova/instances/6a0e67fc-942b-4f05-a6ee-0987944f17da/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:45:00 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Lock "/opt/stack/data/nova/instances/6a0e67fc-942b-4f05-a6ee-0987944f17da/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:45:00 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Lock "/opt/stack/data/nova/instances/6a0e67fc-942b-4f05-a6ee-0987944f17da/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:45:00 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:00 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.214s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:00 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Acquiring lock "4754efee9a6d73d3647f2add2cfe86c291949740" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:45:00 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:45:00 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:00 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.206s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:00 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/6a0e67fc-942b-4f05-a6ee-0987944f17da/disk 1073741824 {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:00 user nova-compute[75341]: DEBUG nova.network.neutron [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 6a0e67fc-942b-4f05-a6ee-0987944f17da] Successfully created port: 2054f2c7-c492-4278-9a66-ee9c030df266 {{(pid=75341) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 23:45:00 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/6a0e67fc-942b-4f05-a6ee-0987944f17da/disk 1073741824" returned: 0 in 0.061s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:00 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:45:00 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.259s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:01 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6a0e67fc-942b-4f05-a6ee-0987944f17da/disk. size=1073741824 {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 23:45:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a0e67fc-942b-4f05-a6ee-0987944f17da/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a0e67fc-942b-4f05-a6ee-0987944f17da/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:01 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Cannot resize image /opt/stack/data/nova/instances/6a0e67fc-942b-4f05-a6ee-0987944f17da/disk to a smaller size. {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 23:45:01 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 6a0e67fc-942b-4f05-a6ee-0987944f17da] Created local disks {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 23:45:01 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 6a0e67fc-942b-4f05-a6ee-0987944f17da] Ensure instance console log exists: /opt/stack/data/nova/instances/6a0e67fc-942b-4f05-a6ee-0987944f17da/console.log {{(pid=75341) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 23:45:01 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:45:01 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:45:01 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:45:01 user nova-compute[75341]: DEBUG nova.network.neutron [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 6a0e67fc-942b-4f05-a6ee-0987944f17da] Successfully updated port: 2054f2c7-c492-4278-9a66-ee9c030df266 {{(pid=75341) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 23:45:01 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Acquiring lock "refresh_cache-6a0e67fc-942b-4f05-a6ee-0987944f17da" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:45:01 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Acquired lock "refresh_cache-6a0e67fc-942b-4f05-a6ee-0987944f17da" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:45:01 user nova-compute[75341]: DEBUG nova.network.neutron [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 6a0e67fc-942b-4f05-a6ee-0987944f17da] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 23:45:01 user nova-compute[75341]: DEBUG nova.compute.manager [req-28a4c87c-39d8-4731-8d64-8f1a2ceb83cb req-9460cf9b-fa82-41a3-bc21-d79a5afec746 service nova] [instance: 6a0e67fc-942b-4f05-a6ee-0987944f17da] Received event network-changed-2054f2c7-c492-4278-9a66-ee9c030df266 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:45:01 user nova-compute[75341]: DEBUG nova.compute.manager [req-28a4c87c-39d8-4731-8d64-8f1a2ceb83cb req-9460cf9b-fa82-41a3-bc21-d79a5afec746 service nova] [instance: 6a0e67fc-942b-4f05-a6ee-0987944f17da] Refreshing instance network info cache due to event network-changed-2054f2c7-c492-4278-9a66-ee9c030df266. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:45:01 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-28a4c87c-39d8-4731-8d64-8f1a2ceb83cb req-9460cf9b-fa82-41a3-bc21-d79a5afec746 service nova] Acquiring lock "refresh_cache-6a0e67fc-942b-4f05-a6ee-0987944f17da" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:45:01 user nova-compute[75341]: DEBUG nova.network.neutron [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 6a0e67fc-942b-4f05-a6ee-0987944f17da] Instance cache missing network info. {{(pid=75341) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 23:45:01 user nova-compute[75341]: DEBUG nova.network.neutron [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 6a0e67fc-942b-4f05-a6ee-0987944f17da] Updating instance_info_cache with network_info: [{"id": "2054f2c7-c492-4278-9a66-ee9c030df266", "address": "fa:16:3e:f0:19:80", "network": {"id": "b87c269d-b129-4bd0-b995-e9a9657dbd1a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1162722602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24aa6f705262457e95f2f3f47c0ee709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2054f2c7-c4", "ovs_interfaceid": "2054f2c7-c492-4278-9a66-ee9c030df266", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:45:01 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Releasing lock "refresh_cache-6a0e67fc-942b-4f05-a6ee-0987944f17da" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:45:01 user nova-compute[75341]: DEBUG nova.compute.manager [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 6a0e67fc-942b-4f05-a6ee-0987944f17da] Instance network_info: |[{"id": "2054f2c7-c492-4278-9a66-ee9c030df266", "address": "fa:16:3e:f0:19:80", "network": {"id": "b87c269d-b129-4bd0-b995-e9a9657dbd1a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1162722602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24aa6f705262457e95f2f3f47c0ee709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2054f2c7-c4", "ovs_interfaceid": "2054f2c7-c492-4278-9a66-ee9c030df266", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 23:45:01 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-28a4c87c-39d8-4731-8d64-8f1a2ceb83cb req-9460cf9b-fa82-41a3-bc21-d79a5afec746 service nova] Acquired lock "refresh_cache-6a0e67fc-942b-4f05-a6ee-0987944f17da" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:45:01 user nova-compute[75341]: DEBUG nova.network.neutron [req-28a4c87c-39d8-4731-8d64-8f1a2ceb83cb req-9460cf9b-fa82-41a3-bc21-d79a5afec746 service nova] [instance: 6a0e67fc-942b-4f05-a6ee-0987944f17da] Refreshing network info cache for port 2054f2c7-c492-4278-9a66-ee9c030df266 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:45:01 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 6a0e67fc-942b-4f05-a6ee-0987944f17da] Start _get_guest_xml network_info=[{"id": "2054f2c7-c492-4278-9a66-ee9c030df266", "address": "fa:16:3e:f0:19:80", "network": {"id": "b87c269d-b129-4bd0-b995-e9a9657dbd1a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1162722602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24aa6f705262457e95f2f3f47c0ee709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2054f2c7-c4", "ovs_interfaceid": "2054f2c7-c492-4278-9a66-ee9c030df266", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encrypted': False, 'image_id': 'e46abb82-b810-490e-a8a1-ccdc5fa1a796'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 23:45:01 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:45:01 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:45:01 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 23:45:01 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 23:45:02 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 23:45:02 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 23:45:02 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 23:45:02 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 23:45:02 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 23:45:02 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 23:45:02 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 23:45:02 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 23:45:02 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 23:45:02 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 23:45:02 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 23:45:02 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 23:45:02 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 23:45:02 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 23:45:02 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:44:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-772570536',display_name='tempest-VolumesActionsTest-instance-772570536',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-772570536',id=20,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='24aa6f705262457e95f2f3f47c0ee709',ramdisk_id='',reservation_id='r-msudfw7e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1514431738',owner_user_name='tempest-VolumesActionsTest-1514431738-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:45:00Z,user_data=None,user_id='aff47f00e24e461787b1224fa6e697fa',uuid=6a0e67fc-942b-4f05-a6ee-0987944f17da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2054f2c7-c492-4278-9a66-ee9c030df266", "address": "fa:16:3e:f0:19:80", "network": {"id": "b87c269d-b129-4bd0-b995-e9a9657dbd1a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1162722602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24aa6f705262457e95f2f3f47c0ee709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2054f2c7-c4", "ovs_interfaceid": "2054f2c7-c492-4278-9a66-ee9c030df266", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:45:02 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Converting VIF {"id": "2054f2c7-c492-4278-9a66-ee9c030df266", "address": "fa:16:3e:f0:19:80", "network": {"id": "b87c269d-b129-4bd0-b995-e9a9657dbd1a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1162722602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24aa6f705262457e95f2f3f47c0ee709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2054f2c7-c4", "ovs_interfaceid": "2054f2c7-c492-4278-9a66-ee9c030df266", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:45:02 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:19:80,bridge_name='br-int',has_traffic_filtering=True,id=2054f2c7-c492-4278-9a66-ee9c030df266,network=Network(b87c269d-b129-4bd0-b995-e9a9657dbd1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2054f2c7-c4') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:45:02 user nova-compute[75341]: DEBUG nova.objects.instance [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Lazy-loading 'pci_devices' on Instance uuid 6a0e67fc-942b-4f05-a6ee-0987944f17da {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:45:02 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 6a0e67fc-942b-4f05-a6ee-0987944f17da] End _get_guest_xml xml=<domain type="kvm">
Nov 14 23:45:02 user nova-compute[75341]:   <uuid>6a0e67fc-942b-4f05-a6ee-0987944f17da</uuid>
Nov 14 23:45:02 user nova-compute[75341]:   <name>instance-00000014</name>
Nov 14 23:45:02 user nova-compute[75341]:   <memory>524288</memory>
Nov 14 23:45:02 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 14 23:45:02 user nova-compute[75341]:   <metadata>
Nov 14 23:45:02 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 23:45:02 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 14 23:45:02 user nova-compute[75341]:       <nova:name>tempest-VolumesActionsTest-instance-772570536</nova:name>
Nov 14 23:45:02 user nova-compute[75341]:       <nova:creationTime>2023-11-14 23:45:01</nova:creationTime>
Nov 14 23:45:02 user nova-compute[75341]:       <nova:flavor name="m1.tiny">
Nov 14 23:45:02 user nova-compute[75341]:         <nova:memory>512</nova:memory>
Nov 14 23:45:02 user nova-compute[75341]:         <nova:disk>1</nova:disk>
Nov 14 23:45:02 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 14 23:45:02 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 23:45:02 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 14 23:45:02 user nova-compute[75341]:       </nova:flavor>
Nov 14 23:45:02 user nova-compute[75341]:       <nova:owner>
Nov 14 23:45:02 user nova-compute[75341]:         <nova:user uuid="aff47f00e24e461787b1224fa6e697fa">tempest-VolumesActionsTest-1514431738-project-member</nova:user>
Nov 14 23:45:02 user nova-compute[75341]:         <nova:project uuid="24aa6f705262457e95f2f3f47c0ee709">tempest-VolumesActionsTest-1514431738</nova:project>
Nov 14 23:45:02 user nova-compute[75341]:       </nova:owner>
Nov 14 23:45:02 user nova-compute[75341]:       <nova:root type="image" uuid="e46abb82-b810-490e-a8a1-ccdc5fa1a796"/>
Nov 14 23:45:02 user nova-compute[75341]:       <nova:ports>
Nov 14 23:45:02 user nova-compute[75341]:         <nova:port uuid="2054f2c7-c492-4278-9a66-ee9c030df266">
Nov 14 23:45:02 user nova-compute[75341]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 23:45:02 user nova-compute[75341]:         </nova:port>
Nov 14 23:45:02 user nova-compute[75341]:       </nova:ports>
Nov 14 23:45:02 user nova-compute[75341]:     </nova:instance>
Nov 14 23:45:02 user nova-compute[75341]:   </metadata>
Nov 14 23:45:02 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 14 23:45:02 user nova-compute[75341]:     <system>
Nov 14 23:45:02 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 23:45:02 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 14 23:45:02 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 14 23:45:02 user nova-compute[75341]:       <entry name="serial">6a0e67fc-942b-4f05-a6ee-0987944f17da</entry>
Nov 14 23:45:02 user nova-compute[75341]:       <entry name="uuid">6a0e67fc-942b-4f05-a6ee-0987944f17da</entry>
Nov 14 23:45:02 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 14 23:45:02 user nova-compute[75341]:     </system>
Nov 14 23:45:02 user nova-compute[75341]:   </sysinfo>
Nov 14 23:45:02 user nova-compute[75341]:   <os>
Nov 14 23:45:02 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 23:45:02 user nova-compute[75341]:     <boot dev="hd"/>
Nov 14 23:45:02 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 14 23:45:02 user nova-compute[75341]:   </os>
Nov 14 23:45:02 user nova-compute[75341]:   <features>
Nov 14 23:45:02 user nova-compute[75341]:     <acpi/>
Nov 14 23:45:02 user nova-compute[75341]:     <apic/>
Nov 14 23:45:02 user nova-compute[75341]:     <vmcoreinfo/>
Nov 14 23:45:02 user nova-compute[75341]:   </features>
Nov 14 23:45:02 user nova-compute[75341]:   <clock offset="utc">
Nov 14 23:45:02 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 23:45:02 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 23:45:02 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 14 23:45:02 user nova-compute[75341]:   </clock>
Nov 14 23:45:02 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 14 23:45:02 user nova-compute[75341]:     <model>Nehalem</model>
Nov 14 23:45:02 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 23:45:02 user nova-compute[75341]:   </cpu>
Nov 14 23:45:02 user nova-compute[75341]:   <devices>
Nov 14 23:45:02 user nova-compute[75341]:     <disk type="file" device="disk">
Nov 14 23:45:02 user nova-compute[75341]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 23:45:02 user nova-compute[75341]:       <source file="/opt/stack/data/nova/instances/6a0e67fc-942b-4f05-a6ee-0987944f17da/disk"/>
Nov 14 23:45:02 user nova-compute[75341]:       <target dev="vda" bus="virtio"/>
Nov 14 23:45:02 user nova-compute[75341]:     </disk>
Nov 14 23:45:02 user nova-compute[75341]:     <interface type="ethernet">
Nov 14 23:45:02 user nova-compute[75341]:       <mac address="fa:16:3e:f0:19:80"/>
Nov 14 23:45:02 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:45:02 user nova-compute[75341]:       <mtu size="1442"/>
Nov 14 23:45:02 user nova-compute[75341]:       <target dev="tap2054f2c7-c4"/>
Nov 14 23:45:02 user nova-compute[75341]:     </interface>
Nov 14 23:45:02 user nova-compute[75341]:     <serial type="pty">
Nov 14 23:45:02 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/6a0e67fc-942b-4f05-a6ee-0987944f17da/console.log" append="off"/>
Nov 14 23:45:02 user nova-compute[75341]:     </serial>
Nov 14 23:45:02 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 23:45:02 user nova-compute[75341]:     <video>
Nov 14 23:45:02 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:45:02 user nova-compute[75341]:     </video>
Nov 14 23:45:02 user nova-compute[75341]:     <rng model="virtio">
Nov 14 23:45:02 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 14 23:45:02 user nova-compute[75341]:     </rng>
Nov 14 23:45:02 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 14 23:45:02 user nova-compute[75341]:     <memballoon model="virtio">
Nov 14 23:45:02 user nova-compute[75341]:       <stats period="10"/>
Nov 14 23:45:02 user nova-compute[75341]:     </memballoon>
Nov 14 23:45:02 user nova-compute[75341]:   </devices>
Nov 14 23:45:02 user nova-compute[75341]: </domain>
Nov 14 23:45:02 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 23:45:02 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:44:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-772570536',display_name='tempest-VolumesActionsTest-instance-772570536',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-772570536',id=20,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='24aa6f705262457e95f2f3f47c0ee709',ramdisk_id='',reservation_id='r-msudfw7e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1514431738',owner_user_name='tempest-VolumesActionsTest-1514431738-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:45:00Z,user_data=None,user_id='aff47f00e24e461787b1224fa6e697fa',uuid=6a0e67fc-942b-4f05-a6ee-0987944f17da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2054f2c7-c492-4278-9a66-ee9c030df266", "address": "fa:16:3e:f0:19:80", "network": {"id": "b87c269d-b129-4bd0-b995-e9a9657dbd1a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1162722602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24aa6f705262457e95f2f3f47c0ee709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2054f2c7-c4", "ovs_interfaceid": "2054f2c7-c492-4278-9a66-ee9c030df266", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 23:45:02 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Converting VIF {"id": "2054f2c7-c492-4278-9a66-ee9c030df266", "address": "fa:16:3e:f0:19:80", "network": {"id": "b87c269d-b129-4bd0-b995-e9a9657dbd1a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1162722602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24aa6f705262457e95f2f3f47c0ee709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2054f2c7-c4", "ovs_interfaceid": "2054f2c7-c492-4278-9a66-ee9c030df266", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:45:02 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:19:80,bridge_name='br-int',has_traffic_filtering=True,id=2054f2c7-c492-4278-9a66-ee9c030df266,network=Network(b87c269d-b129-4bd0-b995-e9a9657dbd1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2054f2c7-c4') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:45:02 user nova-compute[75341]: DEBUG os_vif [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:19:80,bridge_name='br-int',has_traffic_filtering=True,id=2054f2c7-c492-4278-9a66-ee9c030df266,network=Network(b87c269d-b129-4bd0-b995-e9a9657dbd1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2054f2c7-c4') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 23:45:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:45:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 23:45:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8b29cc46-af2a-5dcf-a8af-f5fe861d4e54', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:45:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:45:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2054f2c7-c4, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:45:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2054f2c7-c4, col_values=(('qos', UUID('f8aa7cea-0358-4d71-a989-e0d77249c39c')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:45:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2054f2c7-c4, col_values=(('external_ids', {'iface-id': '2054f2c7-c492-4278-9a66-ee9c030df266', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:19:80', 'vm-uuid': '6a0e67fc-942b-4f05-a6ee-0987944f17da'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:45:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:45:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:02 user nova-compute[75341]: INFO os_vif [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:19:80,bridge_name='br-int',has_traffic_filtering=True,id=2054f2c7-c492-4278-9a66-ee9c030df266,network=Network(b87c269d-b129-4bd0-b995-e9a9657dbd1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2054f2c7-c4')
Nov 14 23:45:02 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:45:02 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] No VIF found with MAC fa:16:3e:f0:19:80, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:45:02 user nova-compute[75341]: DEBUG nova.network.neutron [req-28a4c87c-39d8-4731-8d64-8f1a2ceb83cb req-9460cf9b-fa82-41a3-bc21-d79a5afec746 service nova] [instance: 6a0e67fc-942b-4f05-a6ee-0987944f17da] Updated VIF entry in instance network info cache for port 2054f2c7-c492-4278-9a66-ee9c030df266. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:45:02 user nova-compute[75341]: DEBUG nova.network.neutron [req-28a4c87c-39d8-4731-8d64-8f1a2ceb83cb req-9460cf9b-fa82-41a3-bc21-d79a5afec746 service nova] [instance: 6a0e67fc-942b-4f05-a6ee-0987944f17da] Updating instance_info_cache with network_info: [{"id": "2054f2c7-c492-4278-9a66-ee9c030df266", "address": "fa:16:3e:f0:19:80", "network": {"id": "b87c269d-b129-4bd0-b995-e9a9657dbd1a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1162722602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24aa6f705262457e95f2f3f47c0ee709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2054f2c7-c4", "ovs_interfaceid": "2054f2c7-c492-4278-9a66-ee9c030df266", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:45:02 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-28a4c87c-39d8-4731-8d64-8f1a2ceb83cb req-9460cf9b-fa82-41a3-bc21-d79a5afec746 service nova] Releasing lock "refresh_cache-6a0e67fc-942b-4f05-a6ee-0987944f17da" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:45:03 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:03 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:03 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:03 user nova-compute[75341]: DEBUG nova.compute.manager [req-d0fda1d1-8f61-42e0-8438-f46f456b2ebe req-da348ab7-7de0-416d-8433-c4ae0cb3f5d2 service nova] [instance: 6a0e67fc-942b-4f05-a6ee-0987944f17da] Received event network-vif-plugged-2054f2c7-c492-4278-9a66-ee9c030df266 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:45:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-d0fda1d1-8f61-42e0-8438-f46f456b2ebe req-da348ab7-7de0-416d-8433-c4ae0cb3f5d2 service nova] Acquiring lock "6a0e67fc-942b-4f05-a6ee-0987944f17da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:45:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-d0fda1d1-8f61-42e0-8438-f46f456b2ebe req-da348ab7-7de0-416d-8433-c4ae0cb3f5d2 service nova] Lock "6a0e67fc-942b-4f05-a6ee-0987944f17da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:45:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-d0fda1d1-8f61-42e0-8438-f46f456b2ebe req-da348ab7-7de0-416d-8433-c4ae0cb3f5d2 service nova] Lock "6a0e67fc-942b-4f05-a6ee-0987944f17da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:45:03 user nova-compute[75341]: DEBUG nova.compute.manager [req-d0fda1d1-8f61-42e0-8438-f46f456b2ebe req-da348ab7-7de0-416d-8433-c4ae0cb3f5d2 service nova] [instance: 6a0e67fc-942b-4f05-a6ee-0987944f17da] No waiting events found dispatching network-vif-plugged-2054f2c7-c492-4278-9a66-ee9c030df266 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:45:03 user nova-compute[75341]: WARNING nova.compute.manager [req-d0fda1d1-8f61-42e0-8438-f46f456b2ebe req-da348ab7-7de0-416d-8433-c4ae0cb3f5d2 service nova] [instance: 6a0e67fc-942b-4f05-a6ee-0987944f17da] Received unexpected event network-vif-plugged-2054f2c7-c492-4278-9a66-ee9c030df266 for instance with vm_state building and task_state spawning.
Nov 14 23:45:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:04 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:45:04 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:45:04 user nova-compute[75341]: DEBUG nova.objects.instance [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Lazy-loading 'pci_requests' on Instance uuid 0223a98e-e08f-4a0f-a707-3770c7a99b00 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:45:04 user nova-compute[75341]: DEBUG nova.objects.instance [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Lazy-loading 'numa_topology' on Instance uuid 0223a98e-e08f-4a0f-a707-3770c7a99b00 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:45:04 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75341) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 23:45:04 user nova-compute[75341]: INFO nova.compute.claims [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Claim successful on node user
Nov 14 23:45:05 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:45:05 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:45:05 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.590s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:45:05 user nova-compute[75341]: INFO nova.network.neutron [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Updating port dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG nova.compute.manager [req-8c21c05e-e84c-4fe3-b221-3eb82f3d360f req-b11deb04-0532-4543-9760-996c57e688b7 service nova] [instance: 6a0e67fc-942b-4f05-a6ee-0987944f17da] Received event network-vif-plugged-2054f2c7-c492-4278-9a66-ee9c030df266 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-8c21c05e-e84c-4fe3-b221-3eb82f3d360f req-b11deb04-0532-4543-9760-996c57e688b7 service nova] Acquiring lock "6a0e67fc-942b-4f05-a6ee-0987944f17da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-8c21c05e-e84c-4fe3-b221-3eb82f3d360f req-b11deb04-0532-4543-9760-996c57e688b7 service nova] Lock "6a0e67fc-942b-4f05-a6ee-0987944f17da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-8c21c05e-e84c-4fe3-b221-3eb82f3d360f req-b11deb04-0532-4543-9760-996c57e688b7 service nova] Lock "6a0e67fc-942b-4f05-a6ee-0987944f17da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG nova.compute.manager [req-8c21c05e-e84c-4fe3-b221-3eb82f3d360f req-b11deb04-0532-4543-9760-996c57e688b7 service nova] [instance: 6a0e67fc-942b-4f05-a6ee-0987944f17da] No waiting events found dispatching network-vif-plugged-2054f2c7-c492-4278-9a66-ee9c030df266 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:45:06 user nova-compute[75341]: WARNING nova.compute.manager [req-8c21c05e-e84c-4fe3-b221-3eb82f3d360f req-b11deb04-0532-4543-9760-996c57e688b7 service nova] [instance: 6a0e67fc-942b-4f05-a6ee-0987944f17da] Received unexpected event network-vif-plugged-2054f2c7-c492-4278-9a66-ee9c030df266 for instance with vm_state building and task_state spawning.
Nov 14 23:45:06 user nova-compute[75341]: DEBUG nova.compute.manager [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 6a0e67fc-942b-4f05-a6ee-0987944f17da] Instance event wait completed in 0 seconds for  {{(pid=75341) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 6a0e67fc-942b-4f05-a6ee-0987944f17da] Guest created on hypervisor {{(pid=75341) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 23:45:06 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 6a0e67fc-942b-4f05-a6ee-0987944f17da] Instance spawned successfully.
Nov 14 23:45:06 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 6a0e67fc-942b-4f05-a6ee-0987944f17da] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 6a0e67fc-942b-4f05-a6ee-0987944f17da] Found default for hw_cdrom_bus of ide {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 6a0e67fc-942b-4f05-a6ee-0987944f17da] Found default for hw_disk_bus of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 6a0e67fc-942b-4f05-a6ee-0987944f17da] Found default for hw_input_bus of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 6a0e67fc-942b-4f05-a6ee-0987944f17da] Found default for hw_pointer_model of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 6a0e67fc-942b-4f05-a6ee-0987944f17da] Found default for hw_video_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 6a0e67fc-942b-4f05-a6ee-0987944f17da] Found default for hw_vif_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Acquiring lock "refresh_cache-0223a98e-e08f-4a0f-a707-3770c7a99b00" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Acquired lock "refresh_cache-0223a98e-e08f-4a0f-a707-3770c7a99b00" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG nova.network.neutron [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 23:45:06 user nova-compute[75341]: INFO nova.compute.manager [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 6a0e67fc-942b-4f05-a6ee-0987944f17da] Took 5.77 seconds to spawn the instance on the hypervisor.
Nov 14 23:45:06 user nova-compute[75341]: DEBUG nova.compute.manager [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 6a0e67fc-942b-4f05-a6ee-0987944f17da] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:06 user nova-compute[75341]: INFO nova.compute.manager [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 6a0e67fc-942b-4f05-a6ee-0987944f17da] Took 6.94 seconds to build instance.
Nov 14 23:45:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-19f0aeda-101c-4711-a617-0f19746a9b67 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Lock "6a0e67fc-942b-4f05-a6ee-0987944f17da" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.099s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG nova.compute.manager [req-c73a1c2c-1b20-4f42-8d61-881939783b44 req-4bc8a967-50f2-4077-a931-86b2f923cd3d service nova] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Received event volume-reimaged-b7af2f07-212b-4210-b473-6e1da973682c {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-c73a1c2c-1b20-4f42-8d61-881939783b44 req-4bc8a967-50f2-4077-a931-86b2f923cd3d service nova] Acquiring lock "cffc86d5-2ac6-4dd1-bdcd-5832c134d179-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-c73a1c2c-1b20-4f42-8d61-881939783b44 req-4bc8a967-50f2-4077-a931-86b2f923cd3d service nova] Lock "cffc86d5-2ac6-4dd1-bdcd-5832c134d179-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-c73a1c2c-1b20-4f42-8d61-881939783b44 req-4bc8a967-50f2-4077-a931-86b2f923cd3d service nova] Lock "cffc86d5-2ac6-4dd1-bdcd-5832c134d179-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG nova.compute.manager [req-c73a1c2c-1b20-4f42-8d61-881939783b44 req-4bc8a967-50f2-4077-a931-86b2f923cd3d service nova] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Processing event volume-reimaged-b7af2f07-212b-4210-b473-6e1da973682c {{(pid=75341) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG nova.compute.manager [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Instance event wait completed in 14 seconds for volume-reimaged {{(pid=75341) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 23:45:06 user nova-compute[75341]: INFO nova.virt.block_device [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Booting with volume b7af2f07-212b-4210-b473-6e1da973682c at /dev/vda
Nov 14 23:45:06 user nova-compute[75341]: DEBUG os_brick.utils [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22294b2-e417-4aab-a3be-e3cfab56164e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6d1cfca09c9\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[b240b351-8a2d-4ef8-be09-32b35a528122]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[723b777f-8e2d-43c4-91c3-ee448b0452cc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b794221-4e07-4957-ae49-5cf1bd54dc86]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Running cmd (subprocess): nvme version {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] 'nvme version' failed. Not Retrying. {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG nova.network.neutron [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Updating instance_info_cache with network_info: [{"id": "dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e", "address": "fa:16:3e:19:cd:2f", "network": {"id": "eb5b5fbb-4747-49e9-a830-c9ab1c4d4af7", "bridge": "br-int", "label": "tempest-TestShelveInstance-261763164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9beb6cd1f92a46f4a37459b75b7ff1d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbe5cbca-08", "ovs_interfaceid": "dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] nvme not present on system {{(pid=75341) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:45:06 user nova-compute[75341]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 23:45:06 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da96792-1c03-48f8-959b-3b2ae22a8368]: (4, '') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75341) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] LIGHTOS: no hostnqn found. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG os_brick.utils [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] <== get_connector_properties: return (164ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6d1cfca09c9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG nova.virt.block_device [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Updating existing volume attachment record: 106a8ab2-c0fe-452e-b18b-0825132e34a0 {{(pid=75341) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Releasing lock "refresh_cache-0223a98e-e08f-4a0f-a707-3770c7a99b00" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Creating instance directory {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 23:45:06 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Creating image(s)
Nov 14 23:45:06 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Did not create local disks {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Ensure instance console log exists: /opt/stack/data/nova/instances/0223a98e-e08f-4a0f-a707-3770c7a99b00/console.log {{(pid=75341) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.006s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Start _get_guest_xml network_info=[{"id": "dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e", "address": "fa:16:3e:19:cd:2f", "network": {"id": "eb5b5fbb-4747-49e9-a830-c9ab1c4d4af7", "bridge": "br-int", "label": "tempest-TestShelveInstance-261763164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9beb6cd1f92a46f4a37459b75b7ff1d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbe5cbca-08", "ovs_interfaceid": "dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'f387f63b-2cfa-4aeb-9688-e035c69e56bb', 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fjgHolcY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0223a98e-e08f-4a0f-a707-3770c7a99b00', 'attached_at': '', 'detached_at': '', 'volume_id': '3d4927ae-8df9-41e3-97e6-2eef950500f7', 'serial': '3d4927ae-8df9-41e3-97e6-2eef950500f7'}, 'delete_on_termination': True, 'volume_type': None} {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 23:45:06 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:45:06 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:45:06 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG nova.objects.instance [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0223a98e-e08f-4a0f-a707-3770c7a99b00 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG nova.objects.base [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Object Instance<0223a98e-e08f-4a0f-a707-3770c7a99b00> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75341) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Calling os-brick to attach iSCSI Volume {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fjgHolcY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:45:06 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:45:06 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:45:06 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:45:06 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:45:06 user nova-compute[75341]: INFO os_brick.initiator.connectors.iscsi [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 23:45:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 -p 172.16.0.220:3260 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ebc798f-f707-4ab4-a8d5-3ec3213053b5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 23:45:06 user nova-compute[75341]:  {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[28be2a1b-a07b-430d-ac08-3cac3cf10bcd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7] added\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7] added
Nov 14 23:45:06 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[6986ffc1-0af0-4b73-b9f7-72e46a7f8c87]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[5690183a-259d-469a-8911-8712db297201]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fjgHolcY {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fjgHolcY" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1de52cb-5683-487b-9a7f-d250d67bb6c8]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fjgHolcY'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc6ccac-7b9d-4b3c-bf9f-0f61967bd623]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:06 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:45:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:07 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e376ef-5f2f-4674-9d20-42f64e0cdca7]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:07 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 (non-flash)
Nov 14 23:45:07 user nova-compute[75341]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)
Nov 14 23:45:07 user nova-compute[75341]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 (non-flash)
Nov 14 23:45:07 user nova-compute[75341]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a (non-flash)
Nov 14 23:45:07 user nova-compute[75341]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 (non-flash)
Nov 14 23:45:07 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:45:07 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 (non-flash)
Nov 14 23:45:07 user nova-compute[75341]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)
Nov 14 23:45:07 user nova-compute[75341]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 (non-flash)
Nov 14 23:45:07 user nova-compute[75341]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a (non-flash)
Nov 14 23:45:07 user nova-compute[75341]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 (non-flash)
Nov 14 23:45:07 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:45:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 -p 172.16.0.220:3260 --login {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 -p 172.16.0.220:3260 --login" returned: 0 in 0.103s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:07 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[975506d4-60a6-4fba-8e3a-2c05f13b25be]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:07 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7, portal: 172.16.0.220,3260]
Nov 14 23:45:07 user nova-compute[75341]: Login to [iface: default, target: iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7, portal: 172.16.0.220,3260] successful.
Nov 14 23:45:07 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:45:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:07 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[280e7e9a-454b-4f41-bf56-1caa88d0279a]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:07 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:45:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:07 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[359c5912-36cf-415f-9173-0e545cc8567c]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:07 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 (non-flash)
Nov 14 23:45:07 user nova-compute[75341]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)
Nov 14 23:45:07 user nova-compute[75341]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 (non-flash)
Nov 14 23:45:07 user nova-compute[75341]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a (non-flash)
Nov 14 23:45:07 user nova-compute[75341]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 (non-flash)
Nov 14 23:45:07 user nova-compute[75341]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:45:07 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:45:07 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 (non-flash)
Nov 14 23:45:07 user nova-compute[75341]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)
Nov 14 23:45:07 user nova-compute[75341]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 (non-flash)
Nov 14 23:45:07 user nova-compute[75341]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a (non-flash)
Nov 14 23:45:07 user nova-compute[75341]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 (non-flash)
Nov 14 23:45:07 user nova-compute[75341]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:45:07 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:45:07 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.356s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:45:07 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Connected to 172.16.0.220:3260 {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 23:45:07 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=75341) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 23:45:07 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75341) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 23:45:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:07 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef1e5fc-1632-4d52-800c-0cb3c20a4f27]: (4, ('- - 0', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:07 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: None {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 23:45:08 user nova-compute[75341]: DEBUG nova.compute.manager [req-950c4e37-d052-4892-af49-5db61041641b req-83bb553a-f29a-4b69-b712-22f758494756 service nova] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Received event network-changed-dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:45:08 user nova-compute[75341]: DEBUG nova.compute.manager [req-950c4e37-d052-4892-af49-5db61041641b req-83bb553a-f29a-4b69-b712-22f758494756 service nova] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Refreshing instance network info cache due to event network-changed-dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:45:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-950c4e37-d052-4892-af49-5db61041641b req-83bb553a-f29a-4b69-b712-22f758494756 service nova] Acquiring lock "refresh_cache-0223a98e-e08f-4a0f-a707-3770c7a99b00" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:45:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-950c4e37-d052-4892-af49-5db61041641b req-83bb553a-f29a-4b69-b712-22f758494756 service nova] Acquired lock "refresh_cache-0223a98e-e08f-4a0f-a707-3770c7a99b00" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:45:08 user nova-compute[75341]: DEBUG nova.network.neutron [req-950c4e37-d052-4892-af49-5db61041641b req-83bb553a-f29a-4b69-b712-22f758494756 service nova] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Refreshing network info cache for port dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:45:08 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 23:45:08 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fjgHolcY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 23:45:08 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.389s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:45:08 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] <== connect_volume: return (1391ms) {'type': 'block', 'scsi_wwn': '23661616137303062', 'path': '/dev/sdc'} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:45:08 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661616137303062', 'path': '/dev/sdc'} {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 23:45:08 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T23:41:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-745577741',display_name='tempest-TestShelveInstance-server-745577741',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-745577741',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-272108759',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:41:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9beb6cd1f92a46f4a37459b75b7ff1d4',ramdisk_id='',reservation_id='r-w770xi1a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1537108126',owner_user_name='tempest-TestShelveInstance-1537108126-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:44:59Z,user_data=None,user_id='ee1ed14495f14c7e8bddfde73dbb3a29',uuid=0223a98e-e08f-4a0f-a707-3770c7a99b00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e", "address": "fa:16:3e:19:cd:2f", "network": {"id": "eb5b5fbb-4747-49e9-a830-c9ab1c4d4af7", "bridge": "br-int", "label": "tempest-TestShelveInstance-261763164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9beb6cd1f92a46f4a37459b75b7ff1d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbe5cbca-08", "ovs_interfaceid": "dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:45:08 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Converting VIF {"id": "dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e", "address": "fa:16:3e:19:cd:2f", "network": {"id": "eb5b5fbb-4747-49e9-a830-c9ab1c4d4af7", "bridge": "br-int", "label": "tempest-TestShelveInstance-261763164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9beb6cd1f92a46f4a37459b75b7ff1d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbe5cbca-08", "ovs_interfaceid": "dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:45:08 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:cd:2f,bridge_name='br-int',has_traffic_filtering=True,id=dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e,network=Network(eb5b5fbb-4747-49e9-a830-c9ab1c4d4af7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbe5cbca-08') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:45:08 user nova-compute[75341]: DEBUG nova.objects.instance [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Lazy-loading 'pci_devices' on Instance uuid 0223a98e-e08f-4a0f-a707-3770c7a99b00 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:45:08 user nova-compute[75341]: DEBUG nova.objects.base [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Object Instance<0223a98e-e08f-4a0f-a707-3770c7a99b00> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75341) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 23:45:08 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] End _get_guest_xml xml=<domain type="kvm">
Nov 14 23:45:08 user nova-compute[75341]:   <uuid>0223a98e-e08f-4a0f-a707-3770c7a99b00</uuid>
Nov 14 23:45:08 user nova-compute[75341]:   <name>instance-0000000b</name>
Nov 14 23:45:08 user nova-compute[75341]:   <memory>524288</memory>
Nov 14 23:45:08 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 14 23:45:08 user nova-compute[75341]:   <metadata>
Nov 14 23:45:08 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 23:45:08 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 14 23:45:08 user nova-compute[75341]:       <nova:name>tempest-TestShelveInstance-server-745577741</nova:name>
Nov 14 23:45:08 user nova-compute[75341]:       <nova:creationTime>2023-11-14 23:45:06</nova:creationTime>
Nov 14 23:45:08 user nova-compute[75341]:       <nova:flavor name="m1.tiny">
Nov 14 23:45:08 user nova-compute[75341]:         <nova:memory>512</nova:memory>
Nov 14 23:45:08 user nova-compute[75341]:         <nova:disk>1</nova:disk>
Nov 14 23:45:08 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 14 23:45:08 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 23:45:08 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 14 23:45:08 user nova-compute[75341]:       </nova:flavor>
Nov 14 23:45:08 user nova-compute[75341]:       <nova:owner>
Nov 14 23:45:08 user nova-compute[75341]:         <nova:user uuid="ee1ed14495f14c7e8bddfde73dbb3a29">tempest-TestShelveInstance-1537108126-project-member</nova:user>
Nov 14 23:45:08 user nova-compute[75341]:         <nova:project uuid="9beb6cd1f92a46f4a37459b75b7ff1d4">tempest-TestShelveInstance-1537108126</nova:project>
Nov 14 23:45:08 user nova-compute[75341]:       </nova:owner>
Nov 14 23:45:08 user nova-compute[75341]:       <nova:ports>
Nov 14 23:45:08 user nova-compute[75341]:         <nova:port uuid="dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e">
Nov 14 23:45:08 user nova-compute[75341]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 23:45:08 user nova-compute[75341]:         </nova:port>
Nov 14 23:45:08 user nova-compute[75341]:       </nova:ports>
Nov 14 23:45:08 user nova-compute[75341]:     </nova:instance>
Nov 14 23:45:08 user nova-compute[75341]:   </metadata>
Nov 14 23:45:08 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 14 23:45:08 user nova-compute[75341]:     <system>
Nov 14 23:45:08 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 23:45:08 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 14 23:45:08 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 14 23:45:08 user nova-compute[75341]:       <entry name="serial">0223a98e-e08f-4a0f-a707-3770c7a99b00</entry>
Nov 14 23:45:08 user nova-compute[75341]:       <entry name="uuid">0223a98e-e08f-4a0f-a707-3770c7a99b00</entry>
Nov 14 23:45:08 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 14 23:45:08 user nova-compute[75341]:     </system>
Nov 14 23:45:08 user nova-compute[75341]:   </sysinfo>
Nov 14 23:45:08 user nova-compute[75341]:   <os>
Nov 14 23:45:08 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 23:45:08 user nova-compute[75341]:     <boot dev="hd"/>
Nov 14 23:45:08 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 14 23:45:08 user nova-compute[75341]:   </os>
Nov 14 23:45:08 user nova-compute[75341]:   <features>
Nov 14 23:45:08 user nova-compute[75341]:     <acpi/>
Nov 14 23:45:08 user nova-compute[75341]:     <apic/>
Nov 14 23:45:08 user nova-compute[75341]:     <vmcoreinfo/>
Nov 14 23:45:08 user nova-compute[75341]:   </features>
Nov 14 23:45:08 user nova-compute[75341]:   <clock offset="utc">
Nov 14 23:45:08 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 23:45:08 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 23:45:08 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 14 23:45:08 user nova-compute[75341]:   </clock>
Nov 14 23:45:08 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 14 23:45:08 user nova-compute[75341]:     <model>Nehalem</model>
Nov 14 23:45:08 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 23:45:08 user nova-compute[75341]:   </cpu>
Nov 14 23:45:08 user nova-compute[75341]:   <devices>
Nov 14 23:45:08 user nova-compute[75341]:     <disk type="block" device="disk">
Nov 14 23:45:08 user nova-compute[75341]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:45:08 user nova-compute[75341]:       <source dev="/dev/sdc"/>
Nov 14 23:45:08 user nova-compute[75341]:       <target dev="vda" bus="virtio"/>
Nov 14 23:45:08 user nova-compute[75341]:       <serial>3d4927ae-8df9-41e3-97e6-2eef950500f7</serial>
Nov 14 23:45:08 user nova-compute[75341]:     </disk>
Nov 14 23:45:08 user nova-compute[75341]:     <interface type="ethernet">
Nov 14 23:45:08 user nova-compute[75341]:       <mac address="fa:16:3e:19:cd:2f"/>
Nov 14 23:45:08 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:45:08 user nova-compute[75341]:       <mtu size="1442"/>
Nov 14 23:45:08 user nova-compute[75341]:       <target dev="tapdbe5cbca-08"/>
Nov 14 23:45:08 user nova-compute[75341]:     </interface>
Nov 14 23:45:08 user nova-compute[75341]:     <serial type="pty">
Nov 14 23:45:08 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/0223a98e-e08f-4a0f-a707-3770c7a99b00/console.log" append="off"/>
Nov 14 23:45:08 user nova-compute[75341]:     </serial>
Nov 14 23:45:08 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 23:45:08 user nova-compute[75341]:     <video>
Nov 14 23:45:08 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:45:08 user nova-compute[75341]:     </video>
Nov 14 23:45:08 user nova-compute[75341]:     <rng model="virtio">
Nov 14 23:45:08 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 14 23:45:08 user nova-compute[75341]:     </rng>
Nov 14 23:45:08 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 14 23:45:08 user nova-compute[75341]:     <memballoon model="virtio">
Nov 14 23:45:08 user nova-compute[75341]:       <stats period="10"/>
Nov 14 23:45:08 user nova-compute[75341]:     </memballoon>
Nov 14 23:45:08 user nova-compute[75341]:   </devices>
Nov 14 23:45:08 user nova-compute[75341]: </domain>
Nov 14 23:45:08 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 23:45:08 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T23:41:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-745577741',display_name='tempest-TestShelveInstance-server-745577741',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-745577741',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-272108759',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:41:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9beb6cd1f92a46f4a37459b75b7ff1d4',ramdisk_id='',reservation_id='r-w770xi1a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1537108126',owner_user_name='tempest-TestShelveInstance-1537108126-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:44:59Z,user_data=None,user_id='ee1ed14495f14c7e8bddfde73dbb3a29',uuid=0223a98e-e08f-4a0f-a707-3770c7a99b00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e", "address": "fa:16:3e:19:cd:2f", "network": {"id": "eb5b5fbb-4747-49e9-a830-c9ab1c4d4af7", "bridge": "br-int", "label": "tempest-TestShelveInstance-261763164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9beb6cd1f92a46f4a37459b75b7ff1d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbe5cbca-08", "ovs_interfaceid": "dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 23:45:08 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Converting VIF {"id": "dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e", "address": "fa:16:3e:19:cd:2f", "network": {"id": "eb5b5fbb-4747-49e9-a830-c9ab1c4d4af7", "bridge": "br-int", "label": "tempest-TestShelveInstance-261763164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9beb6cd1f92a46f4a37459b75b7ff1d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbe5cbca-08", "ovs_interfaceid": "dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:45:08 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:cd:2f,bridge_name='br-int',has_traffic_filtering=True,id=dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e,network=Network(eb5b5fbb-4747-49e9-a830-c9ab1c4d4af7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbe5cbca-08') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:45:08 user nova-compute[75341]: DEBUG os_vif [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:cd:2f,bridge_name='br-int',has_traffic_filtering=True,id=dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e,network=Network(eb5b5fbb-4747-49e9-a830-c9ab1c4d4af7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbe5cbca-08') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 23:45:08 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:08 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:45:08 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 23:45:08 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:08 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fab8edeb-7128-56a1-bfd5-8fe6a05e1f0d', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:45:08 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:08 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:08 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:08 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdbe5cbca-08, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:45:08 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdbe5cbca-08, col_values=(('qos', UUID('6a77a11f-7f21-4af1-9f3a-265d3d572cce')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:45:08 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdbe5cbca-08, col_values=(('external_ids', {'iface-id': 'dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:cd:2f', 'vm-uuid': '0223a98e-e08f-4a0f-a707-3770c7a99b00'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:45:08 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:08 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:45:08 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:08 user nova-compute[75341]: INFO os_vif [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:cd:2f,bridge_name='br-int',has_traffic_filtering=True,id=dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e,network=Network(eb5b5fbb-4747-49e9-a830-c9ab1c4d4af7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbe5cbca-08')
Nov 14 23:45:08 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:45:08 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] No VIF found with MAC fa:16:3e:19:cd:2f, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:45:09 user nova-compute[75341]: DEBUG nova.network.neutron [req-950c4e37-d052-4892-af49-5db61041641b req-83bb553a-f29a-4b69-b712-22f758494756 service nova] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Updated VIF entry in instance network info cache for port dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:45:09 user nova-compute[75341]: DEBUG nova.network.neutron [req-950c4e37-d052-4892-af49-5db61041641b req-83bb553a-f29a-4b69-b712-22f758494756 service nova] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Updating instance_info_cache with network_info: [{"id": "dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e", "address": "fa:16:3e:19:cd:2f", "network": {"id": "eb5b5fbb-4747-49e9-a830-c9ab1c4d4af7", "bridge": "br-int", "label": "tempest-TestShelveInstance-261763164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9beb6cd1f92a46f4a37459b75b7ff1d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbe5cbca-08", "ovs_interfaceid": "dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:45:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-950c4e37-d052-4892-af49-5db61041641b req-83bb553a-f29a-4b69-b712-22f758494756 service nova] Releasing lock "refresh_cache-0223a98e-e08f-4a0f-a707-3770c7a99b00" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:45:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:10 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:10 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:10 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:10 user nova-compute[75341]: DEBUG nova.compute.manager [req-83c5d62d-e1ea-4bc5-a559-33b2acd77bf8 req-261f181e-23be-4b04-9d5c-390bef6fadcf service nova] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Received event network-vif-plugged-dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:45:10 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-83c5d62d-e1ea-4bc5-a559-33b2acd77bf8 req-261f181e-23be-4b04-9d5c-390bef6fadcf service nova] Acquiring lock "0223a98e-e08f-4a0f-a707-3770c7a99b00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:45:10 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-83c5d62d-e1ea-4bc5-a559-33b2acd77bf8 req-261f181e-23be-4b04-9d5c-390bef6fadcf service nova] Lock "0223a98e-e08f-4a0f-a707-3770c7a99b00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:45:10 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-83c5d62d-e1ea-4bc5-a559-33b2acd77bf8 req-261f181e-23be-4b04-9d5c-390bef6fadcf service nova] Lock "0223a98e-e08f-4a0f-a707-3770c7a99b00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:45:10 user nova-compute[75341]: DEBUG nova.compute.manager [req-83c5d62d-e1ea-4bc5-a559-33b2acd77bf8 req-261f181e-23be-4b04-9d5c-390bef6fadcf service nova] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] No waiting events found dispatching network-vif-plugged-dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:45:10 user nova-compute[75341]: WARNING nova.compute.manager [req-83c5d62d-e1ea-4bc5-a559-33b2acd77bf8 req-261f181e-23be-4b04-9d5c-390bef6fadcf service nova] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Received unexpected event network-vif-plugged-dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 23:45:10 user nova-compute[75341]: DEBUG nova.compute.manager [req-83c5d62d-e1ea-4bc5-a559-33b2acd77bf8 req-261f181e-23be-4b04-9d5c-390bef6fadcf service nova] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Received event network-vif-plugged-dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:45:10 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-83c5d62d-e1ea-4bc5-a559-33b2acd77bf8 req-261f181e-23be-4b04-9d5c-390bef6fadcf service nova] Acquiring lock "0223a98e-e08f-4a0f-a707-3770c7a99b00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:45:10 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-83c5d62d-e1ea-4bc5-a559-33b2acd77bf8 req-261f181e-23be-4b04-9d5c-390bef6fadcf service nova] Lock "0223a98e-e08f-4a0f-a707-3770c7a99b00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:45:10 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-83c5d62d-e1ea-4bc5-a559-33b2acd77bf8 req-261f181e-23be-4b04-9d5c-390bef6fadcf service nova] Lock "0223a98e-e08f-4a0f-a707-3770c7a99b00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:45:10 user nova-compute[75341]: DEBUG nova.compute.manager [req-83c5d62d-e1ea-4bc5-a559-33b2acd77bf8 req-261f181e-23be-4b04-9d5c-390bef6fadcf service nova] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] No waiting events found dispatching network-vif-plugged-dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:45:10 user nova-compute[75341]: WARNING nova.compute.manager [req-83c5d62d-e1ea-4bc5-a559-33b2acd77bf8 req-261f181e-23be-4b04-9d5c-390bef6fadcf service nova] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Received unexpected event network-vif-plugged-dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 23:45:10 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:11 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:11 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG nova.compute.manager [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Instance event wait completed in 0 seconds for  {{(pid=75341) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Guest created on hypervisor {{(pid=75341) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 23:45:12 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Instance spawned successfully.
Nov 14 23:45:12 user nova-compute[75341]: DEBUG nova.compute.manager [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Creating instance directory {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 23:45:12 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Creating image(s)
Nov 14 23:45:12 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Did not create local disks {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Ensure instance console log exists: /opt/stack/data/nova/instances/cffc86d5-2ac6-4dd1-bdcd-5832c134d179/console.log {{(pid=75341) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Start _get_guest_xml network_info=[{"id": "cdc268e0-0a9a-44cf-87ef-0baca1547f68", "address": "fa:16:3e:10:94:5a", "network": {"id": "c832523e-13e4-44da-9e4b-a4f3e5a276fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1155631271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e4a2efc0fc47a482755f1c375aff46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdc268e0-0a", "ovs_interfaceid": "cdc268e0-0a9a-44cf-87ef-0baca1547f68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '106a8ab2-c0fe-452e-b18b-0825132e34a0', 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cDKCeEGM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cffc86d5-2ac6-4dd1-bdcd-5832c134d179', 'attached_at': '', 'detached_at': '', 'volume_id': 'b7af2f07-212b-4210-b473-6e1da973682c', 'serial': 'b7af2f07-212b-4210-b473-6e1da973682c'}, 'delete_on_termination': True, 'volume_type': None} {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 23:45:12 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 14 23:45:12 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 14 23:45:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c2bc6828-a206-47c9-80b1-bbaab406edae tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Lock "0223a98e-e08f-4a0f-a707-3770c7a99b00" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 13.223s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG nova.objects.instance [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Lazy-loading 'vcpu_model' on Instance uuid cffc86d5-2ac6-4dd1-bdcd-5832c134d179 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Calling os-brick to attach iSCSI Volume {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cDKCeEGM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:45:12 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 23:45:12 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:45:12 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 23:45:12 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:45:12 user nova-compute[75341]: INFO os_brick.initiator.connectors.iscsi [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 23:45:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c -p 172.16.0.220:3260 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[7680a8f3-9681-4977-8462-ff853cc2f5fb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 23:45:12 user nova-compute[75341]:  {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c -p 172.16.0.220:3260 --interface default --op new {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1aceb7-4426-4de2-8116-7b1686a594aa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c] added\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c] added
Nov 14 23:45:12 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[d941743b-2caa-48c4-bfa0-67a36254a476]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6534f8a-1201-4eb2-bafa-a9d174299648]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cDKCeEGM {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cDKCeEGM" returned: 0 in 0.026s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd9c506-0784-46a2-9c6c-8024859f6966]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cDKCeEGM'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cbed18d-df20-454b-8541-697ed9c09cda]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9de9239-45ca-4986-b82d-a2e449d3714a]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 (non-flash)
Nov 14 23:45:12 user nova-compute[75341]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)
Nov 14 23:45:12 user nova-compute[75341]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 (non-flash)
Nov 14 23:45:12 user nova-compute[75341]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a (non-flash)
Nov 14 23:45:12 user nova-compute[75341]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 (non-flash)
Nov 14 23:45:12 user nova-compute[75341]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:45:12 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 (non-flash)
Nov 14 23:45:12 user nova-compute[75341]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)
Nov 14 23:45:12 user nova-compute[75341]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 (non-flash)
Nov 14 23:45:12 user nova-compute[75341]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a (non-flash)
Nov 14 23:45:12 user nova-compute[75341]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 (non-flash)
Nov 14 23:45:12 user nova-compute[75341]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:45:12 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c -p 172.16.0.220:3260 --login {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dfeb674-db20-4488-9e5c-bbdb45c796ec]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c, portal: 172.16.0.220,3260]
Nov 14 23:45:12 user nova-compute[75341]: Login to [iface: default, target: iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c, portal: 172.16.0.220,3260] successful.
Nov 14 23:45:12 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[016032bb-93b6-455f-823a-4732bbfc3b32]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e44243-fc13-4a00-b6d6-ca59f254f1cd]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 (non-flash)
Nov 14 23:45:12 user nova-compute[75341]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)
Nov 14 23:45:12 user nova-compute[75341]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 (non-flash)
Nov 14 23:45:12 user nova-compute[75341]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a (non-flash)
Nov 14 23:45:12 user nova-compute[75341]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 (non-flash)
Nov 14 23:45:12 user nova-compute[75341]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:45:12 user nova-compute[75341]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)
Nov 14 23:45:12 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 (non-flash)
Nov 14 23:45:12 user nova-compute[75341]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)
Nov 14 23:45:12 user nova-compute[75341]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 (non-flash)
Nov 14 23:45:12 user nova-compute[75341]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a (non-flash)
Nov 14 23:45:12 user nova-compute[75341]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 (non-flash)
Nov 14 23:45:12 user nova-compute[75341]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:45:12 user nova-compute[75341]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)
Nov 14 23:45:12 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Connected to 172.16.0.220:3260 {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] HCTL ('39', '-', '-', 0) found on session 26 with lun 0 {{(pid=75341) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75341) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d04f42-93c1-47d0-9565-9d3a1b306d8d]: (4, ('- - 0', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Searching for a device in session 26 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 23:45:12 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cDKCeEGM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 23:45:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:13 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:45:13 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '23633656130666432', 'path': '/dev/sdh'} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:45:13 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23633656130666432', 'path': '/dev/sdh'} {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 23:45:13 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T23:42:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1298649458',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1214898251',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC6p7TTrcora+tA8J6m0Z8kOp9lfGZbeJCVFa4lV20FoOtQs2zaUuehWyGMh3Ev7R8XPb9IKUQhdgHH/8HhowDTVW2MDgUCdP9iYWVYcDyU1L7qQlvAFOYXZMtN51fblTQ==',key_name='tempest-keypair-849876031',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:43:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b7e4a2efc0fc47a482755f1c375aff46',ramdisk_id='',reservation_id='r-p3kv7sbi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-863325357',owner_user_name='tempest-ServerActionsV293TestJSON-863325357-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:45:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2440829d0b0e4d4d8f8266c4e8162223',uuid=cffc86d5-2ac6-4dd1-bdcd-5832c134d179,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cdc268e0-0a9a-44cf-87ef-0baca1547f68", "address": "fa:16:3e:10:94:5a", "network": {"id": "c832523e-13e4-44da-9e4b-a4f3e5a276fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1155631271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e4a2efc0fc47a482755f1c375aff46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdc268e0-0a", "ovs_interfaceid": "cdc268e0-0a9a-44cf-87ef-0baca1547f68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:45:13 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Converting VIF {"id": "cdc268e0-0a9a-44cf-87ef-0baca1547f68", "address": "fa:16:3e:10:94:5a", "network": {"id": "c832523e-13e4-44da-9e4b-a4f3e5a276fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1155631271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e4a2efc0fc47a482755f1c375aff46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdc268e0-0a", "ovs_interfaceid": "cdc268e0-0a9a-44cf-87ef-0baca1547f68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:45:13 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:10:94:5a,bridge_name='br-int',has_traffic_filtering=True,id=cdc268e0-0a9a-44cf-87ef-0baca1547f68,network=Network(c832523e-13e4-44da-9e4b-a4f3e5a276fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdc268e0-0a') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:45:13 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] End _get_guest_xml xml=<domain type="kvm">
Nov 14 23:45:13 user nova-compute[75341]:   <uuid>cffc86d5-2ac6-4dd1-bdcd-5832c134d179</uuid>
Nov 14 23:45:13 user nova-compute[75341]:   <name>instance-0000000d</name>
Nov 14 23:45:13 user nova-compute[75341]:   <memory>524288</memory>
Nov 14 23:45:13 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 14 23:45:13 user nova-compute[75341]:   <metadata>
Nov 14 23:45:13 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 23:45:13 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 14 23:45:13 user nova-compute[75341]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1298649458</nova:name>
Nov 14 23:45:13 user nova-compute[75341]:       <nova:creationTime>2023-11-14 23:45:12</nova:creationTime>
Nov 14 23:45:13 user nova-compute[75341]:       <nova:flavor name="m1.tiny">
Nov 14 23:45:13 user nova-compute[75341]:         <nova:memory>512</nova:memory>
Nov 14 23:45:13 user nova-compute[75341]:         <nova:disk>1</nova:disk>
Nov 14 23:45:13 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 14 23:45:13 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 23:45:13 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 14 23:45:13 user nova-compute[75341]:       </nova:flavor>
Nov 14 23:45:13 user nova-compute[75341]:       <nova:owner>
Nov 14 23:45:13 user nova-compute[75341]:         <nova:user uuid="2440829d0b0e4d4d8f8266c4e8162223">tempest-ServerActionsV293TestJSON-863325357-project-member</nova:user>
Nov 14 23:45:13 user nova-compute[75341]:         <nova:project uuid="b7e4a2efc0fc47a482755f1c375aff46">tempest-ServerActionsV293TestJSON-863325357</nova:project>
Nov 14 23:45:13 user nova-compute[75341]:       </nova:owner>
Nov 14 23:45:13 user nova-compute[75341]:       <nova:ports>
Nov 14 23:45:13 user nova-compute[75341]:         <nova:port uuid="cdc268e0-0a9a-44cf-87ef-0baca1547f68">
Nov 14 23:45:13 user nova-compute[75341]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 23:45:13 user nova-compute[75341]:         </nova:port>
Nov 14 23:45:13 user nova-compute[75341]:       </nova:ports>
Nov 14 23:45:13 user nova-compute[75341]:     </nova:instance>
Nov 14 23:45:13 user nova-compute[75341]:   </metadata>
Nov 14 23:45:13 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 14 23:45:13 user nova-compute[75341]:     <system>
Nov 14 23:45:13 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 23:45:13 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 14 23:45:13 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 14 23:45:13 user nova-compute[75341]:       <entry name="serial">cffc86d5-2ac6-4dd1-bdcd-5832c134d179</entry>
Nov 14 23:45:13 user nova-compute[75341]:       <entry name="uuid">cffc86d5-2ac6-4dd1-bdcd-5832c134d179</entry>
Nov 14 23:45:13 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 14 23:45:13 user nova-compute[75341]:     </system>
Nov 14 23:45:13 user nova-compute[75341]:   </sysinfo>
Nov 14 23:45:13 user nova-compute[75341]:   <os>
Nov 14 23:45:13 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 23:45:13 user nova-compute[75341]:     <boot dev="hd"/>
Nov 14 23:45:13 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 14 23:45:13 user nova-compute[75341]:   </os>
Nov 14 23:45:13 user nova-compute[75341]:   <features>
Nov 14 23:45:13 user nova-compute[75341]:     <acpi/>
Nov 14 23:45:13 user nova-compute[75341]:     <apic/>
Nov 14 23:45:13 user nova-compute[75341]:     <vmcoreinfo/>
Nov 14 23:45:13 user nova-compute[75341]:   </features>
Nov 14 23:45:13 user nova-compute[75341]:   <clock offset="utc">
Nov 14 23:45:13 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 23:45:13 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 23:45:13 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 14 23:45:13 user nova-compute[75341]:   </clock>
Nov 14 23:45:13 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 14 23:45:13 user nova-compute[75341]:     <model>Nehalem</model>
Nov 14 23:45:13 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 23:45:13 user nova-compute[75341]:   </cpu>
Nov 14 23:45:13 user nova-compute[75341]:   <devices>
Nov 14 23:45:13 user nova-compute[75341]:     <disk type="block" device="disk">
Nov 14 23:45:13 user nova-compute[75341]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:45:13 user nova-compute[75341]:       <source dev="/dev/sdh"/>
Nov 14 23:45:13 user nova-compute[75341]:       <target dev="vda" bus="virtio"/>
Nov 14 23:45:13 user nova-compute[75341]:       <serial>b7af2f07-212b-4210-b473-6e1da973682c</serial>
Nov 14 23:45:13 user nova-compute[75341]:     </disk>
Nov 14 23:45:13 user nova-compute[75341]:     <interface type="ethernet">
Nov 14 23:45:13 user nova-compute[75341]:       <mac address="fa:16:3e:10:94:5a"/>
Nov 14 23:45:13 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:45:13 user nova-compute[75341]:       <mtu size="1442"/>
Nov 14 23:45:13 user nova-compute[75341]:       <target dev="tapcdc268e0-0a"/>
Nov 14 23:45:13 user nova-compute[75341]:     </interface>
Nov 14 23:45:13 user nova-compute[75341]:     <serial type="pty">
Nov 14 23:45:13 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/cffc86d5-2ac6-4dd1-bdcd-5832c134d179/console.log" append="off"/>
Nov 14 23:45:13 user nova-compute[75341]:     </serial>
Nov 14 23:45:13 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 23:45:13 user nova-compute[75341]:     <video>
Nov 14 23:45:13 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:45:13 user nova-compute[75341]:     </video>
Nov 14 23:45:13 user nova-compute[75341]:     <rng model="virtio">
Nov 14 23:45:13 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 14 23:45:13 user nova-compute[75341]:     </rng>
Nov 14 23:45:13 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 14 23:45:13 user nova-compute[75341]:     <memballoon model="virtio">
Nov 14 23:45:13 user nova-compute[75341]:       <stats period="10"/>
Nov 14 23:45:13 user nova-compute[75341]:     </memballoon>
Nov 14 23:45:13 user nova-compute[75341]:   </devices>
Nov 14 23:45:13 user nova-compute[75341]: </domain>
Nov 14 23:45:13 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 23:45:13 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T23:42:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1298649458',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1214898251',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC6p7TTrcora+tA8J6m0Z8kOp9lfGZbeJCVFa4lV20FoOtQs2zaUuehWyGMh3Ev7R8XPb9IKUQhdgHH/8HhowDTVW2MDgUCdP9iYWVYcDyU1L7qQlvAFOYXZMtN51fblTQ==',key_name='tempest-keypair-849876031',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:43:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b7e4a2efc0fc47a482755f1c375aff46',ramdisk_id='',reservation_id='r-p3kv7sbi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-863325357',owner_user_name='tempest-ServerActionsV293TestJSON-863325357-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:45:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2440829d0b0e4d4d8f8266c4e8162223',uuid=cffc86d5-2ac6-4dd1-bdcd-5832c134d179,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cdc268e0-0a9a-44cf-87ef-0baca1547f68", "address": "fa:16:3e:10:94:5a", "network": {"id": "c832523e-13e4-44da-9e4b-a4f3e5a276fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1155631271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e4a2efc0fc47a482755f1c375aff46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdc268e0-0a", "ovs_interfaceid": "cdc268e0-0a9a-44cf-87ef-0baca1547f68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 23:45:13 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Converting VIF {"id": "cdc268e0-0a9a-44cf-87ef-0baca1547f68", "address": "fa:16:3e:10:94:5a", "network": {"id": "c832523e-13e4-44da-9e4b-a4f3e5a276fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1155631271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e4a2efc0fc47a482755f1c375aff46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdc268e0-0a", "ovs_interfaceid": "cdc268e0-0a9a-44cf-87ef-0baca1547f68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:45:13 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:10:94:5a,bridge_name='br-int',has_traffic_filtering=True,id=cdc268e0-0a9a-44cf-87ef-0baca1547f68,network=Network(c832523e-13e4-44da-9e4b-a4f3e5a276fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdc268e0-0a') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:45:13 user nova-compute[75341]: DEBUG os_vif [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:94:5a,bridge_name='br-int',has_traffic_filtering=True,id=cdc268e0-0a9a-44cf-87ef-0baca1547f68,network=Network(c832523e-13e4-44da-9e4b-a4f3e5a276fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdc268e0-0a') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 23:45:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:45:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 23:45:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '52f36119-cd31-51b1-92b3-c2a155c13111', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:45:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:45:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcdc268e0-0a, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:45:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcdc268e0-0a, col_values=(('qos', UUID('04eb5351-6067-4919-95e0-3f75e7a8cb33')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:45:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcdc268e0-0a, col_values=(('external_ids', {'iface-id': 'cdc268e0-0a9a-44cf-87ef-0baca1547f68', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:94:5a', 'vm-uuid': 'cffc86d5-2ac6-4dd1-bdcd-5832c134d179'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:45:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:45:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:13 user nova-compute[75341]: INFO os_vif [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:94:5a,bridge_name='br-int',has_traffic_filtering=True,id=cdc268e0-0a9a-44cf-87ef-0baca1547f68,network=Network(c832523e-13e4-44da-9e4b-a4f3e5a276fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdc268e0-0a')
Nov 14 23:45:13 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:45:13 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] No VIF found with MAC fa:16:3e:10:94:5a, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:45:15 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:15 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:15 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:15 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:15 user nova-compute[75341]: DEBUG nova.compute.manager [req-b02345fa-5ec7-42ac-ba9a-a91321759a06 req-43b76cc2-5a9c-44a3-93b1-a6262211eade service nova] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Received event network-vif-plugged-cdc268e0-0a9a-44cf-87ef-0baca1547f68 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:45:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-b02345fa-5ec7-42ac-ba9a-a91321759a06 req-43b76cc2-5a9c-44a3-93b1-a6262211eade service nova] Acquiring lock "cffc86d5-2ac6-4dd1-bdcd-5832c134d179-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:45:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-b02345fa-5ec7-42ac-ba9a-a91321759a06 req-43b76cc2-5a9c-44a3-93b1-a6262211eade service nova] Lock "cffc86d5-2ac6-4dd1-bdcd-5832c134d179-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:45:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-b02345fa-5ec7-42ac-ba9a-a91321759a06 req-43b76cc2-5a9c-44a3-93b1-a6262211eade service nova] Lock "cffc86d5-2ac6-4dd1-bdcd-5832c134d179-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:45:15 user nova-compute[75341]: DEBUG nova.compute.manager [req-b02345fa-5ec7-42ac-ba9a-a91321759a06 req-43b76cc2-5a9c-44a3-93b1-a6262211eade service nova] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] No waiting events found dispatching network-vif-plugged-cdc268e0-0a9a-44cf-87ef-0baca1547f68 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:45:15 user nova-compute[75341]: WARNING nova.compute.manager [req-b02345fa-5ec7-42ac-ba9a-a91321759a06 req-43b76cc2-5a9c-44a3-93b1-a6262211eade service nova] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Received unexpected event network-vif-plugged-cdc268e0-0a9a-44cf-87ef-0baca1547f68 for instance with vm_state active and task_state rebuild_spawning.
Nov 14 23:45:15 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:15 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:15 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:17 user nova-compute[75341]: DEBUG nova.compute.manager [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Instance event wait completed in 0 seconds for  {{(pid=75341) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 23:45:17 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Guest created on hypervisor {{(pid=75341) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 23:45:17 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Instance spawned successfully.
Nov 14 23:45:17 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 23:45:17 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Found default for hw_cdrom_bus of ide {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:45:17 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Found default for hw_disk_bus of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:45:17 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Found default for hw_input_bus of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:45:17 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Found default for hw_pointer_model of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:45:17 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Found default for hw_video_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:45:17 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Found default for hw_vif_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:45:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:17 user nova-compute[75341]: DEBUG nova.compute.manager [req-04895e47-642b-4be5-8995-a244b5a88f29 req-59711650-05c1-45c3-897d-1d7b5279deeb service nova] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Received event network-vif-plugged-cdc268e0-0a9a-44cf-87ef-0baca1547f68 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:45:17 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-04895e47-642b-4be5-8995-a244b5a88f29 req-59711650-05c1-45c3-897d-1d7b5279deeb service nova] Acquiring lock "cffc86d5-2ac6-4dd1-bdcd-5832c134d179-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:45:17 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-04895e47-642b-4be5-8995-a244b5a88f29 req-59711650-05c1-45c3-897d-1d7b5279deeb service nova] Lock "cffc86d5-2ac6-4dd1-bdcd-5832c134d179-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:45:17 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-04895e47-642b-4be5-8995-a244b5a88f29 req-59711650-05c1-45c3-897d-1d7b5279deeb service nova] Lock "cffc86d5-2ac6-4dd1-bdcd-5832c134d179-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:45:17 user nova-compute[75341]: DEBUG nova.compute.manager [req-04895e47-642b-4be5-8995-a244b5a88f29 req-59711650-05c1-45c3-897d-1d7b5279deeb service nova] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] No waiting events found dispatching network-vif-plugged-cdc268e0-0a9a-44cf-87ef-0baca1547f68 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:45:17 user nova-compute[75341]: WARNING nova.compute.manager [req-04895e47-642b-4be5-8995-a244b5a88f29 req-59711650-05c1-45c3-897d-1d7b5279deeb service nova] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Received unexpected event network-vif-plugged-cdc268e0-0a9a-44cf-87ef-0baca1547f68 for instance with vm_state active and task_state rebuild_spawning.
Nov 14 23:45:17 user nova-compute[75341]: DEBUG nova.compute.manager [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 23:45:17 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:45:17 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:45:17 user nova-compute[75341]: DEBUG nova.objects.instance [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75341) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 14 23:45:17 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c73a1c2c-1b20-4f42-8d61-881939783b44 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.076s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:45:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:19 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:21 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:23 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:23 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:26 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-64d5ba3a-df97-4909-8679-c6494afe3952 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Acquiring lock "a308a35f-c8d7-482c-a93d-5d9eb473d4e1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:45:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-64d5ba3a-df97-4909-8679-c6494afe3952 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "a308a35f-c8d7-482c-a93d-5d9eb473d4e1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:45:29 user nova-compute[75341]: INFO nova.compute.manager [None req-64d5ba3a-df97-4909-8679-c6494afe3952 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Detaching volume f3d90713-27fa-493f-978a-af46e9730265
Nov 14 23:45:29 user nova-compute[75341]: INFO nova.virt.block_device [None req-64d5ba3a-df97-4909-8679-c6494afe3952 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Attempting to driver detach volume f3d90713-27fa-493f-978a-af46e9730265 from mountpoint /dev/vdc
Nov 14 23:45:29 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-64d5ba3a-df97-4909-8679-c6494afe3952 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Attempting to detach device vdc from instance a308a35f-c8d7-482c-a93d-5d9eb473d4e1 from the persistent domain config. {{(pid=75341) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 23:45:29 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-64d5ba3a-df97-4909-8679-c6494afe3952 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 23:45:29 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:45:29 user nova-compute[75341]:   <source dev="/dev/sdd"/>
Nov 14 23:45:29 user nova-compute[75341]:   <target dev="vdc" bus="virtio"/>
Nov 14 23:45:29 user nova-compute[75341]:   <serial>f3d90713-27fa-493f-978a-af46e9730265</serial>
Nov 14 23:45:29 user nova-compute[75341]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 23:45:29 user nova-compute[75341]: </disk>
Nov 14 23:45:29 user nova-compute[75341]:  {{(pid=75341) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 23:45:29 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-64d5ba3a-df97-4909-8679-c6494afe3952 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Successfully detached device vdc from instance a308a35f-c8d7-482c-a93d-5d9eb473d4e1 from the persistent domain config.
Nov 14 23:45:29 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-64d5ba3a-df97-4909-8679-c6494afe3952 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance a308a35f-c8d7-482c-a93d-5d9eb473d4e1 from the live domain config. {{(pid=75341) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 23:45:29 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-64d5ba3a-df97-4909-8679-c6494afe3952 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 23:45:29 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:45:29 user nova-compute[75341]:   <source dev="/dev/sdd"/>
Nov 14 23:45:29 user nova-compute[75341]:   <target dev="vdc" bus="virtio"/>
Nov 14 23:45:29 user nova-compute[75341]:   <serial>f3d90713-27fa-493f-978a-af46e9730265</serial>
Nov 14 23:45:29 user nova-compute[75341]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 23:45:29 user nova-compute[75341]: </disk>
Nov 14 23:45:29 user nova-compute[75341]:  {{(pid=75341) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 23:45:29 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-64d5ba3a-df97-4909-8679-c6494afe3952 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance a308a35f-c8d7-482c-a93d-5d9eb473d4e1 {{(pid=75341) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 23:45:30 user nova-compute[75341]: DEBUG nova.network.neutron [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Port dcc0edd5-582a-499a-beaf-6de23ff1537c binding to destination host user is already ACTIVE {{(pid=75341) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 14 23:45:30 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Acquiring lock "refresh_cache-881351d7-31f9-44f4-8571-8f540bbec29c" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:45:30 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Acquired lock "refresh_cache-881351d7-31f9-44f4-8571-8f540bbec29c" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:45:30 user nova-compute[75341]: DEBUG nova.network.neutron [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 23:45:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:31 user nova-compute[75341]: DEBUG nova.network.neutron [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Updating instance_info_cache with network_info: [{"id": "dcc0edd5-582a-499a-beaf-6de23ff1537c", "address": "fa:16:3e:83:5b:7a", "network": {"id": "139c86e9-e6ea-4307-9f78-7f41ab7a6d8c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-487359378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eff8d64949254c7eb3dd8685ca7447b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc0edd5-58", "ovs_interfaceid": "dcc0edd5-582a-499a-beaf-6de23ff1537c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:45:31 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Releasing lock "refresh_cache-881351d7-31f9-44f4-8571-8f540bbec29c" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:45:31 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Creating tmpfile /opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c/tmprd652wab to verify with other compute node that the instance is on the same shared storage. {{(pid=75341) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 14 23:45:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:31 user nova-compute[75341]: DEBUG nova.compute.manager [req-d4f0e409-929a-42bb-af7d-8c76621a4ab6 req-02438a10-adc9-418b-9fca-ff1060b7add1 service nova] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Received event network-vif-unplugged-dcc0edd5-582a-499a-beaf-6de23ff1537c {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:45:31 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-d4f0e409-929a-42bb-af7d-8c76621a4ab6 req-02438a10-adc9-418b-9fca-ff1060b7add1 service nova] Acquiring lock "881351d7-31f9-44f4-8571-8f540bbec29c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:45:31 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-d4f0e409-929a-42bb-af7d-8c76621a4ab6 req-02438a10-adc9-418b-9fca-ff1060b7add1 service nova] Lock "881351d7-31f9-44f4-8571-8f540bbec29c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:45:31 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-d4f0e409-929a-42bb-af7d-8c76621a4ab6 req-02438a10-adc9-418b-9fca-ff1060b7add1 service nova] Lock "881351d7-31f9-44f4-8571-8f540bbec29c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:45:31 user nova-compute[75341]: DEBUG nova.compute.manager [req-d4f0e409-929a-42bb-af7d-8c76621a4ab6 req-02438a10-adc9-418b-9fca-ff1060b7add1 service nova] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] No waiting events found dispatching network-vif-unplugged-dcc0edd5-582a-499a-beaf-6de23ff1537c {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:45:31 user nova-compute[75341]: WARNING nova.compute.manager [req-d4f0e409-929a-42bb-af7d-8c76621a4ab6 req-02438a10-adc9-418b-9fca-ff1060b7add1 service nova] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Received unexpected event network-vif-unplugged-dcc0edd5-582a-499a-beaf-6de23ff1537c for instance with vm_state resized and task_state resize_reverting.
Nov 14 23:45:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:32 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Instance destroyed successfully.
Nov 14 23:45:32 user nova-compute[75341]: DEBUG nova.objects.instance [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Lazy-loading 'resources' on Instance uuid 881351d7-31f9-44f4-8571-8f540bbec29c {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:45:32 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:39:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1731707158',display_name='tempest-ServerActionsTestOtherB-server-1731707158',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1731707158',id=1,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPcpkEsQSTpmH5o8Wvimru34qoMLk4crSEJeEz6XFBwMyGlgEqVH+eZU8RhCkfXTyDuMId//yiBmA84BMG1N70mUPHjpTANep7Y1Hwo1CNlTldBrdW9Ccxs8yCQLXA8Fw==',key_name='tempest-keypair-500318648',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:43:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eff8d64949254c7eb3dd8685ca7447b1',ramdisk_id='',reservation_id='r-505keefc',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1632747205',owner_user_name='tempest-ServerActionsTestOtherB-1632747205-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:44:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='512d2ce7a01c4ffb924f9476a5c4b946',uuid=881351d7-31f9-44f4-8571-8f540bbec29c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "dcc0edd5-582a-499a-beaf-6de23ff1537c", "address": "fa:16:3e:83:5b:7a", "network": {"id": "139c86e9-e6ea-4307-9f78-7f41ab7a6d8c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-487359378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eff8d64949254c7eb3dd8685ca7447b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc0edd5-58", "ovs_interfaceid": "dcc0edd5-582a-499a-beaf-6de23ff1537c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 23:45:32 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Converting VIF {"id": "dcc0edd5-582a-499a-beaf-6de23ff1537c", "address": "fa:16:3e:83:5b:7a", "network": {"id": "139c86e9-e6ea-4307-9f78-7f41ab7a6d8c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-487359378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eff8d64949254c7eb3dd8685ca7447b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc0edd5-58", "ovs_interfaceid": "dcc0edd5-582a-499a-beaf-6de23ff1537c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:45:32 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:5b:7a,bridge_name='br-int',has_traffic_filtering=True,id=dcc0edd5-582a-499a-beaf-6de23ff1537c,network=Network(139c86e9-e6ea-4307-9f78-7f41ab7a6d8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcc0edd5-58') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:45:32 user nova-compute[75341]: DEBUG os_vif [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:5b:7a,bridge_name='br-int',has_traffic_filtering=True,id=dcc0edd5-582a-499a-beaf-6de23ff1537c,network=Network(139c86e9-e6ea-4307-9f78-7f41ab7a6d8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcc0edd5-58') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 23:45:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdcc0edd5-58, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:45:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:45:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=25a0593a-4aba-470d-8094-a4e02f485ee8) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:45:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:32 user nova-compute[75341]: INFO os_vif [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:5b:7a,bridge_name='br-int',has_traffic_filtering=True,id=dcc0edd5-582a-499a-beaf-6de23ff1537c,network=Network(139c86e9-e6ea-4307-9f78-7f41ab7a6d8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcc0edd5-58')
Nov 14 23:45:32 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] calling os-brick to detach iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 23:45:32 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, {'target_iqn': 'iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pzdvecEm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:45:32 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:45:32 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:45:32 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:45:32 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:32 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:32 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f812cf-7eba-458e-9d36-60332f2fa4f8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:32 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 23:45:32 user nova-compute[75341]: No targets found.
Nov 14 23:45:32 user nova-compute[75341]: iSNS:
Nov 14 23:45:32 user nova-compute[75341]: No targets found.
Nov 14 23:45:32 user nova-compute[75341]: STATIC:
Nov 14 23:45:32 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265
Nov 14 23:45:32 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:45:32 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:45:32 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7
Nov 14 23:45:32 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:45:32 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:45:32 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3
Nov 14 23:45:32 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:45:32 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:45:32 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a
Nov 14 23:45:32 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:45:32 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:45:32 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7
Nov 14 23:45:32 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:45:32 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:45:32 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c
Nov 14 23:45:32 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:45:32 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:45:32 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912
Nov 14 23:45:32 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:45:32 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:45:32 user nova-compute[75341]: FIRMWARE:
Nov 14 23:45:32 user nova-compute[75341]: No targets found.
Nov 14 23:45:32 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:45:32 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 23:45:32 user nova-compute[75341]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 23:45:32 user nova-compute[75341]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75341) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 23:45:32 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3', 0)] {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 23:45:32 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:32 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:32 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[49768377-943d-44af-a638-d65de73ffcaa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:32 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:32 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:32 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[00535b7a-beb5-4623-9a96-0d696ea89bda]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:32 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 (non-flash)
Nov 14 23:45:32 user nova-compute[75341]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)
Nov 14 23:45:32 user nova-compute[75341]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 (non-flash)
Nov 14 23:45:32 user nova-compute[75341]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a (non-flash)
Nov 14 23:45:32 user nova-compute[75341]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 (non-flash)
Nov 14 23:45:32 user nova-compute[75341]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:45:32 user nova-compute[75341]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)
Nov 14 23:45:32 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:45:32 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 (non-flash)
Nov 14 23:45:32 user nova-compute[75341]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)
Nov 14 23:45:32 user nova-compute[75341]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 (non-flash)
Nov 14 23:45:32 user nova-compute[75341]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a (non-flash)
Nov 14 23:45:32 user nova-compute[75341]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 (non-flash)
Nov 14 23:45:32 user nova-compute[75341]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:45:32 user nova-compute[75341]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)
Nov 14 23:45:32 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:45:32 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1850717880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3'): ({'sde'}, set())}) {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 23:45:32 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Removing single pathed devices sde {{(pid=75341) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 23:45:32 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:32 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:32 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[70626870-da14-451d-9dfb-254fc30c76d3]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:32 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:32 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:32 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[868a5a18-2041-485e-9963-9dbf84219e1d]: (4, ('ok\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:32 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Flushing IO for device /dev/sde {{(pid=75341) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 23:45:32 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:32 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:32 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[74bff2c3-387d-4a3c-8b6f-c3048063712b]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:32 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75341) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 23:45:32 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:32 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.052s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:32 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b01f32-f3f7-41fa-81c0-f3b87eedca69]: (4, ('1', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:32 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 23:45:32 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] SCSI volumes sde have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 23:45:32 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3')] {{(pid=75341) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 23:45:32 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Acquiring lock "896ee337-80bf-47c3-9530-861c941a2fc6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:45:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "896ee337-80bf-47c3-9530-861c941a2fc6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:45:32 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:32 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[82870597-fd6b-4e0e-851b-f4d4c51eb069]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:32 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:45:32 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 -p 172.16.0.220:3260 --logout {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:32 user nova-compute[75341]: DEBUG nova.compute.manager [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] Starting instance... {{(pid=75341) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 23:45:32 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:32 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb852d1-1cd9-4186-99ea-14afa4adafd9]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:32 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3, portal: 172.16.0.220,3260]
Nov 14 23:45:32 user nova-compute[75341]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3, portal: 172.16.0.220,3260] successful.
Nov 14 23:45:32 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:45:32 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 -p 172.16.0.220:3260 --op delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:32 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:32 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb77351-dad6-4452-92c7-4098147d9e4e]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:32 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:45:32 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:45:32 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] <== disconnect_volume: return (333ms) None {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:45:32 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Disconnected iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 23:45:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:45:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:45:32 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75341) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 23:45:32 user nova-compute[75341]: INFO nova.compute.claims [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] Claim successful on node user
Nov 14 23:45:33 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:45:33 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:45:33 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.567s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:45:33 user nova-compute[75341]: DEBUG nova.compute.manager [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] Start building networks asynchronously for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 23:45:33 user nova-compute[75341]: DEBUG nova.compute.manager [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] Allocating IP information in the background. {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 23:45:33 user nova-compute[75341]: DEBUG nova.network.neutron [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] allocate_for_instance() {{(pid=75341) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 23:45:33 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 23:45:33 user nova-compute[75341]: DEBUG nova.compute.manager [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] Start building block device mappings for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 23:45:33 user nova-compute[75341]: DEBUG nova.policy [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b08f7ddf6c2f4fd596e214d6ca56c234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96674073965642f1af11221b4add8a6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75341) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 23:45:33 user nova-compute[75341]: INFO nova.virt.block_device [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] Booting with volume snapshot ded8dbad-f67a-49f5-b6b4-d932b6659df3 at /dev/vda
Nov 14 23:45:33 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:45:33 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:45:33 user nova-compute[75341]: DEBUG nova.objects.instance [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Lazy-loading 'migration_context' on Instance uuid 881351d7-31f9-44f4-8571-8f540bbec29c {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:45:33 user nova-compute[75341]: DEBUG nova.objects.base [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Object Instance<881351d7-31f9-44f4-8571-8f540bbec29c> lazy-loaded attributes: resources,migration_context {{(pid=75341) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 23:45:33 user nova-compute[75341]: DEBUG nova.compute.manager [req-cb1962f3-6e35-499b-9119-51abd6ce71e5 req-33d5dee1-bc02-4e3f-b707-d2298e7266d0 service nova] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Received event network-vif-plugged-dcc0edd5-582a-499a-beaf-6de23ff1537c {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:45:33 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-cb1962f3-6e35-499b-9119-51abd6ce71e5 req-33d5dee1-bc02-4e3f-b707-d2298e7266d0 service nova] Acquiring lock "881351d7-31f9-44f4-8571-8f540bbec29c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:45:33 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-cb1962f3-6e35-499b-9119-51abd6ce71e5 req-33d5dee1-bc02-4e3f-b707-d2298e7266d0 service nova] Lock "881351d7-31f9-44f4-8571-8f540bbec29c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:45:33 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-cb1962f3-6e35-499b-9119-51abd6ce71e5 req-33d5dee1-bc02-4e3f-b707-d2298e7266d0 service nova] Lock "881351d7-31f9-44f4-8571-8f540bbec29c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:45:33 user nova-compute[75341]: DEBUG nova.compute.manager [req-cb1962f3-6e35-499b-9119-51abd6ce71e5 req-33d5dee1-bc02-4e3f-b707-d2298e7266d0 service nova] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] No waiting events found dispatching network-vif-plugged-dcc0edd5-582a-499a-beaf-6de23ff1537c {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:45:33 user nova-compute[75341]: WARNING nova.compute.manager [req-cb1962f3-6e35-499b-9119-51abd6ce71e5 req-33d5dee1-bc02-4e3f-b707-d2298e7266d0 service nova] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Received unexpected event network-vif-plugged-dcc0edd5-582a-499a-beaf-6de23ff1537c for instance with vm_state resized and task_state resize_reverting.
Nov 14 23:45:33 user nova-compute[75341]: DEBUG nova.network.neutron [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] Successfully created port: 88af4d1e-2d6c-4e86-906e-159a733ab307 {{(pid=75341) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 23:45:34 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:45:34 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:45:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.559s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:45:34 user nova-compute[75341]: INFO nova.compute.manager [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Swapping old allocation on dict_keys(['8fa114cc-b541-418f-865c-16c44294e72d']) held by migration ce0332b8-78dd-4580-ac96-b62cde301a6b for instance
Nov 14 23:45:34 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Overwriting current allocation {'allocations': {'8fa114cc-b541-418f-865c-16c44294e72d': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 27}}, 'project_id': 'eff8d64949254c7eb3dd8685ca7447b1', 'user_id': '512d2ce7a01c4ffb924f9476a5c4b946', 'consumer_generation': 1} on consumer 881351d7-31f9-44f4-8571-8f540bbec29c {{(pid=75341) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 14 23:45:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Acquiring lock "refresh_cache-881351d7-31f9-44f4-8571-8f540bbec29c" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:45:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Acquired lock "refresh_cache-881351d7-31f9-44f4-8571-8f540bbec29c" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:45:34 user nova-compute[75341]: DEBUG nova.network.neutron [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 23:45:34 user nova-compute[75341]: DEBUG nova.network.neutron [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] Successfully updated port: 88af4d1e-2d6c-4e86-906e-159a733ab307 {{(pid=75341) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 23:45:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Acquiring lock "refresh_cache-896ee337-80bf-47c3-9530-861c941a2fc6" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:45:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Acquired lock "refresh_cache-896ee337-80bf-47c3-9530-861c941a2fc6" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:45:34 user nova-compute[75341]: DEBUG nova.network.neutron [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 23:45:34 user nova-compute[75341]: DEBUG nova.compute.manager [req-e524f859-fc85-4ce3-9fca-e310ac052775 req-41aa49a6-f895-43eb-bc7d-3abb99dab695 service nova] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] Received event network-changed-88af4d1e-2d6c-4e86-906e-159a733ab307 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:45:34 user nova-compute[75341]: DEBUG nova.compute.manager [req-e524f859-fc85-4ce3-9fca-e310ac052775 req-41aa49a6-f895-43eb-bc7d-3abb99dab695 service nova] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] Refreshing instance network info cache due to event network-changed-88af4d1e-2d6c-4e86-906e-159a733ab307. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:45:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-e524f859-fc85-4ce3-9fca-e310ac052775 req-41aa49a6-f895-43eb-bc7d-3abb99dab695 service nova] Acquiring lock "refresh_cache-896ee337-80bf-47c3-9530-861c941a2fc6" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:45:34 user nova-compute[75341]: DEBUG nova.network.neutron [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] Instance cache missing network info. {{(pid=75341) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 23:45:34 user nova-compute[75341]: DEBUG nova.network.neutron [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] Updating instance_info_cache with network_info: [{"id": "88af4d1e-2d6c-4e86-906e-159a733ab307", "address": "fa:16:3e:ce:0b:42", "network": {"id": "227eb779-a064-477d-8447-45862017ae7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-3827253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96674073965642f1af11221b4add8a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88af4d1e-2d", "ovs_interfaceid": "88af4d1e-2d6c-4e86-906e-159a733ab307", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:45:34 user nova-compute[75341]: DEBUG nova.network.neutron [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Updating instance_info_cache with network_info: [{"id": "dcc0edd5-582a-499a-beaf-6de23ff1537c", "address": "fa:16:3e:83:5b:7a", "network": {"id": "139c86e9-e6ea-4307-9f78-7f41ab7a6d8c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-487359378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eff8d64949254c7eb3dd8685ca7447b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc0edd5-58", "ovs_interfaceid": "dcc0edd5-582a-499a-beaf-6de23ff1537c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:45:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Releasing lock "refresh_cache-896ee337-80bf-47c3-9530-861c941a2fc6" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:45:34 user nova-compute[75341]: DEBUG nova.compute.manager [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] Instance network_info: |[{"id": "88af4d1e-2d6c-4e86-906e-159a733ab307", "address": "fa:16:3e:ce:0b:42", "network": {"id": "227eb779-a064-477d-8447-45862017ae7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-3827253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96674073965642f1af11221b4add8a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88af4d1e-2d", "ovs_interfaceid": "88af4d1e-2d6c-4e86-906e-159a733ab307", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 23:45:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-e524f859-fc85-4ce3-9fca-e310ac052775 req-41aa49a6-f895-43eb-bc7d-3abb99dab695 service nova] Acquired lock "refresh_cache-896ee337-80bf-47c3-9530-861c941a2fc6" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:45:34 user nova-compute[75341]: DEBUG nova.network.neutron [req-e524f859-fc85-4ce3-9fca-e310ac052775 req-41aa49a6-f895-43eb-bc7d-3abb99dab695 service nova] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] Refreshing network info cache for port 88af4d1e-2d6c-4e86-906e-159a733ab307 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:45:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Releasing lock "refresh_cache-881351d7-31f9-44f4-8571-8f540bbec29c" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:45:34 user nova-compute[75341]: DEBUG os_brick.utils [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:45:34 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:34 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:34 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2771820-ab9e-456c-8f3d-45a4ad6e3ae1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6d1cfca09c9\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:34 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:34 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:34 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[e804213f-4ba6-4be3-9f56-6f8a98a92c33]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:34 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:35 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:35 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad648a7-8a1f-43e2-a836-3eccfefa2168]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:35 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[7535f695-e285-45cd-8a4e-2812abdd9b58]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:35 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Running cmd (subprocess): nvme version {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:35 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] 'nvme version' failed. Not Retrying. {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:45:35 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.nvmeof [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] nvme not present on system {{(pid=75341) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 23:45:35 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:35 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:45:35 user nova-compute[75341]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 23:45:35 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[6654b146-f740-4069-8f8d-819e7f1be640]: (4, '') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:35 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75341) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 23:45:35 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 23:45:35 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] LIGHTOS: no hostnqn found. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 23:45:35 user nova-compute[75341]: DEBUG os_brick.utils [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6d1cfca09c9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:45:35 user nova-compute[75341]: DEBUG nova.network.neutron [req-e524f859-fc85-4ce3-9fca-e310ac052775 req-41aa49a6-f895-43eb-bc7d-3abb99dab695 service nova] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] Updated VIF entry in instance network info cache for port 88af4d1e-2d6c-4e86-906e-159a733ab307. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:45:35 user nova-compute[75341]: DEBUG nova.network.neutron [req-e524f859-fc85-4ce3-9fca-e310ac052775 req-41aa49a6-f895-43eb-bc7d-3abb99dab695 service nova] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] Updating instance_info_cache with network_info: [{"id": "88af4d1e-2d6c-4e86-906e-159a733ab307", "address": "fa:16:3e:ce:0b:42", "network": {"id": "227eb779-a064-477d-8447-45862017ae7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-3827253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96674073965642f1af11221b4add8a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88af4d1e-2d", "ovs_interfaceid": "88af4d1e-2d6c-4e86-906e-159a733ab307", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:45:35 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-e524f859-fc85-4ce3-9fca-e310ac052775 req-41aa49a6-f895-43eb-bc7d-3abb99dab695 service nova] Releasing lock "refresh_cache-896ee337-80bf-47c3-9530-861c941a2fc6" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:45:36 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:37 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:37 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Acquiring lock "c8aa0b26-4099-4a8d-afce-a1e990e5b1f7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:45:37 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Lock "c8aa0b26-4099-4a8d-afce-a1e990e5b1f7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:45:37 user nova-compute[75341]: DEBUG nova.compute.manager [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: c8aa0b26-4099-4a8d-afce-a1e990e5b1f7] Starting instance... {{(pid=75341) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 23:45:37 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:45:37 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:45:37 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75341) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 23:45:37 user nova-compute[75341]: INFO nova.compute.claims [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: c8aa0b26-4099-4a8d-afce-a1e990e5b1f7] Claim successful on node user
Nov 14 23:45:38 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:45:38 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:45:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.470s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:45:38 user nova-compute[75341]: DEBUG nova.compute.manager [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: c8aa0b26-4099-4a8d-afce-a1e990e5b1f7] Start building networks asynchronously for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 23:45:38 user nova-compute[75341]: DEBUG nova.compute.manager [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: c8aa0b26-4099-4a8d-afce-a1e990e5b1f7] Allocating IP information in the background. {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 23:45:38 user nova-compute[75341]: DEBUG nova.network.neutron [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: c8aa0b26-4099-4a8d-afce-a1e990e5b1f7] allocate_for_instance() {{(pid=75341) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 23:45:38 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: c8aa0b26-4099-4a8d-afce-a1e990e5b1f7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 23:45:38 user nova-compute[75341]: DEBUG nova.compute.manager [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: c8aa0b26-4099-4a8d-afce-a1e990e5b1f7] Start building block device mappings for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 23:45:38 user nova-compute[75341]: DEBUG nova.policy [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c449c68aafa04accb8f06dbf87371f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86dc7dc1b6b41bf874f1a25d7bca91d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75341) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 23:45:38 user nova-compute[75341]: DEBUG nova.compute.manager [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: c8aa0b26-4099-4a8d-afce-a1e990e5b1f7] Start spawning the instance on the hypervisor. {{(pid=75341) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 23:45:38 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: c8aa0b26-4099-4a8d-afce-a1e990e5b1f7] Creating instance directory {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 23:45:38 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: c8aa0b26-4099-4a8d-afce-a1e990e5b1f7] Creating image(s)
Nov 14 23:45:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Acquiring lock "/opt/stack/data/nova/instances/c8aa0b26-4099-4a8d-afce-a1e990e5b1f7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:45:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Lock "/opt/stack/data/nova/instances/c8aa0b26-4099-4a8d-afce-a1e990e5b1f7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:45:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Lock "/opt/stack/data/nova/instances/c8aa0b26-4099-4a8d-afce-a1e990e5b1f7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:45:38 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:38 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.177s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Acquiring lock "4754efee9a6d73d3647f2add2cfe86c291949740" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:45:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:45:38 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:38 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.175s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:38 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/c8aa0b26-4099-4a8d-afce-a1e990e5b1f7/disk 1073741824 {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:38 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/c8aa0b26-4099-4a8d-afce-a1e990e5b1f7/disk 1073741824" returned: 0 in 0.053s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:45:38 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG nova.network.neutron [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: c8aa0b26-4099-4a8d-afce-a1e990e5b1f7] Successfully created port: 6c946423-6beb-4e8a-b041-5919bf2ca256 {{(pid=75341) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.184s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c8aa0b26-4099-4a8d-afce-a1e990e5b1f7/disk. size=1073741824 {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8aa0b26-4099-4a8d-afce-a1e990e5b1f7/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG os_brick.utils [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[862d0fd5-3788-40e3-9ad2-d25c92f8b2f1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6d1cfca09c9\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a233327-4b2e-481c-a468-e2883ac5139d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4dfc5d8-9cfa-4a86-9617-bb7c7026ad48]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[8218c627-7045-4cc0-aafd-4554050e0a1c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Running cmd (subprocess): nvme version {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] 'nvme version' failed. Not Retrying. {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] nvme not present on system {{(pid=75341) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:45:39 user nova-compute[75341]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 23:45:39 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca38385-e3d9-4bbd-845a-071eaf78b127]: (4, '') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75341) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] LIGHTOS: no hostnqn found. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG os_brick.utils [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6d1cfca09c9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG nova.virt.block_device [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] Updating existing volume attachment record: d3cf85b2-dd29-4e3a-a655-6428813465c1 {{(pid=75341) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8aa0b26-4099-4a8d-afce-a1e990e5b1f7/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Cannot resize image /opt/stack/data/nova/instances/c8aa0b26-4099-4a8d-afce-a1e990e5b1f7/disk to a smaller size. {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: c8aa0b26-4099-4a8d-afce-a1e990e5b1f7] Created local disks {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: c8aa0b26-4099-4a8d-afce-a1e990e5b1f7] Ensure instance console log exists: /opt/stack/data/nova/instances/c8aa0b26-4099-4a8d-afce-a1e990e5b1f7/console.log {{(pid=75341) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG nova.network.neutron [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: c8aa0b26-4099-4a8d-afce-a1e990e5b1f7] Successfully updated port: 6c946423-6beb-4e8a-b041-5919bf2ca256 {{(pid=75341) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Acquiring lock "refresh_cache-c8aa0b26-4099-4a8d-afce-a1e990e5b1f7" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Acquired lock "refresh_cache-c8aa0b26-4099-4a8d-afce-a1e990e5b1f7" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG nova.network.neutron [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: c8aa0b26-4099-4a8d-afce-a1e990e5b1f7] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG nova.compute.manager [req-57fa162e-fab3-4d70-bac8-0a1fd4a8090c req-6186f990-8a76-4efa-86d6-6c7ee105a072 service nova] [instance: c8aa0b26-4099-4a8d-afce-a1e990e5b1f7] Received event network-changed-6c946423-6beb-4e8a-b041-5919bf2ca256 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG nova.compute.manager [req-57fa162e-fab3-4d70-bac8-0a1fd4a8090c req-6186f990-8a76-4efa-86d6-6c7ee105a072 service nova] [instance: c8aa0b26-4099-4a8d-afce-a1e990e5b1f7] Refreshing instance network info cache due to event network-changed-6c946423-6beb-4e8a-b041-5919bf2ca256. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-57fa162e-fab3-4d70-bac8-0a1fd4a8090c req-6186f990-8a76-4efa-86d6-6c7ee105a072 service nova] Acquiring lock "refresh_cache-c8aa0b26-4099-4a8d-afce-a1e990e5b1f7" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG nova.network.neutron [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: c8aa0b26-4099-4a8d-afce-a1e990e5b1f7] Instance cache missing network info. {{(pid=75341) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Starting finish_revert_migration {{(pid=75341) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Start _get_guest_xml network_info=[{"id": "dcc0edd5-582a-499a-beaf-6de23ff1537c", "address": "fa:16:3e:83:5b:7a", "network": {"id": "139c86e9-e6ea-4307-9f78-7f41ab7a6d8c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-487359378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eff8d64949254c7eb3dd8685ca7447b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc0edd5-58", "ovs_interfaceid": "dcc0edd5-582a-499a-beaf-6de23ff1537c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encrypted': False, 'image_id': 'e46abb82-b810-490e-a8a1-ccdc5fa1a796'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': None, 'attachment_id': '48959eff-b800-4e4c-8776-7fcf4aba869e', 'mount_device': '/dev/vdb', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pzdvecEm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '881351d7-31f9-44f4-8571-8f540bbec29c', 'attached_at': '2023-11-14T23:45:40.000000', 'detached_at': '', 'volume_id': '2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3', 'serial': '2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 23:45:39 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:45:39 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:45:39 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG nova.objects.instance [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Lazy-loading 'vcpu_model' on Instance uuid 881351d7-31f9-44f4-8571-8f540bbec29c {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Calling os-brick to attach iSCSI Volume {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pzdvecEm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:45:39 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:45:39 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:45:39 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:45:39 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:45:39 user nova-compute[75341]: INFO os_brick.initiator.connectors.iscsi [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 23:45:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 -p 172.16.0.220:3260 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d11427-01a8-4098-9794-0f3dff6cd318]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 23:45:39 user nova-compute[75341]:  {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e1c357-0b9e-46ac-8ea2-e975a7528ff7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3] added\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3] added
Nov 14 23:45:39 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG nova.network.neutron [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: c8aa0b26-4099-4a8d-afce-a1e990e5b1f7] Updating instance_info_cache with network_info: [{"id": "6c946423-6beb-4e8a-b041-5919bf2ca256", "address": "fa:16:3e:0b:1c:fe", "network": {"id": "7673016a-86f3-4643-a21f-148adc2a96dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-89785556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d86dc7dc1b6b41bf874f1a25d7bca91d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c946423-6b", "ovs_interfaceid": "6c946423-6beb-4e8a-b041-5919bf2ca256", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[a128b093-7340-400f-8553-353ab5bbc3a0]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Releasing lock "refresh_cache-c8aa0b26-4099-4a8d-afce-a1e990e5b1f7" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG nova.compute.manager [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: c8aa0b26-4099-4a8d-afce-a1e990e5b1f7] Instance network_info: |[{"id": "6c946423-6beb-4e8a-b041-5919bf2ca256", "address": "fa:16:3e:0b:1c:fe", "network": {"id": "7673016a-86f3-4643-a21f-148adc2a96dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-89785556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d86dc7dc1b6b41bf874f1a25d7bca91d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c946423-6b", "ovs_interfaceid": "6c946423-6beb-4e8a-b041-5919bf2ca256", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-57fa162e-fab3-4d70-bac8-0a1fd4a8090c req-6186f990-8a76-4efa-86d6-6c7ee105a072 service nova] Acquired lock "refresh_cache-c8aa0b26-4099-4a8d-afce-a1e990e5b1f7" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG nova.network.neutron [req-57fa162e-fab3-4d70-bac8-0a1fd4a8090c req-6186f990-8a76-4efa-86d6-6c7ee105a072 service nova] [instance: c8aa0b26-4099-4a8d-afce-a1e990e5b1f7] Refreshing network info cache for port 6c946423-6beb-4e8a-b041-5919bf2ca256 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: c8aa0b26-4099-4a8d-afce-a1e990e5b1f7] Start _get_guest_xml network_info=[{"id": "6c946423-6beb-4e8a-b041-5919bf2ca256", "address": "fa:16:3e:0b:1c:fe", "network": {"id": "7673016a-86f3-4643-a21f-148adc2a96dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-89785556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d86dc7dc1b6b41bf874f1a25d7bca91d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c946423-6b", "ovs_interfaceid": "6c946423-6beb-4e8a-b041-5919bf2ca256", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encrypted': False, 'image_id': 'e46abb82-b810-490e-a8a1-ccdc5fa1a796'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e33f746-0f7c-4557-8b5d-7c64aaaf27e5]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:39 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:45:39 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:45:39 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pzdvecEm {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:45:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1811583981',display_name='tempest-ServersNegativeTestJSON-server-1811583981',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1811583981',id=22,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d86dc7dc1b6b41bf874f1a25d7bca91d',ramdisk_id='',reservation_id='r-xegwthf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2018102579',owner_user_name='tempest-ServersNegativeTestJSON-2018102579-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:45:38Z,user_data=None,user_id='c449c68aafa04accb8f06dbf87371f2d',uuid=c8aa0b26-4099-4a8d-afce-a1e990e5b1f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c946423-6beb-4e8a-b041-5919bf2ca256", "address": "fa:16:3e:0b:1c:fe", "network": {"id": "7673016a-86f3-4643-a21f-148adc2a96dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-89785556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d86dc7dc1b6b41bf874f1a25d7bca91d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c946423-6b", "ovs_interfaceid": "6c946423-6beb-4e8a-b041-5919bf2ca256", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Converting VIF {"id": "6c946423-6beb-4e8a-b041-5919bf2ca256", "address": "fa:16:3e:0b:1c:fe", "network": {"id": "7673016a-86f3-4643-a21f-148adc2a96dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-89785556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d86dc7dc1b6b41bf874f1a25d7bca91d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c946423-6b", "ovs_interfaceid": "6c946423-6beb-4e8a-b041-5919bf2ca256", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:1c:fe,bridge_name='br-int',has_traffic_filtering=True,id=6c946423-6beb-4e8a-b041-5919bf2ca256,network=Network(7673016a-86f3-4643-a21f-148adc2a96dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c946423-6b') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG nova.objects.instance [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Lazy-loading 'pci_devices' on Instance uuid c8aa0b26-4099-4a8d-afce-a1e990e5b1f7 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pzdvecEm" returned: 0 in 0.024s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0489f1-459a-46a3-8357-6fd7a798f943]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:39 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pzdvecEm'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:45:40 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:40 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: c8aa0b26-4099-4a8d-afce-a1e990e5b1f7] End _get_guest_xml xml=<domain type="kvm">
Nov 14 23:45:40 user nova-compute[75341]:   <uuid>c8aa0b26-4099-4a8d-afce-a1e990e5b1f7</uuid>
Nov 14 23:45:40 user nova-compute[75341]:   <name>instance-00000016</name>
Nov 14 23:45:40 user nova-compute[75341]:   <memory>524288</memory>
Nov 14 23:45:40 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 14 23:45:40 user nova-compute[75341]:   <metadata>
Nov 14 23:45:40 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 23:45:40 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 14 23:45:40 user nova-compute[75341]:       <nova:name>tempest-ServersNegativeTestJSON-server-1811583981</nova:name>
Nov 14 23:45:40 user nova-compute[75341]:       <nova:creationTime>2023-11-14 23:45:39</nova:creationTime>
Nov 14 23:45:40 user nova-compute[75341]:       <nova:flavor name="m1.tiny">
Nov 14 23:45:40 user nova-compute[75341]:         <nova:memory>512</nova:memory>
Nov 14 23:45:40 user nova-compute[75341]:         <nova:disk>1</nova:disk>
Nov 14 23:45:40 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 14 23:45:40 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 23:45:40 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 14 23:45:40 user nova-compute[75341]:       </nova:flavor>
Nov 14 23:45:40 user nova-compute[75341]:       <nova:owner>
Nov 14 23:45:40 user nova-compute[75341]:         <nova:user uuid="c449c68aafa04accb8f06dbf87371f2d">tempest-ServersNegativeTestJSON-2018102579-project-member</nova:user>
Nov 14 23:45:40 user nova-compute[75341]:         <nova:project uuid="d86dc7dc1b6b41bf874f1a25d7bca91d">tempest-ServersNegativeTestJSON-2018102579</nova:project>
Nov 14 23:45:40 user nova-compute[75341]:       </nova:owner>
Nov 14 23:45:40 user nova-compute[75341]:       <nova:root type="image" uuid="e46abb82-b810-490e-a8a1-ccdc5fa1a796"/>
Nov 14 23:45:40 user nova-compute[75341]:       <nova:ports>
Nov 14 23:45:40 user nova-compute[75341]:         <nova:port uuid="6c946423-6beb-4e8a-b041-5919bf2ca256">
Nov 14 23:45:40 user nova-compute[75341]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 23:45:40 user nova-compute[75341]:         </nova:port>
Nov 14 23:45:40 user nova-compute[75341]:       </nova:ports>
Nov 14 23:45:40 user nova-compute[75341]:     </nova:instance>
Nov 14 23:45:40 user nova-compute[75341]:   </metadata>
Nov 14 23:45:40 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 14 23:45:40 user nova-compute[75341]:     <system>
Nov 14 23:45:40 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 23:45:40 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 14 23:45:40 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 14 23:45:40 user nova-compute[75341]:       <entry name="serial">c8aa0b26-4099-4a8d-afce-a1e990e5b1f7</entry>
Nov 14 23:45:40 user nova-compute[75341]:       <entry name="uuid">c8aa0b26-4099-4a8d-afce-a1e990e5b1f7</entry>
Nov 14 23:45:40 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 14 23:45:40 user nova-compute[75341]:     </system>
Nov 14 23:45:40 user nova-compute[75341]:   </sysinfo>
Nov 14 23:45:40 user nova-compute[75341]:   <os>
Nov 14 23:45:40 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 23:45:40 user nova-compute[75341]:     <boot dev="hd"/>
Nov 14 23:45:40 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 14 23:45:40 user nova-compute[75341]:   </os>
Nov 14 23:45:40 user nova-compute[75341]:   <features>
Nov 14 23:45:40 user nova-compute[75341]:     <acpi/>
Nov 14 23:45:40 user nova-compute[75341]:     <apic/>
Nov 14 23:45:40 user nova-compute[75341]:     <vmcoreinfo/>
Nov 14 23:45:40 user nova-compute[75341]:   </features>
Nov 14 23:45:40 user nova-compute[75341]:   <clock offset="utc">
Nov 14 23:45:40 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 23:45:40 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 23:45:40 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 14 23:45:40 user nova-compute[75341]:   </clock>
Nov 14 23:45:40 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 14 23:45:40 user nova-compute[75341]:     <model>Nehalem</model>
Nov 14 23:45:40 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 23:45:40 user nova-compute[75341]:   </cpu>
Nov 14 23:45:40 user nova-compute[75341]:   <devices>
Nov 14 23:45:40 user nova-compute[75341]:     <disk type="file" device="disk">
Nov 14 23:45:40 user nova-compute[75341]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 23:45:40 user nova-compute[75341]:       <source file="/opt/stack/data/nova/instances/c8aa0b26-4099-4a8d-afce-a1e990e5b1f7/disk"/>
Nov 14 23:45:40 user nova-compute[75341]:       <target dev="vda" bus="virtio"/>
Nov 14 23:45:40 user nova-compute[75341]:     </disk>
Nov 14 23:45:40 user nova-compute[75341]:     <interface type="ethernet">
Nov 14 23:45:40 user nova-compute[75341]:       <mac address="fa:16:3e:0b:1c:fe"/>
Nov 14 23:45:40 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:45:40 user nova-compute[75341]:       <mtu size="1442"/>
Nov 14 23:45:40 user nova-compute[75341]:       <target dev="tap6c946423-6b"/>
Nov 14 23:45:40 user nova-compute[75341]:     </interface>
Nov 14 23:45:40 user nova-compute[75341]:     <serial type="pty">
Nov 14 23:45:40 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/c8aa0b26-4099-4a8d-afce-a1e990e5b1f7/console.log" append="off"/>
Nov 14 23:45:40 user nova-compute[75341]:     </serial>
Nov 14 23:45:40 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 23:45:40 user nova-compute[75341]:     <video>
Nov 14 23:45:40 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:45:40 user nova-compute[75341]:     </video>
Nov 14 23:45:40 user nova-compute[75341]:     <rng model="virtio">
Nov 14 23:45:40 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 14 23:45:40 user nova-compute[75341]:     </rng>
Nov 14 23:45:40 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 14 23:45:40 user nova-compute[75341]:     <memballoon model="virtio">
Nov 14 23:45:40 user nova-compute[75341]:       <stats period="10"/>
Nov 14 23:45:40 user nova-compute[75341]:     </memballoon>
Nov 14 23:45:40 user nova-compute[75341]:   </devices>
Nov 14 23:45:40 user nova-compute[75341]: </domain>
Nov 14 23:45:40 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 23:45:40 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:45:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1811583981',display_name='tempest-ServersNegativeTestJSON-server-1811583981',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1811583981',id=22,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d86dc7dc1b6b41bf874f1a25d7bca91d',ramdisk_id='',reservation_id='r-xegwthf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2018102579',owner_user_name='tempest-ServersNegativeTestJSON-2018102579-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:45:38Z,user_data=None,user_id='c449c68aafa04accb8f06dbf87371f2d',uuid=c8aa0b26-4099-4a8d-afce-a1e990e5b1f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c946423-6beb-4e8a-b041-5919bf2ca256", "address": "fa:16:3e:0b:1c:fe", "network": {"id": "7673016a-86f3-4643-a21f-148adc2a96dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-89785556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d86dc7dc1b6b41bf874f1a25d7bca91d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c946423-6b", "ovs_interfaceid": "6c946423-6beb-4e8a-b041-5919bf2ca256", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 23:45:40 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Converting VIF {"id": "6c946423-6beb-4e8a-b041-5919bf2ca256", "address": "fa:16:3e:0b:1c:fe", "network": {"id": "7673016a-86f3-4643-a21f-148adc2a96dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-89785556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d86dc7dc1b6b41bf874f1a25d7bca91d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c946423-6b", "ovs_interfaceid": "6c946423-6beb-4e8a-b041-5919bf2ca256", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:45:40 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:1c:fe,bridge_name='br-int',has_traffic_filtering=True,id=6c946423-6beb-4e8a-b041-5919bf2ca256,network=Network(7673016a-86f3-4643-a21f-148adc2a96dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c946423-6b') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:45:40 user nova-compute[75341]: DEBUG os_vif [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:1c:fe,bridge_name='br-int',has_traffic_filtering=True,id=6c946423-6beb-4e8a-b041-5919bf2ca256,network=Network(7673016a-86f3-4643-a21f-148adc2a96dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c946423-6b') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 23:45:40 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:40 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:45:40 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 23:45:40 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:40 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3d4293-1676-4eee-82e5-a4d463ffe27c]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:40 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:40 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '79ce25a4-0a4e-502a-80e3-bac0c5e07cf3', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:45:40 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:45:40 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:40 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:40 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:45:40 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:40 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6c946423-6b, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:45:40 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6c946423-6b, col_values=(('qos', UUID('20e6364c-c71d-4dcb-8e2e-64ce6d439734')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:45:40 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6c946423-6b, col_values=(('external_ids', {'iface-id': '6c946423-6beb-4e8a-b041-5919bf2ca256', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:1c:fe', 'vm-uuid': 'c8aa0b26-4099-4a8d-afce-a1e990e5b1f7'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:45:40 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:40 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:45:40 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:40 user nova-compute[75341]: INFO os_vif [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:1c:fe,bridge_name='br-int',has_traffic_filtering=True,id=6c946423-6beb-4e8a-b041-5919bf2ca256,network=Network(7673016a-86f3-4643-a21f-148adc2a96dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c946423-6b')
Nov 14 23:45:40 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:40 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe35058-6f31-4ced-bce2-5a80f29faa8d]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:40 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 (non-flash)
Nov 14 23:45:40 user nova-compute[75341]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 (non-flash)
Nov 14 23:45:40 user nova-compute[75341]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a (non-flash)
Nov 14 23:45:40 user nova-compute[75341]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 (non-flash)
Nov 14 23:45:40 user nova-compute[75341]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:45:40 user nova-compute[75341]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)
Nov 14 23:45:40 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:45:40 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 (non-flash)
Nov 14 23:45:40 user nova-compute[75341]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 (non-flash)
Nov 14 23:45:40 user nova-compute[75341]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a (non-flash)
Nov 14 23:45:40 user nova-compute[75341]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 (non-flash)
Nov 14 23:45:40 user nova-compute[75341]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:45:40 user nova-compute[75341]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)
Nov 14 23:45:40 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:45:40 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 -p 172.16.0.220:3260 --login {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:40 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:45:40 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] No VIF found with MAC fa:16:3e:0b:1c:fe, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:45:40 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 -p 172.16.0.220:3260 --login" returned: 0 in 0.098s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:40 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[f875a16e-5253-463d-870f-07a00a1a8a52]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:40 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3, portal: 172.16.0.220,3260]
Nov 14 23:45:40 user nova-compute[75341]: Login to [iface: default, target: iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3, portal: 172.16.0.220,3260] successful.
Nov 14 23:45:40 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:45:40 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:40 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:40 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[510dfe6f-3be8-439f-83cf-148a67256177]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:40 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:45:40 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:40 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:40 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a84470-2660-40bc-9051-46d728d7777c]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:40 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 (non-flash)
Nov 14 23:45:40 user nova-compute[75341]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 (non-flash)
Nov 14 23:45:40 user nova-compute[75341]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a (non-flash)
Nov 14 23:45:40 user nova-compute[75341]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 (non-flash)
Nov 14 23:45:40 user nova-compute[75341]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:45:40 user nova-compute[75341]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)
Nov 14 23:45:40 user nova-compute[75341]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)
Nov 14 23:45:40 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:45:40 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 (non-flash)
Nov 14 23:45:40 user nova-compute[75341]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 (non-flash)
Nov 14 23:45:40 user nova-compute[75341]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a (non-flash)
Nov 14 23:45:40 user nova-compute[75341]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 (non-flash)
Nov 14 23:45:40 user nova-compute[75341]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:45:40 user nova-compute[75341]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)
Nov 14 23:45:40 user nova-compute[75341]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)
Nov 14 23:45:40 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:45:40 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.381s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:45:40 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Connected to 172.16.0.220:3260 {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 23:45:40 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] HCTL ('36', '-', '-', 0) found on session 27 with lun 0 {{(pid=75341) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 23:45:40 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75341) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 23:45:40 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:40 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:40 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[f606e735-80a0-4159-976d-56888ab79f90]: (4, ('- - 0', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:40 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 23:45:40 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pzdvecEm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 23:45:40 user nova-compute[75341]: DEBUG nova.network.neutron [req-57fa162e-fab3-4d70-bac8-0a1fd4a8090c req-6186f990-8a76-4efa-86d6-6c7ee105a072 service nova] [instance: c8aa0b26-4099-4a8d-afce-a1e990e5b1f7] Updated VIF entry in instance network info cache for port 6c946423-6beb-4e8a-b041-5919bf2ca256. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:45:40 user nova-compute[75341]: DEBUG nova.network.neutron [req-57fa162e-fab3-4d70-bac8-0a1fd4a8090c req-6186f990-8a76-4efa-86d6-6c7ee105a072 service nova] [instance: c8aa0b26-4099-4a8d-afce-a1e990e5b1f7] Updating instance_info_cache with network_info: [{"id": "6c946423-6beb-4e8a-b041-5919bf2ca256", "address": "fa:16:3e:0b:1c:fe", "network": {"id": "7673016a-86f3-4643-a21f-148adc2a96dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-89785556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d86dc7dc1b6b41bf874f1a25d7bca91d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c946423-6b", "ovs_interfaceid": "6c946423-6beb-4e8a-b041-5919bf2ca256", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:45:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-57fa162e-fab3-4d70-bac8-0a1fd4a8090c req-6186f990-8a76-4efa-86d6-6c7ee105a072 service nova] Releasing lock "refresh_cache-c8aa0b26-4099-4a8d-afce-a1e990e5b1f7" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:45:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:41 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.416s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:45:41 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] <== connect_volume: return (1418ms) {'type': 'block', 'scsi_wwn': '26631613763363039', 'path': '/dev/sde'} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:45:41 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26631613763363039', 'path': '/dev/sde'} {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 23:45:41 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:39:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1731707158',display_name='tempest-ServerActionsTestOtherB-server-1731707158',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1731707158',id=1,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPcpkEsQSTpmH5o8Wvimru34qoMLk4crSEJeEz6XFBwMyGlgEqVH+eZU8RhCkfXTyDuMId//yiBmA84BMG1N70mUPHjpTANep7Y1Hwo1CNlTldBrdW9Ccxs8yCQLXA8Fw==',key_name='tempest-keypair-500318648',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:43:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='eff8d64949254c7eb3dd8685ca7447b1',ramdisk_id='',reservation_id='r-505keefc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1632747205',owner_user_name='tempest-ServerActionsTestOtherB-1632747205-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:45:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='512d2ce7a01c4ffb924f9476a5c4b946',uuid=881351d7-31f9-44f4-8571-8f540bbec29c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "dcc0edd5-582a-499a-beaf-6de23ff1537c", "address": "fa:16:3e:83:5b:7a", "network": {"id": "139c86e9-e6ea-4307-9f78-7f41ab7a6d8c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-487359378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eff8d64949254c7eb3dd8685ca7447b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc0edd5-58", "ovs_interfaceid": "dcc0edd5-582a-499a-beaf-6de23ff1537c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:45:41 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Converting VIF {"id": "dcc0edd5-582a-499a-beaf-6de23ff1537c", "address": "fa:16:3e:83:5b:7a", "network": {"id": "139c86e9-e6ea-4307-9f78-7f41ab7a6d8c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-487359378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eff8d64949254c7eb3dd8685ca7447b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc0edd5-58", "ovs_interfaceid": "dcc0edd5-582a-499a-beaf-6de23ff1537c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:45:41 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:5b:7a,bridge_name='br-int',has_traffic_filtering=True,id=dcc0edd5-582a-499a-beaf-6de23ff1537c,network=Network(139c86e9-e6ea-4307-9f78-7f41ab7a6d8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcc0edd5-58') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:45:41 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] End _get_guest_xml xml=<domain type="kvm">
Nov 14 23:45:41 user nova-compute[75341]:   <uuid>881351d7-31f9-44f4-8571-8f540bbec29c</uuid>
Nov 14 23:45:41 user nova-compute[75341]:   <name>instance-00000001</name>
Nov 14 23:45:41 user nova-compute[75341]:   <memory>524288</memory>
Nov 14 23:45:41 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 14 23:45:41 user nova-compute[75341]:   <metadata>
Nov 14 23:45:41 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 23:45:41 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 14 23:45:41 user nova-compute[75341]:       <nova:name>tempest-ServerActionsTestOtherB-server-1731707158</nova:name>
Nov 14 23:45:41 user nova-compute[75341]:       <nova:creationTime>2023-11-14 23:45:39</nova:creationTime>
Nov 14 23:45:41 user nova-compute[75341]:       <nova:flavor name="m1.tiny">
Nov 14 23:45:41 user nova-compute[75341]:         <nova:memory>512</nova:memory>
Nov 14 23:45:41 user nova-compute[75341]:         <nova:disk>1</nova:disk>
Nov 14 23:45:41 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 14 23:45:41 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 23:45:41 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 14 23:45:41 user nova-compute[75341]:       </nova:flavor>
Nov 14 23:45:41 user nova-compute[75341]:       <nova:owner>
Nov 14 23:45:41 user nova-compute[75341]:         <nova:user uuid="512d2ce7a01c4ffb924f9476a5c4b946">tempest-ServerActionsTestOtherB-1632747205-project-member</nova:user>
Nov 14 23:45:41 user nova-compute[75341]:         <nova:project uuid="eff8d64949254c7eb3dd8685ca7447b1">tempest-ServerActionsTestOtherB-1632747205</nova:project>
Nov 14 23:45:41 user nova-compute[75341]:       </nova:owner>
Nov 14 23:45:41 user nova-compute[75341]:       <nova:root type="image" uuid="e46abb82-b810-490e-a8a1-ccdc5fa1a796"/>
Nov 14 23:45:41 user nova-compute[75341]:       <nova:ports>
Nov 14 23:45:41 user nova-compute[75341]:         <nova:port uuid="dcc0edd5-582a-499a-beaf-6de23ff1537c">
Nov 14 23:45:41 user nova-compute[75341]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 23:45:41 user nova-compute[75341]:         </nova:port>
Nov 14 23:45:41 user nova-compute[75341]:       </nova:ports>
Nov 14 23:45:41 user nova-compute[75341]:     </nova:instance>
Nov 14 23:45:41 user nova-compute[75341]:   </metadata>
Nov 14 23:45:41 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 14 23:45:41 user nova-compute[75341]:     <system>
Nov 14 23:45:41 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 23:45:41 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 14 23:45:41 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 14 23:45:41 user nova-compute[75341]:       <entry name="serial">881351d7-31f9-44f4-8571-8f540bbec29c</entry>
Nov 14 23:45:41 user nova-compute[75341]:       <entry name="uuid">881351d7-31f9-44f4-8571-8f540bbec29c</entry>
Nov 14 23:45:41 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 14 23:45:41 user nova-compute[75341]:     </system>
Nov 14 23:45:41 user nova-compute[75341]:   </sysinfo>
Nov 14 23:45:41 user nova-compute[75341]:   <os>
Nov 14 23:45:41 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 23:45:41 user nova-compute[75341]:     <boot dev="hd"/>
Nov 14 23:45:41 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 14 23:45:41 user nova-compute[75341]:   </os>
Nov 14 23:45:41 user nova-compute[75341]:   <features>
Nov 14 23:45:41 user nova-compute[75341]:     <acpi/>
Nov 14 23:45:41 user nova-compute[75341]:     <apic/>
Nov 14 23:45:41 user nova-compute[75341]:     <vmcoreinfo/>
Nov 14 23:45:41 user nova-compute[75341]:   </features>
Nov 14 23:45:41 user nova-compute[75341]:   <clock offset="utc">
Nov 14 23:45:41 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 23:45:41 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 23:45:41 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 14 23:45:41 user nova-compute[75341]:   </clock>
Nov 14 23:45:41 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 14 23:45:41 user nova-compute[75341]:     <model>Nehalem</model>
Nov 14 23:45:41 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 23:45:41 user nova-compute[75341]:   </cpu>
Nov 14 23:45:41 user nova-compute[75341]:   <devices>
Nov 14 23:45:41 user nova-compute[75341]:     <disk type="file" device="disk">
Nov 14 23:45:41 user nova-compute[75341]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 23:45:41 user nova-compute[75341]:       <source file="/opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c/disk"/>
Nov 14 23:45:41 user nova-compute[75341]:       <target dev="vda" bus="virtio"/>
Nov 14 23:45:41 user nova-compute[75341]:     </disk>
Nov 14 23:45:41 user nova-compute[75341]:     <disk type="block" device="disk">
Nov 14 23:45:41 user nova-compute[75341]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:45:41 user nova-compute[75341]:       <source dev="/dev/sde"/>
Nov 14 23:45:41 user nova-compute[75341]:       <target dev="vdb" bus="virtio"/>
Nov 14 23:45:41 user nova-compute[75341]:       <serial>2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3</serial>
Nov 14 23:45:41 user nova-compute[75341]:     </disk>
Nov 14 23:45:41 user nova-compute[75341]:     <interface type="ethernet">
Nov 14 23:45:41 user nova-compute[75341]:       <mac address="fa:16:3e:83:5b:7a"/>
Nov 14 23:45:41 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:45:41 user nova-compute[75341]:       <mtu size="1442"/>
Nov 14 23:45:41 user nova-compute[75341]:       <target dev="tapdcc0edd5-58"/>
Nov 14 23:45:41 user nova-compute[75341]:     </interface>
Nov 14 23:45:41 user nova-compute[75341]:     <serial type="pty">
Nov 14 23:45:41 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c/console.log" append="off"/>
Nov 14 23:45:41 user nova-compute[75341]:     </serial>
Nov 14 23:45:41 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 23:45:41 user nova-compute[75341]:     <video>
Nov 14 23:45:41 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:45:41 user nova-compute[75341]:     </video>
Nov 14 23:45:41 user nova-compute[75341]:     <rng model="virtio">
Nov 14 23:45:41 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 14 23:45:41 user nova-compute[75341]:     </rng>
Nov 14 23:45:41 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 14 23:45:41 user nova-compute[75341]:     <memballoon model="virtio">
Nov 14 23:45:41 user nova-compute[75341]:       <stats period="10"/>
Nov 14 23:45:41 user nova-compute[75341]:     </memballoon>
Nov 14 23:45:41 user nova-compute[75341]:   </devices>
Nov 14 23:45:41 user nova-compute[75341]: </domain>
Nov 14 23:45:41 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 23:45:41 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:39:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1731707158',display_name='tempest-ServerActionsTestOtherB-server-1731707158',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1731707158',id=1,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPcpkEsQSTpmH5o8Wvimru34qoMLk4crSEJeEz6XFBwMyGlgEqVH+eZU8RhCkfXTyDuMId//yiBmA84BMG1N70mUPHjpTANep7Y1Hwo1CNlTldBrdW9Ccxs8yCQLXA8Fw==',key_name='tempest-keypair-500318648',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:43:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='eff8d64949254c7eb3dd8685ca7447b1',ramdisk_id='',reservation_id='r-505keefc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1632747205',owner_user_name='tempest-ServerActionsTestOtherB-1632747205-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:45:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='512d2ce7a01c4ffb924f9476a5c4b946',uuid=881351d7-31f9-44f4-8571-8f540bbec29c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "dcc0edd5-582a-499a-beaf-6de23ff1537c", "address": "fa:16:3e:83:5b:7a", "network": {"id": "139c86e9-e6ea-4307-9f78-7f41ab7a6d8c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-487359378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eff8d64949254c7eb3dd8685ca7447b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc0edd5-58", "ovs_interfaceid": "dcc0edd5-582a-499a-beaf-6de23ff1537c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 23:45:41 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Converting VIF {"id": "dcc0edd5-582a-499a-beaf-6de23ff1537c", "address": "fa:16:3e:83:5b:7a", "network": {"id": "139c86e9-e6ea-4307-9f78-7f41ab7a6d8c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-487359378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eff8d64949254c7eb3dd8685ca7447b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc0edd5-58", "ovs_interfaceid": "dcc0edd5-582a-499a-beaf-6de23ff1537c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:45:41 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:5b:7a,bridge_name='br-int',has_traffic_filtering=True,id=dcc0edd5-582a-499a-beaf-6de23ff1537c,network=Network(139c86e9-e6ea-4307-9f78-7f41ab7a6d8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcc0edd5-58') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:45:41 user nova-compute[75341]: DEBUG os_vif [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:5b:7a,bridge_name='br-int',has_traffic_filtering=True,id=dcc0edd5-582a-499a-beaf-6de23ff1537c,network=Network(139c86e9-e6ea-4307-9f78-7f41ab7a6d8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcc0edd5-58') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 23:45:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:45:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 23:45:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '50b635b7-e3cc-5480-a54f-4b5bf0d82bcd', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:45:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:45:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdcc0edd5-58, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:45:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdcc0edd5-58, col_values=(('qos', UUID('ba24ecde-703c-4524-b8f1-772a9e8cbddc')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:45:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdcc0edd5-58, col_values=(('external_ids', {'iface-id': 'dcc0edd5-582a-499a-beaf-6de23ff1537c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:5b:7a', 'vm-uuid': '881351d7-31f9-44f4-8571-8f540bbec29c'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:45:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:45:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:41 user nova-compute[75341]: INFO os_vif [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:5b:7a,bridge_name='br-int',has_traffic_filtering=True,id=dcc0edd5-582a-499a-beaf-6de23ff1537c,network=Network(139c86e9-e6ea-4307-9f78-7f41ab7a6d8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcc0edd5-58')
Nov 14 23:45:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:41 user nova-compute[75341]: DEBUG nova.compute.manager [req-62f23017-1bfb-47be-b7ce-d66d3e79f402 req-1f01f790-54eb-455f-8943-68286046639d service nova] [instance: c8aa0b26-4099-4a8d-afce-a1e990e5b1f7] Received event network-vif-plugged-6c946423-6beb-4e8a-b041-5919bf2ca256 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:45:41 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-62f23017-1bfb-47be-b7ce-d66d3e79f402 req-1f01f790-54eb-455f-8943-68286046639d service nova] Acquiring lock "c8aa0b26-4099-4a8d-afce-a1e990e5b1f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:45:41 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-62f23017-1bfb-47be-b7ce-d66d3e79f402 req-1f01f790-54eb-455f-8943-68286046639d service nova] Lock "c8aa0b26-4099-4a8d-afce-a1e990e5b1f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:45:41 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-62f23017-1bfb-47be-b7ce-d66d3e79f402 req-1f01f790-54eb-455f-8943-68286046639d service nova] Lock "c8aa0b26-4099-4a8d-afce-a1e990e5b1f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:45:41 user nova-compute[75341]: DEBUG nova.compute.manager [req-62f23017-1bfb-47be-b7ce-d66d3e79f402 req-1f01f790-54eb-455f-8943-68286046639d service nova] [instance: c8aa0b26-4099-4a8d-afce-a1e990e5b1f7] No waiting events found dispatching network-vif-plugged-6c946423-6beb-4e8a-b041-5919bf2ca256 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:45:41 user nova-compute[75341]: WARNING nova.compute.manager [req-62f23017-1bfb-47be-b7ce-d66d3e79f402 req-1f01f790-54eb-455f-8943-68286046639d service nova] [instance: c8aa0b26-4099-4a8d-afce-a1e990e5b1f7] Received unexpected event network-vif-plugged-6c946423-6beb-4e8a-b041-5919bf2ca256 for instance with vm_state building and task_state spawning.
Nov 14 23:45:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:42 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:45:42 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75341) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 23:45:43 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:43 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:43 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:43 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:43 user nova-compute[75341]: DEBUG nova.compute.manager [req-4da7014e-22f2-4b4e-82bb-430965ab75e6 req-2894aa1e-26b6-4487-b70c-e41027411b62 service nova] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Received event network-vif-plugged-dcc0edd5-582a-499a-beaf-6de23ff1537c {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:45:43 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4da7014e-22f2-4b4e-82bb-430965ab75e6 req-2894aa1e-26b6-4487-b70c-e41027411b62 service nova] Acquiring lock "881351d7-31f9-44f4-8571-8f540bbec29c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:45:43 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4da7014e-22f2-4b4e-82bb-430965ab75e6 req-2894aa1e-26b6-4487-b70c-e41027411b62 service nova] Lock "881351d7-31f9-44f4-8571-8f540bbec29c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:45:43 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4da7014e-22f2-4b4e-82bb-430965ab75e6 req-2894aa1e-26b6-4487-b70c-e41027411b62 service nova] Lock "881351d7-31f9-44f4-8571-8f540bbec29c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:45:43 user nova-compute[75341]: DEBUG nova.compute.manager [req-4da7014e-22f2-4b4e-82bb-430965ab75e6 req-2894aa1e-26b6-4487-b70c-e41027411b62 service nova] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] No waiting events found dispatching network-vif-plugged-dcc0edd5-582a-499a-beaf-6de23ff1537c {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:45:43 user nova-compute[75341]: WARNING nova.compute.manager [req-4da7014e-22f2-4b4e-82bb-430965ab75e6 req-2894aa1e-26b6-4487-b70c-e41027411b62 service nova] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Received unexpected event network-vif-plugged-dcc0edd5-582a-499a-beaf-6de23ff1537c for instance with vm_state resized and task_state resize_reverting.
Nov 14 23:45:43 user nova-compute[75341]: DEBUG nova.compute.manager [req-37d58daf-d887-43e2-91bf-5fe165e02cc9 req-df949146-7e33-42ce-94b4-3cb5d2e8feff service nova] [instance: c8aa0b26-4099-4a8d-afce-a1e990e5b1f7] Received event network-vif-plugged-6c946423-6beb-4e8a-b041-5919bf2ca256 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:45:43 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-37d58daf-d887-43e2-91bf-5fe165e02cc9 req-df949146-7e33-42ce-94b4-3cb5d2e8feff service nova] Acquiring lock "c8aa0b26-4099-4a8d-afce-a1e990e5b1f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:45:43 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-37d58daf-d887-43e2-91bf-5fe165e02cc9 req-df949146-7e33-42ce-94b4-3cb5d2e8feff service nova] Lock "c8aa0b26-4099-4a8d-afce-a1e990e5b1f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:45:43 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-37d58daf-d887-43e2-91bf-5fe165e02cc9 req-df949146-7e33-42ce-94b4-3cb5d2e8feff service nova] Lock "c8aa0b26-4099-4a8d-afce-a1e990e5b1f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:45:43 user nova-compute[75341]: DEBUG nova.compute.manager [req-37d58daf-d887-43e2-91bf-5fe165e02cc9 req-df949146-7e33-42ce-94b4-3cb5d2e8feff service nova] [instance: c8aa0b26-4099-4a8d-afce-a1e990e5b1f7] No waiting events found dispatching network-vif-plugged-6c946423-6beb-4e8a-b041-5919bf2ca256 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:45:43 user nova-compute[75341]: WARNING nova.compute.manager [req-37d58daf-d887-43e2-91bf-5fe165e02cc9 req-df949146-7e33-42ce-94b4-3cb5d2e8feff service nova] [instance: c8aa0b26-4099-4a8d-afce-a1e990e5b1f7] Received unexpected event network-vif-plugged-6c946423-6beb-4e8a-b041-5919bf2ca256 for instance with vm_state building and task_state spawning.
Nov 14 23:45:43 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:43 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG nova.compute.manager [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] Start spawning the instance on the hypervisor. {{(pid=75341) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] Creating instance directory {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 23:45:44 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] Creating image(s)
Nov 14 23:45:44 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] Did not create local disks {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] Ensure instance console log exists: /opt/stack/data/nova/instances/896ee337-80bf-47c3-9530-861c941a2fc6/console.log {{(pid=75341) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] Start _get_guest_xml network_info=[{"id": "88af4d1e-2d6c-4e86-906e-159a733ab307", "address": "fa:16:3e:ce:0b:42", "network": {"id": "227eb779-a064-477d-8447-45862017ae7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-3827253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96674073965642f1af11221b4add8a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88af4d1e-2d", "ovs_interfaceid": "88af4d1e-2d6c-4e86-906e-159a733ab307", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'd3cf85b2-dd29-4e3a-a655-6428813465c1', 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aeXonyjL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '896ee337-80bf-47c3-9530-861c941a2fc6', 'attached_at': '', 'detached_at': '', 'volume_id': '0223eb95-57f1-4e16-b903-bdd690fba90d', 'serial': '0223eb95-57f1-4e16-b903-bdd690fba90d'}, 'delete_on_termination': True, 'volume_type': None} {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 23:45:44 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:45:44 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:45:44 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] Calling os-brick to attach iSCSI Volume {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aeXonyjL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:45:44 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:45:44 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:45:44 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:45:44 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:45:44 user nova-compute[75341]: INFO os_brick.initiator.connectors.iscsi [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 23:45:44 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d -p 172.16.0.220:3260 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3ffb08-de69-4e05-8c89-2dad4b20eeeb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 23:45:44 user nova-compute[75341]:  {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d -p 172.16.0.220:3260 --interface default --op new {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[4798c29e-240b-4b19-b031-ff854e233a57]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d] added\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d] added
Nov 14 23:45:44 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[23fd9513-f792-4744-a104-448adf0f0364]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[743099fd-974c-432c-9d34-799b4b4da4b5]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aeXonyjL {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aeXonyjL" returned: 0 in 0.030s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c6ee35-0e59-42f0-90dc-eda53814abdf]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aeXonyjL'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[94549bb2-7ac2-48d1-a052-a26c4364a90f]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bfe1fbe-6779-40e6-8b16-9fc5357715de]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 (non-flash)
Nov 14 23:45:44 user nova-compute[75341]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 (non-flash)
Nov 14 23:45:44 user nova-compute[75341]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a (non-flash)
Nov 14 23:45:44 user nova-compute[75341]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 (non-flash)
Nov 14 23:45:44 user nova-compute[75341]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:45:44 user nova-compute[75341]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)
Nov 14 23:45:44 user nova-compute[75341]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)
Nov 14 23:45:44 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 (non-flash)
Nov 14 23:45:44 user nova-compute[75341]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 (non-flash)
Nov 14 23:45:44 user nova-compute[75341]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a (non-flash)
Nov 14 23:45:44 user nova-compute[75341]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 (non-flash)
Nov 14 23:45:44 user nova-compute[75341]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:45:44 user nova-compute[75341]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)
Nov 14 23:45:44 user nova-compute[75341]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)
Nov 14 23:45:44 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d -p 172.16.0.220:3260 --login {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f3149d-4b95-4c6a-85a6-10b0d6303387]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d, portal: 172.16.0.220,3260]
Nov 14 23:45:44 user nova-compute[75341]: Login to [iface: default, target: iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d, portal: 172.16.0.220,3260] successful.
Nov 14 23:45:44 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a36fd2e-33f4-46e0-9be0-b090cef6b4d5]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[39689ff0-2088-450e-8d34-f8e3b3023bd3]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 (non-flash)
Nov 14 23:45:44 user nova-compute[75341]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 (non-flash)
Nov 14 23:45:44 user nova-compute[75341]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a (non-flash)
Nov 14 23:45:44 user nova-compute[75341]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 (non-flash)
Nov 14 23:45:44 user nova-compute[75341]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:45:44 user nova-compute[75341]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)
Nov 14 23:45:44 user nova-compute[75341]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)
Nov 14 23:45:44 user nova-compute[75341]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d (non-flash)
Nov 14 23:45:44 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 (non-flash)
Nov 14 23:45:44 user nova-compute[75341]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 (non-flash)
Nov 14 23:45:44 user nova-compute[75341]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a (non-flash)
Nov 14 23:45:44 user nova-compute[75341]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 (non-flash)
Nov 14 23:45:44 user nova-compute[75341]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:45:44 user nova-compute[75341]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)
Nov 14 23:45:44 user nova-compute[75341]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)
Nov 14 23:45:44 user nova-compute[75341]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d (non-flash)
Nov 14 23:45:44 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Connected to 172.16.0.220:3260 {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] HCTL ('40', '-', '-', 0) found on session 28 with lun 0 {{(pid=75341) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75341) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[1653ee09-d635-4611-a0fd-36bc1e92a232]: (4, ('- - 0', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Searching for a device in session 28 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aeXonyjL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG nova.compute.manager [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: c8aa0b26-4099-4a8d-afce-a1e990e5b1f7] Instance event wait completed in 0 seconds for  {{(pid=75341) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 23:45:44 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: c8aa0b26-4099-4a8d-afce-a1e990e5b1f7] Guest created on hypervisor {{(pid=75341) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 23:45:44 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: c8aa0b26-4099-4a8d-afce-a1e990e5b1f7] Instance spawned successfully.
Nov 14 23:45:44 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: c8aa0b26-4099-4a8d-afce-a1e990e5b1f7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 23:45:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: c8aa0b26-4099-4a8d-afce-a1e990e5b1f7] Found default for hw_cdrom_bus of ide {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:45:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: c8aa0b26-4099-4a8d-afce-a1e990e5b1f7] Found default for hw_disk_bus of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:45:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: c8aa0b26-4099-4a8d-afce-a1e990e5b1f7] Found default for hw_input_bus of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:45:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: c8aa0b26-4099-4a8d-afce-a1e990e5b1f7] Found default for hw_pointer_model of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:45:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: c8aa0b26-4099-4a8d-afce-a1e990e5b1f7] Found default for hw_video_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:45:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: c8aa0b26-4099-4a8d-afce-a1e990e5b1f7] Found default for hw_vif_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:45:45 user nova-compute[75341]: INFO nova.compute.manager [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: c8aa0b26-4099-4a8d-afce-a1e990e5b1f7] Took 6.55 seconds to spawn the instance on the hypervisor.
Nov 14 23:45:45 user nova-compute[75341]: DEBUG nova.compute.manager [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: c8aa0b26-4099-4a8d-afce-a1e990e5b1f7] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 23:45:45 user nova-compute[75341]: INFO nova.compute.manager [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: c8aa0b26-4099-4a8d-afce-a1e990e5b1f7] Took 7.40 seconds to build instance.
Nov 14 23:45:45 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-42ca4597-10a9-45ab-bf21-c04db98dd17d tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Lock "c8aa0b26-4099-4a8d-afce-a1e990e5b1f7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.520s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:45:45 user nova-compute[75341]: DEBUG nova.compute.manager [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Instance event wait completed in 0 seconds for  {{(pid=75341) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 23:45:45 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Instance running successfully.
Nov 14 23:45:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] finish_revert_migration finished successfully. {{(pid=75341) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 14 23:45:45 user nova-compute[75341]: DEBUG nova.compute.manager [req-744f11f9-eba0-4f01-9a70-44576c26efe1 req-be00c86d-a63c-46f7-905a-458cea3bc62c service nova] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Received event network-vif-plugged-dcc0edd5-582a-499a-beaf-6de23ff1537c {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:45:45 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-744f11f9-eba0-4f01-9a70-44576c26efe1 req-be00c86d-a63c-46f7-905a-458cea3bc62c service nova] Acquiring lock "881351d7-31f9-44f4-8571-8f540bbec29c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:45:45 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-744f11f9-eba0-4f01-9a70-44576c26efe1 req-be00c86d-a63c-46f7-905a-458cea3bc62c service nova] Lock "881351d7-31f9-44f4-8571-8f540bbec29c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:45:45 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-744f11f9-eba0-4f01-9a70-44576c26efe1 req-be00c86d-a63c-46f7-905a-458cea3bc62c service nova] Lock "881351d7-31f9-44f4-8571-8f540bbec29c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:45:45 user nova-compute[75341]: DEBUG nova.compute.manager [req-744f11f9-eba0-4f01-9a70-44576c26efe1 req-be00c86d-a63c-46f7-905a-458cea3bc62c service nova] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] No waiting events found dispatching network-vif-plugged-dcc0edd5-582a-499a-beaf-6de23ff1537c {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:45:45 user nova-compute[75341]: WARNING nova.compute.manager [req-744f11f9-eba0-4f01-9a70-44576c26efe1 req-be00c86d-a63c-46f7-905a-458cea3bc62c service nova] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Received unexpected event network-vif-plugged-dcc0edd5-582a-499a-beaf-6de23ff1537c for instance with vm_state resized and task_state resize_reverting.
Nov 14 23:45:45 user nova-compute[75341]: INFO nova.compute.manager [None req-08aa5653-40ef-49f9-ac25-895a3a052b99 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Updating instance to original state: 'active'
Nov 14 23:45:45 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:45:45 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '23231666362613864', 'path': '/dev/sdi'} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:45:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231666362613864', 'path': '/dev/sdi'} {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 23:45:45 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:45:45 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Starting heal instance info cache {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 23:45:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:45:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-466449092',display_name='tempest-TestVolumeBootPattern-server-466449092',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-466449092',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96674073965642f1af11221b4add8a6d',ramdisk_id='',reservation_id='r-6uxj85qf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-320933673',owner_user_name='tempest-TestVolumeBootPattern-320933673-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:45:33Z,user_data=None,user_id='b08f7ddf6c2f4fd596e214d6ca56c234',uuid=896ee337-80bf-47c3-9530-861c941a2fc6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88af4d1e-2d6c-4e86-906e-159a733ab307", "address": "fa:16:3e:ce:0b:42", "network": {"id": "227eb779-a064-477d-8447-45862017ae7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-3827253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96674073965642f1af11221b4add8a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88af4d1e-2d", "ovs_interfaceid": "88af4d1e-2d6c-4e86-906e-159a733ab307", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:45:45 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Converting VIF {"id": "88af4d1e-2d6c-4e86-906e-159a733ab307", "address": "fa:16:3e:ce:0b:42", "network": {"id": "227eb779-a064-477d-8447-45862017ae7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-3827253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96674073965642f1af11221b4add8a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88af4d1e-2d", "ovs_interfaceid": "88af4d1e-2d6c-4e86-906e-159a733ab307", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:45:45 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:0b:42,bridge_name='br-int',has_traffic_filtering=True,id=88af4d1e-2d6c-4e86-906e-159a733ab307,network=Network(227eb779-a064-477d-8447-45862017ae7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88af4d1e-2d') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:45:45 user nova-compute[75341]: DEBUG nova.objects.instance [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lazy-loading 'pci_devices' on Instance uuid 896ee337-80bf-47c3-9530-861c941a2fc6 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:45:46 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] End _get_guest_xml xml=<domain type="kvm">
Nov 14 23:45:46 user nova-compute[75341]:   <uuid>896ee337-80bf-47c3-9530-861c941a2fc6</uuid>
Nov 14 23:45:46 user nova-compute[75341]:   <name>instance-00000015</name>
Nov 14 23:45:46 user nova-compute[75341]:   <memory>524288</memory>
Nov 14 23:45:46 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 14 23:45:46 user nova-compute[75341]:   <metadata>
Nov 14 23:45:46 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 23:45:46 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 14 23:45:46 user nova-compute[75341]:       <nova:name>tempest-TestVolumeBootPattern-server-466449092</nova:name>
Nov 14 23:45:46 user nova-compute[75341]:       <nova:creationTime>2023-11-14 23:45:44</nova:creationTime>
Nov 14 23:45:46 user nova-compute[75341]:       <nova:flavor name="m1.tiny">
Nov 14 23:45:46 user nova-compute[75341]:         <nova:memory>512</nova:memory>
Nov 14 23:45:46 user nova-compute[75341]:         <nova:disk>1</nova:disk>
Nov 14 23:45:46 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 14 23:45:46 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 23:45:46 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 14 23:45:46 user nova-compute[75341]:       </nova:flavor>
Nov 14 23:45:46 user nova-compute[75341]:       <nova:owner>
Nov 14 23:45:46 user nova-compute[75341]:         <nova:user uuid="b08f7ddf6c2f4fd596e214d6ca56c234">tempest-TestVolumeBootPattern-320933673-project-member</nova:user>
Nov 14 23:45:46 user nova-compute[75341]:         <nova:project uuid="96674073965642f1af11221b4add8a6d">tempest-TestVolumeBootPattern-320933673</nova:project>
Nov 14 23:45:46 user nova-compute[75341]:       </nova:owner>
Nov 14 23:45:46 user nova-compute[75341]:       <nova:ports>
Nov 14 23:45:46 user nova-compute[75341]:         <nova:port uuid="88af4d1e-2d6c-4e86-906e-159a733ab307">
Nov 14 23:45:46 user nova-compute[75341]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 23:45:46 user nova-compute[75341]:         </nova:port>
Nov 14 23:45:46 user nova-compute[75341]:       </nova:ports>
Nov 14 23:45:46 user nova-compute[75341]:     </nova:instance>
Nov 14 23:45:46 user nova-compute[75341]:   </metadata>
Nov 14 23:45:46 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 14 23:45:46 user nova-compute[75341]:     <system>
Nov 14 23:45:46 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 23:45:46 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 14 23:45:46 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 14 23:45:46 user nova-compute[75341]:       <entry name="serial">896ee337-80bf-47c3-9530-861c941a2fc6</entry>
Nov 14 23:45:46 user nova-compute[75341]:       <entry name="uuid">896ee337-80bf-47c3-9530-861c941a2fc6</entry>
Nov 14 23:45:46 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 14 23:45:46 user nova-compute[75341]:     </system>
Nov 14 23:45:46 user nova-compute[75341]:   </sysinfo>
Nov 14 23:45:46 user nova-compute[75341]:   <os>
Nov 14 23:45:46 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 23:45:46 user nova-compute[75341]:     <boot dev="hd"/>
Nov 14 23:45:46 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 14 23:45:46 user nova-compute[75341]:   </os>
Nov 14 23:45:46 user nova-compute[75341]:   <features>
Nov 14 23:45:46 user nova-compute[75341]:     <acpi/>
Nov 14 23:45:46 user nova-compute[75341]:     <apic/>
Nov 14 23:45:46 user nova-compute[75341]:     <vmcoreinfo/>
Nov 14 23:45:46 user nova-compute[75341]:   </features>
Nov 14 23:45:46 user nova-compute[75341]:   <clock offset="utc">
Nov 14 23:45:46 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 23:45:46 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 23:45:46 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 14 23:45:46 user nova-compute[75341]:   </clock>
Nov 14 23:45:46 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 14 23:45:46 user nova-compute[75341]:     <model>Nehalem</model>
Nov 14 23:45:46 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 23:45:46 user nova-compute[75341]:   </cpu>
Nov 14 23:45:46 user nova-compute[75341]:   <devices>
Nov 14 23:45:46 user nova-compute[75341]:     <disk type="block" device="disk">
Nov 14 23:45:46 user nova-compute[75341]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:45:46 user nova-compute[75341]:       <source dev="/dev/sdi"/>
Nov 14 23:45:46 user nova-compute[75341]:       <target dev="vda" bus="virtio"/>
Nov 14 23:45:46 user nova-compute[75341]:       <serial>0223eb95-57f1-4e16-b903-bdd690fba90d</serial>
Nov 14 23:45:46 user nova-compute[75341]:     </disk>
Nov 14 23:45:46 user nova-compute[75341]:     <interface type="ethernet">
Nov 14 23:45:46 user nova-compute[75341]:       <mac address="fa:16:3e:ce:0b:42"/>
Nov 14 23:45:46 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:45:46 user nova-compute[75341]:       <mtu size="1442"/>
Nov 14 23:45:46 user nova-compute[75341]:       <target dev="tap88af4d1e-2d"/>
Nov 14 23:45:46 user nova-compute[75341]:     </interface>
Nov 14 23:45:46 user nova-compute[75341]:     <serial type="pty">
Nov 14 23:45:46 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/896ee337-80bf-47c3-9530-861c941a2fc6/console.log" append="off"/>
Nov 14 23:45:46 user nova-compute[75341]:     </serial>
Nov 14 23:45:46 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 23:45:46 user nova-compute[75341]:     <video>
Nov 14 23:45:46 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:45:46 user nova-compute[75341]:     </video>
Nov 14 23:45:46 user nova-compute[75341]:     <rng model="virtio">
Nov 14 23:45:46 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 14 23:45:46 user nova-compute[75341]:     </rng>
Nov 14 23:45:46 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 14 23:45:46 user nova-compute[75341]:     <memballoon model="virtio">
Nov 14 23:45:46 user nova-compute[75341]:       <stats period="10"/>
Nov 14 23:45:46 user nova-compute[75341]:     </memballoon>
Nov 14 23:45:46 user nova-compute[75341]:   </devices>
Nov 14 23:45:46 user nova-compute[75341]: </domain>
Nov 14 23:45:46 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 23:45:46 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:45:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-466449092',display_name='tempest-TestVolumeBootPattern-server-466449092',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-466449092',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96674073965642f1af11221b4add8a6d',ramdisk_id='',reservation_id='r-6uxj85qf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-320933673',owner_user_name='tempest-TestVolumeBootPattern-320933673-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:45:33Z,user_data=None,user_id='b08f7ddf6c2f4fd596e214d6ca56c234',uuid=896ee337-80bf-47c3-9530-861c941a2fc6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88af4d1e-2d6c-4e86-906e-159a733ab307", "address": "fa:16:3e:ce:0b:42", "network": {"id": "227eb779-a064-477d-8447-45862017ae7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-3827253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96674073965642f1af11221b4add8a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88af4d1e-2d", "ovs_interfaceid": "88af4d1e-2d6c-4e86-906e-159a733ab307", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 23:45:46 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Converting VIF {"id": "88af4d1e-2d6c-4e86-906e-159a733ab307", "address": "fa:16:3e:ce:0b:42", "network": {"id": "227eb779-a064-477d-8447-45862017ae7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-3827253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96674073965642f1af11221b4add8a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88af4d1e-2d", "ovs_interfaceid": "88af4d1e-2d6c-4e86-906e-159a733ab307", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:45:46 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:0b:42,bridge_name='br-int',has_traffic_filtering=True,id=88af4d1e-2d6c-4e86-906e-159a733ab307,network=Network(227eb779-a064-477d-8447-45862017ae7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88af4d1e-2d') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:45:46 user nova-compute[75341]: DEBUG os_vif [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:0b:42,bridge_name='br-int',has_traffic_filtering=True,id=88af4d1e-2d6c-4e86-906e-159a733ab307,network=Network(227eb779-a064-477d-8447-45862017ae7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88af4d1e-2d') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 23:45:46 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:46 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:45:46 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 23:45:46 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:46 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '79ed6e5d-acd6-5a49-9756-427054f76365', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:45:46 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:46 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:46 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:46 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap88af4d1e-2d, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:45:46 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap88af4d1e-2d, col_values=(('qos', UUID('5371a54d-78f2-4123-86dd-ce1b40ca3f66')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:45:46 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap88af4d1e-2d, col_values=(('external_ids', {'iface-id': '88af4d1e-2d6c-4e86-906e-159a733ab307', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:0b:42', 'vm-uuid': '896ee337-80bf-47c3-9530-861c941a2fc6'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:45:46 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:46 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:45:46 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:46 user nova-compute[75341]: INFO os_vif [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:0b:42,bridge_name='br-int',has_traffic_filtering=True,id=88af4d1e-2d6c-4e86-906e-159a733ab307,network=Network(227eb779-a064-477d-8447-45862017ae7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88af4d1e-2d')
Nov 14 23:45:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "refresh_cache-a0cffbac-f552-47bf-bd6c-dabb70e7c867" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:45:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquired lock "refresh_cache-a0cffbac-f552-47bf-bd6c-dabb70e7c867" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:45:46 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Forcefully refreshing network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 23:45:46 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:45:46 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] No VIF found with MAC fa:16:3e:ce:0b:42, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:45:46 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:46 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Updating instance_info_cache with network_info: [{"id": "8a863ecb-919e-42ac-8507-1c9af9135895", "address": "fa:16:3e:0c:75:47", "network": {"id": "a59b651e-81c5-4a68-b694-1e84de25e915", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1023462603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8a897400c74100ad6c115397bc84ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a863ecb-91", "ovs_interfaceid": "8a863ecb-919e-42ac-8507-1c9af9135895", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:45:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Releasing lock "refresh_cache-a0cffbac-f552-47bf-bd6c-dabb70e7c867" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:45:46 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Updated the network info_cache for instance {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 23:45:46 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:45:46 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Cleaning up deleted instances {{(pid=75341) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 23:45:46 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] There are 0 instances to clean {{(pid=75341) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 23:45:46 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:45:46 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:45:47 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:47 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:47 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:47 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:47 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:45:48 user nova-compute[75341]: DEBUG nova.compute.manager [req-da31fbd2-14f0-4a0c-a2ed-10d46e852e86 req-997d5158-dcff-4e30-bdee-a9969947f2c3 service nova] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] Received event network-vif-plugged-88af4d1e-2d6c-4e86-906e-159a733ab307 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:45:48 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-da31fbd2-14f0-4a0c-a2ed-10d46e852e86 req-997d5158-dcff-4e30-bdee-a9969947f2c3 service nova] Acquiring lock "896ee337-80bf-47c3-9530-861c941a2fc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:45:48 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-da31fbd2-14f0-4a0c-a2ed-10d46e852e86 req-997d5158-dcff-4e30-bdee-a9969947f2c3 service nova] Lock "896ee337-80bf-47c3-9530-861c941a2fc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:45:48 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-da31fbd2-14f0-4a0c-a2ed-10d46e852e86 req-997d5158-dcff-4e30-bdee-a9969947f2c3 service nova] Lock "896ee337-80bf-47c3-9530-861c941a2fc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:45:48 user nova-compute[75341]: DEBUG nova.compute.manager [req-da31fbd2-14f0-4a0c-a2ed-10d46e852e86 req-997d5158-dcff-4e30-bdee-a9969947f2c3 service nova] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] No waiting events found dispatching network-vif-plugged-88af4d1e-2d6c-4e86-906e-159a733ab307 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:45:48 user nova-compute[75341]: WARNING nova.compute.manager [req-da31fbd2-14f0-4a0c-a2ed-10d46e852e86 req-997d5158-dcff-4e30-bdee-a9969947f2c3 service nova] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] Received unexpected event network-vif-plugged-88af4d1e-2d6c-4e86-906e-159a733ab307 for instance with vm_state building and task_state spawning.
Nov 14 23:45:48 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:48 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:48 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:48 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:48 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:45:48 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75341) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 23:45:49 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-64d5ba3a-df97-4909-8679-c6494afe3952 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance a308a35f-c8d7-482c-a93d-5d9eb473d4e1 is timed out.
Nov 14 23:45:49 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-64d5ba3a-df97-4909-8679-c6494afe3952 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Successfully detached device vdc from instance a308a35f-c8d7-482c-a93d-5d9eb473d4e1 from the live domain config.
Nov 14 23:45:49 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64d5ba3a-df97-4909-8679-c6494afe3952 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] calling os-brick to detach iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 23:45:49 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d5ba3a-df97-4909-8679-c6494afe3952 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, {'target_iqn': 'iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tHcxlgio', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:45:49 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-64d5ba3a-df97-4909-8679-c6494afe3952 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:45:49 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-64d5ba3a-df97-4909-8679-c6494afe3952 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:45:49 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-64d5ba3a-df97-4909-8679-c6494afe3952 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:45:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:49 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a0e1e7-a871-4748-b1aa-85154d681952]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:49 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d5ba3a-df97-4909-8679-c6494afe3952 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 23:45:49 user nova-compute[75341]: No targets found.
Nov 14 23:45:49 user nova-compute[75341]: iSNS:
Nov 14 23:45:49 user nova-compute[75341]: No targets found.
Nov 14 23:45:49 user nova-compute[75341]: STATIC:
Nov 14 23:45:49 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265
Nov 14 23:45:49 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:45:49 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:45:49 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7
Nov 14 23:45:49 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:45:49 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:45:49 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3
Nov 14 23:45:49 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:45:49 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:45:49 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a
Nov 14 23:45:49 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:45:49 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:45:49 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7
Nov 14 23:45:49 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:45:49 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:45:49 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c
Nov 14 23:45:49 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:45:49 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:45:49 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912
Nov 14 23:45:49 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:45:49 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:45:49 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d
Nov 14 23:45:49 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:45:49 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:45:49 user nova-compute[75341]: FIRMWARE:
Nov 14 23:45:49 user nova-compute[75341]: No targets found.
Nov 14 23:45:49 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:45:49 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d5ba3a-df97-4909-8679-c6494afe3952 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 23:45:49 user nova-compute[75341]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 23:45:49 user nova-compute[75341]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75341) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 23:45:49 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d5ba3a-df97-4909-8679-c6494afe3952 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265', 0)] {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 23:45:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:49 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b0585a-a5ba-493a-a41c-4cf6eb9fe3a2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:49 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[db644c2e-ec82-4fa5-9bf4-b98505705957]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:49 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d5ba3a-df97-4909-8679-c6494afe3952 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 (non-flash)
Nov 14 23:45:49 user nova-compute[75341]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 (non-flash)
Nov 14 23:45:49 user nova-compute[75341]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a (non-flash)
Nov 14 23:45:49 user nova-compute[75341]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 (non-flash)
Nov 14 23:45:49 user nova-compute[75341]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:45:49 user nova-compute[75341]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)
Nov 14 23:45:49 user nova-compute[75341]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)
Nov 14 23:45:49 user nova-compute[75341]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d (non-flash)
Nov 14 23:45:49 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:45:49 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d5ba3a-df97-4909-8679-c6494afe3952 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 (non-flash)
Nov 14 23:45:49 user nova-compute[75341]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 (non-flash)
Nov 14 23:45:49 user nova-compute[75341]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a (non-flash)
Nov 14 23:45:49 user nova-compute[75341]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 (non-flash)
Nov 14 23:45:49 user nova-compute[75341]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:45:49 user nova-compute[75341]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)
Nov 14 23:45:49 user nova-compute[75341]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)
Nov 14 23:45:49 user nova-compute[75341]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d (non-flash)
Nov 14 23:45:49 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:45:49 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d5ba3a-df97-4909-8679-c6494afe3952 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18507f75b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265'): ({'sdd'}, set())}) {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 23:45:49 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-64d5ba3a-df97-4909-8679-c6494afe3952 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Removing single pathed devices sdd {{(pid=75341) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 23:45:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:49 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9b0e59-a35f-4806-b6c8-85a40e7bdee7]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:49 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[4332da1c-d3d9-4144-8661-5584a620634c]: (4, ('ok\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:49 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-64d5ba3a-df97-4909-8679-c6494afe3952 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Flushing IO for device /dev/sdd {{(pid=75341) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 23:45:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:49 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:45:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:49 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[0975c9fd-599c-48b0-93ba-8b3b7270ab9c]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:49 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-64d5ba3a-df97-4909-8679-c6494afe3952 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75341) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 23:45:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:45:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:45:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:45:49 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75341) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 23:45:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:49 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[54215b0a-de83-4b06-849e-a454bbc57a8e]: (4, ('1', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:49 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-64d5ba3a-df97-4909-8679-c6494afe3952 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 23:45:49 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-64d5ba3a-df97-4909-8679-c6494afe3952 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] SCSI volumes sdd have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 23:45:50 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d5ba3a-df97-4909-8679-c6494afe3952 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265')] {{(pid=75341) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 23:45:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:50 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[4015d3a1-61f9-4a46-b983-e61819d57b0b]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:50 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d5ba3a-df97-4909-8679-c6494afe3952 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:45:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 -p 172.16.0.220:3260 --logout {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:50 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb89e62-b17e-43b4-9d66-f7a4040851f0]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:50 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d5ba3a-df97-4909-8679-c6494afe3952 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265, portal: 172.16.0.220,3260]
Nov 14 23:45:50 user nova-compute[75341]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265, portal: 172.16.0.220,3260] successful.
Nov 14 23:45:50 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:45:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 -p 172.16.0.220:3260 --op delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3d90713-27fa-493f-978a-af46e9730265 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:50 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[5821eb4c-9aac-4c20-bf8f-bbe766a1743f]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:45:50 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d5ba3a-df97-4909-8679-c6494afe3952 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:45:50 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-64d5ba3a-df97-4909-8679-c6494afe3952 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.410s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:45:50 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d5ba3a-df97-4909-8679-c6494afe3952 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] <== disconnect_volume: return (411ms) None {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:45:50 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64d5ba3a-df97-4909-8679-c6494afe3952 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Disconnected iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 23:45:50 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 23:45:50 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 23:45:50 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 23:45:50 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 23:45:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a141d7ee-3f77-4fdc-85ec-2cbd5af17646/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:50 user nova-compute[75341]: DEBUG nova.compute.manager [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] Instance event wait completed in 0 seconds for  {{(pid=75341) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 23:45:50 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] Guest created on hypervisor {{(pid=75341) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 23:45:50 user nova-compute[75341]: DEBUG nova.compute.manager [req-58cbd17f-9ddb-4d35-a972-63c7b51f46a3 req-0ceba5eb-6205-4cec-8def-24e29b999642 service nova] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] Received event network-vif-plugged-88af4d1e-2d6c-4e86-906e-159a733ab307 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:45:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-58cbd17f-9ddb-4d35-a972-63c7b51f46a3 req-0ceba5eb-6205-4cec-8def-24e29b999642 service nova] Acquiring lock "896ee337-80bf-47c3-9530-861c941a2fc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:45:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-58cbd17f-9ddb-4d35-a972-63c7b51f46a3 req-0ceba5eb-6205-4cec-8def-24e29b999642 service nova] Lock "896ee337-80bf-47c3-9530-861c941a2fc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:45:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-58cbd17f-9ddb-4d35-a972-63c7b51f46a3 req-0ceba5eb-6205-4cec-8def-24e29b999642 service nova] Lock "896ee337-80bf-47c3-9530-861c941a2fc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:45:50 user nova-compute[75341]: DEBUG nova.compute.manager [req-58cbd17f-9ddb-4d35-a972-63c7b51f46a3 req-0ceba5eb-6205-4cec-8def-24e29b999642 service nova] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] No waiting events found dispatching network-vif-plugged-88af4d1e-2d6c-4e86-906e-159a733ab307 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:45:50 user nova-compute[75341]: WARNING nova.compute.manager [req-58cbd17f-9ddb-4d35-a972-63c7b51f46a3 req-0ceba5eb-6205-4cec-8def-24e29b999642 service nova] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] Received unexpected event network-vif-plugged-88af4d1e-2d6c-4e86-906e-159a733ab307 for instance with vm_state building and task_state spawning.
Nov 14 23:45:50 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] Instance spawned successfully.
Nov 14 23:45:50 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 23:45:50 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] Found default for hw_cdrom_bus of ide {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:45:50 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] Found default for hw_disk_bus of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:45:50 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] Found default for hw_input_bus of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:45:50 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] Found default for hw_pointer_model of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:45:50 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] Found default for hw_video_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:45:50 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] Found default for hw_vif_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:45:50 user nova-compute[75341]: INFO nova.compute.manager [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] Took 5.96 seconds to spawn the instance on the hypervisor.
Nov 14 23:45:50 user nova-compute[75341]: DEBUG nova.compute.manager [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 23:45:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a141d7ee-3f77-4fdc-85ec-2cbd5af17646/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a141d7ee-3f77-4fdc-85ec-2cbd5af17646/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:50 user nova-compute[75341]: INFO nova.compute.manager [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] Took 18.03 seconds to build instance.
Nov 14 23:45:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c42e2c4b-2b7d-49b6-b425-0ee40bb795ad tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "896ee337-80bf-47c3-9530-861c941a2fc6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.157s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:45:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a141d7ee-3f77-4fdc-85ec-2cbd5af17646/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d92ba9df-c739-414d-a701-ddba04563427/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d92ba9df-c739-414d-a701-ddba04563427/disk --force-share --output=json" returned: 0 in 0.289s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d92ba9df-c739-414d-a701-ddba04563427/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d92ba9df-c739-414d-a701-ddba04563427/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:51 user nova-compute[75341]: DEBUG nova.objects.instance [None req-64d5ba3a-df97-4909-8679-c6494afe3952 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lazy-loading 'flavor' on Instance uuid a308a35f-c8d7-482c-a93d-5d9eb473d4e1 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:45:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-64d5ba3a-df97-4909-8679-c6494afe3952 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "a308a35f-c8d7-482c-a93d-5d9eb473d4e1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.701s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:45:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-7ceac858-dbc9-4ab7-b46f-19b8f8786a4b tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Acquiring lock "a0cffbac-f552-47bf-bd6c-dabb70e7c867" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:45:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-7ceac858-dbc9-4ab7-b46f-19b8f8786a4b tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Lock "a0cffbac-f552-47bf-bd6c-dabb70e7c867" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:45:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-7ceac858-dbc9-4ab7-b46f-19b8f8786a4b tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Acquiring lock "a0cffbac-f552-47bf-bd6c-dabb70e7c867-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:45:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-7ceac858-dbc9-4ab7-b46f-19b8f8786a4b tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Lock "a0cffbac-f552-47bf-bd6c-dabb70e7c867-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:45:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-7ceac858-dbc9-4ab7-b46f-19b8f8786a4b tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Lock "a0cffbac-f552-47bf-bd6c-dabb70e7c867-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:45:51 user nova-compute[75341]: INFO nova.compute.manager [None req-7ceac858-dbc9-4ab7-b46f-19b8f8786a4b tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Terminating instance
Nov 14 23:45:51 user nova-compute[75341]: DEBUG nova.compute.manager [None req-7ceac858-dbc9-4ab7-b46f-19b8f8786a4b tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Start destroying the instance on the hypervisor. {{(pid=75341) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 23:45:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:52 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:52 user nova-compute[75341]: DEBUG nova.compute.manager [req-d77751f6-f29a-4e67-be53-dfc4068be3b2 req-344a8c36-eaa5-4bfe-a316-841dc7c714d1 service nova] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Received event network-vif-unplugged-8a863ecb-919e-42ac-8507-1c9af9135895 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:45:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-d77751f6-f29a-4e67-be53-dfc4068be3b2 req-344a8c36-eaa5-4bfe-a316-841dc7c714d1 service nova] Acquiring lock "a0cffbac-f552-47bf-bd6c-dabb70e7c867-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:45:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-d77751f6-f29a-4e67-be53-dfc4068be3b2 req-344a8c36-eaa5-4bfe-a316-841dc7c714d1 service nova] Lock "a0cffbac-f552-47bf-bd6c-dabb70e7c867-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:45:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-d77751f6-f29a-4e67-be53-dfc4068be3b2 req-344a8c36-eaa5-4bfe-a316-841dc7c714d1 service nova] Lock "a0cffbac-f552-47bf-bd6c-dabb70e7c867-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:45:52 user nova-compute[75341]: DEBUG nova.compute.manager [req-d77751f6-f29a-4e67-be53-dfc4068be3b2 req-344a8c36-eaa5-4bfe-a316-841dc7c714d1 service nova] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] No waiting events found dispatching network-vif-unplugged-8a863ecb-919e-42ac-8507-1c9af9135895 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:45:52 user nova-compute[75341]: DEBUG nova.compute.manager [req-d77751f6-f29a-4e67-be53-dfc4068be3b2 req-344a8c36-eaa5-4bfe-a316-841dc7c714d1 service nova] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Received event network-vif-unplugged-8a863ecb-919e-42ac-8507-1c9af9135895 for instance with task_state deleting. {{(pid=75341) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 23:45:52 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0cffbac-f552-47bf-bd6c-dabb70e7c867/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:52 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0cffbac-f552-47bf-bd6c-dabb70e7c867/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:52 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0cffbac-f552-47bf-bd6c-dabb70e7c867/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:52 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Instance destroyed successfully.
Nov 14 23:45:52 user nova-compute[75341]: DEBUG nova.objects.instance [None req-7ceac858-dbc9-4ab7-b46f-19b8f8786a4b tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Lazy-loading 'resources' on Instance uuid a0cffbac-f552-47bf-bd6c-dabb70e7c867 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:45:52 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-7ceac858-dbc9-4ab7-b46f-19b8f8786a4b tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:40:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-807909284',display_name='tempest-VolumesAdminNegativeTest-server-807909284',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-807909284',id=4,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN++rg/5aiXfrPnlzHCWuLQ3r8o7hy8ulHI0qfthn9zAC77asJ8kE9stlg/Vfy7c8tKUC0aAMrWh7glflCSCZBtNolNf3iMY91+pkGd7YugPHHZNXQezIDh4x8HvnEFMkA==',key_name='tempest-keypair-185827126',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:40:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7c8a897400c74100ad6c115397bc84ff',ramdisk_id='',reservation_id='r-lw53hsch',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-2087255478',owner_user_name='tempest-VolumesAdminNegativeTest-2087255478-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:40:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cc85fb2b1a141578ba9558bc79ccc02',uuid=a0cffbac-f552-47bf-bd6c-dabb70e7c867,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a863ecb-919e-42ac-8507-1c9af9135895", "address": "fa:16:3e:0c:75:47", "network": {"id": "a59b651e-81c5-4a68-b694-1e84de25e915", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1023462603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8a897400c74100ad6c115397bc84ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a863ecb-91", "ovs_interfaceid": "8a863ecb-919e-42ac-8507-1c9af9135895", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 23:45:52 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-7ceac858-dbc9-4ab7-b46f-19b8f8786a4b tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Converting VIF {"id": "8a863ecb-919e-42ac-8507-1c9af9135895", "address": "fa:16:3e:0c:75:47", "network": {"id": "a59b651e-81c5-4a68-b694-1e84de25e915", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1023462603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c8a897400c74100ad6c115397bc84ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a863ecb-91", "ovs_interfaceid": "8a863ecb-919e-42ac-8507-1c9af9135895", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:45:52 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-7ceac858-dbc9-4ab7-b46f-19b8f8786a4b tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:75:47,bridge_name='br-int',has_traffic_filtering=True,id=8a863ecb-919e-42ac-8507-1c9af9135895,network=Network(a59b651e-81c5-4a68-b694-1e84de25e915),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a863ecb-91') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:45:52 user nova-compute[75341]: DEBUG os_vif [None req-7ceac858-dbc9-4ab7-b46f-19b8f8786a4b tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:75:47,bridge_name='br-int',has_traffic_filtering=True,id=8a863ecb-919e-42ac-8507-1c9af9135895,network=Network(a59b651e-81c5-4a68-b694-1e84de25e915),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a863ecb-91') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 23:45:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a863ecb-91, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:45:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:45:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c6e11717-17b2-4d05-94af-9e1672303f00) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:45:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:45:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:52 user nova-compute[75341]: INFO os_vif [None req-7ceac858-dbc9-4ab7-b46f-19b8f8786a4b tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:75:47,bridge_name='br-int',has_traffic_filtering=True,id=8a863ecb-919e-42ac-8507-1c9af9135895,network=Network(a59b651e-81c5-4a68-b694-1e84de25e915),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a863ecb-91')
Nov 14 23:45:52 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-7ceac858-dbc9-4ab7-b46f-19b8f8786a4b tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Deleting instance files /opt/stack/data/nova/instances/a0cffbac-f552-47bf-bd6c-dabb70e7c867_del
Nov 14 23:45:52 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-7ceac858-dbc9-4ab7-b46f-19b8f8786a4b tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Deletion of /opt/stack/data/nova/instances/a0cffbac-f552-47bf-bd6c-dabb70e7c867_del complete
Nov 14 23:45:52 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0cffbac-f552-47bf-bd6c-dabb70e7c867/disk --force-share --output=json" returned: 1 in 0.279s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:52 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0cffbac-f552-47bf-bd6c-dabb70e7c867/disk --force-share --output=json' failed. Not Retrying. {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:45:53 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000004, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/a0cffbac-f552-47bf-bd6c-dabb70e7c867/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/a0cffbac-f552-47bf-bd6c-dabb70e7c867/disk
Nov 14 23:45:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a0e67fc-942b-4f05-a6ee-0987944f17da/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:53 user nova-compute[75341]: INFO nova.compute.manager [None req-7ceac858-dbc9-4ab7-b46f-19b8f8786a4b tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 14 23:45:53 user nova-compute[75341]: DEBUG oslo.service.loopingcall [None req-7ceac858-dbc9-4ab7-b46f-19b8f8786a4b tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75341) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 23:45:53 user nova-compute[75341]: DEBUG nova.compute.manager [-] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Deallocating network for instance {{(pid=75341) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 23:45:53 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] deallocate_for_instance() {{(pid=75341) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 23:45:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a0e67fc-942b-4f05-a6ee-0987944f17da/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a0e67fc-942b-4f05-a6ee-0987944f17da/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a0e67fc-942b-4f05-a6ee-0987944f17da/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:53 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 23:45:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8aa0b26-4099-4a8d-afce-a1e990e5b1f7/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:53 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:53 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:53 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8aa0b26-4099-4a8d-afce-a1e990e5b1f7/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8aa0b26-4099-4a8d-afce-a1e990e5b1f7/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:53 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8aa0b26-4099-4a8d-afce-a1e990e5b1f7/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:53 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 23:45:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a308a35f-c8d7-482c-a93d-5d9eb473d4e1/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a308a35f-c8d7-482c-a93d-5d9eb473d4e1/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a308a35f-c8d7-482c-a93d-5d9eb473d4e1/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a308a35f-c8d7-482c-a93d-5d9eb473d4e1/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:54 user nova-compute[75341]: DEBUG nova.compute.manager [req-4fc22268-93e7-422a-bf67-1b6ed1beef49 req-c6d4e1d3-d4ff-4515-b64f-7eb08c46a2ad service nova] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Received event network-vif-plugged-8a863ecb-919e-42ac-8507-1c9af9135895 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:45:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4fc22268-93e7-422a-bf67-1b6ed1beef49 req-c6d4e1d3-d4ff-4515-b64f-7eb08c46a2ad service nova] Acquiring lock "a0cffbac-f552-47bf-bd6c-dabb70e7c867-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:45:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4fc22268-93e7-422a-bf67-1b6ed1beef49 req-c6d4e1d3-d4ff-4515-b64f-7eb08c46a2ad service nova] Lock "a0cffbac-f552-47bf-bd6c-dabb70e7c867-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:45:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4fc22268-93e7-422a-bf67-1b6ed1beef49 req-c6d4e1d3-d4ff-4515-b64f-7eb08c46a2ad service nova] Lock "a0cffbac-f552-47bf-bd6c-dabb70e7c867-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:45:54 user nova-compute[75341]: DEBUG nova.compute.manager [req-4fc22268-93e7-422a-bf67-1b6ed1beef49 req-c6d4e1d3-d4ff-4515-b64f-7eb08c46a2ad service nova] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] No waiting events found dispatching network-vif-plugged-8a863ecb-919e-42ac-8507-1c9af9135895 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:45:54 user nova-compute[75341]: WARNING nova.compute.manager [req-4fc22268-93e7-422a-bf67-1b6ed1beef49 req-c6d4e1d3-d4ff-4515-b64f-7eb08c46a2ad service nova] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Received unexpected event network-vif-plugged-8a863ecb-919e-42ac-8507-1c9af9135895 for instance with vm_state active and task_state deleting.
Nov 14 23:45:54 user nova-compute[75341]: DEBUG nova.compute.manager [req-4fc22268-93e7-422a-bf67-1b6ed1beef49 req-c6d4e1d3-d4ff-4515-b64f-7eb08c46a2ad service nova] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Received event network-vif-plugged-8a863ecb-919e-42ac-8507-1c9af9135895 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:45:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4fc22268-93e7-422a-bf67-1b6ed1beef49 req-c6d4e1d3-d4ff-4515-b64f-7eb08c46a2ad service nova] Acquiring lock "a0cffbac-f552-47bf-bd6c-dabb70e7c867-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:45:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4fc22268-93e7-422a-bf67-1b6ed1beef49 req-c6d4e1d3-d4ff-4515-b64f-7eb08c46a2ad service nova] Lock "a0cffbac-f552-47bf-bd6c-dabb70e7c867-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:45:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4fc22268-93e7-422a-bf67-1b6ed1beef49 req-c6d4e1d3-d4ff-4515-b64f-7eb08c46a2ad service nova] Lock "a0cffbac-f552-47bf-bd6c-dabb70e7c867-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:45:54 user nova-compute[75341]: DEBUG nova.compute.manager [req-4fc22268-93e7-422a-bf67-1b6ed1beef49 req-c6d4e1d3-d4ff-4515-b64f-7eb08c46a2ad service nova] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] No waiting events found dispatching network-vif-plugged-8a863ecb-919e-42ac-8507-1c9af9135895 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:45:54 user nova-compute[75341]: WARNING nova.compute.manager [req-4fc22268-93e7-422a-bf67-1b6ed1beef49 req-c6d4e1d3-d4ff-4515-b64f-7eb08c46a2ad service nova] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Received unexpected event network-vif-plugged-8a863ecb-919e-42ac-8507-1c9af9135895 for instance with vm_state active and task_state deleting.
Nov 14 23:45:54 user nova-compute[75341]: DEBUG nova.compute.manager [req-4fc22268-93e7-422a-bf67-1b6ed1beef49 req-c6d4e1d3-d4ff-4515-b64f-7eb08c46a2ad service nova] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Received event network-vif-plugged-8a863ecb-919e-42ac-8507-1c9af9135895 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:45:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4fc22268-93e7-422a-bf67-1b6ed1beef49 req-c6d4e1d3-d4ff-4515-b64f-7eb08c46a2ad service nova] Acquiring lock "a0cffbac-f552-47bf-bd6c-dabb70e7c867-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:45:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4fc22268-93e7-422a-bf67-1b6ed1beef49 req-c6d4e1d3-d4ff-4515-b64f-7eb08c46a2ad service nova] Lock "a0cffbac-f552-47bf-bd6c-dabb70e7c867-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:45:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4fc22268-93e7-422a-bf67-1b6ed1beef49 req-c6d4e1d3-d4ff-4515-b64f-7eb08c46a2ad service nova] Lock "a0cffbac-f552-47bf-bd6c-dabb70e7c867-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:45:54 user nova-compute[75341]: DEBUG nova.compute.manager [req-4fc22268-93e7-422a-bf67-1b6ed1beef49 req-c6d4e1d3-d4ff-4515-b64f-7eb08c46a2ad service nova] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] No waiting events found dispatching network-vif-plugged-8a863ecb-919e-42ac-8507-1c9af9135895 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:45:54 user nova-compute[75341]: WARNING nova.compute.manager [req-4fc22268-93e7-422a-bf67-1b6ed1beef49 req-c6d4e1d3-d4ff-4515-b64f-7eb08c46a2ad service nova] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Received unexpected event network-vif-plugged-8a863ecb-919e-42ac-8507-1c9af9135895 for instance with vm_state active and task_state deleting.
Nov 14 23:45:54 user nova-compute[75341]: DEBUG nova.compute.manager [req-4fc22268-93e7-422a-bf67-1b6ed1beef49 req-c6d4e1d3-d4ff-4515-b64f-7eb08c46a2ad service nova] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Received event network-vif-unplugged-8a863ecb-919e-42ac-8507-1c9af9135895 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:45:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4fc22268-93e7-422a-bf67-1b6ed1beef49 req-c6d4e1d3-d4ff-4515-b64f-7eb08c46a2ad service nova] Acquiring lock "a0cffbac-f552-47bf-bd6c-dabb70e7c867-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:45:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4fc22268-93e7-422a-bf67-1b6ed1beef49 req-c6d4e1d3-d4ff-4515-b64f-7eb08c46a2ad service nova] Lock "a0cffbac-f552-47bf-bd6c-dabb70e7c867-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:45:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4fc22268-93e7-422a-bf67-1b6ed1beef49 req-c6d4e1d3-d4ff-4515-b64f-7eb08c46a2ad service nova] Lock "a0cffbac-f552-47bf-bd6c-dabb70e7c867-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:45:54 user nova-compute[75341]: DEBUG nova.compute.manager [req-4fc22268-93e7-422a-bf67-1b6ed1beef49 req-c6d4e1d3-d4ff-4515-b64f-7eb08c46a2ad service nova] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] No waiting events found dispatching network-vif-unplugged-8a863ecb-919e-42ac-8507-1c9af9135895 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:45:54 user nova-compute[75341]: DEBUG nova.compute.manager [req-4fc22268-93e7-422a-bf67-1b6ed1beef49 req-c6d4e1d3-d4ff-4515-b64f-7eb08c46a2ad service nova] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Received event network-vif-unplugged-8a863ecb-919e-42ac-8507-1c9af9135895 for instance with task_state deleting. {{(pid=75341) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 23:45:54 user nova-compute[75341]: DEBUG nova.compute.manager [req-4fc22268-93e7-422a-bf67-1b6ed1beef49 req-c6d4e1d3-d4ff-4515-b64f-7eb08c46a2ad service nova] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Received event network-vif-plugged-8a863ecb-919e-42ac-8507-1c9af9135895 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:45:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4fc22268-93e7-422a-bf67-1b6ed1beef49 req-c6d4e1d3-d4ff-4515-b64f-7eb08c46a2ad service nova] Acquiring lock "a0cffbac-f552-47bf-bd6c-dabb70e7c867-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:45:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4fc22268-93e7-422a-bf67-1b6ed1beef49 req-c6d4e1d3-d4ff-4515-b64f-7eb08c46a2ad service nova] Lock "a0cffbac-f552-47bf-bd6c-dabb70e7c867-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:45:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4fc22268-93e7-422a-bf67-1b6ed1beef49 req-c6d4e1d3-d4ff-4515-b64f-7eb08c46a2ad service nova] Lock "a0cffbac-f552-47bf-bd6c-dabb70e7c867-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:45:54 user nova-compute[75341]: DEBUG nova.compute.manager [req-4fc22268-93e7-422a-bf67-1b6ed1beef49 req-c6d4e1d3-d4ff-4515-b64f-7eb08c46a2ad service nova] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] No waiting events found dispatching network-vif-plugged-8a863ecb-919e-42ac-8507-1c9af9135895 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:45:54 user nova-compute[75341]: WARNING nova.compute.manager [req-4fc22268-93e7-422a-bf67-1b6ed1beef49 req-c6d4e1d3-d4ff-4515-b64f-7eb08c46a2ad service nova] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Received unexpected event network-vif-plugged-8a863ecb-919e-42ac-8507-1c9af9135895 for instance with vm_state active and task_state deleting.
Nov 14 23:45:54 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:45:54 user nova-compute[75341]: INFO nova.compute.manager [-] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Took 1.39 seconds to deallocate network for instance.
Nov 14 23:45:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-7ceac858-dbc9-4ab7-b46f-19b8f8786a4b tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:45:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-7ceac858-dbc9-4ab7-b46f-19b8f8786a4b tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:45:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:45:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:45:54 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 23:45:55 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-7ceac858-dbc9-4ab7-b46f-19b8f8786a4b tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Refreshing inventories for resource provider 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 23:45:55 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:45:55 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:45:55 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Hypervisor/Node resource view: name=user free_ram=6958MB free_disk=25.590496063232422GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75341) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 23:45:55 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:45:55 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-7ceac858-dbc9-4ab7-b46f-19b8f8786a4b tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Updating ProviderTree inventory for provider 8fa114cc-b541-418f-865c-16c44294e72d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 23:45:55 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-7ceac858-dbc9-4ab7-b46f-19b8f8786a4b tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Updating inventory in ProviderTree for provider 8fa114cc-b541-418f-865c-16c44294e72d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 23:45:55 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-7ceac858-dbc9-4ab7-b46f-19b8f8786a4b tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Refreshing aggregate associations for resource provider 8fa114cc-b541-418f-865c-16c44294e72d, aggregates: None {{(pid=75341) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 23:45:55 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-7ceac858-dbc9-4ab7-b46f-19b8f8786a4b tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Refreshing trait associations for resource provider 8fa114cc-b541-418f-865c-16c44294e72d, traits: COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_MMX,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000E {{(pid=75341) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 23:45:55 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-7ceac858-dbc9-4ab7-b46f-19b8f8786a4b tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:45:55 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-7ceac858-dbc9-4ab7-b46f-19b8f8786a4b tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:45:55 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-7ceac858-dbc9-4ab7-b46f-19b8f8786a4b tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.369s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:45:55 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.521s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:45:56 user nova-compute[75341]: INFO nova.scheduler.client.report [None req-7ceac858-dbc9-4ab7-b46f-19b8f8786a4b tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Deleted allocations for instance a0cffbac-f552-47bf-bd6c-dabb70e7c867
Nov 14 23:45:56 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-7ceac858-dbc9-4ab7-b46f-19b8f8786a4b tempest-VolumesAdminNegativeTest-2087255478 tempest-VolumesAdminNegativeTest-2087255478-project-member] Lock "a0cffbac-f552-47bf-bd6c-dabb70e7c867" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.165s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:45:56 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance cffc86d5-2ac6-4dd1-bdcd-5832c134d179 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:45:56 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance a308a35f-c8d7-482c-a93d-5d9eb473d4e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:45:56 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 881351d7-31f9-44f4-8571-8f540bbec29c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:45:56 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance a141d7ee-3f77-4fdc-85ec-2cbd5af17646 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:45:56 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance dbc9a6db-b536-426a-91fd-691a44c66528 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:45:56 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 51045050-c7c6-49c5-acd4-2a76be0f466f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:45:56 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 6382e432-838f-4d89-a743-cbaa37f50ab5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:45:56 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance d92ba9df-c739-414d-a701-ddba04563427 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:45:56 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 0223a98e-e08f-4a0f-a707-3770c7a99b00 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:45:56 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 6a0e67fc-942b-4f05-a6ee-0987944f17da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:45:56 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 896ee337-80bf-47c3-9530-861c941a2fc6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:45:56 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance c8aa0b26-4099-4a8d-afce-a1e990e5b1f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:45:56 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 23:45:56 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 23:45:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:56 user nova-compute[75341]: DEBUG nova.compute.manager [req-4d5151d0-2a99-4c8b-b7bc-2f45ad925ed1 req-f55603b2-8092-4edc-978b-7076c85b7361 service nova] [instance: a0cffbac-f552-47bf-bd6c-dabb70e7c867] Received event network-vif-deleted-8a863ecb-919e-42ac-8507-1c9af9135895 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:45:56 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:45:56 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:45:56 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Compute_service record updated for user:user {{(pid=75341) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 23:45:56 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.660s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:45:57 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:45:57 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:45:57 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:45:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:58 user nova-compute[75341]: DEBUG nova.compute.manager [req-ed444dd4-f9ed-42da-bc52-a83d9ea348fe req-71bef41e-e1b6-4aef-8360-a918dc7269ce service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received event network-changed-1ad25d31-80fa-41ba-8a1c-73f01ac1c832 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:45:58 user nova-compute[75341]: DEBUG nova.compute.manager [req-ed444dd4-f9ed-42da-bc52-a83d9ea348fe req-71bef41e-e1b6-4aef-8360-a918dc7269ce service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Refreshing instance network info cache due to event network-changed-1ad25d31-80fa-41ba-8a1c-73f01ac1c832. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:45:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ed444dd4-f9ed-42da-bc52-a83d9ea348fe req-71bef41e-e1b6-4aef-8360-a918dc7269ce service nova] Acquiring lock "refresh_cache-dbc9a6db-b536-426a-91fd-691a44c66528" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:45:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ed444dd4-f9ed-42da-bc52-a83d9ea348fe req-71bef41e-e1b6-4aef-8360-a918dc7269ce service nova] Acquired lock "refresh_cache-dbc9a6db-b536-426a-91fd-691a44c66528" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:45:58 user nova-compute[75341]: DEBUG nova.network.neutron [req-ed444dd4-f9ed-42da-bc52-a83d9ea348fe req-71bef41e-e1b6-4aef-8360-a918dc7269ce service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Refreshing network info cache for port 1ad25d31-80fa-41ba-8a1c-73f01ac1c832 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:45:59 user nova-compute[75341]: DEBUG nova.network.neutron [req-ed444dd4-f9ed-42da-bc52-a83d9ea348fe req-71bef41e-e1b6-4aef-8360-a918dc7269ce service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Updated VIF entry in instance network info cache for port 1ad25d31-80fa-41ba-8a1c-73f01ac1c832. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:45:59 user nova-compute[75341]: DEBUG nova.network.neutron [req-ed444dd4-f9ed-42da-bc52-a83d9ea348fe req-71bef41e-e1b6-4aef-8360-a918dc7269ce service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Updating instance_info_cache with network_info: [{"id": "1ad25d31-80fa-41ba-8a1c-73f01ac1c832", "address": "fa:16:3e:70:63:49", "network": {"id": "304d198c-016a-470b-9504-145a5823966a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2033085667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad25d31-80", "ovs_interfaceid": "1ad25d31-80fa-41ba-8a1c-73f01ac1c832", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7b7251c7-1a54-46d9-9a9b-4103a659502c", "address": "fa:16:3e:b4:1d:7d", "network": {"id": "66be3b1a-ec5a-4c25-86fb-8350b80ce72d", "bridge": "br-int", "label": "tempest-device-tagging-net1-719453354", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b7251c7-1a", "ovs_interfaceid": "7b7251c7-1a54-46d9-9a9b-4103a659502c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0f140fc0-2078-47c4-985f-28a4ee8b2824", "address": "fa:16:3e:c6:94:07", "network": {"id": "66be3b1a-ec5a-4c25-86fb-8350b80ce72d", "bridge": "br-int", "label": "tempest-device-tagging-net1-719453354", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f140fc0-20", "ovs_interfaceid": "0f140fc0-2078-47c4-985f-28a4ee8b2824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f4b96195-ecba-4530-aa46-47e368eb294d", "address": "fa:16:3e:c1:9e:73", "network": {"id": "66be3b1a-ec5a-4c25-86fb-8350b80ce72d", "bridge": "br-int", "label": "tempest-device-tagging-net1-719453354", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4b96195-ec", "ovs_interfaceid": "f4b96195-ecba-4530-aa46-47e368eb294d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "52e41618-df29-407f-8843-3e1c55fb2a18", "address": "fa:16:3e:f9:73:7b", "network": {"id": "66be3b1a-ec5a-4c25-86fb-8350b80ce72d", "bridge": "br-int", "label": "tempest-device-tagging-net1-719453354", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e41618-df", "ovs_interfaceid": "52e41618-df29-407f-8843-3e1c55fb2a18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6368ff99-db9d-4a3e-b940-afc0300d7aa0", "address": "fa:16:3e:8a:4f:bb", "network": {"id": "21622931-8859-4310-85b4-e6c88ea4fd26", "bridge": "br-int", "label": "tempest-device-tagging-net2-1204896773", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6368ff99-db", "ovs_interfaceid": "6368ff99-db9d-4a3e-b940-afc0300d7aa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4f71d722-661a-44d6-81fa-cd588c0d6f4b", "address": "fa:16:3e:fe:bb:e6", "network": {"id": "21622931-8859-4310-85b4-e6c88ea4fd26", "bridge": "br-int", "label": "tempest-device-tagging-net2-1204896773", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f71d722-66", "ovs_interfaceid": "4f71d722-661a-44d6-81fa-cd588c0d6f4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:45:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ed444dd4-f9ed-42da-bc52-a83d9ea348fe req-71bef41e-e1b6-4aef-8360-a918dc7269ce service nova] Releasing lock "refresh_cache-dbc9a6db-b536-426a-91fd-691a44c66528" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:45:59 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Acquiring lock "dbc9a6db-b536-426a-91fd-691a44c66528" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:45:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Lock "dbc9a6db-b536-426a-91fd-691a44c66528" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:45:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Acquiring lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:45:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:45:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:45:59 user nova-compute[75341]: INFO nova.compute.manager [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Terminating instance
Nov 14 23:45:59 user nova-compute[75341]: DEBUG nova.compute.manager [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Start destroying the instance on the hypervisor. {{(pid=75341) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 23:45:59 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:59 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:59 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:59 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:45:59 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:00 user nova-compute[75341]: DEBUG nova.compute.manager [req-3c860104-78ac-45d5-9600-3970b859ec68 req-cca1addd-986e-4c3c-a4ad-0367f2adc9f3 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received event network-vif-unplugged-0f140fc0-2078-47c4-985f-28a4ee8b2824 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:46:00 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-3c860104-78ac-45d5-9600-3970b859ec68 req-cca1addd-986e-4c3c-a4ad-0367f2adc9f3 service nova] Acquiring lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:00 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-3c860104-78ac-45d5-9600-3970b859ec68 req-cca1addd-986e-4c3c-a4ad-0367f2adc9f3 service nova] Lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:00 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-3c860104-78ac-45d5-9600-3970b859ec68 req-cca1addd-986e-4c3c-a4ad-0367f2adc9f3 service nova] Lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:00 user nova-compute[75341]: DEBUG nova.compute.manager [req-3c860104-78ac-45d5-9600-3970b859ec68 req-cca1addd-986e-4c3c-a4ad-0367f2adc9f3 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] No waiting events found dispatching network-vif-unplugged-0f140fc0-2078-47c4-985f-28a4ee8b2824 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:46:00 user nova-compute[75341]: DEBUG nova.compute.manager [req-3c860104-78ac-45d5-9600-3970b859ec68 req-cca1addd-986e-4c3c-a4ad-0367f2adc9f3 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received event network-vif-unplugged-0f140fc0-2078-47c4-985f-28a4ee8b2824 for instance with task_state deleting. {{(pid=75341) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 23:46:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:00 user nova-compute[75341]: DEBUG nova.compute.manager [req-c5793645-bc1d-4d9a-8430-ef531fc7e31e req-b162112f-0f64-40db-b36e-a4a5098b1dff service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received event network-vif-unplugged-52e41618-df29-407f-8843-3e1c55fb2a18 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:46:00 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-c5793645-bc1d-4d9a-8430-ef531fc7e31e req-b162112f-0f64-40db-b36e-a4a5098b1dff service nova] Acquiring lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:00 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-c5793645-bc1d-4d9a-8430-ef531fc7e31e req-b162112f-0f64-40db-b36e-a4a5098b1dff service nova] Lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:00 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-c5793645-bc1d-4d9a-8430-ef531fc7e31e req-b162112f-0f64-40db-b36e-a4a5098b1dff service nova] Lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:00 user nova-compute[75341]: DEBUG nova.compute.manager [req-c5793645-bc1d-4d9a-8430-ef531fc7e31e req-b162112f-0f64-40db-b36e-a4a5098b1dff service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] No waiting events found dispatching network-vif-unplugged-52e41618-df29-407f-8843-3e1c55fb2a18 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:46:00 user nova-compute[75341]: DEBUG nova.compute.manager [req-c5793645-bc1d-4d9a-8430-ef531fc7e31e req-b162112f-0f64-40db-b36e-a4a5098b1dff service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received event network-vif-unplugged-52e41618-df29-407f-8843-3e1c55fb2a18 for instance with task_state deleting. {{(pid=75341) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 23:46:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:01 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Instance destroyed successfully.
Nov 14 23:46:01 user nova-compute[75341]: DEBUG nova.objects.instance [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Lazy-loading 'resources' on Instance uuid dbc9a6db-b536-426a-91fd-691a44c66528 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:46:01 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T23:44:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1597759010',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1597759010',id=16,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGnRmDUcLksc+OQYrjq9UG1KiJjjVMGQYkKKfVFXltSoFebOxmwKjrBwKmhCWBLgc7pjoNkrWhgcNR0z6ZvOVHzUrRBlskAqkoIwov2bgQawttj1nxc2fiDvWmCs0aFTzg==',key_name='tempest-keypair-633489156',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:44:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c40c4897cbbd4ac8b3192eb149adcb41',ramdisk_id='',reservation_id='r-rsnxw87s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1944630985',owner_user_name='tempest-TaggedBootDevicesTest_v242-1944630985-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:44:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfcd7dc4048345cca7a8facabde9e209',uuid=dbc9a6db-b536-426a-91fd-691a44c66528,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ad25d31-80fa-41ba-8a1c-73f01ac1c832", "address": "fa:16:3e:70:63:49", "network": {"id": "304d198c-016a-470b-9504-145a5823966a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2033085667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad25d31-80", "ovs_interfaceid": "1ad25d31-80fa-41ba-8a1c-73f01ac1c832", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 23:46:01 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Converting VIF {"id": "1ad25d31-80fa-41ba-8a1c-73f01ac1c832", "address": "fa:16:3e:70:63:49", "network": {"id": "304d198c-016a-470b-9504-145a5823966a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2033085667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad25d31-80", "ovs_interfaceid": "1ad25d31-80fa-41ba-8a1c-73f01ac1c832", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:46:01 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:63:49,bridge_name='br-int',has_traffic_filtering=True,id=1ad25d31-80fa-41ba-8a1c-73f01ac1c832,network=Network(304d198c-016a-470b-9504-145a5823966a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ad25d31-80') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:46:01 user nova-compute[75341]: DEBUG os_vif [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:63:49,bridge_name='br-int',has_traffic_filtering=True,id=1ad25d31-80fa-41ba-8a1c-73f01ac1c832,network=Network(304d198c-016a-470b-9504-145a5823966a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ad25d31-80') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 23:46:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1ad25d31-80, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:46:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:46:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f90e0909-54a6-4b6c-8641-9c2d5bb661b5) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:46:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:46:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:01 user nova-compute[75341]: INFO os_vif [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:63:49,bridge_name='br-int',has_traffic_filtering=True,id=1ad25d31-80fa-41ba-8a1c-73f01ac1c832,network=Network(304d198c-016a-470b-9504-145a5823966a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ad25d31-80')
Nov 14 23:46:01 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T23:44:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1597759010',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1597759010',id=16,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGnRmDUcLksc+OQYrjq9UG1KiJjjVMGQYkKKfVFXltSoFebOxmwKjrBwKmhCWBLgc7pjoNkrWhgcNR0z6ZvOVHzUrRBlskAqkoIwov2bgQawttj1nxc2fiDvWmCs0aFTzg==',key_name='tempest-keypair-633489156',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:44:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c40c4897cbbd4ac8b3192eb149adcb41',ramdisk_id='',reservation_id='r-rsnxw87s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1944630985',owner_user_name='tempest-TaggedBootDevicesTest_v242-1944630985-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:44:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfcd7dc4048345cca7a8facabde9e209',uuid=dbc9a6db-b536-426a-91fd-691a44c66528,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7b7251c7-1a54-46d9-9a9b-4103a659502c", "address": "fa:16:3e:b4:1d:7d", "network": {"id": "66be3b1a-ec5a-4c25-86fb-8350b80ce72d", "bridge": "br-int", "label": "tempest-device-tagging-net1-719453354", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b7251c7-1a", "ovs_interfaceid": "7b7251c7-1a54-46d9-9a9b-4103a659502c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 23:46:01 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Converting VIF {"id": "7b7251c7-1a54-46d9-9a9b-4103a659502c", "address": "fa:16:3e:b4:1d:7d", "network": {"id": "66be3b1a-ec5a-4c25-86fb-8350b80ce72d", "bridge": "br-int", "label": "tempest-device-tagging-net1-719453354", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b7251c7-1a", "ovs_interfaceid": "7b7251c7-1a54-46d9-9a9b-4103a659502c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:46:01 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:1d:7d,bridge_name='br-int',has_traffic_filtering=True,id=7b7251c7-1a54-46d9-9a9b-4103a659502c,network=Network(66be3b1a-ec5a-4c25-86fb-8350b80ce72d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7b7251c7-1a') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:46:01 user nova-compute[75341]: DEBUG os_vif [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:1d:7d,bridge_name='br-int',has_traffic_filtering=True,id=7b7251c7-1a54-46d9-9a9b-4103a659502c,network=Network(66be3b1a-ec5a-4c25-86fb-8350b80ce72d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7b7251c7-1a') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 23:46:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7b7251c7-1a, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:46:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:46:01 user nova-compute[75341]: DEBUG nova.compute.manager [req-9e220ff3-ba3f-4009-8a35-428933ce10b1 req-22df2678-bfab-4e84-b285-6ce551e78959 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received event network-vif-unplugged-1ad25d31-80fa-41ba-8a1c-73f01ac1c832 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:46:01 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-9e220ff3-ba3f-4009-8a35-428933ce10b1 req-22df2678-bfab-4e84-b285-6ce551e78959 service nova] Acquiring lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:01 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-9e220ff3-ba3f-4009-8a35-428933ce10b1 req-22df2678-bfab-4e84-b285-6ce551e78959 service nova] Lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:01 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-9e220ff3-ba3f-4009-8a35-428933ce10b1 req-22df2678-bfab-4e84-b285-6ce551e78959 service nova] Lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:01 user nova-compute[75341]: DEBUG nova.compute.manager [req-9e220ff3-ba3f-4009-8a35-428933ce10b1 req-22df2678-bfab-4e84-b285-6ce551e78959 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] No waiting events found dispatching network-vif-unplugged-1ad25d31-80fa-41ba-8a1c-73f01ac1c832 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:46:01 user nova-compute[75341]: DEBUG nova.compute.manager [req-9e220ff3-ba3f-4009-8a35-428933ce10b1 req-22df2678-bfab-4e84-b285-6ce551e78959 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received event network-vif-unplugged-1ad25d31-80fa-41ba-8a1c-73f01ac1c832 for instance with task_state deleting. {{(pid=75341) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 23:46:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7720bd12-ea76-4464-b2fa-69dde93ebc24) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:46:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:46:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:01 user nova-compute[75341]: INFO os_vif [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:1d:7d,bridge_name='br-int',has_traffic_filtering=True,id=7b7251c7-1a54-46d9-9a9b-4103a659502c,network=Network(66be3b1a-ec5a-4c25-86fb-8350b80ce72d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7b7251c7-1a')
Nov 14 23:46:01 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T23:44:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1597759010',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1597759010',id=16,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGnRmDUcLksc+OQYrjq9UG1KiJjjVMGQYkKKfVFXltSoFebOxmwKjrBwKmhCWBLgc7pjoNkrWhgcNR0z6ZvOVHzUrRBlskAqkoIwov2bgQawttj1nxc2fiDvWmCs0aFTzg==',key_name='tempest-keypair-633489156',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:44:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c40c4897cbbd4ac8b3192eb149adcb41',ramdisk_id='',reservation_id='r-rsnxw87s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1944630985',owner_user_name='tempest-TaggedBootDevicesTest_v242-1944630985-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:44:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfcd7dc4048345cca7a8facabde9e209',uuid=dbc9a6db-b536-426a-91fd-691a44c66528,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0f140fc0-2078-47c4-985f-28a4ee8b2824", "address": "fa:16:3e:c6:94:07", "network": {"id": "66be3b1a-ec5a-4c25-86fb-8350b80ce72d", "bridge": "br-int", "label": "tempest-device-tagging-net1-719453354", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f140fc0-20", "ovs_interfaceid": "0f140fc0-2078-47c4-985f-28a4ee8b2824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 23:46:01 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Converting VIF {"id": "0f140fc0-2078-47c4-985f-28a4ee8b2824", "address": "fa:16:3e:c6:94:07", "network": {"id": "66be3b1a-ec5a-4c25-86fb-8350b80ce72d", "bridge": "br-int", "label": "tempest-device-tagging-net1-719453354", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f140fc0-20", "ovs_interfaceid": "0f140fc0-2078-47c4-985f-28a4ee8b2824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:46:01 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:94:07,bridge_name='br-int',has_traffic_filtering=True,id=0f140fc0-2078-47c4-985f-28a4ee8b2824,network=Network(66be3b1a-ec5a-4c25-86fb-8350b80ce72d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0f140fc0-20') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:46:01 user nova-compute[75341]: DEBUG os_vif [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:94:07,bridge_name='br-int',has_traffic_filtering=True,id=0f140fc0-2078-47c4-985f-28a4ee8b2824,network=Network(66be3b1a-ec5a-4c25-86fb-8350b80ce72d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0f140fc0-20') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 23:46:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0f140fc0-20, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:46:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:46:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a91ab0f0-42cf-489f-a000-75f7b790be98) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:46:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:46:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:01 user nova-compute[75341]: INFO os_vif [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:94:07,bridge_name='br-int',has_traffic_filtering=True,id=0f140fc0-2078-47c4-985f-28a4ee8b2824,network=Network(66be3b1a-ec5a-4c25-86fb-8350b80ce72d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0f140fc0-20')
Nov 14 23:46:01 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T23:44:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1597759010',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1597759010',id=16,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGnRmDUcLksc+OQYrjq9UG1KiJjjVMGQYkKKfVFXltSoFebOxmwKjrBwKmhCWBLgc7pjoNkrWhgcNR0z6ZvOVHzUrRBlskAqkoIwov2bgQawttj1nxc2fiDvWmCs0aFTzg==',key_name='tempest-keypair-633489156',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:44:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c40c4897cbbd4ac8b3192eb149adcb41',ramdisk_id='',reservation_id='r-rsnxw87s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1944630985',owner_user_name='tempest-TaggedBootDevicesTest_v242-1944630985-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:44:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfcd7dc4048345cca7a8facabde9e209',uuid=dbc9a6db-b536-426a-91fd-691a44c66528,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4b96195-ecba-4530-aa46-47e368eb294d", "address": "fa:16:3e:c1:9e:73", "network": {"id": "66be3b1a-ec5a-4c25-86fb-8350b80ce72d", "bridge": "br-int", "label": "tempest-device-tagging-net1-719453354", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4b96195-ec", "ovs_interfaceid": "f4b96195-ecba-4530-aa46-47e368eb294d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 23:46:01 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Converting VIF {"id": "f4b96195-ecba-4530-aa46-47e368eb294d", "address": "fa:16:3e:c1:9e:73", "network": {"id": "66be3b1a-ec5a-4c25-86fb-8350b80ce72d", "bridge": "br-int", "label": "tempest-device-tagging-net1-719453354", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4b96195-ec", "ovs_interfaceid": "f4b96195-ecba-4530-aa46-47e368eb294d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:46:01 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:9e:73,bridge_name='br-int',has_traffic_filtering=True,id=f4b96195-ecba-4530-aa46-47e368eb294d,network=Network(66be3b1a-ec5a-4c25-86fb-8350b80ce72d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4b96195-ec') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:46:01 user nova-compute[75341]: DEBUG os_vif [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:9e:73,bridge_name='br-int',has_traffic_filtering=True,id=f4b96195-ecba-4530-aa46-47e368eb294d,network=Network(66be3b1a-ec5a-4c25-86fb-8350b80ce72d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4b96195-ec') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 23:46:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4b96195-ec, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:46:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:46:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a0c8ba5d-8bcd-4835-a770-99187cbef13d) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:46:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:46:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:01 user nova-compute[75341]: INFO os_vif [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:9e:73,bridge_name='br-int',has_traffic_filtering=True,id=f4b96195-ecba-4530-aa46-47e368eb294d,network=Network(66be3b1a-ec5a-4c25-86fb-8350b80ce72d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4b96195-ec')
Nov 14 23:46:01 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T23:44:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1597759010',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1597759010',id=16,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGnRmDUcLksc+OQYrjq9UG1KiJjjVMGQYkKKfVFXltSoFebOxmwKjrBwKmhCWBLgc7pjoNkrWhgcNR0z6ZvOVHzUrRBlskAqkoIwov2bgQawttj1nxc2fiDvWmCs0aFTzg==',key_name='tempest-keypair-633489156',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:44:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c40c4897cbbd4ac8b3192eb149adcb41',ramdisk_id='',reservation_id='r-rsnxw87s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1944630985',owner_user_name='tempest-TaggedBootDevicesTest_v242-1944630985-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:44:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfcd7dc4048345cca7a8facabde9e209',uuid=dbc9a6db-b536-426a-91fd-691a44c66528,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "52e41618-df29-407f-8843-3e1c55fb2a18", "address": "fa:16:3e:f9:73:7b", "network": {"id": "66be3b1a-ec5a-4c25-86fb-8350b80ce72d", "bridge": "br-int", "label": "tempest-device-tagging-net1-719453354", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e41618-df", "ovs_interfaceid": "52e41618-df29-407f-8843-3e1c55fb2a18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 23:46:01 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Converting VIF {"id": "52e41618-df29-407f-8843-3e1c55fb2a18", "address": "fa:16:3e:f9:73:7b", "network": {"id": "66be3b1a-ec5a-4c25-86fb-8350b80ce72d", "bridge": "br-int", "label": "tempest-device-tagging-net1-719453354", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e41618-df", "ovs_interfaceid": "52e41618-df29-407f-8843-3e1c55fb2a18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:46:01 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:73:7b,bridge_name='br-int',has_traffic_filtering=True,id=52e41618-df29-407f-8843-3e1c55fb2a18,network=Network(66be3b1a-ec5a-4c25-86fb-8350b80ce72d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52e41618-df') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:46:01 user nova-compute[75341]: DEBUG os_vif [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:73:7b,bridge_name='br-int',has_traffic_filtering=True,id=52e41618-df29-407f-8843-3e1c55fb2a18,network=Network(66be3b1a-ec5a-4c25-86fb-8350b80ce72d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52e41618-df') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 23:46:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap52e41618-df, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:46:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7e08412c-2c5d-42f5-834e-2b38c41a40d5) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:02 user nova-compute[75341]: INFO os_vif [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:73:7b,bridge_name='br-int',has_traffic_filtering=True,id=52e41618-df29-407f-8843-3e1c55fb2a18,network=Network(66be3b1a-ec5a-4c25-86fb-8350b80ce72d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52e41618-df')
Nov 14 23:46:02 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T23:44:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1597759010',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1597759010',id=16,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGnRmDUcLksc+OQYrjq9UG1KiJjjVMGQYkKKfVFXltSoFebOxmwKjrBwKmhCWBLgc7pjoNkrWhgcNR0z6ZvOVHzUrRBlskAqkoIwov2bgQawttj1nxc2fiDvWmCs0aFTzg==',key_name='tempest-keypair-633489156',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:44:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c40c4897cbbd4ac8b3192eb149adcb41',ramdisk_id='',reservation_id='r-rsnxw87s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1944630985',owner_user_name='tempest-TaggedBootDevicesTest_v242-1944630985-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:44:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfcd7dc4048345cca7a8facabde9e209',uuid=dbc9a6db-b536-426a-91fd-691a44c66528,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6368ff99-db9d-4a3e-b940-afc0300d7aa0", "address": "fa:16:3e:8a:4f:bb", "network": {"id": "21622931-8859-4310-85b4-e6c88ea4fd26", "bridge": "br-int", "label": "tempest-device-tagging-net2-1204896773", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6368ff99-db", "ovs_interfaceid": "6368ff99-db9d-4a3e-b940-afc0300d7aa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Converting VIF {"id": "6368ff99-db9d-4a3e-b940-afc0300d7aa0", "address": "fa:16:3e:8a:4f:bb", "network": {"id": "21622931-8859-4310-85b4-e6c88ea4fd26", "bridge": "br-int", "label": "tempest-device-tagging-net2-1204896773", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6368ff99-db", "ovs_interfaceid": "6368ff99-db9d-4a3e-b940-afc0300d7aa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:4f:bb,bridge_name='br-int',has_traffic_filtering=True,id=6368ff99-db9d-4a3e-b940-afc0300d7aa0,network=Network(21622931-8859-4310-85b4-e6c88ea4fd26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6368ff99-db') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG os_vif [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:4f:bb,bridge_name='br-int',has_traffic_filtering=True,id=6368ff99-db9d-4a3e-b940-afc0300d7aa0,network=Network(21622931-8859-4310-85b4-e6c88ea4fd26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6368ff99-db') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6368ff99-db, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=32144cea-d791-4304-b6e7-ffe123a3ea4f) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:02 user nova-compute[75341]: INFO os_vif [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:4f:bb,bridge_name='br-int',has_traffic_filtering=True,id=6368ff99-db9d-4a3e-b940-afc0300d7aa0,network=Network(21622931-8859-4310-85b4-e6c88ea4fd26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6368ff99-db')
Nov 14 23:46:02 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T23:44:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1597759010',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1597759010',id=16,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGnRmDUcLksc+OQYrjq9UG1KiJjjVMGQYkKKfVFXltSoFebOxmwKjrBwKmhCWBLgc7pjoNkrWhgcNR0z6ZvOVHzUrRBlskAqkoIwov2bgQawttj1nxc2fiDvWmCs0aFTzg==',key_name='tempest-keypair-633489156',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:44:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c40c4897cbbd4ac8b3192eb149adcb41',ramdisk_id='',reservation_id='r-rsnxw87s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1944630985',owner_user_name='tempest-TaggedBootDevicesTest_v242-1944630985-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:44:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfcd7dc4048345cca7a8facabde9e209',uuid=dbc9a6db-b536-426a-91fd-691a44c66528,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4f71d722-661a-44d6-81fa-cd588c0d6f4b", "address": "fa:16:3e:fe:bb:e6", "network": {"id": "21622931-8859-4310-85b4-e6c88ea4fd26", "bridge": "br-int", "label": "tempest-device-tagging-net2-1204896773", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f71d722-66", "ovs_interfaceid": "4f71d722-661a-44d6-81fa-cd588c0d6f4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Converting VIF {"id": "4f71d722-661a-44d6-81fa-cd588c0d6f4b", "address": "fa:16:3e:fe:bb:e6", "network": {"id": "21622931-8859-4310-85b4-e6c88ea4fd26", "bridge": "br-int", "label": "tempest-device-tagging-net2-1204896773", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f71d722-66", "ovs_interfaceid": "4f71d722-661a-44d6-81fa-cd588c0d6f4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:bb:e6,bridge_name='br-int',has_traffic_filtering=True,id=4f71d722-661a-44d6-81fa-cd588c0d6f4b,network=Network(21622931-8859-4310-85b4-e6c88ea4fd26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f71d722-66') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG os_vif [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:bb:e6,bridge_name='br-int',has_traffic_filtering=True,id=4f71d722-661a-44d6-81fa-cd588c0d6f4b,network=Network(21622931-8859-4310-85b4-e6c88ea4fd26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f71d722-66') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4f71d722-66, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5053a5b1-a5b1-423f-b2b3-a3f2811c11ad) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:02 user nova-compute[75341]: INFO os_vif [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:bb:e6,bridge_name='br-int',has_traffic_filtering=True,id=4f71d722-661a-44d6-81fa-cd588c0d6f4b,network=Network(21622931-8859-4310-85b4-e6c88ea4fd26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f71d722-66')
Nov 14 23:46:02 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] calling os-brick to detach iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, {'target_iqn': 'iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'poTPrwdx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:46:02 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:46:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b59d31-83d1-41cc-8b3a-7aa76f537141]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 23:46:02 user nova-compute[75341]: No targets found.
Nov 14 23:46:02 user nova-compute[75341]: iSNS:
Nov 14 23:46:02 user nova-compute[75341]: No targets found.
Nov 14 23:46:02 user nova-compute[75341]: STATIC:
Nov 14 23:46:02 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7
Nov 14 23:46:02 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:46:02 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:46:02 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3
Nov 14 23:46:02 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:46:02 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:46:02 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a
Nov 14 23:46:02 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:46:02 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:46:02 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7
Nov 14 23:46:02 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:46:02 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:46:02 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c
Nov 14 23:46:02 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:46:02 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:46:02 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912
Nov 14 23:46:02 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:46:02 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:46:02 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d
Nov 14 23:46:02 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:46:02 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:46:02 user nova-compute[75341]: FIRMWARE:
Nov 14 23:46:02 user nova-compute[75341]: No targets found.
Nov 14 23:46:02 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 23:46:02 user nova-compute[75341]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 23:46:02 user nova-compute[75341]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75341) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7', 0)] {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8adfa5-6e91-4ec4-863e-5822fe101281]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[8426c0f1-7d48-4d78-ada8-b6ed2fc15b16]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 (non-flash)
Nov 14 23:46:02 user nova-compute[75341]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a (non-flash)
Nov 14 23:46:02 user nova-compute[75341]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 (non-flash)
Nov 14 23:46:02 user nova-compute[75341]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:46:02 user nova-compute[75341]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)
Nov 14 23:46:02 user nova-compute[75341]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)
Nov 14 23:46:02 user nova-compute[75341]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d (non-flash)
Nov 14 23:46:02 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 (non-flash)
Nov 14 23:46:02 user nova-compute[75341]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a (non-flash)
Nov 14 23:46:02 user nova-compute[75341]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 (non-flash)
Nov 14 23:46:02 user nova-compute[75341]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:46:02 user nova-compute[75341]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)
Nov 14 23:46:02 user nova-compute[75341]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)
Nov 14 23:46:02 user nova-compute[75341]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d (non-flash)
Nov 14 23:46:02 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1890157b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7'): ({'sdb'}, set())}) {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Removing single pathed devices sdb {{(pid=75341) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fdb6d9c-80d7-4701-aa02-ba0cbc5cc4e6]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[6167bead-f7e6-4af9-8e60-0a08f5a0b0bb]: (4, ('ok\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Flushing IO for device /dev/sdb {{(pid=75341) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[04104b54-cbf3-433c-acca-5875f609f139]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75341) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a465a62-be90-40b0-a23b-e30dfaf2061d]: (4, ('1', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] SCSI volumes sdb have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7')] {{(pid=75341) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[416b7dec-96e0-4fbe-88e0-fb5231a75a1e]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 -p 172.16.0.220:3260 --logout {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG nova.compute.manager [req-bcf0d965-18a4-424d-9676-98fae09e13cd req-518d9ad1-721c-497a-babe-d4fd4af70188 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received event network-vif-plugged-0f140fc0-2078-47c4-985f-28a4ee8b2824 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-bcf0d965-18a4-424d-9676-98fae09e13cd req-518d9ad1-721c-497a-babe-d4fd4af70188 service nova] Acquiring lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-bcf0d965-18a4-424d-9676-98fae09e13cd req-518d9ad1-721c-497a-babe-d4fd4af70188 service nova] Lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-bcf0d965-18a4-424d-9676-98fae09e13cd req-518d9ad1-721c-497a-babe-d4fd4af70188 service nova] Lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG nova.compute.manager [req-bcf0d965-18a4-424d-9676-98fae09e13cd req-518d9ad1-721c-497a-babe-d4fd4af70188 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] No waiting events found dispatching network-vif-plugged-0f140fc0-2078-47c4-985f-28a4ee8b2824 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:46:02 user nova-compute[75341]: WARNING nova.compute.manager [req-bcf0d965-18a4-424d-9676-98fae09e13cd req-518d9ad1-721c-497a-babe-d4fd4af70188 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received unexpected event network-vif-plugged-0f140fc0-2078-47c4-985f-28a4ee8b2824 for instance with vm_state active and task_state deleting.
Nov 14 23:46:02 user nova-compute[75341]: DEBUG nova.compute.manager [req-bcf0d965-18a4-424d-9676-98fae09e13cd req-518d9ad1-721c-497a-babe-d4fd4af70188 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received event network-vif-unplugged-f4b96195-ecba-4530-aa46-47e368eb294d {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-bcf0d965-18a4-424d-9676-98fae09e13cd req-518d9ad1-721c-497a-babe-d4fd4af70188 service nova] Acquiring lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-bcf0d965-18a4-424d-9676-98fae09e13cd req-518d9ad1-721c-497a-babe-d4fd4af70188 service nova] Lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-bcf0d965-18a4-424d-9676-98fae09e13cd req-518d9ad1-721c-497a-babe-d4fd4af70188 service nova] Lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG nova.compute.manager [req-bcf0d965-18a4-424d-9676-98fae09e13cd req-518d9ad1-721c-497a-babe-d4fd4af70188 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] No waiting events found dispatching network-vif-unplugged-f4b96195-ecba-4530-aa46-47e368eb294d {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG nova.compute.manager [req-bcf0d965-18a4-424d-9676-98fae09e13cd req-518d9ad1-721c-497a-babe-d4fd4af70188 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received event network-vif-unplugged-f4b96195-ecba-4530-aa46-47e368eb294d for instance with task_state deleting. {{(pid=75341) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG nova.compute.manager [req-bcf0d965-18a4-424d-9676-98fae09e13cd req-518d9ad1-721c-497a-babe-d4fd4af70188 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received event network-vif-plugged-f4b96195-ecba-4530-aa46-47e368eb294d {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-bcf0d965-18a4-424d-9676-98fae09e13cd req-518d9ad1-721c-497a-babe-d4fd4af70188 service nova] Acquiring lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-bcf0d965-18a4-424d-9676-98fae09e13cd req-518d9ad1-721c-497a-babe-d4fd4af70188 service nova] Lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-bcf0d965-18a4-424d-9676-98fae09e13cd req-518d9ad1-721c-497a-babe-d4fd4af70188 service nova] Lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG nova.compute.manager [req-bcf0d965-18a4-424d-9676-98fae09e13cd req-518d9ad1-721c-497a-babe-d4fd4af70188 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] No waiting events found dispatching network-vif-plugged-f4b96195-ecba-4530-aa46-47e368eb294d {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:46:02 user nova-compute[75341]: WARNING nova.compute.manager [req-bcf0d965-18a4-424d-9676-98fae09e13cd req-518d9ad1-721c-497a-babe-d4fd4af70188 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received unexpected event network-vif-plugged-f4b96195-ecba-4530-aa46-47e368eb294d for instance with vm_state active and task_state deleting.
Nov 14 23:46:02 user nova-compute[75341]: DEBUG nova.compute.manager [req-bcf0d965-18a4-424d-9676-98fae09e13cd req-518d9ad1-721c-497a-babe-d4fd4af70188 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received event network-vif-unplugged-4f71d722-661a-44d6-81fa-cd588c0d6f4b {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-bcf0d965-18a4-424d-9676-98fae09e13cd req-518d9ad1-721c-497a-babe-d4fd4af70188 service nova] Acquiring lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-bcf0d965-18a4-424d-9676-98fae09e13cd req-518d9ad1-721c-497a-babe-d4fd4af70188 service nova] Lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-bcf0d965-18a4-424d-9676-98fae09e13cd req-518d9ad1-721c-497a-babe-d4fd4af70188 service nova] Lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG nova.compute.manager [req-bcf0d965-18a4-424d-9676-98fae09e13cd req-518d9ad1-721c-497a-babe-d4fd4af70188 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] No waiting events found dispatching network-vif-unplugged-4f71d722-661a-44d6-81fa-cd588c0d6f4b {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG nova.compute.manager [req-bcf0d965-18a4-424d-9676-98fae09e13cd req-518d9ad1-721c-497a-babe-d4fd4af70188 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received event network-vif-unplugged-4f71d722-661a-44d6-81fa-cd588c0d6f4b for instance with task_state deleting. {{(pid=75341) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG nova.compute.manager [req-bcf0d965-18a4-424d-9676-98fae09e13cd req-518d9ad1-721c-497a-babe-d4fd4af70188 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received event network-vif-plugged-4f71d722-661a-44d6-81fa-cd588c0d6f4b {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-bcf0d965-18a4-424d-9676-98fae09e13cd req-518d9ad1-721c-497a-babe-d4fd4af70188 service nova] Acquiring lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-bcf0d965-18a4-424d-9676-98fae09e13cd req-518d9ad1-721c-497a-babe-d4fd4af70188 service nova] Lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-bcf0d965-18a4-424d-9676-98fae09e13cd req-518d9ad1-721c-497a-babe-d4fd4af70188 service nova] Lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG nova.compute.manager [req-bcf0d965-18a4-424d-9676-98fae09e13cd req-518d9ad1-721c-497a-babe-d4fd4af70188 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] No waiting events found dispatching network-vif-plugged-4f71d722-661a-44d6-81fa-cd588c0d6f4b {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:46:02 user nova-compute[75341]: WARNING nova.compute.manager [req-bcf0d965-18a4-424d-9676-98fae09e13cd req-518d9ad1-721c-497a-babe-d4fd4af70188 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received unexpected event network-vif-plugged-4f71d722-661a-44d6-81fa-cd588c0d6f4b for instance with vm_state active and task_state deleting.
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[94908f53-e901-4a29-a194-f14955d5a4c1]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7, portal: 172.16.0.220,3260]
Nov 14 23:46:02 user nova-compute[75341]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7, portal: 172.16.0.220,3260] successful.
Nov 14 23:46:02 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 -p 172.16.0.220:3260 --op delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98ea7106-6e3b-4aa5-9d18-051e15cc3ac7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37ba63b-5d6e-447a-ae8b-4c28f53c5fb6]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.383s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] <== disconnect_volume: return (385ms) None {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Disconnected iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] calling os-brick to detach iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, {'target_iqn': 'iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xpTSQODc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:46:02 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:46:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a5a89f7-1c9d-4a78-b9a4-906babab1172]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 23:46:02 user nova-compute[75341]: No targets found.
Nov 14 23:46:02 user nova-compute[75341]: iSNS:
Nov 14 23:46:02 user nova-compute[75341]: No targets found.
Nov 14 23:46:02 user nova-compute[75341]: STATIC:
Nov 14 23:46:02 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7
Nov 14 23:46:02 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:46:02 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:46:02 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3
Nov 14 23:46:02 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:46:02 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:46:02 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a
Nov 14 23:46:02 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:46:02 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:46:02 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c
Nov 14 23:46:02 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:46:02 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:46:02 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912
Nov 14 23:46:02 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:46:02 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:46:02 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d
Nov 14 23:46:02 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:46:02 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:46:02 user nova-compute[75341]: FIRMWARE:
Nov 14 23:46:02 user nova-compute[75341]: No targets found.
Nov 14 23:46:02 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 23:46:02 user nova-compute[75341]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 23:46:02 user nova-compute[75341]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75341) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a', 0)] {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0a6508-2f85-463a-8f88-995734e0d924]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b63ef5-055e-4f8c-8dac-f9489f05616e]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a (non-flash)
Nov 14 23:46:02 user nova-compute[75341]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 (non-flash)
Nov 14 23:46:02 user nova-compute[75341]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:46:02 user nova-compute[75341]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)
Nov 14 23:46:02 user nova-compute[75341]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)
Nov 14 23:46:02 user nova-compute[75341]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d (non-flash)
Nov 14 23:46:02 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a (non-flash)
Nov 14 23:46:02 user nova-compute[75341]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 (non-flash)
Nov 14 23:46:02 user nova-compute[75341]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:46:02 user nova-compute[75341]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)
Nov 14 23:46:02 user nova-compute[75341]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)
Nov 14 23:46:02 user nova-compute[75341]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d (non-flash)
Nov 14 23:46:02 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1890157b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a'): ({'sdf'}, set())}) {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Removing single pathed devices sdf {{(pid=75341) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2196d5-2725-4a2e-9a17-09da4d9e0eb4]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.028s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[7428cca3-699f-4064-b453-d8ce3f5616af]: (4, ('ok\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Flushing IO for device /dev/sdf {{(pid=75341) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG nova.compute.manager [req-9873e8fd-0b23-48c1-8472-8f1f3dd34d3d req-897d0b20-c048-4682-a21a-a83808149504 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received event network-vif-plugged-52e41618-df29-407f-8843-3e1c55fb2a18 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-9873e8fd-0b23-48c1-8472-8f1f3dd34d3d req-897d0b20-c048-4682-a21a-a83808149504 service nova] Acquiring lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-9873e8fd-0b23-48c1-8472-8f1f3dd34d3d req-897d0b20-c048-4682-a21a-a83808149504 service nova] Lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-9873e8fd-0b23-48c1-8472-8f1f3dd34d3d req-897d0b20-c048-4682-a21a-a83808149504 service nova] Lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG nova.compute.manager [req-9873e8fd-0b23-48c1-8472-8f1f3dd34d3d req-897d0b20-c048-4682-a21a-a83808149504 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] No waiting events found dispatching network-vif-plugged-52e41618-df29-407f-8843-3e1c55fb2a18 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:46:02 user nova-compute[75341]: WARNING nova.compute.manager [req-9873e8fd-0b23-48c1-8472-8f1f3dd34d3d req-897d0b20-c048-4682-a21a-a83808149504 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received unexpected event network-vif-plugged-52e41618-df29-407f-8843-3e1c55fb2a18 for instance with vm_state active and task_state deleting.
Nov 14 23:46:02 user nova-compute[75341]: DEBUG nova.compute.manager [req-9873e8fd-0b23-48c1-8472-8f1f3dd34d3d req-897d0b20-c048-4682-a21a-a83808149504 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received event network-vif-unplugged-6368ff99-db9d-4a3e-b940-afc0300d7aa0 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-9873e8fd-0b23-48c1-8472-8f1f3dd34d3d req-897d0b20-c048-4682-a21a-a83808149504 service nova] Acquiring lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-9873e8fd-0b23-48c1-8472-8f1f3dd34d3d req-897d0b20-c048-4682-a21a-a83808149504 service nova] Lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-9873e8fd-0b23-48c1-8472-8f1f3dd34d3d req-897d0b20-c048-4682-a21a-a83808149504 service nova] Lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG nova.compute.manager [req-9873e8fd-0b23-48c1-8472-8f1f3dd34d3d req-897d0b20-c048-4682-a21a-a83808149504 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] No waiting events found dispatching network-vif-unplugged-6368ff99-db9d-4a3e-b940-afc0300d7aa0 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG nova.compute.manager [req-9873e8fd-0b23-48c1-8472-8f1f3dd34d3d req-897d0b20-c048-4682-a21a-a83808149504 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received event network-vif-unplugged-6368ff99-db9d-4a3e-b940-afc0300d7aa0 for instance with task_state deleting. {{(pid=75341) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG nova.compute.manager [req-9873e8fd-0b23-48c1-8472-8f1f3dd34d3d req-897d0b20-c048-4682-a21a-a83808149504 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received event network-vif-plugged-6368ff99-db9d-4a3e-b940-afc0300d7aa0 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-9873e8fd-0b23-48c1-8472-8f1f3dd34d3d req-897d0b20-c048-4682-a21a-a83808149504 service nova] Acquiring lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-9873e8fd-0b23-48c1-8472-8f1f3dd34d3d req-897d0b20-c048-4682-a21a-a83808149504 service nova] Lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-9873e8fd-0b23-48c1-8472-8f1f3dd34d3d req-897d0b20-c048-4682-a21a-a83808149504 service nova] Lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG nova.compute.manager [req-9873e8fd-0b23-48c1-8472-8f1f3dd34d3d req-897d0b20-c048-4682-a21a-a83808149504 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] No waiting events found dispatching network-vif-plugged-6368ff99-db9d-4a3e-b940-afc0300d7aa0 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:46:02 user nova-compute[75341]: WARNING nova.compute.manager [req-9873e8fd-0b23-48c1-8472-8f1f3dd34d3d req-897d0b20-c048-4682-a21a-a83808149504 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received unexpected event network-vif-plugged-6368ff99-db9d-4a3e-b940-afc0300d7aa0 for instance with vm_state active and task_state deleting.
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d85453-aabb-43d6-b7bb-2f56e9629600]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75341) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.056s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[0efd2f95-a4d1-4d78-9580-1958e3913132]: (4, ('1', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] SCSI volumes sdf have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a')] {{(pid=75341) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[1564d4e8-b9af-43b9-9166-8191a85136a3]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a -p 172.16.0.220:3260 --logout {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[b873a515-6464-4531-8039-56486852756c]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a, portal: 172.16.0.220,3260]
Nov 14 23:46:02 user nova-compute[75341]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a, portal: 172.16.0.220,3260] successful.
Nov 14 23:46:02 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a -p 172.16.0.220:3260 --op delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:042bfbcb-fb28-4378-9754-8ecf4641438a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d4391f-fde4-49e0-a342-162798ead448]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] <== disconnect_volume: return (359ms) None {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Disconnected iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] calling os-brick to detach iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, {'target_iqn': 'iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RNtFXsiP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:46:02 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:46:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce041f57-7bc7-43dd-b71f-ad4c719d6d74]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 23:46:02 user nova-compute[75341]: No targets found.
Nov 14 23:46:02 user nova-compute[75341]: iSNS:
Nov 14 23:46:02 user nova-compute[75341]: No targets found.
Nov 14 23:46:02 user nova-compute[75341]: STATIC:
Nov 14 23:46:02 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7
Nov 14 23:46:02 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:46:02 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:46:02 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3
Nov 14 23:46:02 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:46:02 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:46:02 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c
Nov 14 23:46:02 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:46:02 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:46:02 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912
Nov 14 23:46:02 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:46:02 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:46:02 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d
Nov 14 23:46:02 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:46:02 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:46:02 user nova-compute[75341]: FIRMWARE:
Nov 14 23:46:02 user nova-compute[75341]: No targets found.
Nov 14 23:46:02 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 23:46:02 user nova-compute[75341]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 23:46:02 user nova-compute[75341]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75341) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912', 0)] {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[a211b460-d077-4407-afec-13bf926bc8f8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee8b524-99d1-48e1-b45e-c1cfbaccb9fa]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 (non-flash)
Nov 14 23:46:02 user nova-compute[75341]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:46:02 user nova-compute[75341]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)
Nov 14 23:46:02 user nova-compute[75341]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)
Nov 14 23:46:02 user nova-compute[75341]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d (non-flash)
Nov 14 23:46:02 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 (non-flash)
Nov 14 23:46:02 user nova-compute[75341]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:46:02 user nova-compute[75341]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)
Nov 14 23:46:02 user nova-compute[75341]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)
Nov 14 23:46:02 user nova-compute[75341]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d (non-flash)
Nov 14 23:46:02 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1890157b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912'): ({'sdg'}, set())}) {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Removing single pathed devices sdg {{(pid=75341) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[9791fb86-81dc-42ce-9bda-e0ea768b0d9c]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[854e3243-3396-4d33-b5e0-e9c650c114b3]: (4, ('ok\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Flushing IO for device /dev/sdg {{(pid=75341) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 23:46:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:03 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4865ed-f77e-4f40-b5dc-8eb0e1d2938b]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:46:03 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75341) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 23:46:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.042s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:03 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f03d153-00bd-4fd3-8d95-0ea2dccd7674]: (4, ('1', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:46:03 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 23:46:03 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] SCSI volumes sdg have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 23:46:03 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912')] {{(pid=75341) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 23:46:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:03 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[3401d246-7dc2-442a-9035-83b994c4e24a]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:46:03 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:46:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 -p 172.16.0.220:3260 --logout {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:03 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[4656b344-0bd6-4112-a9dc-e0e5eab62803]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:46:03 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912, portal: 172.16.0.220,3260]
Nov 14 23:46:03 user nova-compute[75341]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912, portal: 172.16.0.220,3260] successful.
Nov 14 23:46:03 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:46:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 -p 172.16.0.220:3260 --op delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3762dcbb-d796-4b60-a654-ae1973ad2912 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:03 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[620ff96c-e9b2-4774-8a80-8f7213215835]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:46:03 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:46:03 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:46:03 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] <== disconnect_volume: return (333ms) None {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:46:03 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Disconnected iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 23:46:03 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Deleting instance files /opt/stack/data/nova/instances/dbc9a6db-b536-426a-91fd-691a44c66528_del
Nov 14 23:46:03 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Deletion of /opt/stack/data/nova/instances/dbc9a6db-b536-426a-91fd-691a44c66528_del complete
Nov 14 23:46:03 user nova-compute[75341]: INFO nova.compute.manager [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Took 3.61 seconds to destroy the instance on the hypervisor.
Nov 14 23:46:03 user nova-compute[75341]: DEBUG oslo.service.loopingcall [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75341) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 23:46:03 user nova-compute[75341]: DEBUG nova.compute.manager [-] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Deallocating network for instance {{(pid=75341) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 23:46:03 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] deallocate_for_instance() {{(pid=75341) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 23:46:03 user nova-compute[75341]: DEBUG nova.compute.manager [req-da772850-2643-4758-9966-6e5285096d24 req-eeb13aa0-c4f3-4e36-a7bd-5bbde6aeacc8 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received event network-vif-plugged-1ad25d31-80fa-41ba-8a1c-73f01ac1c832 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:46:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-da772850-2643-4758-9966-6e5285096d24 req-eeb13aa0-c4f3-4e36-a7bd-5bbde6aeacc8 service nova] Acquiring lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-da772850-2643-4758-9966-6e5285096d24 req-eeb13aa0-c4f3-4e36-a7bd-5bbde6aeacc8 service nova] Lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-da772850-2643-4758-9966-6e5285096d24 req-eeb13aa0-c4f3-4e36-a7bd-5bbde6aeacc8 service nova] Lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:03 user nova-compute[75341]: DEBUG nova.compute.manager [req-da772850-2643-4758-9966-6e5285096d24 req-eeb13aa0-c4f3-4e36-a7bd-5bbde6aeacc8 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] No waiting events found dispatching network-vif-plugged-1ad25d31-80fa-41ba-8a1c-73f01ac1c832 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:46:03 user nova-compute[75341]: WARNING nova.compute.manager [req-da772850-2643-4758-9966-6e5285096d24 req-eeb13aa0-c4f3-4e36-a7bd-5bbde6aeacc8 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received unexpected event network-vif-plugged-1ad25d31-80fa-41ba-8a1c-73f01ac1c832 for instance with vm_state active and task_state deleting.
Nov 14 23:46:03 user nova-compute[75341]: DEBUG nova.compute.manager [req-da772850-2643-4758-9966-6e5285096d24 req-eeb13aa0-c4f3-4e36-a7bd-5bbde6aeacc8 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received event network-vif-unplugged-7b7251c7-1a54-46d9-9a9b-4103a659502c {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:46:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-da772850-2643-4758-9966-6e5285096d24 req-eeb13aa0-c4f3-4e36-a7bd-5bbde6aeacc8 service nova] Acquiring lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-da772850-2643-4758-9966-6e5285096d24 req-eeb13aa0-c4f3-4e36-a7bd-5bbde6aeacc8 service nova] Lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-da772850-2643-4758-9966-6e5285096d24 req-eeb13aa0-c4f3-4e36-a7bd-5bbde6aeacc8 service nova] Lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:03 user nova-compute[75341]: DEBUG nova.compute.manager [req-da772850-2643-4758-9966-6e5285096d24 req-eeb13aa0-c4f3-4e36-a7bd-5bbde6aeacc8 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] No waiting events found dispatching network-vif-unplugged-7b7251c7-1a54-46d9-9a9b-4103a659502c {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:46:03 user nova-compute[75341]: DEBUG nova.compute.manager [req-da772850-2643-4758-9966-6e5285096d24 req-eeb13aa0-c4f3-4e36-a7bd-5bbde6aeacc8 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received event network-vif-unplugged-7b7251c7-1a54-46d9-9a9b-4103a659502c for instance with task_state deleting. {{(pid=75341) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 23:46:03 user nova-compute[75341]: DEBUG nova.compute.manager [req-da772850-2643-4758-9966-6e5285096d24 req-eeb13aa0-c4f3-4e36-a7bd-5bbde6aeacc8 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received event network-vif-plugged-7b7251c7-1a54-46d9-9a9b-4103a659502c {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:46:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-da772850-2643-4758-9966-6e5285096d24 req-eeb13aa0-c4f3-4e36-a7bd-5bbde6aeacc8 service nova] Acquiring lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-da772850-2643-4758-9966-6e5285096d24 req-eeb13aa0-c4f3-4e36-a7bd-5bbde6aeacc8 service nova] Lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-da772850-2643-4758-9966-6e5285096d24 req-eeb13aa0-c4f3-4e36-a7bd-5bbde6aeacc8 service nova] Lock "dbc9a6db-b536-426a-91fd-691a44c66528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:03 user nova-compute[75341]: DEBUG nova.compute.manager [req-da772850-2643-4758-9966-6e5285096d24 req-eeb13aa0-c4f3-4e36-a7bd-5bbde6aeacc8 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] No waiting events found dispatching network-vif-plugged-7b7251c7-1a54-46d9-9a9b-4103a659502c {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:46:03 user nova-compute[75341]: WARNING nova.compute.manager [req-da772850-2643-4758-9966-6e5285096d24 req-eeb13aa0-c4f3-4e36-a7bd-5bbde6aeacc8 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received unexpected event network-vif-plugged-7b7251c7-1a54-46d9-9a9b-4103a659502c for instance with vm_state active and task_state deleting.
Nov 14 23:46:05 user nova-compute[75341]: DEBUG nova.compute.manager [req-7168b4c8-fac5-4f89-9bcb-d14667ec6559 req-0e3cf25b-f5da-4b68-9f45-b1a0708be53f service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received event network-vif-deleted-1ad25d31-80fa-41ba-8a1c-73f01ac1c832 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:46:05 user nova-compute[75341]: INFO nova.compute.manager [req-7168b4c8-fac5-4f89-9bcb-d14667ec6559 req-0e3cf25b-f5da-4b68-9f45-b1a0708be53f service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Neutron deleted interface 1ad25d31-80fa-41ba-8a1c-73f01ac1c832; detaching it from the instance and deleting it from the info cache
Nov 14 23:46:05 user nova-compute[75341]: DEBUG nova.network.neutron [req-7168b4c8-fac5-4f89-9bcb-d14667ec6559 req-0e3cf25b-f5da-4b68-9f45-b1a0708be53f service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Updating instance_info_cache with network_info: [{"id": "7b7251c7-1a54-46d9-9a9b-4103a659502c", "address": "fa:16:3e:b4:1d:7d", "network": {"id": "66be3b1a-ec5a-4c25-86fb-8350b80ce72d", "bridge": "br-int", "label": "tempest-device-tagging-net1-719453354", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b7251c7-1a", "ovs_interfaceid": "7b7251c7-1a54-46d9-9a9b-4103a659502c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0f140fc0-2078-47c4-985f-28a4ee8b2824", "address": "fa:16:3e:c6:94:07", "network": {"id": "66be3b1a-ec5a-4c25-86fb-8350b80ce72d", "bridge": "br-int", "label": "tempest-device-tagging-net1-719453354", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f140fc0-20", "ovs_interfaceid": "0f140fc0-2078-47c4-985f-28a4ee8b2824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f4b96195-ecba-4530-aa46-47e368eb294d", "address": "fa:16:3e:c1:9e:73", "network": {"id": "66be3b1a-ec5a-4c25-86fb-8350b80ce72d", "bridge": "br-int", "label": "tempest-device-tagging-net1-719453354", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4b96195-ec", "ovs_interfaceid": "f4b96195-ecba-4530-aa46-47e368eb294d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "52e41618-df29-407f-8843-3e1c55fb2a18", "address": "fa:16:3e:f9:73:7b", "network": {"id": "66be3b1a-ec5a-4c25-86fb-8350b80ce72d", "bridge": "br-int", "label": "tempest-device-tagging-net1-719453354", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e41618-df", "ovs_interfaceid": "52e41618-df29-407f-8843-3e1c55fb2a18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6368ff99-db9d-4a3e-b940-afc0300d7aa0", "address": "fa:16:3e:8a:4f:bb", "network": {"id": "21622931-8859-4310-85b4-e6c88ea4fd26", "bridge": "br-int", "label": "tempest-device-tagging-net2-1204896773", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6368ff99-db", "ovs_interfaceid": "6368ff99-db9d-4a3e-b940-afc0300d7aa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4f71d722-661a-44d6-81fa-cd588c0d6f4b", "address": "fa:16:3e:fe:bb:e6", "network": {"id": "21622931-8859-4310-85b4-e6c88ea4fd26", "bridge": "br-int", "label": "tempest-device-tagging-net2-1204896773", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f71d722-66", "ovs_interfaceid": "4f71d722-661a-44d6-81fa-cd588c0d6f4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:46:05 user nova-compute[75341]: DEBUG nova.compute.manager [req-7168b4c8-fac5-4f89-9bcb-d14667ec6559 req-0e3cf25b-f5da-4b68-9f45-b1a0708be53f service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Detach interface failed, port_id=1ad25d31-80fa-41ba-8a1c-73f01ac1c832, reason: Instance dbc9a6db-b536-426a-91fd-691a44c66528 could not be found. {{(pid=75341) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 23:46:05 user nova-compute[75341]: DEBUG nova.compute.manager [req-7168b4c8-fac5-4f89-9bcb-d14667ec6559 req-0e3cf25b-f5da-4b68-9f45-b1a0708be53f service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received event network-vif-deleted-6368ff99-db9d-4a3e-b940-afc0300d7aa0 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:46:05 user nova-compute[75341]: INFO nova.compute.manager [req-7168b4c8-fac5-4f89-9bcb-d14667ec6559 req-0e3cf25b-f5da-4b68-9f45-b1a0708be53f service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Neutron deleted interface 6368ff99-db9d-4a3e-b940-afc0300d7aa0; detaching it from the instance and deleting it from the info cache
Nov 14 23:46:05 user nova-compute[75341]: DEBUG nova.network.neutron [req-7168b4c8-fac5-4f89-9bcb-d14667ec6559 req-0e3cf25b-f5da-4b68-9f45-b1a0708be53f service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Updating instance_info_cache with network_info: [{"id": "7b7251c7-1a54-46d9-9a9b-4103a659502c", "address": "fa:16:3e:b4:1d:7d", "network": {"id": "66be3b1a-ec5a-4c25-86fb-8350b80ce72d", "bridge": "br-int", "label": "tempest-device-tagging-net1-719453354", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b7251c7-1a", "ovs_interfaceid": "7b7251c7-1a54-46d9-9a9b-4103a659502c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0f140fc0-2078-47c4-985f-28a4ee8b2824", "address": "fa:16:3e:c6:94:07", "network": {"id": "66be3b1a-ec5a-4c25-86fb-8350b80ce72d", "bridge": "br-int", "label": "tempest-device-tagging-net1-719453354", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f140fc0-20", "ovs_interfaceid": "0f140fc0-2078-47c4-985f-28a4ee8b2824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f4b96195-ecba-4530-aa46-47e368eb294d", "address": "fa:16:3e:c1:9e:73", "network": {"id": "66be3b1a-ec5a-4c25-86fb-8350b80ce72d", "bridge": "br-int", "label": "tempest-device-tagging-net1-719453354", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4b96195-ec", "ovs_interfaceid": "f4b96195-ecba-4530-aa46-47e368eb294d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "52e41618-df29-407f-8843-3e1c55fb2a18", "address": "fa:16:3e:f9:73:7b", "network": {"id": "66be3b1a-ec5a-4c25-86fb-8350b80ce72d", "bridge": "br-int", "label": "tempest-device-tagging-net1-719453354", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e41618-df", "ovs_interfaceid": "52e41618-df29-407f-8843-3e1c55fb2a18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4f71d722-661a-44d6-81fa-cd588c0d6f4b", "address": "fa:16:3e:fe:bb:e6", "network": {"id": "21622931-8859-4310-85b4-e6c88ea4fd26", "bridge": "br-int", "label": "tempest-device-tagging-net2-1204896773", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f71d722-66", "ovs_interfaceid": "4f71d722-661a-44d6-81fa-cd588c0d6f4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:46:05 user nova-compute[75341]: DEBUG nova.compute.manager [req-7168b4c8-fac5-4f89-9bcb-d14667ec6559 req-0e3cf25b-f5da-4b68-9f45-b1a0708be53f service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Detach interface failed, port_id=6368ff99-db9d-4a3e-b940-afc0300d7aa0, reason: Instance dbc9a6db-b536-426a-91fd-691a44c66528 could not be found. {{(pid=75341) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 23:46:05 user nova-compute[75341]: DEBUG nova.compute.manager [req-7168b4c8-fac5-4f89-9bcb-d14667ec6559 req-0e3cf25b-f5da-4b68-9f45-b1a0708be53f service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received event network-vif-deleted-4f71d722-661a-44d6-81fa-cd588c0d6f4b {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:46:05 user nova-compute[75341]: INFO nova.compute.manager [req-7168b4c8-fac5-4f89-9bcb-d14667ec6559 req-0e3cf25b-f5da-4b68-9f45-b1a0708be53f service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Neutron deleted interface 4f71d722-661a-44d6-81fa-cd588c0d6f4b; detaching it from the instance and deleting it from the info cache
Nov 14 23:46:05 user nova-compute[75341]: DEBUG nova.network.neutron [req-7168b4c8-fac5-4f89-9bcb-d14667ec6559 req-0e3cf25b-f5da-4b68-9f45-b1a0708be53f service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Updating instance_info_cache with network_info: [{"id": "7b7251c7-1a54-46d9-9a9b-4103a659502c", "address": "fa:16:3e:b4:1d:7d", "network": {"id": "66be3b1a-ec5a-4c25-86fb-8350b80ce72d", "bridge": "br-int", "label": "tempest-device-tagging-net1-719453354", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b7251c7-1a", "ovs_interfaceid": "7b7251c7-1a54-46d9-9a9b-4103a659502c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0f140fc0-2078-47c4-985f-28a4ee8b2824", "address": "fa:16:3e:c6:94:07", "network": {"id": "66be3b1a-ec5a-4c25-86fb-8350b80ce72d", "bridge": "br-int", "label": "tempest-device-tagging-net1-719453354", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f140fc0-20", "ovs_interfaceid": "0f140fc0-2078-47c4-985f-28a4ee8b2824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f4b96195-ecba-4530-aa46-47e368eb294d", "address": "fa:16:3e:c1:9e:73", "network": {"id": "66be3b1a-ec5a-4c25-86fb-8350b80ce72d", "bridge": "br-int", "label": "tempest-device-tagging-net1-719453354", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4b96195-ec", "ovs_interfaceid": "f4b96195-ecba-4530-aa46-47e368eb294d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "52e41618-df29-407f-8843-3e1c55fb2a18", "address": "fa:16:3e:f9:73:7b", "network": {"id": "66be3b1a-ec5a-4c25-86fb-8350b80ce72d", "bridge": "br-int", "label": "tempest-device-tagging-net1-719453354", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c40c4897cbbd4ac8b3192eb149adcb41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e41618-df", "ovs_interfaceid": "52e41618-df29-407f-8843-3e1c55fb2a18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:46:05 user nova-compute[75341]: DEBUG nova.compute.manager [req-7168b4c8-fac5-4f89-9bcb-d14667ec6559 req-0e3cf25b-f5da-4b68-9f45-b1a0708be53f service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Detach interface failed, port_id=4f71d722-661a-44d6-81fa-cd588c0d6f4b, reason: Instance dbc9a6db-b536-426a-91fd-691a44c66528 could not be found. {{(pid=75341) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 23:46:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:06 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:46:06 user nova-compute[75341]: INFO nova.compute.manager [-] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Took 3.11 seconds to deallocate network for instance.
Nov 14 23:46:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:07 user nova-compute[75341]: DEBUG nova.compute.manager [req-c39fc01f-a65f-49c4-80c8-3cf769581f47 req-ae36edac-4399-4be8-b93e-da21e6a073e6 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received event network-vif-deleted-f4b96195-ecba-4530-aa46-47e368eb294d {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:46:07 user nova-compute[75341]: DEBUG nova.compute.manager [req-c39fc01f-a65f-49c4-80c8-3cf769581f47 req-ae36edac-4399-4be8-b93e-da21e6a073e6 service nova] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Received event network-vif-deleted-52e41618-df29-407f-8843-3e1c55fb2a18 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:46:08 user nova-compute[75341]: INFO nova.compute.manager [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] [instance: dbc9a6db-b536-426a-91fd-691a44c66528] Took 2.21 seconds to detach 3 volumes for instance.
Nov 14 23:46:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:08 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:46:08 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:46:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.360s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:09 user nova-compute[75341]: INFO nova.scheduler.client.report [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Deleted allocations for instance dbc9a6db-b536-426a-91fd-691a44c66528
Nov 14 23:46:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-49d444e4-661e-4954-a9df-13d345472c46 tempest-TaggedBootDevicesTest_v242-1944630985 tempest-TaggedBootDevicesTest_v242-1944630985-project-member] Lock "dbc9a6db-b536-426a-91fd-691a44c66528" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.492s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:10 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Acquiring lock "5070fb03-8f40-426c-8c3e-192f6517f7c3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:10 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Lock "5070fb03-8f40-426c-8c3e-192f6517f7c3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:10 user nova-compute[75341]: DEBUG nova.compute.manager [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Starting instance... {{(pid=75341) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 23:46:10 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:46:11 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Triggering sync for uuid 881351d7-31f9-44f4-8571-8f540bbec29c {{(pid=75341) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 23:46:11 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Triggering sync for uuid a141d7ee-3f77-4fdc-85ec-2cbd5af17646 {{(pid=75341) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 23:46:11 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Triggering sync for uuid 51045050-c7c6-49c5-acd4-2a76be0f466f {{(pid=75341) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 23:46:11 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Triggering sync for uuid 6382e432-838f-4d89-a743-cbaa37f50ab5 {{(pid=75341) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 23:46:11 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Triggering sync for uuid d92ba9df-c739-414d-a701-ddba04563427 {{(pid=75341) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 23:46:11 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Triggering sync for uuid 6a0e67fc-942b-4f05-a6ee-0987944f17da {{(pid=75341) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 23:46:11 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Triggering sync for uuid 896ee337-80bf-47c3-9530-861c941a2fc6 {{(pid=75341) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 23:46:11 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Triggering sync for uuid c8aa0b26-4099-4a8d-afce-a1e990e5b1f7 {{(pid=75341) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 23:46:11 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Triggering sync for uuid a308a35f-c8d7-482c-a93d-5d9eb473d4e1 {{(pid=75341) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 23:46:11 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Triggering sync for uuid 0223a98e-e08f-4a0f-a707-3770c7a99b00 {{(pid=75341) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 23:46:11 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Triggering sync for uuid cffc86d5-2ac6-4dd1-bdcd-5832c134d179 {{(pid=75341) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 23:46:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "881351d7-31f9-44f4-8571-8f540bbec29c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "881351d7-31f9-44f4-8571-8f540bbec29c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "a141d7ee-3f77-4fdc-85ec-2cbd5af17646" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "a141d7ee-3f77-4fdc-85ec-2cbd5af17646" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "51045050-c7c6-49c5-acd4-2a76be0f466f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "51045050-c7c6-49c5-acd4-2a76be0f466f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "6382e432-838f-4d89-a743-cbaa37f50ab5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "6382e432-838f-4d89-a743-cbaa37f50ab5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "d92ba9df-c739-414d-a701-ddba04563427" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "d92ba9df-c739-414d-a701-ddba04563427" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "6a0e67fc-942b-4f05-a6ee-0987944f17da" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "6a0e67fc-942b-4f05-a6ee-0987944f17da" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "896ee337-80bf-47c3-9530-861c941a2fc6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "896ee337-80bf-47c3-9530-861c941a2fc6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "c8aa0b26-4099-4a8d-afce-a1e990e5b1f7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "c8aa0b26-4099-4a8d-afce-a1e990e5b1f7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "a308a35f-c8d7-482c-a93d-5d9eb473d4e1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "a308a35f-c8d7-482c-a93d-5d9eb473d4e1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "0223a98e-e08f-4a0f-a707-3770c7a99b00" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "0223a98e-e08f-4a0f-a707-3770c7a99b00" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "cffc86d5-2ac6-4dd1-bdcd-5832c134d179" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "cffc86d5-2ac6-4dd1-bdcd-5832c134d179" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:11 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75341) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 23:46:11 user nova-compute[75341]: INFO nova.compute.claims [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Claim successful on node user
Nov 14 23:46:11 user nova-compute[75341]: WARNING oslo_messaging._drivers.amqpdriver [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20
Nov 14 23:46:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "881351d7-31f9-44f4-8571-8f540bbec29c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.089s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "6382e432-838f-4d89-a743-cbaa37f50ab5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.089s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "51045050-c7c6-49c5-acd4-2a76be0f466f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.103s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "0223a98e-e08f-4a0f-a707-3770c7a99b00" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.101s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "6a0e67fc-942b-4f05-a6ee-0987944f17da" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.104s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "896ee337-80bf-47c3-9530-861c941a2fc6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.105s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "a141d7ee-3f77-4fdc-85ec-2cbd5af17646" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.122s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "cffc86d5-2ac6-4dd1-bdcd-5832c134d179" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.117s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "d92ba9df-c739-414d-a701-ddba04563427" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.124s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "a308a35f-c8d7-482c-a93d-5d9eb473d4e1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.135s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "c8aa0b26-4099-4a8d-afce-a1e990e5b1f7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.139s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:11 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:11 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:46:11 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:46:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.486s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:11 user nova-compute[75341]: DEBUG nova.compute.manager [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Start building networks asynchronously for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 23:46:11 user nova-compute[75341]: DEBUG nova.compute.manager [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Allocating IP information in the background. {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 23:46:11 user nova-compute[75341]: DEBUG nova.network.neutron [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] allocate_for_instance() {{(pid=75341) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 23:46:11 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 23:46:11 user nova-compute[75341]: DEBUG nova.compute.manager [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Start building block device mappings for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 23:46:11 user nova-compute[75341]: DEBUG nova.policy [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1bea063034a84067bd8645aecfe3560d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af462be688d4127a8368ee3dcb2a340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75341) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 23:46:11 user nova-compute[75341]: DEBUG nova.compute.manager [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Start spawning the instance on the hypervisor. {{(pid=75341) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 23:46:11 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Creating instance directory {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 23:46:11 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Creating image(s)
Nov 14 23:46:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Acquiring lock "/opt/stack/data/nova/instances/5070fb03-8f40-426c-8c3e-192f6517f7c3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Lock "/opt/stack/data/nova/instances/5070fb03-8f40-426c-8c3e-192f6517f7c3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Lock "/opt/stack/data/nova/instances/5070fb03-8f40-426c-8c3e-192f6517f7c3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:11 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:11 user nova-compute[75341]: INFO nova.compute.manager [None req-b45f5423-a952-42b4-ae0b-9e611ec81652 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Rescuing
Nov 14 23:46:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b45f5423-a952-42b4-ae0b-9e611ec81652 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Acquiring lock "refresh_cache-6382e432-838f-4d89-a743-cbaa37f50ab5" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:46:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b45f5423-a952-42b4-ae0b-9e611ec81652 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Acquired lock "refresh_cache-6382e432-838f-4d89-a743-cbaa37f50ab5" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:46:11 user nova-compute[75341]: DEBUG nova.network.neutron [None req-b45f5423-a952-42b4-ae0b-9e611ec81652 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 23:46:11 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.182s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Acquiring lock "4754efee9a6d73d3647f2add2cfe86c291949740" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:11 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.170s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/5070fb03-8f40-426c-8c3e-192f6517f7c3/disk 1073741824 {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/5070fb03-8f40-426c-8c3e-192f6517f7c3/disk 1073741824" returned: 0 in 0.058s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:12 user nova-compute[75341]: DEBUG nova.network.neutron [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Successfully created port: 59640fb6-107f-4eec-90ec-730997028287 {{(pid=75341) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 23:46:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.186s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:12 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5070fb03-8f40-426c-8c3e-192f6517f7c3/disk. size=1073741824 {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 23:46:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5070fb03-8f40-426c-8c3e-192f6517f7c3/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:12 user nova-compute[75341]: DEBUG nova.network.neutron [None req-b45f5423-a952-42b4-ae0b-9e611ec81652 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Updating instance_info_cache with network_info: [{"id": "61a9a4a7-170b-4ed9-8d52-8cb4defd1cae", "address": "fa:16:3e:0c:42:07", "network": {"id": "fcd22da6-016e-4872-a84c-4d82601c48d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-550677181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44bb8b1415c14bb59c4c35cc2b830875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61a9a4a7-17", "ovs_interfaceid": "61a9a4a7-170b-4ed9-8d52-8cb4defd1cae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:46:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b45f5423-a952-42b4-ae0b-9e611ec81652 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Releasing lock "refresh_cache-6382e432-838f-4d89-a743-cbaa37f50ab5" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:46:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5070fb03-8f40-426c-8c3e-192f6517f7c3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:12 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Cannot resize image /opt/stack/data/nova/instances/5070fb03-8f40-426c-8c3e-192f6517f7c3/disk to a smaller size. {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 23:46:12 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Created local disks {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 23:46:12 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Ensure instance console log exists: /opt/stack/data/nova/instances/5070fb03-8f40-426c-8c3e-192f6517f7c3/console.log {{(pid=75341) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 23:46:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:12 user nova-compute[75341]: DEBUG nova.compute.manager [req-9fe92028-c772-419c-a736-720d36c2da9c req-c6eec885-9746-4168-9fce-29167e53f826 service nova] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Received event network-vif-unplugged-61a9a4a7-170b-4ed9-8d52-8cb4defd1cae {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:46:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-9fe92028-c772-419c-a736-720d36c2da9c req-c6eec885-9746-4168-9fce-29167e53f826 service nova] Acquiring lock "6382e432-838f-4d89-a743-cbaa37f50ab5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-9fe92028-c772-419c-a736-720d36c2da9c req-c6eec885-9746-4168-9fce-29167e53f826 service nova] Lock "6382e432-838f-4d89-a743-cbaa37f50ab5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-9fe92028-c772-419c-a736-720d36c2da9c req-c6eec885-9746-4168-9fce-29167e53f826 service nova] Lock "6382e432-838f-4d89-a743-cbaa37f50ab5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:12 user nova-compute[75341]: DEBUG nova.compute.manager [req-9fe92028-c772-419c-a736-720d36c2da9c req-c6eec885-9746-4168-9fce-29167e53f826 service nova] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] No waiting events found dispatching network-vif-unplugged-61a9a4a7-170b-4ed9-8d52-8cb4defd1cae {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:46:12 user nova-compute[75341]: WARNING nova.compute.manager [req-9fe92028-c772-419c-a736-720d36c2da9c req-c6eec885-9746-4168-9fce-29167e53f826 service nova] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Received unexpected event network-vif-unplugged-61a9a4a7-170b-4ed9-8d52-8cb4defd1cae for instance with vm_state active and task_state rescuing.
Nov 14 23:46:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:12 user nova-compute[75341]: DEBUG nova.network.neutron [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Successfully updated port: 59640fb6-107f-4eec-90ec-730997028287 {{(pid=75341) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 23:46:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Acquiring lock "refresh_cache-5070fb03-8f40-426c-8c3e-192f6517f7c3" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:46:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Acquired lock "refresh_cache-5070fb03-8f40-426c-8c3e-192f6517f7c3" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:46:12 user nova-compute[75341]: DEBUG nova.network.neutron [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 23:46:12 user nova-compute[75341]: DEBUG nova.compute.manager [req-db1ad7de-e241-4576-a234-045d10af1da8 req-b68467ef-52aa-4690-8539-a2384ca3fce4 service nova] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Received event network-changed-59640fb6-107f-4eec-90ec-730997028287 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:46:12 user nova-compute[75341]: DEBUG nova.compute.manager [req-db1ad7de-e241-4576-a234-045d10af1da8 req-b68467ef-52aa-4690-8539-a2384ca3fce4 service nova] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Refreshing instance network info cache due to event network-changed-59640fb6-107f-4eec-90ec-730997028287. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:46:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-db1ad7de-e241-4576-a234-045d10af1da8 req-b68467ef-52aa-4690-8539-a2384ca3fce4 service nova] Acquiring lock "refresh_cache-5070fb03-8f40-426c-8c3e-192f6517f7c3" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:46:12 user nova-compute[75341]: DEBUG nova.network.neutron [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Instance cache missing network info. {{(pid=75341) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 23:46:13 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Instance destroyed successfully.
Nov 14 23:46:13 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-b45f5423-a952-42b4-ae0b-9e611ec81652 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Attempting rescue
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b45f5423-a952-42b4-ae0b-9e611ec81652 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75341) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b45f5423-a952-42b4-ae0b-9e611ec81652 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Instance directory exists: not creating {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 23:46:13 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-b45f5423-a952-42b4-ae0b-9e611ec81652 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Creating image(s)
Nov 14 23:46:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b45f5423-a952-42b4-ae0b-9e611ec81652 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Acquiring lock "/opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b45f5423-a952-42b4-ae0b-9e611ec81652 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "/opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b45f5423-a952-42b4-ae0b-9e611ec81652 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "/opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.objects.instance [None req-b45f5423-a952-42b4-ae0b-9e611ec81652 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6382e432-838f-4d89-a743-cbaa37f50ab5 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b45f5423-a952-42b4-ae0b-9e611ec81652 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Acquiring lock "4754efee9a6d73d3647f2add2cfe86c291949740" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b45f5423-a952-42b4-ae0b-9e611ec81652 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-b45f5423-a952-42b4-ae0b-9e611ec81652 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.network.neutron [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Updating instance_info_cache with network_info: [{"id": "59640fb6-107f-4eec-90ec-730997028287", "address": "fa:16:3e:9e:2f:c0", "network": {"id": "e9abba2c-7994-4781-a3ca-07e8e4be7825", "bridge": "br-int", "label": "tempest-TestStampPattern-1410971761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af462be688d4127a8368ee3dcb2a340", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59640fb6-10", "ovs_interfaceid": "59640fb6-107f-4eec-90ec-730997028287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Releasing lock "refresh_cache-5070fb03-8f40-426c-8c3e-192f6517f7c3" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.compute.manager [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Instance network_info: |[{"id": "59640fb6-107f-4eec-90ec-730997028287", "address": "fa:16:3e:9e:2f:c0", "network": {"id": "e9abba2c-7994-4781-a3ca-07e8e4be7825", "bridge": "br-int", "label": "tempest-TestStampPattern-1410971761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af462be688d4127a8368ee3dcb2a340", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59640fb6-10", "ovs_interfaceid": "59640fb6-107f-4eec-90ec-730997028287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-db1ad7de-e241-4576-a234-045d10af1da8 req-b68467ef-52aa-4690-8539-a2384ca3fce4 service nova] Acquired lock "refresh_cache-5070fb03-8f40-426c-8c3e-192f6517f7c3" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.network.neutron [req-db1ad7de-e241-4576-a234-045d10af1da8 req-b68467ef-52aa-4690-8539-a2384ca3fce4 service nova] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Refreshing network info cache for port 59640fb6-107f-4eec-90ec-730997028287 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Start _get_guest_xml network_info=[{"id": "59640fb6-107f-4eec-90ec-730997028287", "address": "fa:16:3e:9e:2f:c0", "network": {"id": "e9abba2c-7994-4781-a3ca-07e8e4be7825", "bridge": "br-int", "label": "tempest-TestStampPattern-1410971761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af462be688d4127a8368ee3dcb2a340", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59640fb6-10", "ovs_interfaceid": "59640fb6-107f-4eec-90ec-730997028287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encrypted': False, 'image_id': 'e46abb82-b810-490e-a8a1-ccdc5fa1a796'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 23:46:13 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:46:13 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:46:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-691673290',display_name='tempest-TestStampPattern-server-691673290',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-691673290',id=23,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3k4a6947+jIKLvmTnCELFNO1dnVN6DgXq9Xj0CmQaSvYB0hJlJ042GniTnSgjACK17rkv4NlkLk+t1g4KrW1PNXrKxIcV24jCAaqde0p0EUk9jn7Pe6DP8ihh+nNZNxg==',key_name='tempest-TestStampPattern-1455376223',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0af462be688d4127a8368ee3dcb2a340',ramdisk_id='',reservation_id='r-2znjrp9g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1579449792',owner_user_name='tempest-TestStampPattern-1579449792-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:46:12Z,user_data=None,user_id='1bea063034a84067bd8645aecfe3560d',uuid=5070fb03-8f40-426c-8c3e-192f6517f7c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59640fb6-107f-4eec-90ec-730997028287", "address": "fa:16:3e:9e:2f:c0", "network": {"id": "e9abba2c-7994-4781-a3ca-07e8e4be7825", "bridge": "br-int", "label": "tempest-TestStampPattern-1410971761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af462be688d4127a8368ee3dcb2a340", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59640fb6-10", "ovs_interfaceid": "59640fb6-107f-4eec-90ec-730997028287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Converting VIF {"id": "59640fb6-107f-4eec-90ec-730997028287", "address": "fa:16:3e:9e:2f:c0", "network": {"id": "e9abba2c-7994-4781-a3ca-07e8e4be7825", "bridge": "br-int", "label": "tempest-TestStampPattern-1410971761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af462be688d4127a8368ee3dcb2a340", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59640fb6-10", "ovs_interfaceid": "59640fb6-107f-4eec-90ec-730997028287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:2f:c0,bridge_name='br-int',has_traffic_filtering=True,id=59640fb6-107f-4eec-90ec-730997028287,network=Network(e9abba2c-7994-4781-a3ca-07e8e4be7825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59640fb6-10') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.objects.instance [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Lazy-loading 'pci_devices' on Instance uuid 5070fb03-8f40-426c-8c3e-192f6517f7c3 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-b45f5423-a952-42b4-ae0b-9e611ec81652 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.198s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-b45f5423-a952-42b4-ae0b-9e611ec81652 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk.rescue {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] End _get_guest_xml xml=<domain type="kvm">
Nov 14 23:46:13 user nova-compute[75341]:   <uuid>5070fb03-8f40-426c-8c3e-192f6517f7c3</uuid>
Nov 14 23:46:13 user nova-compute[75341]:   <name>instance-00000017</name>
Nov 14 23:46:13 user nova-compute[75341]:   <memory>524288</memory>
Nov 14 23:46:13 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 14 23:46:13 user nova-compute[75341]:   <metadata>
Nov 14 23:46:13 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 23:46:13 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 14 23:46:13 user nova-compute[75341]:       <nova:name>tempest-TestStampPattern-server-691673290</nova:name>
Nov 14 23:46:13 user nova-compute[75341]:       <nova:creationTime>2023-11-14 23:46:13</nova:creationTime>
Nov 14 23:46:13 user nova-compute[75341]:       <nova:flavor name="m1.tiny">
Nov 14 23:46:13 user nova-compute[75341]:         <nova:memory>512</nova:memory>
Nov 14 23:46:13 user nova-compute[75341]:         <nova:disk>1</nova:disk>
Nov 14 23:46:13 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 14 23:46:13 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 23:46:13 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 14 23:46:13 user nova-compute[75341]:       </nova:flavor>
Nov 14 23:46:13 user nova-compute[75341]:       <nova:owner>
Nov 14 23:46:13 user nova-compute[75341]:         <nova:user uuid="1bea063034a84067bd8645aecfe3560d">tempest-TestStampPattern-1579449792-project-member</nova:user>
Nov 14 23:46:13 user nova-compute[75341]:         <nova:project uuid="0af462be688d4127a8368ee3dcb2a340">tempest-TestStampPattern-1579449792</nova:project>
Nov 14 23:46:13 user nova-compute[75341]:       </nova:owner>
Nov 14 23:46:13 user nova-compute[75341]:       <nova:root type="image" uuid="e46abb82-b810-490e-a8a1-ccdc5fa1a796"/>
Nov 14 23:46:13 user nova-compute[75341]:       <nova:ports>
Nov 14 23:46:13 user nova-compute[75341]:         <nova:port uuid="59640fb6-107f-4eec-90ec-730997028287">
Nov 14 23:46:13 user nova-compute[75341]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 23:46:13 user nova-compute[75341]:         </nova:port>
Nov 14 23:46:13 user nova-compute[75341]:       </nova:ports>
Nov 14 23:46:13 user nova-compute[75341]:     </nova:instance>
Nov 14 23:46:13 user nova-compute[75341]:   </metadata>
Nov 14 23:46:13 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 14 23:46:13 user nova-compute[75341]:     <system>
Nov 14 23:46:13 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 23:46:13 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 14 23:46:13 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 14 23:46:13 user nova-compute[75341]:       <entry name="serial">5070fb03-8f40-426c-8c3e-192f6517f7c3</entry>
Nov 14 23:46:13 user nova-compute[75341]:       <entry name="uuid">5070fb03-8f40-426c-8c3e-192f6517f7c3</entry>
Nov 14 23:46:13 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 14 23:46:13 user nova-compute[75341]:     </system>
Nov 14 23:46:13 user nova-compute[75341]:   </sysinfo>
Nov 14 23:46:13 user nova-compute[75341]:   <os>
Nov 14 23:46:13 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 23:46:13 user nova-compute[75341]:     <boot dev="hd"/>
Nov 14 23:46:13 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 14 23:46:13 user nova-compute[75341]:   </os>
Nov 14 23:46:13 user nova-compute[75341]:   <features>
Nov 14 23:46:13 user nova-compute[75341]:     <acpi/>
Nov 14 23:46:13 user nova-compute[75341]:     <apic/>
Nov 14 23:46:13 user nova-compute[75341]:     <vmcoreinfo/>
Nov 14 23:46:13 user nova-compute[75341]:   </features>
Nov 14 23:46:13 user nova-compute[75341]:   <clock offset="utc">
Nov 14 23:46:13 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 23:46:13 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 23:46:13 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 14 23:46:13 user nova-compute[75341]:   </clock>
Nov 14 23:46:13 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 14 23:46:13 user nova-compute[75341]:     <model>Nehalem</model>
Nov 14 23:46:13 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 23:46:13 user nova-compute[75341]:   </cpu>
Nov 14 23:46:13 user nova-compute[75341]:   <devices>
Nov 14 23:46:13 user nova-compute[75341]:     <disk type="file" device="disk">
Nov 14 23:46:13 user nova-compute[75341]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 23:46:13 user nova-compute[75341]:       <source file="/opt/stack/data/nova/instances/5070fb03-8f40-426c-8c3e-192f6517f7c3/disk"/>
Nov 14 23:46:13 user nova-compute[75341]:       <target dev="vda" bus="virtio"/>
Nov 14 23:46:13 user nova-compute[75341]:     </disk>
Nov 14 23:46:13 user nova-compute[75341]:     <interface type="ethernet">
Nov 14 23:46:13 user nova-compute[75341]:       <mac address="fa:16:3e:9e:2f:c0"/>
Nov 14 23:46:13 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:46:13 user nova-compute[75341]:       <mtu size="1442"/>
Nov 14 23:46:13 user nova-compute[75341]:       <target dev="tap59640fb6-10"/>
Nov 14 23:46:13 user nova-compute[75341]:     </interface>
Nov 14 23:46:13 user nova-compute[75341]:     <serial type="pty">
Nov 14 23:46:13 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/5070fb03-8f40-426c-8c3e-192f6517f7c3/console.log" append="off"/>
Nov 14 23:46:13 user nova-compute[75341]:     </serial>
Nov 14 23:46:13 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 23:46:13 user nova-compute[75341]:     <video>
Nov 14 23:46:13 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:46:13 user nova-compute[75341]:     </video>
Nov 14 23:46:13 user nova-compute[75341]:     <rng model="virtio">
Nov 14 23:46:13 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 14 23:46:13 user nova-compute[75341]:     </rng>
Nov 14 23:46:13 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 14 23:46:13 user nova-compute[75341]:     <memballoon model="virtio">
Nov 14 23:46:13 user nova-compute[75341]:       <stats period="10"/>
Nov 14 23:46:13 user nova-compute[75341]:     </memballoon>
Nov 14 23:46:13 user nova-compute[75341]:   </devices>
Nov 14 23:46:13 user nova-compute[75341]: </domain>
Nov 14 23:46:13 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:46:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-691673290',display_name='tempest-TestStampPattern-server-691673290',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-691673290',id=23,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3k4a6947+jIKLvmTnCELFNO1dnVN6DgXq9Xj0CmQaSvYB0hJlJ042GniTnSgjACK17rkv4NlkLk+t1g4KrW1PNXrKxIcV24jCAaqde0p0EUk9jn7Pe6DP8ihh+nNZNxg==',key_name='tempest-TestStampPattern-1455376223',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0af462be688d4127a8368ee3dcb2a340',ramdisk_id='',reservation_id='r-2znjrp9g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1579449792',owner_user_name='tempest-TestStampPattern-1579449792-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:46:12Z,user_data=None,user_id='1bea063034a84067bd8645aecfe3560d',uuid=5070fb03-8f40-426c-8c3e-192f6517f7c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59640fb6-107f-4eec-90ec-730997028287", "address": "fa:16:3e:9e:2f:c0", "network": {"id": "e9abba2c-7994-4781-a3ca-07e8e4be7825", "bridge": "br-int", "label": "tempest-TestStampPattern-1410971761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af462be688d4127a8368ee3dcb2a340", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59640fb6-10", "ovs_interfaceid": "59640fb6-107f-4eec-90ec-730997028287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Converting VIF {"id": "59640fb6-107f-4eec-90ec-730997028287", "address": "fa:16:3e:9e:2f:c0", "network": {"id": "e9abba2c-7994-4781-a3ca-07e8e4be7825", "bridge": "br-int", "label": "tempest-TestStampPattern-1410971761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af462be688d4127a8368ee3dcb2a340", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59640fb6-10", "ovs_interfaceid": "59640fb6-107f-4eec-90ec-730997028287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:2f:c0,bridge_name='br-int',has_traffic_filtering=True,id=59640fb6-107f-4eec-90ec-730997028287,network=Network(e9abba2c-7994-4781-a3ca-07e8e4be7825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59640fb6-10') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG os_vif [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:2f:c0,bridge_name='br-int',has_traffic_filtering=True,id=59640fb6-107f-4eec-90ec-730997028287,network=Network(e9abba2c-7994-4781-a3ca-07e8e4be7825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59640fb6-10') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ad205935-89e1-5280-925b-b0f6b38d2725', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-b45f5423-a952-42b4-ae0b-9e611ec81652 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk.rescue" returned: 0 in 0.069s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b45f5423-a952-42b4-ae0b-9e611ec81652 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.objects.instance [None req-b45f5423-a952-42b4-ae0b-9e611ec81652 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lazy-loading 'migration_context' on Instance uuid 6382e432-838f-4d89-a743-cbaa37f50ab5 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.objects.base [None req-b45f5423-a952-42b4-ae0b-9e611ec81652 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Object Instance<6382e432-838f-4d89-a743-cbaa37f50ab5> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75341) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b45f5423-a952-42b4-ae0b-9e611ec81652 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Created local disks {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b45f5423-a952-42b4-ae0b-9e611ec81652 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Start _get_guest_xml network_info=[{"id": "61a9a4a7-170b-4ed9-8d52-8cb4defd1cae", "address": "fa:16:3e:0c:42:07", "network": {"id": "fcd22da6-016e-4872-a84c-4d82601c48d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-550677181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-550677181-network", "vif_mac": "fa:16:3e:0c:42:07"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44bb8b1415c14bb59c4c35cc2b830875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61a9a4a7-17", "ovs_interfaceid": "61a9a4a7-170b-4ed9-8d52-8cb4defd1cae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e46abb82-b810-490e-a8a1-ccdc5fa1a796', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.objects.instance [None req-b45f5423-a952-42b4-ae0b-9e611ec81652 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lazy-loading 'resources' on Instance uuid 6382e432-838f-4d89-a743-cbaa37f50ab5 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap59640fb6-10, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap59640fb6-10, col_values=(('qos', UUID('87597d7d-93fe-4e36-9a12-2ae691798a6d')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap59640fb6-10, col_values=(('external_ids', {'iface-id': '59640fb6-107f-4eec-90ec-730997028287', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:2f:c0', 'vm-uuid': '5070fb03-8f40-426c-8c3e-192f6517f7c3'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.objects.base [None req-b45f5423-a952-42b4-ae0b-9e611ec81652 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Object Instance<6382e432-838f-4d89-a743-cbaa37f50ab5> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75341) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.objects.instance [None req-b45f5423-a952-42b4-ae0b-9e611ec81652 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lazy-loading 'numa_topology' on Instance uuid 6382e432-838f-4d89-a743-cbaa37f50ab5 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.objects.base [None req-b45f5423-a952-42b4-ae0b-9e611ec81652 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Object Instance<6382e432-838f-4d89-a743-cbaa37f50ab5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75341) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:13 user nova-compute[75341]: INFO os_vif [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:2f:c0,bridge_name='br-int',has_traffic_filtering=True,id=59640fb6-107f-4eec-90ec-730997028287,network=Network(e9abba2c-7994-4781-a3ca-07e8e4be7825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59640fb6-10')
Nov 14 23:46:13 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-b45f5423-a952-42b4-ae0b-9e611ec81652 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:46:13 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-b45f5423-a952-42b4-ae0b-9e611ec81652 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-b45f5423-a952-42b4-ae0b-9e611ec81652 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-b45f5423-a952-42b4-ae0b-9e611ec81652 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-b45f5423-a952-42b4-ae0b-9e611ec81652 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-b45f5423-a952-42b4-ae0b-9e611ec81652 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b45f5423-a952-42b4-ae0b-9e611ec81652 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-b45f5423-a952-42b4-ae0b-9e611ec81652 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-b45f5423-a952-42b4-ae0b-9e611ec81652 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-b45f5423-a952-42b4-ae0b-9e611ec81652 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-b45f5423-a952-42b4-ae0b-9e611ec81652 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-b45f5423-a952-42b4-ae0b-9e611ec81652 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-b45f5423-a952-42b4-ae0b-9e611ec81652 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-b45f5423-a952-42b4-ae0b-9e611ec81652 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-b45f5423-a952-42b4-ae0b-9e611ec81652 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-b45f5423-a952-42b4-ae0b-9e611ec81652 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-b45f5423-a952-42b4-ae0b-9e611ec81652 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-b45f5423-a952-42b4-ae0b-9e611ec81652 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.objects.instance [None req-b45f5423-a952-42b4-ae0b-9e611ec81652 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6382e432-838f-4d89-a743-cbaa37f50ab5 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.objects.base [None req-b45f5423-a952-42b4-ae0b-9e611ec81652 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Object Instance<6382e432-838f-4d89-a743-cbaa37f50ab5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75341) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-b45f5423-a952-42b4-ae0b-9e611ec81652 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:44:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-774340686',display_name='tempest-ServerRescueNegativeTestJSON-server-774340686',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-774340686',id=18,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:44:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='44bb8b1415c14bb59c4c35cc2b830875',ramdisk_id='',reservation_id='r-je794ae3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1956631656',owner_user_name='tempest-ServerRescueNegativeTestJSON-1956631656-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:44:31Z,user_data=None,user_id='3c49a358e2f942f3a9777910ee755575',uuid=6382e432-838f-4d89-a743-cbaa37f50ab5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "61a9a4a7-170b-4ed9-8d52-8cb4defd1cae", "address": "fa:16:3e:0c:42:07", "network": {"id": "fcd22da6-016e-4872-a84c-4d82601c48d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-550677181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-550677181-network", "vif_mac": "fa:16:3e:0c:42:07"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44bb8b1415c14bb59c4c35cc2b830875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61a9a4a7-17", "ovs_interfaceid": "61a9a4a7-170b-4ed9-8d52-8cb4defd1cae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-b45f5423-a952-42b4-ae0b-9e611ec81652 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Converting VIF {"id": "61a9a4a7-170b-4ed9-8d52-8cb4defd1cae", "address": "fa:16:3e:0c:42:07", "network": {"id": "fcd22da6-016e-4872-a84c-4d82601c48d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-550677181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-550677181-network", "vif_mac": "fa:16:3e:0c:42:07"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44bb8b1415c14bb59c4c35cc2b830875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61a9a4a7-17", "ovs_interfaceid": "61a9a4a7-170b-4ed9-8d52-8cb4defd1cae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-b45f5423-a952-42b4-ae0b-9e611ec81652 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:42:07,bridge_name='br-int',has_traffic_filtering=True,id=61a9a4a7-170b-4ed9-8d52-8cb4defd1cae,network=Network(fcd22da6-016e-4872-a84c-4d82601c48d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61a9a4a7-17') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.objects.instance [None req-b45f5423-a952-42b4-ae0b-9e611ec81652 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lazy-loading 'pci_devices' on Instance uuid 6382e432-838f-4d89-a743-cbaa37f50ab5 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.objects.base [None req-b45f5423-a952-42b4-ae0b-9e611ec81652 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Object Instance<6382e432-838f-4d89-a743-cbaa37f50ab5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75341) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b45f5423-a952-42b4-ae0b-9e611ec81652 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] End _get_guest_xml xml=<domain type="kvm">
Nov 14 23:46:13 user nova-compute[75341]:   <uuid>6382e432-838f-4d89-a743-cbaa37f50ab5</uuid>
Nov 14 23:46:13 user nova-compute[75341]:   <name>instance-00000012</name>
Nov 14 23:46:13 user nova-compute[75341]:   <memory>524288</memory>
Nov 14 23:46:13 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 14 23:46:13 user nova-compute[75341]:   <metadata>
Nov 14 23:46:13 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 23:46:13 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 14 23:46:13 user nova-compute[75341]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-774340686</nova:name>
Nov 14 23:46:13 user nova-compute[75341]:       <nova:creationTime>2023-11-14 23:46:13</nova:creationTime>
Nov 14 23:46:13 user nova-compute[75341]:       <nova:flavor name="m1.tiny">
Nov 14 23:46:13 user nova-compute[75341]:         <nova:memory>512</nova:memory>
Nov 14 23:46:13 user nova-compute[75341]:         <nova:disk>1</nova:disk>
Nov 14 23:46:13 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 14 23:46:13 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 23:46:13 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 14 23:46:13 user nova-compute[75341]:       </nova:flavor>
Nov 14 23:46:13 user nova-compute[75341]:       <nova:owner>
Nov 14 23:46:13 user nova-compute[75341]:         <nova:user uuid="3c49a358e2f942f3a9777910ee755575">tempest-ServerRescueNegativeTestJSON-1956631656-project-member</nova:user>
Nov 14 23:46:13 user nova-compute[75341]:         <nova:project uuid="44bb8b1415c14bb59c4c35cc2b830875">tempest-ServerRescueNegativeTestJSON-1956631656</nova:project>
Nov 14 23:46:13 user nova-compute[75341]:       </nova:owner>
Nov 14 23:46:13 user nova-compute[75341]:       <nova:root type="image" uuid="e46abb82-b810-490e-a8a1-ccdc5fa1a796"/>
Nov 14 23:46:13 user nova-compute[75341]:       <nova:ports>
Nov 14 23:46:13 user nova-compute[75341]:         <nova:port uuid="61a9a4a7-170b-4ed9-8d52-8cb4defd1cae">
Nov 14 23:46:13 user nova-compute[75341]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 23:46:13 user nova-compute[75341]:         </nova:port>
Nov 14 23:46:13 user nova-compute[75341]:       </nova:ports>
Nov 14 23:46:13 user nova-compute[75341]:     </nova:instance>
Nov 14 23:46:13 user nova-compute[75341]:   </metadata>
Nov 14 23:46:13 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 14 23:46:13 user nova-compute[75341]:     <system>
Nov 14 23:46:13 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 23:46:13 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 14 23:46:13 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 14 23:46:13 user nova-compute[75341]:       <entry name="serial">6382e432-838f-4d89-a743-cbaa37f50ab5</entry>
Nov 14 23:46:13 user nova-compute[75341]:       <entry name="uuid">6382e432-838f-4d89-a743-cbaa37f50ab5</entry>
Nov 14 23:46:13 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 14 23:46:13 user nova-compute[75341]:     </system>
Nov 14 23:46:13 user nova-compute[75341]:   </sysinfo>
Nov 14 23:46:13 user nova-compute[75341]:   <os>
Nov 14 23:46:13 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 23:46:13 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 14 23:46:13 user nova-compute[75341]:   </os>
Nov 14 23:46:13 user nova-compute[75341]:   <features>
Nov 14 23:46:13 user nova-compute[75341]:     <acpi/>
Nov 14 23:46:13 user nova-compute[75341]:     <apic/>
Nov 14 23:46:13 user nova-compute[75341]:     <vmcoreinfo/>
Nov 14 23:46:13 user nova-compute[75341]:   </features>
Nov 14 23:46:13 user nova-compute[75341]:   <clock offset="utc">
Nov 14 23:46:13 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 23:46:13 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 23:46:13 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 14 23:46:13 user nova-compute[75341]:   </clock>
Nov 14 23:46:13 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 14 23:46:13 user nova-compute[75341]:     <model>Nehalem</model>
Nov 14 23:46:13 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 23:46:13 user nova-compute[75341]:   </cpu>
Nov 14 23:46:13 user nova-compute[75341]:   <devices>
Nov 14 23:46:13 user nova-compute[75341]:     <disk type="file" device="disk">
Nov 14 23:46:13 user nova-compute[75341]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 23:46:13 user nova-compute[75341]:       <source file="/opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk.rescue"/>
Nov 14 23:46:13 user nova-compute[75341]:       <target dev="vda" bus="virtio"/>
Nov 14 23:46:13 user nova-compute[75341]:     </disk>
Nov 14 23:46:13 user nova-compute[75341]:     <disk type="file" device="disk">
Nov 14 23:46:13 user nova-compute[75341]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 23:46:13 user nova-compute[75341]:       <source file="/opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk"/>
Nov 14 23:46:13 user nova-compute[75341]:       <target dev="vdb" bus="virtio"/>
Nov 14 23:46:13 user nova-compute[75341]:     </disk>
Nov 14 23:46:13 user nova-compute[75341]:     <interface type="ethernet">
Nov 14 23:46:13 user nova-compute[75341]:       <mac address="fa:16:3e:0c:42:07"/>
Nov 14 23:46:13 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:46:13 user nova-compute[75341]:       <mtu size="1442"/>
Nov 14 23:46:13 user nova-compute[75341]:       <target dev="tap61a9a4a7-17"/>
Nov 14 23:46:13 user nova-compute[75341]:     </interface>
Nov 14 23:46:13 user nova-compute[75341]:     <serial type="pty">
Nov 14 23:46:13 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/console.log" append="off"/>
Nov 14 23:46:13 user nova-compute[75341]:     </serial>
Nov 14 23:46:13 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 23:46:13 user nova-compute[75341]:     <video>
Nov 14 23:46:13 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:46:13 user nova-compute[75341]:     </video>
Nov 14 23:46:13 user nova-compute[75341]:     <rng model="virtio">
Nov 14 23:46:13 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 14 23:46:13 user nova-compute[75341]:     </rng>
Nov 14 23:46:13 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 14 23:46:13 user nova-compute[75341]:     <memballoon model="virtio">
Nov 14 23:46:13 user nova-compute[75341]:       <stats period="10"/>
Nov 14 23:46:13 user nova-compute[75341]:     </memballoon>
Nov 14 23:46:13 user nova-compute[75341]:   </devices>
Nov 14 23:46:13 user nova-compute[75341]: </domain>
Nov 14 23:46:13 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] No VIF found with MAC fa:16:3e:9e:2f:c0, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:46:13 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Instance destroyed successfully.
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b45f5423-a952-42b4-ae0b-9e611ec81652 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b45f5423-a952-42b4-ae0b-9e611ec81652 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b45f5423-a952-42b4-ae0b-9e611ec81652 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] No VIF found with MAC fa:16:3e:0c:42:07, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.network.neutron [req-db1ad7de-e241-4576-a234-045d10af1da8 req-b68467ef-52aa-4690-8539-a2384ca3fce4 service nova] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Updated VIF entry in instance network info cache for port 59640fb6-107f-4eec-90ec-730997028287. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG nova.network.neutron [req-db1ad7de-e241-4576-a234-045d10af1da8 req-b68467ef-52aa-4690-8539-a2384ca3fce4 service nova] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Updating instance_info_cache with network_info: [{"id": "59640fb6-107f-4eec-90ec-730997028287", "address": "fa:16:3e:9e:2f:c0", "network": {"id": "e9abba2c-7994-4781-a3ca-07e8e4be7825", "bridge": "br-int", "label": "tempest-TestStampPattern-1410971761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af462be688d4127a8368ee3dcb2a340", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59640fb6-10", "ovs_interfaceid": "59640fb6-107f-4eec-90ec-730997028287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:46:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-db1ad7de-e241-4576-a234-045d10af1da8 req-b68467ef-52aa-4690-8539-a2384ca3fce4 service nova] Releasing lock "refresh_cache-5070fb03-8f40-426c-8c3e-192f6517f7c3" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:46:14 user nova-compute[75341]: DEBUG nova.compute.manager [req-58f6ddfa-bcbf-4ab5-8e4e-2034b4763cae req-7a41287f-473d-40d2-b661-7a298f02f78d service nova] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Received event network-vif-plugged-61a9a4a7-170b-4ed9-8d52-8cb4defd1cae {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:46:14 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-58f6ddfa-bcbf-4ab5-8e4e-2034b4763cae req-7a41287f-473d-40d2-b661-7a298f02f78d service nova] Acquiring lock "6382e432-838f-4d89-a743-cbaa37f50ab5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:14 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-58f6ddfa-bcbf-4ab5-8e4e-2034b4763cae req-7a41287f-473d-40d2-b661-7a298f02f78d service nova] Lock "6382e432-838f-4d89-a743-cbaa37f50ab5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:14 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-58f6ddfa-bcbf-4ab5-8e4e-2034b4763cae req-7a41287f-473d-40d2-b661-7a298f02f78d service nova] Lock "6382e432-838f-4d89-a743-cbaa37f50ab5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:14 user nova-compute[75341]: DEBUG nova.compute.manager [req-58f6ddfa-bcbf-4ab5-8e4e-2034b4763cae req-7a41287f-473d-40d2-b661-7a298f02f78d service nova] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] No waiting events found dispatching network-vif-plugged-61a9a4a7-170b-4ed9-8d52-8cb4defd1cae {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:46:14 user nova-compute[75341]: WARNING nova.compute.manager [req-58f6ddfa-bcbf-4ab5-8e4e-2034b4763cae req-7a41287f-473d-40d2-b661-7a298f02f78d service nova] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Received unexpected event network-vif-plugged-61a9a4a7-170b-4ed9-8d52-8cb4defd1cae for instance with vm_state active and task_state rescuing.
Nov 14 23:46:15 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:15 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:15 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:15 user nova-compute[75341]: DEBUG nova.compute.manager [req-7614f672-9441-4c58-b98d-05731b30a9f0 req-671902c6-1933-4d62-bfc1-362cdaf374d5 service nova] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Received event network-vif-plugged-59640fb6-107f-4eec-90ec-730997028287 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:46:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-7614f672-9441-4c58-b98d-05731b30a9f0 req-671902c6-1933-4d62-bfc1-362cdaf374d5 service nova] Acquiring lock "5070fb03-8f40-426c-8c3e-192f6517f7c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-7614f672-9441-4c58-b98d-05731b30a9f0 req-671902c6-1933-4d62-bfc1-362cdaf374d5 service nova] Lock "5070fb03-8f40-426c-8c3e-192f6517f7c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-7614f672-9441-4c58-b98d-05731b30a9f0 req-671902c6-1933-4d62-bfc1-362cdaf374d5 service nova] Lock "5070fb03-8f40-426c-8c3e-192f6517f7c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:15 user nova-compute[75341]: DEBUG nova.compute.manager [req-7614f672-9441-4c58-b98d-05731b30a9f0 req-671902c6-1933-4d62-bfc1-362cdaf374d5 service nova] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] No waiting events found dispatching network-vif-plugged-59640fb6-107f-4eec-90ec-730997028287 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:46:15 user nova-compute[75341]: WARNING nova.compute.manager [req-7614f672-9441-4c58-b98d-05731b30a9f0 req-671902c6-1933-4d62-bfc1-362cdaf374d5 service nova] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Received unexpected event network-vif-plugged-59640fb6-107f-4eec-90ec-730997028287 for instance with vm_state building and task_state spawning.
Nov 14 23:46:15 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:15 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:16 user nova-compute[75341]: DEBUG nova.compute.manager [req-04d809ad-0450-4598-9257-2e86b9d57a68 req-9e833bd2-2dfb-44a2-8b44-c1a2daf1ffc4 service nova] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Received event network-vif-plugged-61a9a4a7-170b-4ed9-8d52-8cb4defd1cae {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:46:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-04d809ad-0450-4598-9257-2e86b9d57a68 req-9e833bd2-2dfb-44a2-8b44-c1a2daf1ffc4 service nova] Acquiring lock "6382e432-838f-4d89-a743-cbaa37f50ab5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-04d809ad-0450-4598-9257-2e86b9d57a68 req-9e833bd2-2dfb-44a2-8b44-c1a2daf1ffc4 service nova] Lock "6382e432-838f-4d89-a743-cbaa37f50ab5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-04d809ad-0450-4598-9257-2e86b9d57a68 req-9e833bd2-2dfb-44a2-8b44-c1a2daf1ffc4 service nova] Lock "6382e432-838f-4d89-a743-cbaa37f50ab5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:16 user nova-compute[75341]: DEBUG nova.compute.manager [req-04d809ad-0450-4598-9257-2e86b9d57a68 req-9e833bd2-2dfb-44a2-8b44-c1a2daf1ffc4 service nova] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] No waiting events found dispatching network-vif-plugged-61a9a4a7-170b-4ed9-8d52-8cb4defd1cae {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:46:16 user nova-compute[75341]: WARNING nova.compute.manager [req-04d809ad-0450-4598-9257-2e86b9d57a68 req-9e833bd2-2dfb-44a2-8b44-c1a2daf1ffc4 service nova] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Received unexpected event network-vif-plugged-61a9a4a7-170b-4ed9-8d52-8cb4defd1cae for instance with vm_state active and task_state rescuing.
Nov 14 23:46:16 user nova-compute[75341]: DEBUG nova.compute.manager [req-04d809ad-0450-4598-9257-2e86b9d57a68 req-9e833bd2-2dfb-44a2-8b44-c1a2daf1ffc4 service nova] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Received event network-vif-plugged-61a9a4a7-170b-4ed9-8d52-8cb4defd1cae {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:46:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-04d809ad-0450-4598-9257-2e86b9d57a68 req-9e833bd2-2dfb-44a2-8b44-c1a2daf1ffc4 service nova] Acquiring lock "6382e432-838f-4d89-a743-cbaa37f50ab5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-04d809ad-0450-4598-9257-2e86b9d57a68 req-9e833bd2-2dfb-44a2-8b44-c1a2daf1ffc4 service nova] Lock "6382e432-838f-4d89-a743-cbaa37f50ab5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-04d809ad-0450-4598-9257-2e86b9d57a68 req-9e833bd2-2dfb-44a2-8b44-c1a2daf1ffc4 service nova] Lock "6382e432-838f-4d89-a743-cbaa37f50ab5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:16 user nova-compute[75341]: DEBUG nova.compute.manager [req-04d809ad-0450-4598-9257-2e86b9d57a68 req-9e833bd2-2dfb-44a2-8b44-c1a2daf1ffc4 service nova] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] No waiting events found dispatching network-vif-plugged-61a9a4a7-170b-4ed9-8d52-8cb4defd1cae {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:46:16 user nova-compute[75341]: WARNING nova.compute.manager [req-04d809ad-0450-4598-9257-2e86b9d57a68 req-9e833bd2-2dfb-44a2-8b44-c1a2daf1ffc4 service nova] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Received unexpected event network-vif-plugged-61a9a4a7-170b-4ed9-8d52-8cb4defd1cae for instance with vm_state active and task_state rescuing.
Nov 14 23:46:17 user nova-compute[75341]: DEBUG nova.compute.manager [req-6c7ee2da-0f41-48b6-a225-e26b5cdb8978 req-8503e743-cf5e-4dd6-aaef-440f9a292a98 service nova] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Received event network-vif-plugged-59640fb6-107f-4eec-90ec-730997028287 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:46:17 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6c7ee2da-0f41-48b6-a225-e26b5cdb8978 req-8503e743-cf5e-4dd6-aaef-440f9a292a98 service nova] Acquiring lock "5070fb03-8f40-426c-8c3e-192f6517f7c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:17 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6c7ee2da-0f41-48b6-a225-e26b5cdb8978 req-8503e743-cf5e-4dd6-aaef-440f9a292a98 service nova] Lock "5070fb03-8f40-426c-8c3e-192f6517f7c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:17 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6c7ee2da-0f41-48b6-a225-e26b5cdb8978 req-8503e743-cf5e-4dd6-aaef-440f9a292a98 service nova] Lock "5070fb03-8f40-426c-8c3e-192f6517f7c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:17 user nova-compute[75341]: DEBUG nova.compute.manager [req-6c7ee2da-0f41-48b6-a225-e26b5cdb8978 req-8503e743-cf5e-4dd6-aaef-440f9a292a98 service nova] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] No waiting events found dispatching network-vif-plugged-59640fb6-107f-4eec-90ec-730997028287 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:46:17 user nova-compute[75341]: WARNING nova.compute.manager [req-6c7ee2da-0f41-48b6-a225-e26b5cdb8978 req-8503e743-cf5e-4dd6-aaef-440f9a292a98 service nova] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Received unexpected event network-vif-plugged-59640fb6-107f-4eec-90ec-730997028287 for instance with vm_state building and task_state spawning.
Nov 14 23:46:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:18 user nova-compute[75341]: DEBUG nova.compute.manager [None req-b45f5423-a952-42b4-ae0b-9e611ec81652 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 23:46:18 user nova-compute[75341]: DEBUG nova.compute.manager [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Instance event wait completed in 0 seconds for  {{(pid=75341) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 23:46:18 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Guest created on hypervisor {{(pid=75341) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 23:46:18 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Instance spawned successfully.
Nov 14 23:46:18 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 23:46:18 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Found default for hw_cdrom_bus of ide {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:46:18 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Found default for hw_disk_bus of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:46:18 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Found default for hw_input_bus of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:46:18 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Found default for hw_pointer_model of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:46:18 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Found default for hw_video_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:46:18 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Found default for hw_vif_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:46:18 user nova-compute[75341]: INFO nova.compute.manager [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Took 6.80 seconds to spawn the instance on the hypervisor.
Nov 14 23:46:18 user nova-compute[75341]: DEBUG nova.compute.manager [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 23:46:18 user nova-compute[75341]: INFO nova.compute.manager [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Took 7.60 seconds to build instance.
Nov 14 23:46:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6e50f2cd-c713-4916-98c7-7d42a73a1abe tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Lock "5070fb03-8f40-426c-8c3e-192f6517f7c3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.708s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:19 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1bbfcdb5-5ce2-4f5a-b219-900a1bb9306a tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Acquiring lock "a308a35f-c8d7-482c-a93d-5d9eb473d4e1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:19 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1bbfcdb5-5ce2-4f5a-b219-900a1bb9306a tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "a308a35f-c8d7-482c-a93d-5d9eb473d4e1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:19 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1bbfcdb5-5ce2-4f5a-b219-900a1bb9306a tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Acquiring lock "a308a35f-c8d7-482c-a93d-5d9eb473d4e1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:19 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1bbfcdb5-5ce2-4f5a-b219-900a1bb9306a tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "a308a35f-c8d7-482c-a93d-5d9eb473d4e1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:19 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1bbfcdb5-5ce2-4f5a-b219-900a1bb9306a tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "a308a35f-c8d7-482c-a93d-5d9eb473d4e1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:19 user nova-compute[75341]: INFO nova.compute.manager [None req-1bbfcdb5-5ce2-4f5a-b219-900a1bb9306a tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Terminating instance
Nov 14 23:46:19 user nova-compute[75341]: DEBUG nova.compute.manager [None req-1bbfcdb5-5ce2-4f5a-b219-900a1bb9306a tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Start destroying the instance on the hypervisor. {{(pid=75341) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 23:46:19 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:19 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:19 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:19 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:19 user nova-compute[75341]: DEBUG nova.compute.manager [req-a42d4593-e83e-4b2e-ac73-5dbb1435da91 req-94a95843-6962-45bb-a310-6969a8eaf6e7 service nova] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Received event network-vif-unplugged-4f1d8292-7392-4939-9303-437dc108b4a4 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:46:19 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a42d4593-e83e-4b2e-ac73-5dbb1435da91 req-94a95843-6962-45bb-a310-6969a8eaf6e7 service nova] Acquiring lock "a308a35f-c8d7-482c-a93d-5d9eb473d4e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:19 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a42d4593-e83e-4b2e-ac73-5dbb1435da91 req-94a95843-6962-45bb-a310-6969a8eaf6e7 service nova] Lock "a308a35f-c8d7-482c-a93d-5d9eb473d4e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:19 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a42d4593-e83e-4b2e-ac73-5dbb1435da91 req-94a95843-6962-45bb-a310-6969a8eaf6e7 service nova] Lock "a308a35f-c8d7-482c-a93d-5d9eb473d4e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:19 user nova-compute[75341]: DEBUG nova.compute.manager [req-a42d4593-e83e-4b2e-ac73-5dbb1435da91 req-94a95843-6962-45bb-a310-6969a8eaf6e7 service nova] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] No waiting events found dispatching network-vif-unplugged-4f1d8292-7392-4939-9303-437dc108b4a4 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:46:19 user nova-compute[75341]: DEBUG nova.compute.manager [req-a42d4593-e83e-4b2e-ac73-5dbb1435da91 req-94a95843-6962-45bb-a310-6969a8eaf6e7 service nova] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Received event network-vif-unplugged-4f1d8292-7392-4939-9303-437dc108b4a4 for instance with task_state deleting. {{(pid=75341) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 23:46:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:20 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Instance destroyed successfully.
Nov 14 23:46:20 user nova-compute[75341]: DEBUG nova.objects.instance [None req-1bbfcdb5-5ce2-4f5a-b219-900a1bb9306a tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lazy-loading 'resources' on Instance uuid a308a35f-c8d7-482c-a93d-5d9eb473d4e1 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:46:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:20 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-1bbfcdb5-5ce2-4f5a-b219-900a1bb9306a tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T23:39:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-173111556',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-173111556',id=3,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0Mg2JrUiYyfg6677+2Zv9Zqfgif2/3/pm4zugiZs2hm3xmaZY7SDs9SySwEI9I4Xie+mX5Zi6rK0j32qh+7Hye8jW21rtlODM9AFIkTLXzgrChX2YVLtprZJUc0cBR9g==',key_name='tempest-keypair-2143336801',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:43:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5f27e41f4cc1451291b8aca34544867b',ramdisk_id='',reservation_id='r-w2ae1nv0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-946394493',owner_user_name='tempest-AttachVolumeShelveTestJSON-946394493-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:43:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38acd33ad6754965a53017185f473f8a',uuid=a308a35f-c8d7-482c-a93d-5d9eb473d4e1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4f1d8292-7392-4939-9303-437dc108b4a4", "address": "fa:16:3e:be:2c:ef", "network": {"id": "e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-64240219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f27e41f4cc1451291b8aca34544867b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f1d8292-73", "ovs_interfaceid": "4f1d8292-7392-4939-9303-437dc108b4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 23:46:20 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-1bbfcdb5-5ce2-4f5a-b219-900a1bb9306a tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Converting VIF {"id": "4f1d8292-7392-4939-9303-437dc108b4a4", "address": "fa:16:3e:be:2c:ef", "network": {"id": "e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-64240219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f27e41f4cc1451291b8aca34544867b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f1d8292-73", "ovs_interfaceid": "4f1d8292-7392-4939-9303-437dc108b4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:46:20 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-1bbfcdb5-5ce2-4f5a-b219-900a1bb9306a tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:2c:ef,bridge_name='br-int',has_traffic_filtering=True,id=4f1d8292-7392-4939-9303-437dc108b4a4,network=Network(e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f1d8292-73') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:46:20 user nova-compute[75341]: DEBUG os_vif [None req-1bbfcdb5-5ce2-4f5a-b219-900a1bb9306a tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:2c:ef,bridge_name='br-int',has_traffic_filtering=True,id=4f1d8292-7392-4939-9303-437dc108b4a4,network=Network(e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f1d8292-73') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 23:46:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4f1d8292-73, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:46:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c629b9c7-00bd-43f9-ba40-7b85a7f08f4e) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:46:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:46:20 user nova-compute[75341]: INFO os_vif [None req-1bbfcdb5-5ce2-4f5a-b219-900a1bb9306a tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:2c:ef,bridge_name='br-int',has_traffic_filtering=True,id=4f1d8292-7392-4939-9303-437dc108b4a4,network=Network(e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f1d8292-73')
Nov 14 23:46:20 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-1bbfcdb5-5ce2-4f5a-b219-900a1bb9306a tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Deleting instance files /opt/stack/data/nova/instances/a308a35f-c8d7-482c-a93d-5d9eb473d4e1_del
Nov 14 23:46:20 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-1bbfcdb5-5ce2-4f5a-b219-900a1bb9306a tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Deletion of /opt/stack/data/nova/instances/a308a35f-c8d7-482c-a93d-5d9eb473d4e1_del complete
Nov 14 23:46:20 user nova-compute[75341]: INFO nova.compute.manager [None req-1bbfcdb5-5ce2-4f5a-b219-900a1bb9306a tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Took 1.10 seconds to destroy the instance on the hypervisor.
Nov 14 23:46:20 user nova-compute[75341]: DEBUG oslo.service.loopingcall [None req-1bbfcdb5-5ce2-4f5a-b219-900a1bb9306a tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75341) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 23:46:20 user nova-compute[75341]: DEBUG nova.compute.manager [-] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Deallocating network for instance {{(pid=75341) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 23:46:20 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] deallocate_for_instance() {{(pid=75341) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 23:46:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:21 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:21 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:21 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:21 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:21 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:21 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:21 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:46:21 user nova-compute[75341]: INFO nova.compute.manager [-] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Took 0.84 seconds to deallocate network for instance.
Nov 14 23:46:21 user nova-compute[75341]: DEBUG nova.compute.manager [req-60318c23-8133-4b77-9166-d745cf0514f8 req-fce7c36a-b180-485e-9f59-48b4e180ab67 service nova] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Received event network-vif-deleted-4f1d8292-7392-4939-9303-437dc108b4a4 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:46:21 user nova-compute[75341]: INFO nova.compute.manager [req-60318c23-8133-4b77-9166-d745cf0514f8 req-fce7c36a-b180-485e-9f59-48b4e180ab67 service nova] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Neutron deleted interface 4f1d8292-7392-4939-9303-437dc108b4a4; detaching it from the instance and deleting it from the info cache
Nov 14 23:46:21 user nova-compute[75341]: DEBUG nova.network.neutron [req-60318c23-8133-4b77-9166-d745cf0514f8 req-fce7c36a-b180-485e-9f59-48b4e180ab67 service nova] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:46:21 user nova-compute[75341]: DEBUG nova.compute.manager [req-60318c23-8133-4b77-9166-d745cf0514f8 req-fce7c36a-b180-485e-9f59-48b4e180ab67 service nova] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Detach interface failed, port_id=4f1d8292-7392-4939-9303-437dc108b4a4, reason: Instance a308a35f-c8d7-482c-a93d-5d9eb473d4e1 could not be found. {{(pid=75341) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 23:46:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1bbfcdb5-5ce2-4f5a-b219-900a1bb9306a tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1bbfcdb5-5ce2-4f5a-b219-900a1bb9306a tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:21 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-1bbfcdb5-5ce2-4f5a-b219-900a1bb9306a tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:46:21 user nova-compute[75341]: DEBUG nova.compute.manager [req-bc1a46ae-539b-4557-8e07-e1f81a24d62c req-b45e62da-6d89-42cd-987f-2927a123972a service nova] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Received event network-vif-plugged-4f1d8292-7392-4939-9303-437dc108b4a4 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:46:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-bc1a46ae-539b-4557-8e07-e1f81a24d62c req-b45e62da-6d89-42cd-987f-2927a123972a service nova] Acquiring lock "a308a35f-c8d7-482c-a93d-5d9eb473d4e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-bc1a46ae-539b-4557-8e07-e1f81a24d62c req-b45e62da-6d89-42cd-987f-2927a123972a service nova] Lock "a308a35f-c8d7-482c-a93d-5d9eb473d4e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-bc1a46ae-539b-4557-8e07-e1f81a24d62c req-b45e62da-6d89-42cd-987f-2927a123972a service nova] Lock "a308a35f-c8d7-482c-a93d-5d9eb473d4e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:21 user nova-compute[75341]: DEBUG nova.compute.manager [req-bc1a46ae-539b-4557-8e07-e1f81a24d62c req-b45e62da-6d89-42cd-987f-2927a123972a service nova] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] No waiting events found dispatching network-vif-plugged-4f1d8292-7392-4939-9303-437dc108b4a4 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:46:21 user nova-compute[75341]: WARNING nova.compute.manager [req-bc1a46ae-539b-4557-8e07-e1f81a24d62c req-b45e62da-6d89-42cd-987f-2927a123972a service nova] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Received unexpected event network-vif-plugged-4f1d8292-7392-4939-9303-437dc108b4a4 for instance with vm_state deleted and task_state None.
Nov 14 23:46:21 user nova-compute[75341]: DEBUG nova.compute.manager [req-bc1a46ae-539b-4557-8e07-e1f81a24d62c req-b45e62da-6d89-42cd-987f-2927a123972a service nova] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Received event network-vif-plugged-4f1d8292-7392-4939-9303-437dc108b4a4 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:46:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-bc1a46ae-539b-4557-8e07-e1f81a24d62c req-b45e62da-6d89-42cd-987f-2927a123972a service nova] Acquiring lock "a308a35f-c8d7-482c-a93d-5d9eb473d4e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-bc1a46ae-539b-4557-8e07-e1f81a24d62c req-b45e62da-6d89-42cd-987f-2927a123972a service nova] Lock "a308a35f-c8d7-482c-a93d-5d9eb473d4e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-bc1a46ae-539b-4557-8e07-e1f81a24d62c req-b45e62da-6d89-42cd-987f-2927a123972a service nova] Lock "a308a35f-c8d7-482c-a93d-5d9eb473d4e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:21 user nova-compute[75341]: DEBUG nova.compute.manager [req-bc1a46ae-539b-4557-8e07-e1f81a24d62c req-b45e62da-6d89-42cd-987f-2927a123972a service nova] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] No waiting events found dispatching network-vif-plugged-4f1d8292-7392-4939-9303-437dc108b4a4 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:46:21 user nova-compute[75341]: WARNING nova.compute.manager [req-bc1a46ae-539b-4557-8e07-e1f81a24d62c req-b45e62da-6d89-42cd-987f-2927a123972a service nova] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Received unexpected event network-vif-plugged-4f1d8292-7392-4939-9303-437dc108b4a4 for instance with vm_state deleted and task_state None.
Nov 14 23:46:21 user nova-compute[75341]: DEBUG nova.compute.manager [req-bc1a46ae-539b-4557-8e07-e1f81a24d62c req-b45e62da-6d89-42cd-987f-2927a123972a service nova] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Received event network-vif-plugged-4f1d8292-7392-4939-9303-437dc108b4a4 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:46:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-bc1a46ae-539b-4557-8e07-e1f81a24d62c req-b45e62da-6d89-42cd-987f-2927a123972a service nova] Acquiring lock "a308a35f-c8d7-482c-a93d-5d9eb473d4e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-bc1a46ae-539b-4557-8e07-e1f81a24d62c req-b45e62da-6d89-42cd-987f-2927a123972a service nova] Lock "a308a35f-c8d7-482c-a93d-5d9eb473d4e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-bc1a46ae-539b-4557-8e07-e1f81a24d62c req-b45e62da-6d89-42cd-987f-2927a123972a service nova] Lock "a308a35f-c8d7-482c-a93d-5d9eb473d4e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:21 user nova-compute[75341]: DEBUG nova.compute.manager [req-bc1a46ae-539b-4557-8e07-e1f81a24d62c req-b45e62da-6d89-42cd-987f-2927a123972a service nova] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] No waiting events found dispatching network-vif-plugged-4f1d8292-7392-4939-9303-437dc108b4a4 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:46:21 user nova-compute[75341]: WARNING nova.compute.manager [req-bc1a46ae-539b-4557-8e07-e1f81a24d62c req-b45e62da-6d89-42cd-987f-2927a123972a service nova] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Received unexpected event network-vif-plugged-4f1d8292-7392-4939-9303-437dc108b4a4 for instance with vm_state deleted and task_state None.
Nov 14 23:46:21 user nova-compute[75341]: DEBUG nova.compute.manager [req-bc1a46ae-539b-4557-8e07-e1f81a24d62c req-b45e62da-6d89-42cd-987f-2927a123972a service nova] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Received event network-vif-unplugged-4f1d8292-7392-4939-9303-437dc108b4a4 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:46:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-bc1a46ae-539b-4557-8e07-e1f81a24d62c req-b45e62da-6d89-42cd-987f-2927a123972a service nova] Acquiring lock "a308a35f-c8d7-482c-a93d-5d9eb473d4e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-bc1a46ae-539b-4557-8e07-e1f81a24d62c req-b45e62da-6d89-42cd-987f-2927a123972a service nova] Lock "a308a35f-c8d7-482c-a93d-5d9eb473d4e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-bc1a46ae-539b-4557-8e07-e1f81a24d62c req-b45e62da-6d89-42cd-987f-2927a123972a service nova] Lock "a308a35f-c8d7-482c-a93d-5d9eb473d4e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:21 user nova-compute[75341]: DEBUG nova.compute.manager [req-bc1a46ae-539b-4557-8e07-e1f81a24d62c req-b45e62da-6d89-42cd-987f-2927a123972a service nova] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] No waiting events found dispatching network-vif-unplugged-4f1d8292-7392-4939-9303-437dc108b4a4 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:46:21 user nova-compute[75341]: WARNING nova.compute.manager [req-bc1a46ae-539b-4557-8e07-e1f81a24d62c req-b45e62da-6d89-42cd-987f-2927a123972a service nova] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Received unexpected event network-vif-unplugged-4f1d8292-7392-4939-9303-437dc108b4a4 for instance with vm_state deleted and task_state None.
Nov 14 23:46:21 user nova-compute[75341]: DEBUG nova.compute.manager [req-bc1a46ae-539b-4557-8e07-e1f81a24d62c req-b45e62da-6d89-42cd-987f-2927a123972a service nova] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Received event network-vif-plugged-4f1d8292-7392-4939-9303-437dc108b4a4 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:46:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-bc1a46ae-539b-4557-8e07-e1f81a24d62c req-b45e62da-6d89-42cd-987f-2927a123972a service nova] Acquiring lock "a308a35f-c8d7-482c-a93d-5d9eb473d4e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-bc1a46ae-539b-4557-8e07-e1f81a24d62c req-b45e62da-6d89-42cd-987f-2927a123972a service nova] Lock "a308a35f-c8d7-482c-a93d-5d9eb473d4e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-bc1a46ae-539b-4557-8e07-e1f81a24d62c req-b45e62da-6d89-42cd-987f-2927a123972a service nova] Lock "a308a35f-c8d7-482c-a93d-5d9eb473d4e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:21 user nova-compute[75341]: DEBUG nova.compute.manager [req-bc1a46ae-539b-4557-8e07-e1f81a24d62c req-b45e62da-6d89-42cd-987f-2927a123972a service nova] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] No waiting events found dispatching network-vif-plugged-4f1d8292-7392-4939-9303-437dc108b4a4 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:46:21 user nova-compute[75341]: WARNING nova.compute.manager [req-bc1a46ae-539b-4557-8e07-e1f81a24d62c req-b45e62da-6d89-42cd-987f-2927a123972a service nova] [instance: a308a35f-c8d7-482c-a93d-5d9eb473d4e1] Received unexpected event network-vif-plugged-4f1d8292-7392-4939-9303-437dc108b4a4 for instance with vm_state deleted and task_state None.
Nov 14 23:46:21 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-1bbfcdb5-5ce2-4f5a-b219-900a1bb9306a tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:46:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1bbfcdb5-5ce2-4f5a-b219-900a1bb9306a tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.402s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:21 user nova-compute[75341]: INFO nova.scheduler.client.report [None req-1bbfcdb5-5ce2-4f5a-b219-900a1bb9306a tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Deleted allocations for instance a308a35f-c8d7-482c-a93d-5d9eb473d4e1
Nov 14 23:46:22 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1bbfcdb5-5ce2-4f5a-b219-900a1bb9306a tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "a308a35f-c8d7-482c-a93d-5d9eb473d4e1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.548s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:26 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:35 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:36 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:38 user nova-compute[75341]: DEBUG nova.compute.manager [req-13aee13d-9983-4497-88e2-8d6f62b7ba7d req-5f5b664b-97f5-4560-b275-871ccd87ce61 service nova] [instance: d92ba9df-c739-414d-a701-ddba04563427] Received event network-changed-5d23fcc8-0277-4900-b524-398ad1f6f27a {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:46:38 user nova-compute[75341]: DEBUG nova.compute.manager [req-13aee13d-9983-4497-88e2-8d6f62b7ba7d req-5f5b664b-97f5-4560-b275-871ccd87ce61 service nova] [instance: d92ba9df-c739-414d-a701-ddba04563427] Refreshing instance network info cache due to event network-changed-5d23fcc8-0277-4900-b524-398ad1f6f27a. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:46:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-13aee13d-9983-4497-88e2-8d6f62b7ba7d req-5f5b664b-97f5-4560-b275-871ccd87ce61 service nova] Acquiring lock "refresh_cache-d92ba9df-c739-414d-a701-ddba04563427" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:46:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-13aee13d-9983-4497-88e2-8d6f62b7ba7d req-5f5b664b-97f5-4560-b275-871ccd87ce61 service nova] Acquired lock "refresh_cache-d92ba9df-c739-414d-a701-ddba04563427" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:46:38 user nova-compute[75341]: DEBUG nova.network.neutron [req-13aee13d-9983-4497-88e2-8d6f62b7ba7d req-5f5b664b-97f5-4560-b275-871ccd87ce61 service nova] [instance: d92ba9df-c739-414d-a701-ddba04563427] Refreshing network info cache for port 5d23fcc8-0277-4900-b524-398ad1f6f27a {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:46:39 user nova-compute[75341]: DEBUG nova.network.neutron [req-13aee13d-9983-4497-88e2-8d6f62b7ba7d req-5f5b664b-97f5-4560-b275-871ccd87ce61 service nova] [instance: d92ba9df-c739-414d-a701-ddba04563427] Updated VIF entry in instance network info cache for port 5d23fcc8-0277-4900-b524-398ad1f6f27a. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:46:39 user nova-compute[75341]: DEBUG nova.network.neutron [req-13aee13d-9983-4497-88e2-8d6f62b7ba7d req-5f5b664b-97f5-4560-b275-871ccd87ce61 service nova] [instance: d92ba9df-c739-414d-a701-ddba04563427] Updating instance_info_cache with network_info: [{"id": "5d23fcc8-0277-4900-b524-398ad1f6f27a", "address": "fa:16:3e:0d:0a:ad", "network": {"id": "9ad7204e-07f5-4676-b2de-09e036a92e61", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-718201239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542a85b3a6d14c77872f1957120ba655", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d23fcc8-02", "ovs_interfaceid": "5d23fcc8-0277-4900-b524-398ad1f6f27a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:46:39 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-13aee13d-9983-4497-88e2-8d6f62b7ba7d req-5f5b664b-97f5-4560-b275-871ccd87ce61 service nova] Releasing lock "refresh_cache-d92ba9df-c739-414d-a701-ddba04563427" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:46:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-814165d4-3b23-4df3-868f-e36dd699cbaa tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Acquiring lock "d92ba9df-c739-414d-a701-ddba04563427" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-814165d4-3b23-4df3-868f-e36dd699cbaa tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "d92ba9df-c739-414d-a701-ddba04563427" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:40 user nova-compute[75341]: DEBUG nova.objects.instance [None req-814165d4-3b23-4df3-868f-e36dd699cbaa tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lazy-loading 'flavor' on Instance uuid d92ba9df-c739-414d-a701-ddba04563427 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:46:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-814165d4-3b23-4df3-868f-e36dd699cbaa tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "d92ba9df-c739-414d-a701-ddba04563427" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:40 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-814165d4-3b23-4df3-868f-e36dd699cbaa tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Acquiring lock "d92ba9df-c739-414d-a701-ddba04563427" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-814165d4-3b23-4df3-868f-e36dd699cbaa tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "d92ba9df-c739-414d-a701-ddba04563427" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:40 user nova-compute[75341]: INFO nova.compute.manager [None req-814165d4-3b23-4df3-868f-e36dd699cbaa tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d92ba9df-c739-414d-a701-ddba04563427] Attaching volume 346c1ba7-daae-453a-ae47-97d5556b6774 to /dev/vdb
Nov 14 23:46:40 user nova-compute[75341]: DEBUG os_brick.utils [None req-814165d4-3b23-4df3-868f-e36dd699cbaa tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:46:40 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:40 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:40 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2cdf096-12c8-4d35-bfe8-b7140e17b23c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6d1cfca09c9\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:46:40 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:40 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:40 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[9322468c-4c9b-4460-bcf0-2cc4f6828486]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:46:40 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:40 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:40 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a8c5c7-fd35-4d0c-9adb-f81cef95b487]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:46:40 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2a8878-d1a9-49f2-9a86-8a16535da73c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:46:40 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-814165d4-3b23-4df3-868f-e36dd699cbaa tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Running cmd (subprocess): nvme version {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:40 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-814165d4-3b23-4df3-868f-e36dd699cbaa tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] 'nvme version' failed. Not Retrying. {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:46:40 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.nvmeof [None req-814165d4-3b23-4df3-868f-e36dd699cbaa tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] nvme not present on system {{(pid=75341) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 23:46:40 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:40 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:46:40 user nova-compute[75341]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 23:46:40 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3c0ec7-debb-4077-94e5-d46db17a3e9b]: (4, '') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:46:40 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-814165d4-3b23-4df3-868f-e36dd699cbaa tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75341) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 23:46:40 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-814165d4-3b23-4df3-868f-e36dd699cbaa tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 23:46:40 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-814165d4-3b23-4df3-868f-e36dd699cbaa tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] LIGHTOS: no hostnqn found. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 23:46:40 user nova-compute[75341]: DEBUG os_brick.utils [None req-814165d4-3b23-4df3-868f-e36dd699cbaa tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6d1cfca09c9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:46:40 user nova-compute[75341]: DEBUG nova.virt.block_device [None req-814165d4-3b23-4df3-868f-e36dd699cbaa tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d92ba9df-c739-414d-a701-ddba04563427] Updating existing volume attachment record: 5ec45bc7-aa22-4744-8af3-3414ff7b8f9b {{(pid=75341) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 23:46:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:41 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-97386bd6-ab6d-4677-a1ff-9ad193365d38 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Acquiring lock "cffc86d5-2ac6-4dd1-bdcd-5832c134d179" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:41 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-97386bd6-ab6d-4677-a1ff-9ad193365d38 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Lock "cffc86d5-2ac6-4dd1-bdcd-5832c134d179" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:41 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-97386bd6-ab6d-4677-a1ff-9ad193365d38 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Acquiring lock "cffc86d5-2ac6-4dd1-bdcd-5832c134d179-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:41 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-97386bd6-ab6d-4677-a1ff-9ad193365d38 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Lock "cffc86d5-2ac6-4dd1-bdcd-5832c134d179-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:41 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-97386bd6-ab6d-4677-a1ff-9ad193365d38 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Lock "cffc86d5-2ac6-4dd1-bdcd-5832c134d179-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:41 user nova-compute[75341]: INFO nova.compute.manager [None req-97386bd6-ab6d-4677-a1ff-9ad193365d38 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Terminating instance
Nov 14 23:46:41 user nova-compute[75341]: DEBUG nova.compute.manager [None req-97386bd6-ab6d-4677-a1ff-9ad193365d38 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Start destroying the instance on the hypervisor. {{(pid=75341) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 23:46:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG nova.compute.manager [req-ac546305-6e87-48e5-bc65-b42fd135a92c req-6286ec04-7623-4997-ab80-56c5f997cf1c service nova] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Received event network-vif-unplugged-cdc268e0-0a9a-44cf-87ef-0baca1547f68 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ac546305-6e87-48e5-bc65-b42fd135a92c req-6286ec04-7623-4997-ab80-56c5f997cf1c service nova] Acquiring lock "cffc86d5-2ac6-4dd1-bdcd-5832c134d179-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ac546305-6e87-48e5-bc65-b42fd135a92c req-6286ec04-7623-4997-ab80-56c5f997cf1c service nova] Lock "cffc86d5-2ac6-4dd1-bdcd-5832c134d179-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ac546305-6e87-48e5-bc65-b42fd135a92c req-6286ec04-7623-4997-ab80-56c5f997cf1c service nova] Lock "cffc86d5-2ac6-4dd1-bdcd-5832c134d179-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG nova.compute.manager [req-ac546305-6e87-48e5-bc65-b42fd135a92c req-6286ec04-7623-4997-ab80-56c5f997cf1c service nova] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] No waiting events found dispatching network-vif-unplugged-cdc268e0-0a9a-44cf-87ef-0baca1547f68 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG nova.compute.manager [req-ac546305-6e87-48e5-bc65-b42fd135a92c req-6286ec04-7623-4997-ab80-56c5f997cf1c service nova] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Received event network-vif-unplugged-cdc268e0-0a9a-44cf-87ef-0baca1547f68 for instance with task_state deleting. {{(pid=75341) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:42 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Instance destroyed successfully.
Nov 14 23:46:42 user nova-compute[75341]: DEBUG nova.objects.instance [None req-97386bd6-ab6d-4677-a1ff-9ad193365d38 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Lazy-loading 'resources' on Instance uuid cffc86d5-2ac6-4dd1-bdcd-5832c134d179 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-97386bd6-ab6d-4677-a1ff-9ad193365d38 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T23:42:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1298649458',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1214898251',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC6p7TTrcora+tA8J6m0Z8kOp9lfGZbeJCVFa4lV20FoOtQs2zaUuehWyGMh3Ev7R8XPb9IKUQhdgHH/8HhowDTVW2MDgUCdP9iYWVYcDyU1L7qQlvAFOYXZMtN51fblTQ==',key_name='tempest-keypair-849876031',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:45:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b7e4a2efc0fc47a482755f1c375aff46',ramdisk_id='',reservation_id='r-p3kv7sbi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-863325357',owner_user_name='tempest-ServerActionsV293TestJSON-863325357-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:45:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2440829d0b0e4d4d8f8266c4e8162223',uuid=cffc86d5-2ac6-4dd1-bdcd-5832c134d179,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cdc268e0-0a9a-44cf-87ef-0baca1547f68", "address": "fa:16:3e:10:94:5a", "network": {"id": "c832523e-13e4-44da-9e4b-a4f3e5a276fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1155631271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e4a2efc0fc47a482755f1c375aff46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdc268e0-0a", "ovs_interfaceid": "cdc268e0-0a9a-44cf-87ef-0baca1547f68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-97386bd6-ab6d-4677-a1ff-9ad193365d38 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Converting VIF {"id": "cdc268e0-0a9a-44cf-87ef-0baca1547f68", "address": "fa:16:3e:10:94:5a", "network": {"id": "c832523e-13e4-44da-9e4b-a4f3e5a276fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1155631271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e4a2efc0fc47a482755f1c375aff46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdc268e0-0a", "ovs_interfaceid": "cdc268e0-0a9a-44cf-87ef-0baca1547f68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-97386bd6-ab6d-4677-a1ff-9ad193365d38 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:10:94:5a,bridge_name='br-int',has_traffic_filtering=True,id=cdc268e0-0a9a-44cf-87ef-0baca1547f68,network=Network(c832523e-13e4-44da-9e4b-a4f3e5a276fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdc268e0-0a') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG os_vif [None req-97386bd6-ab6d-4677-a1ff-9ad193365d38 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:94:5a,bridge_name='br-int',has_traffic_filtering=True,id=cdc268e0-0a9a-44cf-87ef-0baca1547f68,network=Network(c832523e-13e4-44da-9e4b-a4f3e5a276fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdc268e0-0a') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcdc268e0-0a, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=04eb5351-6067-4919-95e0-3f75e7a8cb33) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:42 user nova-compute[75341]: INFO os_vif [None req-97386bd6-ab6d-4677-a1ff-9ad193365d38 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:94:5a,bridge_name='br-int',has_traffic_filtering=True,id=cdc268e0-0a9a-44cf-87ef-0baca1547f68,network=Network(c832523e-13e4-44da-9e4b-a4f3e5a276fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdc268e0-0a')
Nov 14 23:46:42 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97386bd6-ab6d-4677-a1ff-9ad193365d38 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] calling os-brick to detach iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-97386bd6-ab6d-4677-a1ff-9ad193365d38 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, {'target_iqn': 'iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cDKCeEGM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:46:42 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-97386bd6-ab6d-4677-a1ff-9ad193365d38 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:46:42 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-97386bd6-ab6d-4677-a1ff-9ad193365d38 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-97386bd6-ab6d-4677-a1ff-9ad193365d38 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[15cf2d97-7c74-43dc-8277-34c525d6fb36]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-97386bd6-ab6d-4677-a1ff-9ad193365d38 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 23:46:42 user nova-compute[75341]: No targets found.
Nov 14 23:46:42 user nova-compute[75341]: iSNS:
Nov 14 23:46:42 user nova-compute[75341]: No targets found.
Nov 14 23:46:42 user nova-compute[75341]: STATIC:
Nov 14 23:46:42 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7
Nov 14 23:46:42 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:46:42 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:46:42 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3
Nov 14 23:46:42 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:46:42 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:46:42 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c
Nov 14 23:46:42 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:46:42 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:46:42 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d
Nov 14 23:46:42 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:46:42 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:46:42 user nova-compute[75341]: FIRMWARE:
Nov 14 23:46:42 user nova-compute[75341]: No targets found.
Nov 14 23:46:42 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-97386bd6-ab6d-4677-a1ff-9ad193365d38 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 23:46:42 user nova-compute[75341]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 23:46:42 user nova-compute[75341]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75341) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-97386bd6-ab6d-4677-a1ff-9ad193365d38 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c', 0)] {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4f06be-fab9-42fa-a28b-fc536ec7c90f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb8ce9b-42eb-4350-94fe-be3b8887ba45]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-97386bd6-ab6d-4677-a1ff-9ad193365d38 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:46:42 user nova-compute[75341]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)
Nov 14 23:46:42 user nova-compute[75341]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)
Nov 14 23:46:42 user nova-compute[75341]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d (non-flash)
Nov 14 23:46:42 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-97386bd6-ab6d-4677-a1ff-9ad193365d38 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:46:42 user nova-compute[75341]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c (non-flash)
Nov 14 23:46:42 user nova-compute[75341]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)
Nov 14 23:46:42 user nova-compute[75341]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d (non-flash)
Nov 14 23:46:42 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-97386bd6-ab6d-4677-a1ff-9ad193365d38 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18701ed630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c'): ({'sdh'}, set())}) {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-97386bd6-ab6d-4677-a1ff-9ad193365d38 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Removing single pathed devices sdh {{(pid=75341) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6643d6a-2e6c-4fec-b104-55087f263737]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[7030c5aa-ed7c-42ce-99d4-e1ea5206ae63]: (4, ('ok\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-97386bd6-ab6d-4677-a1ff-9ad193365d38 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Flushing IO for device /dev/sdh {{(pid=75341) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8044a2-e111-4869-bd0f-d4efe791c26f]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-97386bd6-ab6d-4677-a1ff-9ad193365d38 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75341) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.035s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df662b7-efdc-4116-8d57-85909fcc47f7]: (4, ('1', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-97386bd6-ab6d-4677-a1ff-9ad193365d38 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-97386bd6-ab6d-4677-a1ff-9ad193365d38 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] SCSI volumes sdh have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_46422292', '/dev/disk/by-id/scsi-23633656130666432', '/dev/disk/by-id/scsi-1SCST_BIO46422292-63ea0fd2ec0b3627') {{(pid=86063) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e7e89a-c794-4d04-968c-b471e3359859]: (4, None) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-97386bd6-ab6d-4677-a1ff-9ad193365d38 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c')] {{(pid=75341) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc16d46-8524-4eda-bf08-41fa01d39d18]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-97386bd6-ab6d-4677-a1ff-9ad193365d38 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c -p 172.16.0.220:3260 --logout {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6cab71-4d3f-47c6-b39f-124f1d34b45c]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-97386bd6-ab6d-4677-a1ff-9ad193365d38 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c, portal: 172.16.0.220,3260]
Nov 14 23:46:42 user nova-compute[75341]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c, portal: 172.16.0.220,3260] successful.
Nov 14 23:46:42 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c -p 172.16.0.220:3260 --op delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7af2f07-212b-4210-b473-6e1da973682c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[344e035d-0060-4cec-9996-af3e1ba7be70]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-97386bd6-ab6d-4677-a1ff-9ad193365d38 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-97386bd6-ab6d-4677-a1ff-9ad193365d38 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-97386bd6-ab6d-4677-a1ff-9ad193365d38 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] <== disconnect_volume: return (335ms) None {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97386bd6-ab6d-4677-a1ff-9ad193365d38 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Disconnected iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 23:46:42 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-97386bd6-ab6d-4677-a1ff-9ad193365d38 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Deleting instance files /opt/stack/data/nova/instances/cffc86d5-2ac6-4dd1-bdcd-5832c134d179_del
Nov 14 23:46:42 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-97386bd6-ab6d-4677-a1ff-9ad193365d38 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Deletion of /opt/stack/data/nova/instances/cffc86d5-2ac6-4dd1-bdcd-5832c134d179_del complete
Nov 14 23:46:42 user nova-compute[75341]: INFO nova.compute.manager [None req-97386bd6-ab6d-4677-a1ff-9ad193365d38 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 14 23:46:42 user nova-compute[75341]: DEBUG oslo.service.loopingcall [None req-97386bd6-ab6d-4677-a1ff-9ad193365d38 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75341) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG nova.compute.manager [-] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Deallocating network for instance {{(pid=75341) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 23:46:42 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] deallocate_for_instance() {{(pid=75341) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 23:46:43 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:46:43 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:43 user nova-compute[75341]: DEBUG nova.compute.manager [req-a5c9971c-537c-4307-9622-5494d978ade2 req-dd03d0b3-e334-44dc-bd07-757943ecdd82 service nova] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Received event network-vif-deleted-cdc268e0-0a9a-44cf-87ef-0baca1547f68 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:46:43 user nova-compute[75341]: INFO nova.compute.manager [req-a5c9971c-537c-4307-9622-5494d978ade2 req-dd03d0b3-e334-44dc-bd07-757943ecdd82 service nova] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Neutron deleted interface cdc268e0-0a9a-44cf-87ef-0baca1547f68; detaching it from the instance and deleting it from the info cache
Nov 14 23:46:43 user nova-compute[75341]: DEBUG nova.network.neutron [req-a5c9971c-537c-4307-9622-5494d978ade2 req-dd03d0b3-e334-44dc-bd07-757943ecdd82 service nova] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:46:43 user nova-compute[75341]: INFO nova.compute.manager [-] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Took 0.99 seconds to deallocate network for instance.
Nov 14 23:46:43 user nova-compute[75341]: DEBUG nova.compute.manager [req-a5c9971c-537c-4307-9622-5494d978ade2 req-dd03d0b3-e334-44dc-bd07-757943ecdd82 service nova] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Detach interface failed, port_id=cdc268e0-0a9a-44cf-87ef-0baca1547f68, reason: Instance cffc86d5-2ac6-4dd1-bdcd-5832c134d179 could not be found. {{(pid=75341) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 23:46:44 user nova-compute[75341]: DEBUG nova.compute.manager [req-1238f0d9-ce1a-4c4c-92ab-34c48a1e0370 req-1db589e9-3d4f-4c4c-9fdc-0cf483422ce9 service nova] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Received event network-vif-plugged-cdc268e0-0a9a-44cf-87ef-0baca1547f68 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:46:44 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-1238f0d9-ce1a-4c4c-92ab-34c48a1e0370 req-1db589e9-3d4f-4c4c-9fdc-0cf483422ce9 service nova] Acquiring lock "cffc86d5-2ac6-4dd1-bdcd-5832c134d179-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:44 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-1238f0d9-ce1a-4c4c-92ab-34c48a1e0370 req-1db589e9-3d4f-4c4c-9fdc-0cf483422ce9 service nova] Lock "cffc86d5-2ac6-4dd1-bdcd-5832c134d179-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:44 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-1238f0d9-ce1a-4c4c-92ab-34c48a1e0370 req-1db589e9-3d4f-4c4c-9fdc-0cf483422ce9 service nova] Lock "cffc86d5-2ac6-4dd1-bdcd-5832c134d179-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:44 user nova-compute[75341]: DEBUG nova.compute.manager [req-1238f0d9-ce1a-4c4c-92ab-34c48a1e0370 req-1db589e9-3d4f-4c4c-9fdc-0cf483422ce9 service nova] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] No waiting events found dispatching network-vif-plugged-cdc268e0-0a9a-44cf-87ef-0baca1547f68 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:46:44 user nova-compute[75341]: WARNING nova.compute.manager [req-1238f0d9-ce1a-4c4c-92ab-34c48a1e0370 req-1db589e9-3d4f-4c4c-9fdc-0cf483422ce9 service nova] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Received unexpected event network-vif-plugged-cdc268e0-0a9a-44cf-87ef-0baca1547f68 for instance with vm_state active and task_state deleting.
Nov 14 23:46:44 user nova-compute[75341]: INFO nova.compute.manager [None req-97386bd6-ab6d-4677-a1ff-9ad193365d38 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Took 0.72 seconds to detach 1 volumes for instance.
Nov 14 23:46:44 user nova-compute[75341]: DEBUG nova.compute.manager [None req-97386bd6-ab6d-4677-a1ff-9ad193365d38 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] [instance: cffc86d5-2ac6-4dd1-bdcd-5832c134d179] Deleting volume: b7af2f07-212b-4210-b473-6e1da973682c {{(pid=75341) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 23:46:44 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-97386bd6-ab6d-4677-a1ff-9ad193365d38 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:44 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-97386bd6-ab6d-4677-a1ff-9ad193365d38 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:44 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:46:45 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-97386bd6-ab6d-4677-a1ff-9ad193365d38 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:46:45 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-97386bd6-ab6d-4677-a1ff-9ad193365d38 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:46:45 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-97386bd6-ab6d-4677-a1ff-9ad193365d38 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.383s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:45 user nova-compute[75341]: INFO nova.scheduler.client.report [None req-97386bd6-ab6d-4677-a1ff-9ad193365d38 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Deleted allocations for instance cffc86d5-2ac6-4dd1-bdcd-5832c134d179
Nov 14 23:46:45 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-97386bd6-ab6d-4677-a1ff-9ad193365d38 tempest-ServerActionsV293TestJSON-863325357 tempest-ServerActionsV293TestJSON-863325357-project-member] Lock "cffc86d5-2ac6-4dd1-bdcd-5832c134d179" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.552s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-814165d4-3b23-4df3-868f-e36dd699cbaa tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d92ba9df-c739-414d-a701-ddba04563427] Calling os-brick to attach iSCSI Volume {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 23:46:45 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-814165d4-3b23-4df3-868f-e36dd699cbaa tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SMizbvOp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:46:45 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-814165d4-3b23-4df3-868f-e36dd699cbaa tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:46:45 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-814165d4-3b23-4df3-868f-e36dd699cbaa tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:46:45 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-814165d4-3b23-4df3-868f-e36dd699cbaa tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:46:45 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-814165d4-3b23-4df3-868f-e36dd699cbaa tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:46:45 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-814165d4-3b23-4df3-868f-e36dd699cbaa tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:46:45 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-814165d4-3b23-4df3-868f-e36dd699cbaa tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:46:45 user nova-compute[75341]: INFO os_brick.initiator.connectors.iscsi [None req-814165d4-3b23-4df3-868f-e36dd699cbaa tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 23:46:45 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774 -p 172.16.0.220:3260 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:45 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:45 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[e480bd5c-e02f-4b4a-b85c-134d42d9a77d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:46:45 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-814165d4-3b23-4df3-868f-e36dd699cbaa tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 23:46:45 user nova-compute[75341]:  {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:46:45 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774 -p 172.16.0.220:3260 --interface default --op new {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:45 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:45 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[1693e3e2-32e1-4956-9b7e-5f36043ab653]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774] added\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:46:45 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-814165d4-3b23-4df3-868f-e36dd699cbaa tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774] added
Nov 14 23:46:45 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:46:45 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:45 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:45 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e24700-0ef4-454c-8036-cbd8c518da26]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:46:45 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-814165d4-3b23-4df3-868f-e36dd699cbaa tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:46:45 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:45 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:45 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e33cce2-442c-44d2-9a38-db0e2659cf0d]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:46:45 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-814165d4-3b23-4df3-868f-e36dd699cbaa tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:46:45 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SMizbvOp {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:45 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SMizbvOp" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:45 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d2bef6-3623-4434-b307-fe7bf8bb0d04]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:46:45 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-814165d4-3b23-4df3-868f-e36dd699cbaa tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SMizbvOp'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:46:45 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:45 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:45 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62d5bdd-849c-4bc3-af3a-74efa5e03665]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:46:45 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-814165d4-3b23-4df3-868f-e36dd699cbaa tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:46:45 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:45 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:45 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c4d7e5-099b-4307-8149-2df89817ba71]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:46:45 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-814165d4-3b23-4df3-868f-e36dd699cbaa tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:46:45 user nova-compute[75341]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)
Nov 14 23:46:45 user nova-compute[75341]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d (non-flash)
Nov 14 23:46:45 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:46:45 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-814165d4-3b23-4df3-868f-e36dd699cbaa tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:46:45 user nova-compute[75341]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)
Nov 14 23:46:45 user nova-compute[75341]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d (non-flash)
Nov 14 23:46:45 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:46:45 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774 -p 172.16.0.220:3260 --login {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:45 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:45 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[3164e4ec-fe12-4a3c-94d0-6cb80f601947]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:46:45 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-814165d4-3b23-4df3-868f-e36dd699cbaa tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774, portal: 172.16.0.220,3260]
Nov 14 23:46:45 user nova-compute[75341]: Login to [iface: default, target: iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774, portal: 172.16.0.220,3260] successful.
Nov 14 23:46:45 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:46:45 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:45 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:45 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[2409eb6f-3157-4d08-b64d-18f726ee86bc]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:46:45 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-814165d4-3b23-4df3-868f-e36dd699cbaa tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:46:45 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:45 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:45 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[472bdaf2-552c-402a-96b4-22fa1d1b73fd]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:46:45 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-814165d4-3b23-4df3-868f-e36dd699cbaa tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:46:45 user nova-compute[75341]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)
Nov 14 23:46:45 user nova-compute[75341]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d (non-flash)
Nov 14 23:46:45 user nova-compute[75341]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774 (non-flash)
Nov 14 23:46:45 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:46:45 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-814165d4-3b23-4df3-868f-e36dd699cbaa tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:46:45 user nova-compute[75341]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)
Nov 14 23:46:45 user nova-compute[75341]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d (non-flash)
Nov 14 23:46:45 user nova-compute[75341]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774 (non-flash)
Nov 14 23:46:45 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:46:45 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-814165d4-3b23-4df3-868f-e36dd699cbaa tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:46:45 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-814165d4-3b23-4df3-868f-e36dd699cbaa tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Connected to 172.16.0.220:3260 {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 23:46:45 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-814165d4-3b23-4df3-868f-e36dd699cbaa tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] HCTL ('33', '-', '-', 0) found on session 29 with lun 0 {{(pid=75341) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 23:46:45 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-814165d4-3b23-4df3-868f-e36dd699cbaa tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75341) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 23:46:45 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:45 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:45 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e9b605-ac18-4f9e-8e29-1a4429c3446f]: (4, ('- - 0', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:46:45 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-814165d4-3b23-4df3-868f-e36dd699cbaa tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 23:46:45 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-814165d4-3b23-4df3-868f-e36dd699cbaa tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SMizbvOp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 23:46:45 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:46 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:46 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-814165d4-3b23-4df3-868f-e36dd699cbaa tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:46:46 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-814165d4-3b23-4df3-868f-e36dd699cbaa tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23736366166383761', 'path': '/dev/sdb'} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:46:46 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-814165d4-3b23-4df3-868f-e36dd699cbaa tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d92ba9df-c739-414d-a701-ddba04563427] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736366166383761', 'path': '/dev/sdb'} {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 23:46:46 user nova-compute[75341]: DEBUG nova.objects.instance [None req-814165d4-3b23-4df3-868f-e36dd699cbaa tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lazy-loading 'flavor' on Instance uuid d92ba9df-c739-414d-a701-ddba04563427 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:46:46 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-814165d4-3b23-4df3-868f-e36dd699cbaa tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 23:46:46 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:46:46 user nova-compute[75341]:   <source dev="/dev/sdb"/>
Nov 14 23:46:46 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:46:46 user nova-compute[75341]:   <serial>346c1ba7-daae-453a-ae47-97d5556b6774</serial>
Nov 14 23:46:46 user nova-compute[75341]: </disk>
Nov 14 23:46:46 user nova-compute[75341]:  {{(pid=75341) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 23:46:46 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:46:46 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Starting heal instance info cache {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 23:46:47 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "refresh_cache-a141d7ee-3f77-4fdc-85ec-2cbd5af17646" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:46:47 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquired lock "refresh_cache-a141d7ee-3f77-4fdc-85ec-2cbd5af17646" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:46:47 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: a141d7ee-3f77-4fdc-85ec-2cbd5af17646] Forcefully refreshing network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 23:46:47 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-814165d4-3b23-4df3-868f-e36dd699cbaa tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:46:47 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-814165d4-3b23-4df3-868f-e36dd699cbaa tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:46:47 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-814165d4-3b23-4df3-868f-e36dd699cbaa tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] No VIF found with MAC fa:16:3e:0d:0a:ad, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:46:47 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-814165d4-3b23-4df3-868f-e36dd699cbaa tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "d92ba9df-c739-414d-a701-ddba04563427" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.824s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:47 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: a141d7ee-3f77-4fdc-85ec-2cbd5af17646] Updating instance_info_cache with network_info: [{"id": "a64b87d5-7175-42f5-b6d0-09f45ac29e96", "address": "fa:16:3e:4c:4c:c2", "network": {"id": "7673016a-86f3-4643-a21f-148adc2a96dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-89785556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d86dc7dc1b6b41bf874f1a25d7bca91d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa64b87d5-71", "ovs_interfaceid": "a64b87d5-7175-42f5-b6d0-09f45ac29e96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:46:47 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Releasing lock "refresh_cache-a141d7ee-3f77-4fdc-85ec-2cbd5af17646" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:46:47 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: a141d7ee-3f77-4fdc-85ec-2cbd5af17646] Updated the network info_cache for instance {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 23:46:47 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:46:47 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:47 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:46:48 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:48 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:46:49 user nova-compute[75341]: DEBUG nova.compute.manager [req-5204f6a7-4b1b-40bc-a6c0-62f7dadaa8be req-86914f2a-ee5b-49ee-b8d0-063523bac7a6 service nova] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Received event network-changed-dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:46:49 user nova-compute[75341]: DEBUG nova.compute.manager [req-5204f6a7-4b1b-40bc-a6c0-62f7dadaa8be req-86914f2a-ee5b-49ee-b8d0-063523bac7a6 service nova] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Refreshing instance network info cache due to event network-changed-dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:46:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-5204f6a7-4b1b-40bc-a6c0-62f7dadaa8be req-86914f2a-ee5b-49ee-b8d0-063523bac7a6 service nova] Acquiring lock "refresh_cache-0223a98e-e08f-4a0f-a707-3770c7a99b00" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:46:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-5204f6a7-4b1b-40bc-a6c0-62f7dadaa8be req-86914f2a-ee5b-49ee-b8d0-063523bac7a6 service nova] Acquired lock "refresh_cache-0223a98e-e08f-4a0f-a707-3770c7a99b00" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:46:49 user nova-compute[75341]: DEBUG nova.network.neutron [req-5204f6a7-4b1b-40bc-a6c0-62f7dadaa8be req-86914f2a-ee5b-49ee-b8d0-063523bac7a6 service nova] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Refreshing network info cache for port dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:46:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-bbc57c2e-186f-4030-b1a8-25aa6ea2aca6 tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Acquiring lock "0223a98e-e08f-4a0f-a707-3770c7a99b00" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-bbc57c2e-186f-4030-b1a8-25aa6ea2aca6 tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Lock "0223a98e-e08f-4a0f-a707-3770c7a99b00" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-bbc57c2e-186f-4030-b1a8-25aa6ea2aca6 tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Acquiring lock "0223a98e-e08f-4a0f-a707-3770c7a99b00-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-bbc57c2e-186f-4030-b1a8-25aa6ea2aca6 tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Lock "0223a98e-e08f-4a0f-a707-3770c7a99b00-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-bbc57c2e-186f-4030-b1a8-25aa6ea2aca6 tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Lock "0223a98e-e08f-4a0f-a707-3770c7a99b00-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:49 user nova-compute[75341]: INFO nova.compute.manager [None req-bbc57c2e-186f-4030-b1a8-25aa6ea2aca6 tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Terminating instance
Nov 14 23:46:49 user nova-compute[75341]: DEBUG nova.compute.manager [None req-bbc57c2e-186f-4030-b1a8-25aa6ea2aca6 tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Start destroying the instance on the hypervisor. {{(pid=75341) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 23:46:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-95929f5c-ef47-46d9-82f5-ebcad8284005 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Acquiring lock "6a0e67fc-942b-4f05-a6ee-0987944f17da" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-95929f5c-ef47-46d9-82f5-ebcad8284005 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Lock "6a0e67fc-942b-4f05-a6ee-0987944f17da" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-95929f5c-ef47-46d9-82f5-ebcad8284005 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Acquiring lock "6a0e67fc-942b-4f05-a6ee-0987944f17da-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-95929f5c-ef47-46d9-82f5-ebcad8284005 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Lock "6a0e67fc-942b-4f05-a6ee-0987944f17da-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-95929f5c-ef47-46d9-82f5-ebcad8284005 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Lock "6a0e67fc-942b-4f05-a6ee-0987944f17da-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:49 user nova-compute[75341]: INFO nova.compute.manager [None req-95929f5c-ef47-46d9-82f5-ebcad8284005 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 6a0e67fc-942b-4f05-a6ee-0987944f17da] Terminating instance
Nov 14 23:46:49 user nova-compute[75341]: DEBUG nova.compute.manager [None req-95929f5c-ef47-46d9-82f5-ebcad8284005 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 6a0e67fc-942b-4f05-a6ee-0987944f17da] Start destroying the instance on the hypervisor. {{(pid=75341) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 23:46:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:49 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:46:49 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75341) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 23:46:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:50 user nova-compute[75341]: DEBUG nova.network.neutron [req-5204f6a7-4b1b-40bc-a6c0-62f7dadaa8be req-86914f2a-ee5b-49ee-b8d0-063523bac7a6 service nova] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Updated VIF entry in instance network info cache for port dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:46:50 user nova-compute[75341]: DEBUG nova.network.neutron [req-5204f6a7-4b1b-40bc-a6c0-62f7dadaa8be req-86914f2a-ee5b-49ee-b8d0-063523bac7a6 service nova] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Updating instance_info_cache with network_info: [{"id": "dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e", "address": "fa:16:3e:19:cd:2f", "network": {"id": "eb5b5fbb-4747-49e9-a830-c9ab1c4d4af7", "bridge": "br-int", "label": "tempest-TestShelveInstance-261763164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9beb6cd1f92a46f4a37459b75b7ff1d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbe5cbca-08", "ovs_interfaceid": "dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:46:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-5204f6a7-4b1b-40bc-a6c0-62f7dadaa8be req-86914f2a-ee5b-49ee-b8d0-063523bac7a6 service nova] Releasing lock "refresh_cache-0223a98e-e08f-4a0f-a707-3770c7a99b00" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:46:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:50 user nova-compute[75341]: DEBUG nova.compute.manager [req-09638dfe-8d14-45e5-9d2d-eee5201d9f7f req-4f08d8d5-1389-44f5-b749-3fb0dcee7bf4 service nova] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Received event network-vif-unplugged-dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:46:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-09638dfe-8d14-45e5-9d2d-eee5201d9f7f req-4f08d8d5-1389-44f5-b749-3fb0dcee7bf4 service nova] Acquiring lock "0223a98e-e08f-4a0f-a707-3770c7a99b00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-09638dfe-8d14-45e5-9d2d-eee5201d9f7f req-4f08d8d5-1389-44f5-b749-3fb0dcee7bf4 service nova] Lock "0223a98e-e08f-4a0f-a707-3770c7a99b00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-09638dfe-8d14-45e5-9d2d-eee5201d9f7f req-4f08d8d5-1389-44f5-b749-3fb0dcee7bf4 service nova] Lock "0223a98e-e08f-4a0f-a707-3770c7a99b00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:50 user nova-compute[75341]: DEBUG nova.compute.manager [req-09638dfe-8d14-45e5-9d2d-eee5201d9f7f req-4f08d8d5-1389-44f5-b749-3fb0dcee7bf4 service nova] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] No waiting events found dispatching network-vif-unplugged-dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:46:50 user nova-compute[75341]: DEBUG nova.compute.manager [req-09638dfe-8d14-45e5-9d2d-eee5201d9f7f req-4f08d8d5-1389-44f5-b749-3fb0dcee7bf4 service nova] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Received event network-vif-unplugged-dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e for instance with task_state deleting. {{(pid=75341) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 23:46:50 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 6a0e67fc-942b-4f05-a6ee-0987944f17da] Instance destroyed successfully.
Nov 14 23:46:50 user nova-compute[75341]: DEBUG nova.objects.instance [None req-95929f5c-ef47-46d9-82f5-ebcad8284005 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Lazy-loading 'resources' on Instance uuid 6a0e67fc-942b-4f05-a6ee-0987944f17da {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:46:50 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-95929f5c-ef47-46d9-82f5-ebcad8284005 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:44:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-772570536',display_name='tempest-VolumesActionsTest-instance-772570536',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-772570536',id=20,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:45:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='24aa6f705262457e95f2f3f47c0ee709',ramdisk_id='',reservation_id='r-msudfw7e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1514431738',owner_user_name='tempest-VolumesActionsTest-1514431738-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:45:06Z,user_data=None,user_id='aff47f00e24e461787b1224fa6e697fa',uuid=6a0e67fc-942b-4f05-a6ee-0987944f17da,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2054f2c7-c492-4278-9a66-ee9c030df266", "address": "fa:16:3e:f0:19:80", "network": {"id": "b87c269d-b129-4bd0-b995-e9a9657dbd1a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1162722602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24aa6f705262457e95f2f3f47c0ee709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2054f2c7-c4", "ovs_interfaceid": "2054f2c7-c492-4278-9a66-ee9c030df266", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 23:46:50 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-95929f5c-ef47-46d9-82f5-ebcad8284005 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Converting VIF {"id": "2054f2c7-c492-4278-9a66-ee9c030df266", "address": "fa:16:3e:f0:19:80", "network": {"id": "b87c269d-b129-4bd0-b995-e9a9657dbd1a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1162722602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24aa6f705262457e95f2f3f47c0ee709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2054f2c7-c4", "ovs_interfaceid": "2054f2c7-c492-4278-9a66-ee9c030df266", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:46:50 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-95929f5c-ef47-46d9-82f5-ebcad8284005 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:19:80,bridge_name='br-int',has_traffic_filtering=True,id=2054f2c7-c492-4278-9a66-ee9c030df266,network=Network(b87c269d-b129-4bd0-b995-e9a9657dbd1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2054f2c7-c4') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:46:50 user nova-compute[75341]: DEBUG os_vif [None req-95929f5c-ef47-46d9-82f5-ebcad8284005 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:19:80,bridge_name='br-int',has_traffic_filtering=True,id=2054f2c7-c492-4278-9a66-ee9c030df266,network=Network(b87c269d-b129-4bd0-b995-e9a9657dbd1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2054f2c7-c4') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 23:46:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2054f2c7-c4, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:46:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:46:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f8aa7cea-0358-4d71-a989-e0d77249c39c) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:46:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:46:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:50 user nova-compute[75341]: INFO os_vif [None req-95929f5c-ef47-46d9-82f5-ebcad8284005 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:19:80,bridge_name='br-int',has_traffic_filtering=True,id=2054f2c7-c492-4278-9a66-ee9c030df266,network=Network(b87c269d-b129-4bd0-b995-e9a9657dbd1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2054f2c7-c4')
Nov 14 23:46:50 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-95929f5c-ef47-46d9-82f5-ebcad8284005 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 6a0e67fc-942b-4f05-a6ee-0987944f17da] Deleting instance files /opt/stack/data/nova/instances/6a0e67fc-942b-4f05-a6ee-0987944f17da_del
Nov 14 23:46:50 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-95929f5c-ef47-46d9-82f5-ebcad8284005 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 6a0e67fc-942b-4f05-a6ee-0987944f17da] Deletion of /opt/stack/data/nova/instances/6a0e67fc-942b-4f05-a6ee-0987944f17da_del complete
Nov 14 23:46:50 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Instance destroyed successfully.
Nov 14 23:46:50 user nova-compute[75341]: DEBUG nova.objects.instance [None req-bbc57c2e-186f-4030-b1a8-25aa6ea2aca6 tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Lazy-loading 'resources' on Instance uuid 0223a98e-e08f-4a0f-a707-3770c7a99b00 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:46:50 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-bbc57c2e-186f-4030-b1a8-25aa6ea2aca6 tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T23:41:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-745577741',display_name='tempest-TestShelveInstance-server-745577741',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-745577741',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCC/fpuT6kOHQaV9HZ2f/yPGx85iWhp/2ZbngnYaFTTZ0up9RjcbLjQe5XMoVflV9AQ+bAmt83ts1O90HoYfCtqnb8fvFlLRjy7CrBRwtOEIR115LUYMUcjq8rDRKo0GlA==',key_name='tempest-TestShelveInstance-272108759',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:45:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9beb6cd1f92a46f4a37459b75b7ff1d4',ramdisk_id='',reservation_id='r-w770xi1a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1537108126',owner_user_name='tempest-TestShelveInstance-1537108126-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:45:12Z,user_data=None,user_id='ee1ed14495f14c7e8bddfde73dbb3a29',uuid=0223a98e-e08f-4a0f-a707-3770c7a99b00,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e", "address": "fa:16:3e:19:cd:2f", "network": {"id": "eb5b5fbb-4747-49e9-a830-c9ab1c4d4af7", "bridge": "br-int", "label": "tempest-TestShelveInstance-261763164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9beb6cd1f92a46f4a37459b75b7ff1d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbe5cbca-08", "ovs_interfaceid": "dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 23:46:50 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-bbc57c2e-186f-4030-b1a8-25aa6ea2aca6 tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Converting VIF {"id": "dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e", "address": "fa:16:3e:19:cd:2f", "network": {"id": "eb5b5fbb-4747-49e9-a830-c9ab1c4d4af7", "bridge": "br-int", "label": "tempest-TestShelveInstance-261763164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9beb6cd1f92a46f4a37459b75b7ff1d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbe5cbca-08", "ovs_interfaceid": "dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:46:50 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-bbc57c2e-186f-4030-b1a8-25aa6ea2aca6 tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:cd:2f,bridge_name='br-int',has_traffic_filtering=True,id=dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e,network=Network(eb5b5fbb-4747-49e9-a830-c9ab1c4d4af7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbe5cbca-08') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:46:50 user nova-compute[75341]: DEBUG os_vif [None req-bbc57c2e-186f-4030-b1a8-25aa6ea2aca6 tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:cd:2f,bridge_name='br-int',has_traffic_filtering=True,id=dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e,network=Network(eb5b5fbb-4747-49e9-a830-c9ab1c4d4af7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbe5cbca-08') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 23:46:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdbe5cbca-08, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:46:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:46:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6a77a11f-7f21-4af1-9f3a-265d3d572cce) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:46:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:46:50 user nova-compute[75341]: INFO os_vif [None req-bbc57c2e-186f-4030-b1a8-25aa6ea2aca6 tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:cd:2f,bridge_name='br-int',has_traffic_filtering=True,id=dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e,network=Network(eb5b5fbb-4747-49e9-a830-c9ab1c4d4af7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbe5cbca-08')
Nov 14 23:46:50 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbc57c2e-186f-4030-b1a8-25aa6ea2aca6 tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] calling os-brick to detach iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 23:46:50 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc57c2e-186f-4030-b1a8-25aa6ea2aca6 tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, {'target_iqn': 'iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fjgHolcY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:46:50 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-bbc57c2e-186f-4030-b1a8-25aa6ea2aca6 tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:46:50 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-bbc57c2e-186f-4030-b1a8-25aa6ea2aca6 tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:46:50 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-bbc57c2e-186f-4030-b1a8-25aa6ea2aca6 tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:46:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:50 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:46:50 user nova-compute[75341]: INFO nova.compute.manager [None req-95929f5c-ef47-46d9-82f5-ebcad8284005 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 6a0e67fc-942b-4f05-a6ee-0987944f17da] Took 1.03 seconds to destroy the instance on the hypervisor.
Nov 14 23:46:50 user nova-compute[75341]: DEBUG oslo.service.loopingcall [None req-95929f5c-ef47-46d9-82f5-ebcad8284005 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75341) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 23:46:50 user nova-compute[75341]: DEBUG nova.compute.manager [-] [instance: 6a0e67fc-942b-4f05-a6ee-0987944f17da] Deallocating network for instance {{(pid=75341) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 23:46:50 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: 6a0e67fc-942b-4f05-a6ee-0987944f17da] deallocate_for_instance() {{(pid=75341) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 23:46:50 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:46:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:50 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9e1764-6b64-449c-a6d5-cb405f808f5a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:46:50 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc57c2e-186f-4030-b1a8-25aa6ea2aca6 tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 23:46:50 user nova-compute[75341]: No targets found.
Nov 14 23:46:50 user nova-compute[75341]: iSNS:
Nov 14 23:46:50 user nova-compute[75341]: No targets found.
Nov 14 23:46:50 user nova-compute[75341]: STATIC:
Nov 14 23:46:50 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7
Nov 14 23:46:50 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:46:50 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:46:50 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3
Nov 14 23:46:50 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:46:50 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:46:50 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d
Nov 14 23:46:50 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:46:50 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:46:50 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774
Nov 14 23:46:50 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:46:50 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:46:50 user nova-compute[75341]: FIRMWARE:
Nov 14 23:46:50 user nova-compute[75341]: No targets found.
Nov 14 23:46:50 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:46:50 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc57c2e-186f-4030-b1a8-25aa6ea2aca6 tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 23:46:50 user nova-compute[75341]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 23:46:50 user nova-compute[75341]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75341) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 23:46:50 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc57c2e-186f-4030-b1a8-25aa6ea2aca6 tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7', 0)] {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 23:46:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:50 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75341) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 23:46:50 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e8b463-f091-41a7-bdd4-22974107735b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:46:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:51 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[b000e240-e3c5-4d37-86f3-e02a72eb64e5]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:46:51 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc57c2e-186f-4030-b1a8-25aa6ea2aca6 tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:46:51 user nova-compute[75341]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)
Nov 14 23:46:51 user nova-compute[75341]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d (non-flash)
Nov 14 23:46:51 user nova-compute[75341]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774 (non-flash)
Nov 14 23:46:51 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:46:51 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc57c2e-186f-4030-b1a8-25aa6ea2aca6 tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 (non-flash)
Nov 14 23:46:51 user nova-compute[75341]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)
Nov 14 23:46:51 user nova-compute[75341]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d (non-flash)
Nov 14 23:46:51 user nova-compute[75341]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774 (non-flash)
Nov 14 23:46:51 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:46:51 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc57c2e-186f-4030-b1a8-25aa6ea2aca6 tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18701efc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7'): ({'sdc'}, set())}) {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 23:46:51 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-bbc57c2e-186f-4030-b1a8-25aa6ea2aca6 tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Removing single pathed devices sdc {{(pid=75341) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 23:46:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:51 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[90098ff9-5855-4a02-80f0-6c167ae88de3]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:46:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:51 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a1ec77-405a-4fc7-a93b-b63d03a508af]: (4, ('ok\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:46:51 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-bbc57c2e-186f-4030-b1a8-25aa6ea2aca6 tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Flushing IO for device /dev/sdc {{(pid=75341) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 23:46:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:51 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea46801-4275-46d5-9784-65625277e22e]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:46:51 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-bbc57c2e-186f-4030-b1a8-25aa6ea2aca6 tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75341) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 23:46:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.060s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:51 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf9009f-d92d-455b-98ad-f255d556d7f2]: (4, ('1', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:46:51 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-bbc57c2e-186f-4030-b1a8-25aa6ea2aca6 tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 23:46:51 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-bbc57c2e-186f-4030-b1a8-25aa6ea2aca6 tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] SCSI volumes sdc have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 23:46:51 user nova-compute[75341]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23661616137303062', '/dev/disk/by-id/scsi-1SCST_BIO337b1114-6aaa700bb5e0b03d', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_337b1114') {{(pid=86063) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 23:46:51 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce87737-b458-4b5e-8ab8-01d519c7db9b]: (4, None) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:46:51 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc57c2e-186f-4030-b1a8-25aa6ea2aca6 tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7')] {{(pid=75341) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 23:46:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:51 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 23:46:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5070fb03-8f40-426c-8c3e-192f6517f7c3/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:51 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[216d09f5-88c4-4f1a-83cf-5edab62d3827]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:46:51 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc57c2e-186f-4030-b1a8-25aa6ea2aca6 tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:46:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 -p 172.16.0.220:3260 --logout {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:51 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[9537e39f-6244-44ad-8905-f4cad726a8de]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:46:51 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc57c2e-186f-4030-b1a8-25aa6ea2aca6 tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7, portal: 172.16.0.220,3260]
Nov 14 23:46:51 user nova-compute[75341]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7, portal: 172.16.0.220,3260] successful.
Nov 14 23:46:51 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:46:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 -p 172.16.0.220:3260 --op delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d4927ae-8df9-41e3-97e6-2eef950500f7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:51 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e26271-99f2-4273-a692-33436bffd6f8]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:46:51 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc57c2e-186f-4030-b1a8-25aa6ea2aca6 tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:46:51 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-bbc57c2e-186f-4030-b1a8-25aa6ea2aca6 tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.412s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:46:51 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc57c2e-186f-4030-b1a8-25aa6ea2aca6 tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] <== disconnect_volume: return (412ms) None {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:46:51 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbc57c2e-186f-4030-b1a8-25aa6ea2aca6 tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Disconnected iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 23:46:51 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-bbc57c2e-186f-4030-b1a8-25aa6ea2aca6 tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Deleting instance files /opt/stack/data/nova/instances/0223a98e-e08f-4a0f-a707-3770c7a99b00_del
Nov 14 23:46:51 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-bbc57c2e-186f-4030-b1a8-25aa6ea2aca6 tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Deletion of /opt/stack/data/nova/instances/0223a98e-e08f-4a0f-a707-3770c7a99b00_del complete
Nov 14 23:46:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5070fb03-8f40-426c-8c3e-192f6517f7c3/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5070fb03-8f40-426c-8c3e-192f6517f7c3/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:51 user nova-compute[75341]: INFO nova.compute.manager [None req-bbc57c2e-186f-4030-b1a8-25aa6ea2aca6 tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Took 1.61 seconds to destroy the instance on the hypervisor.
Nov 14 23:46:51 user nova-compute[75341]: DEBUG oslo.service.loopingcall [None req-bbc57c2e-186f-4030-b1a8-25aa6ea2aca6 tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75341) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 23:46:51 user nova-compute[75341]: DEBUG nova.compute.manager [-] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Deallocating network for instance {{(pid=75341) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 23:46:51 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] deallocate_for_instance() {{(pid=75341) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 23:46:51 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: 6a0e67fc-942b-4f05-a6ee-0987944f17da] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:46:51 user nova-compute[75341]: INFO nova.compute.manager [-] [instance: 6a0e67fc-942b-4f05-a6ee-0987944f17da] Took 0.58 seconds to deallocate network for instance.
Nov 14 23:46:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-95929f5c-ef47-46d9-82f5-ebcad8284005 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-95929f5c-ef47-46d9-82f5-ebcad8284005 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5070fb03-8f40-426c-8c3e-192f6517f7c3/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a141d7ee-3f77-4fdc-85ec-2cbd5af17646/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:51 user nova-compute[75341]: DEBUG nova.compute.manager [req-1d6bc3bb-c372-4671-bdaa-12081a7302a4 req-199cd176-6ea0-4946-b05c-2fa0721a4216 service nova] [instance: 6a0e67fc-942b-4f05-a6ee-0987944f17da] Received event network-vif-deleted-2054f2c7-c492-4278-9a66-ee9c030df266 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:46:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a141d7ee-3f77-4fdc-85ec-2cbd5af17646/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a141d7ee-3f77-4fdc-85ec-2cbd5af17646/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:51 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:46:51 user nova-compute[75341]: INFO nova.compute.manager [-] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Took 0.45 seconds to deallocate network for instance.
Nov 14 23:46:51 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-95929f5c-ef47-46d9-82f5-ebcad8284005 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:46:51 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-95929f5c-ef47-46d9-82f5-ebcad8284005 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:46:52 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a141d7ee-3f77-4fdc-85ec-2cbd5af17646/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:52 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d92ba9df-c739-414d-a701-ddba04563427/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-95929f5c-ef47-46d9-82f5-ebcad8284005 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.490s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:52 user nova-compute[75341]: INFO nova.scheduler.client.report [None req-95929f5c-ef47-46d9-82f5-ebcad8284005 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Deleted allocations for instance 6a0e67fc-942b-4f05-a6ee-0987944f17da
Nov 14 23:46:52 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d92ba9df-c739-414d-a701-ddba04563427/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:52 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d92ba9df-c739-414d-a701-ddba04563427/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-95929f5c-ef47-46d9-82f5-ebcad8284005 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Lock "6a0e67fc-942b-4f05-a6ee-0987944f17da" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.396s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Acquiring lock "eada8790-de2a-4bfd-954c-55627e554a84" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "eada8790-de2a-4bfd-954c-55627e554a84" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:52 user nova-compute[75341]: DEBUG nova.compute.manager [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: eada8790-de2a-4bfd-954c-55627e554a84] Starting instance... {{(pid=75341) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 23:46:52 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d92ba9df-c739-414d-a701-ddba04563427/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:52 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 23:46:52 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:52 user nova-compute[75341]: DEBUG nova.compute.manager [req-df0506be-e698-4a38-9980-1ba271c2f2cf req-d584f25c-4da9-49d4-b721-4ef1fbfa6784 service nova] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Received event network-vif-plugged-dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:46:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-df0506be-e698-4a38-9980-1ba271c2f2cf req-d584f25c-4da9-49d4-b721-4ef1fbfa6784 service nova] Acquiring lock "0223a98e-e08f-4a0f-a707-3770c7a99b00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-df0506be-e698-4a38-9980-1ba271c2f2cf req-d584f25c-4da9-49d4-b721-4ef1fbfa6784 service nova] Lock "0223a98e-e08f-4a0f-a707-3770c7a99b00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-df0506be-e698-4a38-9980-1ba271c2f2cf req-d584f25c-4da9-49d4-b721-4ef1fbfa6784 service nova] Lock "0223a98e-e08f-4a0f-a707-3770c7a99b00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:52 user nova-compute[75341]: DEBUG nova.compute.manager [req-df0506be-e698-4a38-9980-1ba271c2f2cf req-d584f25c-4da9-49d4-b721-4ef1fbfa6784 service nova] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] No waiting events found dispatching network-vif-plugged-dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:46:52 user nova-compute[75341]: WARNING nova.compute.manager [req-df0506be-e698-4a38-9980-1ba271c2f2cf req-d584f25c-4da9-49d4-b721-4ef1fbfa6784 service nova] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Received unexpected event network-vif-plugged-dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e for instance with vm_state active and task_state deleting.
Nov 14 23:46:52 user nova-compute[75341]: DEBUG nova.compute.manager [req-df0506be-e698-4a38-9980-1ba271c2f2cf req-d584f25c-4da9-49d4-b721-4ef1fbfa6784 service nova] [instance: 6a0e67fc-942b-4f05-a6ee-0987944f17da] Received event network-vif-unplugged-2054f2c7-c492-4278-9a66-ee9c030df266 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:46:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-df0506be-e698-4a38-9980-1ba271c2f2cf req-d584f25c-4da9-49d4-b721-4ef1fbfa6784 service nova] Acquiring lock "6a0e67fc-942b-4f05-a6ee-0987944f17da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-df0506be-e698-4a38-9980-1ba271c2f2cf req-d584f25c-4da9-49d4-b721-4ef1fbfa6784 service nova] Lock "6a0e67fc-942b-4f05-a6ee-0987944f17da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-df0506be-e698-4a38-9980-1ba271c2f2cf req-d584f25c-4da9-49d4-b721-4ef1fbfa6784 service nova] Lock "6a0e67fc-942b-4f05-a6ee-0987944f17da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:52 user nova-compute[75341]: DEBUG nova.compute.manager [req-df0506be-e698-4a38-9980-1ba271c2f2cf req-d584f25c-4da9-49d4-b721-4ef1fbfa6784 service nova] [instance: 6a0e67fc-942b-4f05-a6ee-0987944f17da] No waiting events found dispatching network-vif-unplugged-2054f2c7-c492-4278-9a66-ee9c030df266 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:46:52 user nova-compute[75341]: WARNING nova.compute.manager [req-df0506be-e698-4a38-9980-1ba271c2f2cf req-d584f25c-4da9-49d4-b721-4ef1fbfa6784 service nova] [instance: 6a0e67fc-942b-4f05-a6ee-0987944f17da] Received unexpected event network-vif-unplugged-2054f2c7-c492-4278-9a66-ee9c030df266 for instance with vm_state deleted and task_state None.
Nov 14 23:46:52 user nova-compute[75341]: DEBUG nova.compute.manager [req-df0506be-e698-4a38-9980-1ba271c2f2cf req-d584f25c-4da9-49d4-b721-4ef1fbfa6784 service nova] [instance: 6a0e67fc-942b-4f05-a6ee-0987944f17da] Received event network-vif-plugged-2054f2c7-c492-4278-9a66-ee9c030df266 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:46:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-df0506be-e698-4a38-9980-1ba271c2f2cf req-d584f25c-4da9-49d4-b721-4ef1fbfa6784 service nova] Acquiring lock "6a0e67fc-942b-4f05-a6ee-0987944f17da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-df0506be-e698-4a38-9980-1ba271c2f2cf req-d584f25c-4da9-49d4-b721-4ef1fbfa6784 service nova] Lock "6a0e67fc-942b-4f05-a6ee-0987944f17da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-df0506be-e698-4a38-9980-1ba271c2f2cf req-d584f25c-4da9-49d4-b721-4ef1fbfa6784 service nova] Lock "6a0e67fc-942b-4f05-a6ee-0987944f17da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:52 user nova-compute[75341]: DEBUG nova.compute.manager [req-df0506be-e698-4a38-9980-1ba271c2f2cf req-d584f25c-4da9-49d4-b721-4ef1fbfa6784 service nova] [instance: 6a0e67fc-942b-4f05-a6ee-0987944f17da] No waiting events found dispatching network-vif-plugged-2054f2c7-c492-4278-9a66-ee9c030df266 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:46:52 user nova-compute[75341]: WARNING nova.compute.manager [req-df0506be-e698-4a38-9980-1ba271c2f2cf req-d584f25c-4da9-49d4-b721-4ef1fbfa6784 service nova] [instance: 6a0e67fc-942b-4f05-a6ee-0987944f17da] Received unexpected event network-vif-plugged-2054f2c7-c492-4278-9a66-ee9c030df266 for instance with vm_state deleted and task_state None.
Nov 14 23:46:52 user nova-compute[75341]: DEBUG nova.compute.manager [req-df0506be-e698-4a38-9980-1ba271c2f2cf req-d584f25c-4da9-49d4-b721-4ef1fbfa6784 service nova] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Received event network-vif-deleted-dbe5cbca-08b7-440b-a6c3-0f1a6f5f318e {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:46:52 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75341) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 23:46:52 user nova-compute[75341]: INFO nova.compute.claims [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: eada8790-de2a-4bfd-954c-55627e554a84] Claim successful on node user
Nov 14 23:46:52 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:52 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:52 user nova-compute[75341]: INFO nova.compute.manager [None req-bbc57c2e-186f-4030-b1a8-25aa6ea2aca6 tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Took 0.80 seconds to detach 1 volumes for instance.
Nov 14 23:46:52 user nova-compute[75341]: DEBUG nova.compute.manager [None req-bbc57c2e-186f-4030-b1a8-25aa6ea2aca6 tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] [instance: 0223a98e-e08f-4a0f-a707-3770c7a99b00] Deleting volume: 3d4927ae-8df9-41e3-97e6-2eef950500f7 {{(pid=75341) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 23:46:52 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:52 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk.rescue --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-bbc57c2e-186f-4030-b1a8-25aa6ea2aca6 tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:52 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:46:52 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:46:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.578s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:53 user nova-compute[75341]: DEBUG nova.compute.manager [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: eada8790-de2a-4bfd-954c-55627e554a84] Start building networks asynchronously for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 23:46:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-bbc57c2e-186f-4030-b1a8-25aa6ea2aca6 tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.150s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk.rescue --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:53 user nova-compute[75341]: DEBUG nova.compute.manager [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: eada8790-de2a-4bfd-954c-55627e554a84] Allocating IP information in the background. {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 23:46:53 user nova-compute[75341]: DEBUG nova.network.neutron [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: eada8790-de2a-4bfd-954c-55627e554a84] allocate_for_instance() {{(pid=75341) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 23:46:53 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: eada8790-de2a-4bfd-954c-55627e554a84] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 23:46:53 user nova-compute[75341]: DEBUG nova.compute.manager [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: eada8790-de2a-4bfd-954c-55627e554a84] Start building block device mappings for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 23:46:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:53 user nova-compute[75341]: DEBUG nova.compute.manager [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: eada8790-de2a-4bfd-954c-55627e554a84] Start spawning the instance on the hypervisor. {{(pid=75341) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 23:46:53 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: eada8790-de2a-4bfd-954c-55627e554a84] Creating instance directory {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 23:46:53 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: eada8790-de2a-4bfd-954c-55627e554a84] Creating image(s)
Nov 14 23:46:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Acquiring lock "/opt/stack/data/nova/instances/eada8790-de2a-4bfd-954c-55627e554a84/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "/opt/stack/data/nova/instances/eada8790-de2a-4bfd-954c-55627e554a84/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "/opt/stack/data/nova/instances/eada8790-de2a-4bfd-954c-55627e554a84/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:53 user nova-compute[75341]: DEBUG nova.policy [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd0b6eae0d3124f70982781555ccc7ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542a85b3a6d14c77872f1957120ba655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75341) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 23:46:53 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-bbc57c2e-186f-4030-b1a8-25aa6ea2aca6 tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:46:53 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-bbc57c2e-186f-4030-b1a8-25aa6ea2aca6 tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:46:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.245s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Acquiring lock "4754efee9a6d73d3647f2add2cfe86c291949740" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-bbc57c2e-186f-4030-b1a8-25aa6ea2aca6 tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.607s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:53 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Error from libvirt while getting description of instance-0000000b: [Error Code 42] Domain not found: no domain with matching uuid '0223a98e-e08f-4a0f-a707-3770c7a99b00' (instance-0000000b): libvirt.libvirtError: Domain not found: no domain with matching uuid '0223a98e-e08f-4a0f-a707-3770c7a99b00' (instance-0000000b)
Nov 14 23:46:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8aa0b26-4099-4a8d-afce-a1e990e5b1f7/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:53 user nova-compute[75341]: INFO nova.scheduler.client.report [None req-bbc57c2e-186f-4030-b1a8-25aa6ea2aca6 tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Deleted allocations for instance 0223a98e-e08f-4a0f-a707-3770c7a99b00
Nov 14 23:46:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.170s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/eada8790-de2a-4bfd-954c-55627e554a84/disk 1073741824 {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-bbc57c2e-186f-4030-b1a8-25aa6ea2aca6 tempest-TestShelveInstance-1537108126 tempest-TestShelveInstance-1537108126-project-member] Lock "0223a98e-e08f-4a0f-a707-3770c7a99b00" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.013s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/eada8790-de2a-4bfd-954c-55627e554a84/disk 1073741824" returned: 0 in 0.066s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8aa0b26-4099-4a8d-afce-a1e990e5b1f7/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8aa0b26-4099-4a8d-afce-a1e990e5b1f7/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.204s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:54 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eada8790-de2a-4bfd-954c-55627e554a84/disk. size=1073741824 {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 23:46:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eada8790-de2a-4bfd-954c-55627e554a84/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8aa0b26-4099-4a8d-afce-a1e990e5b1f7/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eada8790-de2a-4bfd-954c-55627e554a84/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:54 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Cannot resize image /opt/stack/data/nova/instances/eada8790-de2a-4bfd-954c-55627e554a84/disk to a smaller size. {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 23:46:54 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: eada8790-de2a-4bfd-954c-55627e554a84] Created local disks {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 23:46:54 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: eada8790-de2a-4bfd-954c-55627e554a84] Ensure instance console log exists: /opt/stack/data/nova/instances/eada8790-de2a-4bfd-954c-55627e554a84/console.log {{(pid=75341) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 23:46:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:46:54 user nova-compute[75341]: DEBUG nova.network.neutron [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: eada8790-de2a-4bfd-954c-55627e554a84] Successfully created port: b261a90f-503d-4ba7-839a-67203bb28e65 {{(pid=75341) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 23:46:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:46:54 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 23:46:54 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:46:54 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:46:54 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Hypervisor/Node resource view: name=user free_ram=7297MB free_disk=25.60403060913086GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75341) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 23:46:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG nova.network.neutron [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: eada8790-de2a-4bfd-954c-55627e554a84] Successfully updated port: b261a90f-503d-4ba7-839a-67203bb28e65 {{(pid=75341) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Acquiring lock "refresh_cache-eada8790-de2a-4bfd-954c-55627e554a84" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Acquired lock "refresh_cache-eada8790-de2a-4bfd-954c-55627e554a84" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG nova.network.neutron [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: eada8790-de2a-4bfd-954c-55627e554a84] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG nova.compute.manager [req-6d5f2eec-e39b-4ede-b363-92bae3feb9e5 req-9a72a0aa-a84d-442f-ab6b-4e13420a5592 service nova] [instance: eada8790-de2a-4bfd-954c-55627e554a84] Received event network-changed-b261a90f-503d-4ba7-839a-67203bb28e65 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG nova.compute.manager [req-6d5f2eec-e39b-4ede-b363-92bae3feb9e5 req-9a72a0aa-a84d-442f-ab6b-4e13420a5592 service nova] [instance: eada8790-de2a-4bfd-954c-55627e554a84] Refreshing instance network info cache due to event network-changed-b261a90f-503d-4ba7-839a-67203bb28e65. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6d5f2eec-e39b-4ede-b363-92bae3feb9e5 req-9a72a0aa-a84d-442f-ab6b-4e13420a5592 service nova] Acquiring lock "refresh_cache-eada8790-de2a-4bfd-954c-55627e554a84" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 881351d7-31f9-44f4-8571-8f540bbec29c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance a141d7ee-3f77-4fdc-85ec-2cbd5af17646 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 51045050-c7c6-49c5-acd4-2a76be0f466f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 6382e432-838f-4d89-a743-cbaa37f50ab5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance d92ba9df-c739-414d-a701-ddba04563427 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 896ee337-80bf-47c3-9530-861c941a2fc6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance c8aa0b26-4099-4a8d-afce-a1e990e5b1f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 5070fb03-8f40-426c-8c3e-192f6517f7c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance eada8790-de2a-4bfd-954c-55627e554a84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG nova.network.neutron [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: eada8790-de2a-4bfd-954c-55627e554a84] Instance cache missing network info. {{(pid=75341) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG nova.network.neutron [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: eada8790-de2a-4bfd-954c-55627e554a84] Updating instance_info_cache with network_info: [{"id": "b261a90f-503d-4ba7-839a-67203bb28e65", "address": "fa:16:3e:e2:ae:53", "network": {"id": "9ad7204e-07f5-4676-b2de-09e036a92e61", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-718201239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542a85b3a6d14c77872f1957120ba655", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb261a90f-50", "ovs_interfaceid": "b261a90f-503d-4ba7-839a-67203bb28e65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Releasing lock "refresh_cache-eada8790-de2a-4bfd-954c-55627e554a84" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG nova.compute.manager [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: eada8790-de2a-4bfd-954c-55627e554a84] Instance network_info: |[{"id": "b261a90f-503d-4ba7-839a-67203bb28e65", "address": "fa:16:3e:e2:ae:53", "network": {"id": "9ad7204e-07f5-4676-b2de-09e036a92e61", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-718201239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542a85b3a6d14c77872f1957120ba655", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb261a90f-50", "ovs_interfaceid": "b261a90f-503d-4ba7-839a-67203bb28e65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6d5f2eec-e39b-4ede-b363-92bae3feb9e5 req-9a72a0aa-a84d-442f-ab6b-4e13420a5592 service nova] Acquired lock "refresh_cache-eada8790-de2a-4bfd-954c-55627e554a84" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG nova.network.neutron [req-6d5f2eec-e39b-4ede-b363-92bae3feb9e5 req-9a72a0aa-a84d-442f-ab6b-4e13420a5592 service nova] [instance: eada8790-de2a-4bfd-954c-55627e554a84] Refreshing network info cache for port b261a90f-503d-4ba7-839a-67203bb28e65 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: eada8790-de2a-4bfd-954c-55627e554a84] Start _get_guest_xml network_info=[{"id": "b261a90f-503d-4ba7-839a-67203bb28e65", "address": "fa:16:3e:e2:ae:53", "network": {"id": "9ad7204e-07f5-4676-b2de-09e036a92e61", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-718201239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542a85b3a6d14c77872f1957120ba655", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb261a90f-50", "ovs_interfaceid": "b261a90f-503d-4ba7-839a-67203bb28e65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encrypted': False, 'image_id': 'e46abb82-b810-490e-a8a1-ccdc5fa1a796'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 23:46:55 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:46:55 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:46:55 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Compute_service record updated for user:user {{(pid=75341) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.492s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:46:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1996063953',display_name='tempest-AttachVolumeNegativeTest-server-1996063953',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1996063953',id=24,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDsI/+Jm9ziTKZZ63fwRKNxVrhKSKgFpH2Jq/ejIMTfRjOynsKPylcTJbZUom3nh8LxLpyC2SuC26uYF0v06JsmfPVRX8vy1vg5bOXpqVzYzAHFjlh5QKm/wErEHzZI0HQ==',key_name='tempest-keypair-708836602',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='542a85b3a6d14c77872f1957120ba655',ramdisk_id='',reservation_id='r-7x7895p9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-802469934',owner_user_name='tempest-AttachVolumeNegativeTest-802469934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:46:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d0b6eae0d3124f70982781555ccc7ec0',uuid=eada8790-de2a-4bfd-954c-55627e554a84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b261a90f-503d-4ba7-839a-67203bb28e65", "address": "fa:16:3e:e2:ae:53", "network": {"id": "9ad7204e-07f5-4676-b2de-09e036a92e61", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-718201239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542a85b3a6d14c77872f1957120ba655", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb261a90f-50", "ovs_interfaceid": "b261a90f-503d-4ba7-839a-67203bb28e65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Converting VIF {"id": "b261a90f-503d-4ba7-839a-67203bb28e65", "address": "fa:16:3e:e2:ae:53", "network": {"id": "9ad7204e-07f5-4676-b2de-09e036a92e61", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-718201239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542a85b3a6d14c77872f1957120ba655", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb261a90f-50", "ovs_interfaceid": "b261a90f-503d-4ba7-839a-67203bb28e65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:ae:53,bridge_name='br-int',has_traffic_filtering=True,id=b261a90f-503d-4ba7-839a-67203bb28e65,network=Network(9ad7204e-07f5-4676-b2de-09e036a92e61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb261a90f-50') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG nova.objects.instance [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lazy-loading 'pci_devices' on Instance uuid eada8790-de2a-4bfd-954c-55627e554a84 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: eada8790-de2a-4bfd-954c-55627e554a84] End _get_guest_xml xml=<domain type="kvm">
Nov 14 23:46:55 user nova-compute[75341]:   <uuid>eada8790-de2a-4bfd-954c-55627e554a84</uuid>
Nov 14 23:46:55 user nova-compute[75341]:   <name>instance-00000018</name>
Nov 14 23:46:55 user nova-compute[75341]:   <memory>524288</memory>
Nov 14 23:46:55 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 14 23:46:55 user nova-compute[75341]:   <metadata>
Nov 14 23:46:55 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 23:46:55 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 14 23:46:55 user nova-compute[75341]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1996063953</nova:name>
Nov 14 23:46:55 user nova-compute[75341]:       <nova:creationTime>2023-11-14 23:46:55</nova:creationTime>
Nov 14 23:46:55 user nova-compute[75341]:       <nova:flavor name="m1.tiny">
Nov 14 23:46:55 user nova-compute[75341]:         <nova:memory>512</nova:memory>
Nov 14 23:46:55 user nova-compute[75341]:         <nova:disk>1</nova:disk>
Nov 14 23:46:55 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 14 23:46:55 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 23:46:55 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 14 23:46:55 user nova-compute[75341]:       </nova:flavor>
Nov 14 23:46:55 user nova-compute[75341]:       <nova:owner>
Nov 14 23:46:55 user nova-compute[75341]:         <nova:user uuid="d0b6eae0d3124f70982781555ccc7ec0">tempest-AttachVolumeNegativeTest-802469934-project-member</nova:user>
Nov 14 23:46:55 user nova-compute[75341]:         <nova:project uuid="542a85b3a6d14c77872f1957120ba655">tempest-AttachVolumeNegativeTest-802469934</nova:project>
Nov 14 23:46:55 user nova-compute[75341]:       </nova:owner>
Nov 14 23:46:55 user nova-compute[75341]:       <nova:root type="image" uuid="e46abb82-b810-490e-a8a1-ccdc5fa1a796"/>
Nov 14 23:46:55 user nova-compute[75341]:       <nova:ports>
Nov 14 23:46:55 user nova-compute[75341]:         <nova:port uuid="b261a90f-503d-4ba7-839a-67203bb28e65">
Nov 14 23:46:55 user nova-compute[75341]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 23:46:55 user nova-compute[75341]:         </nova:port>
Nov 14 23:46:55 user nova-compute[75341]:       </nova:ports>
Nov 14 23:46:55 user nova-compute[75341]:     </nova:instance>
Nov 14 23:46:55 user nova-compute[75341]:   </metadata>
Nov 14 23:46:55 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 14 23:46:55 user nova-compute[75341]:     <system>
Nov 14 23:46:55 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 23:46:55 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 14 23:46:55 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 14 23:46:55 user nova-compute[75341]:       <entry name="serial">eada8790-de2a-4bfd-954c-55627e554a84</entry>
Nov 14 23:46:55 user nova-compute[75341]:       <entry name="uuid">eada8790-de2a-4bfd-954c-55627e554a84</entry>
Nov 14 23:46:55 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 14 23:46:55 user nova-compute[75341]:     </system>
Nov 14 23:46:55 user nova-compute[75341]:   </sysinfo>
Nov 14 23:46:55 user nova-compute[75341]:   <os>
Nov 14 23:46:55 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 23:46:55 user nova-compute[75341]:     <boot dev="hd"/>
Nov 14 23:46:55 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 14 23:46:55 user nova-compute[75341]:   </os>
Nov 14 23:46:55 user nova-compute[75341]:   <features>
Nov 14 23:46:55 user nova-compute[75341]:     <acpi/>
Nov 14 23:46:55 user nova-compute[75341]:     <apic/>
Nov 14 23:46:55 user nova-compute[75341]:     <vmcoreinfo/>
Nov 14 23:46:55 user nova-compute[75341]:   </features>
Nov 14 23:46:55 user nova-compute[75341]:   <clock offset="utc">
Nov 14 23:46:55 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 23:46:55 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 23:46:55 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 14 23:46:55 user nova-compute[75341]:   </clock>
Nov 14 23:46:55 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 14 23:46:55 user nova-compute[75341]:     <model>Nehalem</model>
Nov 14 23:46:55 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 23:46:55 user nova-compute[75341]:   </cpu>
Nov 14 23:46:55 user nova-compute[75341]:   <devices>
Nov 14 23:46:55 user nova-compute[75341]:     <disk type="file" device="disk">
Nov 14 23:46:55 user nova-compute[75341]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 23:46:55 user nova-compute[75341]:       <source file="/opt/stack/data/nova/instances/eada8790-de2a-4bfd-954c-55627e554a84/disk"/>
Nov 14 23:46:55 user nova-compute[75341]:       <target dev="vda" bus="virtio"/>
Nov 14 23:46:55 user nova-compute[75341]:     </disk>
Nov 14 23:46:55 user nova-compute[75341]:     <interface type="ethernet">
Nov 14 23:46:55 user nova-compute[75341]:       <mac address="fa:16:3e:e2:ae:53"/>
Nov 14 23:46:55 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:46:55 user nova-compute[75341]:       <mtu size="1442"/>
Nov 14 23:46:55 user nova-compute[75341]:       <target dev="tapb261a90f-50"/>
Nov 14 23:46:55 user nova-compute[75341]:     </interface>
Nov 14 23:46:55 user nova-compute[75341]:     <serial type="pty">
Nov 14 23:46:55 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/eada8790-de2a-4bfd-954c-55627e554a84/console.log" append="off"/>
Nov 14 23:46:55 user nova-compute[75341]:     </serial>
Nov 14 23:46:55 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 23:46:55 user nova-compute[75341]:     <video>
Nov 14 23:46:55 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:46:55 user nova-compute[75341]:     </video>
Nov 14 23:46:55 user nova-compute[75341]:     <rng model="virtio">
Nov 14 23:46:55 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 14 23:46:55 user nova-compute[75341]:     </rng>
Nov 14 23:46:55 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 14 23:46:55 user nova-compute[75341]:     <memballoon model="virtio">
Nov 14 23:46:55 user nova-compute[75341]:       <stats period="10"/>
Nov 14 23:46:55 user nova-compute[75341]:     </memballoon>
Nov 14 23:46:55 user nova-compute[75341]:   </devices>
Nov 14 23:46:55 user nova-compute[75341]: </domain>
Nov 14 23:46:55 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:46:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1996063953',display_name='tempest-AttachVolumeNegativeTest-server-1996063953',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1996063953',id=24,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDsI/+Jm9ziTKZZ63fwRKNxVrhKSKgFpH2Jq/ejIMTfRjOynsKPylcTJbZUom3nh8LxLpyC2SuC26uYF0v06JsmfPVRX8vy1vg5bOXpqVzYzAHFjlh5QKm/wErEHzZI0HQ==',key_name='tempest-keypair-708836602',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='542a85b3a6d14c77872f1957120ba655',ramdisk_id='',reservation_id='r-7x7895p9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-802469934',owner_user_name='tempest-AttachVolumeNegativeTest-802469934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:46:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d0b6eae0d3124f70982781555ccc7ec0',uuid=eada8790-de2a-4bfd-954c-55627e554a84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b261a90f-503d-4ba7-839a-67203bb28e65", "address": "fa:16:3e:e2:ae:53", "network": {"id": "9ad7204e-07f5-4676-b2de-09e036a92e61", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-718201239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542a85b3a6d14c77872f1957120ba655", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb261a90f-50", "ovs_interfaceid": "b261a90f-503d-4ba7-839a-67203bb28e65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Converting VIF {"id": "b261a90f-503d-4ba7-839a-67203bb28e65", "address": "fa:16:3e:e2:ae:53", "network": {"id": "9ad7204e-07f5-4676-b2de-09e036a92e61", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-718201239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542a85b3a6d14c77872f1957120ba655", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb261a90f-50", "ovs_interfaceid": "b261a90f-503d-4ba7-839a-67203bb28e65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:ae:53,bridge_name='br-int',has_traffic_filtering=True,id=b261a90f-503d-4ba7-839a-67203bb28e65,network=Network(9ad7204e-07f5-4676-b2de-09e036a92e61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb261a90f-50') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG os_vif [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:ae:53,bridge_name='br-int',has_traffic_filtering=True,id=b261a90f-503d-4ba7-839a-67203bb28e65,network=Network(9ad7204e-07f5-4676-b2de-09e036a92e61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb261a90f-50') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3c744b61-af18-5239-8955-f86031a04754', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb261a90f-50, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb261a90f-50, col_values=(('qos', UUID('b606b3ba-caa8-40a5-900e-b7a0df71ca57')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb261a90f-50, col_values=(('external_ids', {'iface-id': 'b261a90f-503d-4ba7-839a-67203bb28e65', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:ae:53', 'vm-uuid': 'eada8790-de2a-4bfd-954c-55627e554a84'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:55 user nova-compute[75341]: INFO os_vif [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:ae:53,bridge_name='br-int',has_traffic_filtering=True,id=b261a90f-503d-4ba7-839a-67203bb28e65,network=Network(9ad7204e-07f5-4676-b2de-09e036a92e61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb261a90f-50')
Nov 14 23:46:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] No VIF found with MAC fa:16:3e:e2:ae:53, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG nova.network.neutron [req-6d5f2eec-e39b-4ede-b363-92bae3feb9e5 req-9a72a0aa-a84d-442f-ab6b-4e13420a5592 service nova] [instance: eada8790-de2a-4bfd-954c-55627e554a84] Updated VIF entry in instance network info cache for port b261a90f-503d-4ba7-839a-67203bb28e65. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG nova.network.neutron [req-6d5f2eec-e39b-4ede-b363-92bae3feb9e5 req-9a72a0aa-a84d-442f-ab6b-4e13420a5592 service nova] [instance: eada8790-de2a-4bfd-954c-55627e554a84] Updating instance_info_cache with network_info: [{"id": "b261a90f-503d-4ba7-839a-67203bb28e65", "address": "fa:16:3e:e2:ae:53", "network": {"id": "9ad7204e-07f5-4676-b2de-09e036a92e61", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-718201239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542a85b3a6d14c77872f1957120ba655", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb261a90f-50", "ovs_interfaceid": "b261a90f-503d-4ba7-839a-67203bb28e65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:46:55 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6d5f2eec-e39b-4ede-b363-92bae3feb9e5 req-9a72a0aa-a84d-442f-ab6b-4e13420a5592 service nova] Releasing lock "refresh_cache-eada8790-de2a-4bfd-954c-55627e554a84" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:46:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:56 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:46:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:57 user nova-compute[75341]: DEBUG nova.compute.manager [req-6627617e-2b98-43f6-ac87-fb405bd7e2d5 req-18926cd7-d00f-4d71-bec1-5602c2ef394a service nova] [instance: eada8790-de2a-4bfd-954c-55627e554a84] Received event network-vif-plugged-b261a90f-503d-4ba7-839a-67203bb28e65 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:46:57 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6627617e-2b98-43f6-ac87-fb405bd7e2d5 req-18926cd7-d00f-4d71-bec1-5602c2ef394a service nova] Acquiring lock "eada8790-de2a-4bfd-954c-55627e554a84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:57 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6627617e-2b98-43f6-ac87-fb405bd7e2d5 req-18926cd7-d00f-4d71-bec1-5602c2ef394a service nova] Lock "eada8790-de2a-4bfd-954c-55627e554a84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:57 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6627617e-2b98-43f6-ac87-fb405bd7e2d5 req-18926cd7-d00f-4d71-bec1-5602c2ef394a service nova] Lock "eada8790-de2a-4bfd-954c-55627e554a84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:57 user nova-compute[75341]: DEBUG nova.compute.manager [req-6627617e-2b98-43f6-ac87-fb405bd7e2d5 req-18926cd7-d00f-4d71-bec1-5602c2ef394a service nova] [instance: eada8790-de2a-4bfd-954c-55627e554a84] No waiting events found dispatching network-vif-plugged-b261a90f-503d-4ba7-839a-67203bb28e65 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:46:57 user nova-compute[75341]: WARNING nova.compute.manager [req-6627617e-2b98-43f6-ac87-fb405bd7e2d5 req-18926cd7-d00f-4d71-bec1-5602c2ef394a service nova] [instance: eada8790-de2a-4bfd-954c-55627e554a84] Received unexpected event network-vif-plugged-b261a90f-503d-4ba7-839a-67203bb28e65 for instance with vm_state building and task_state spawning.
Nov 14 23:46:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:46:59 user nova-compute[75341]: DEBUG nova.compute.manager [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: eada8790-de2a-4bfd-954c-55627e554a84] Instance event wait completed in 0 seconds for  {{(pid=75341) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 23:46:59 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: eada8790-de2a-4bfd-954c-55627e554a84] Guest created on hypervisor {{(pid=75341) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 23:46:59 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: eada8790-de2a-4bfd-954c-55627e554a84] Instance spawned successfully.
Nov 14 23:46:59 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: eada8790-de2a-4bfd-954c-55627e554a84] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 23:46:59 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: eada8790-de2a-4bfd-954c-55627e554a84] Found default for hw_cdrom_bus of ide {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:46:59 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: eada8790-de2a-4bfd-954c-55627e554a84] Found default for hw_disk_bus of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:46:59 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: eada8790-de2a-4bfd-954c-55627e554a84] Found default for hw_input_bus of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:46:59 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: eada8790-de2a-4bfd-954c-55627e554a84] Found default for hw_pointer_model of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:46:59 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: eada8790-de2a-4bfd-954c-55627e554a84] Found default for hw_video_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:46:59 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: eada8790-de2a-4bfd-954c-55627e554a84] Found default for hw_vif_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:46:59 user nova-compute[75341]: INFO nova.compute.manager [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: eada8790-de2a-4bfd-954c-55627e554a84] Took 5.82 seconds to spawn the instance on the hypervisor.
Nov 14 23:46:59 user nova-compute[75341]: DEBUG nova.compute.manager [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: eada8790-de2a-4bfd-954c-55627e554a84] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 23:46:59 user nova-compute[75341]: DEBUG nova.compute.manager [req-233e4066-248b-4389-aa1d-afe3b1da4e44 req-150e855e-733e-49a4-8fad-c7552403e338 service nova] [instance: eada8790-de2a-4bfd-954c-55627e554a84] Received event network-vif-plugged-b261a90f-503d-4ba7-839a-67203bb28e65 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:46:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-233e4066-248b-4389-aa1d-afe3b1da4e44 req-150e855e-733e-49a4-8fad-c7552403e338 service nova] Acquiring lock "eada8790-de2a-4bfd-954c-55627e554a84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:46:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-233e4066-248b-4389-aa1d-afe3b1da4e44 req-150e855e-733e-49a4-8fad-c7552403e338 service nova] Lock "eada8790-de2a-4bfd-954c-55627e554a84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:46:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-233e4066-248b-4389-aa1d-afe3b1da4e44 req-150e855e-733e-49a4-8fad-c7552403e338 service nova] Lock "eada8790-de2a-4bfd-954c-55627e554a84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:46:59 user nova-compute[75341]: DEBUG nova.compute.manager [req-233e4066-248b-4389-aa1d-afe3b1da4e44 req-150e855e-733e-49a4-8fad-c7552403e338 service nova] [instance: eada8790-de2a-4bfd-954c-55627e554a84] No waiting events found dispatching network-vif-plugged-b261a90f-503d-4ba7-839a-67203bb28e65 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:46:59 user nova-compute[75341]: WARNING nova.compute.manager [req-233e4066-248b-4389-aa1d-afe3b1da4e44 req-150e855e-733e-49a4-8fad-c7552403e338 service nova] [instance: eada8790-de2a-4bfd-954c-55627e554a84] Received unexpected event network-vif-plugged-b261a90f-503d-4ba7-839a-67203bb28e65 for instance with vm_state building and task_state spawning.
Nov 14 23:46:59 user nova-compute[75341]: INFO nova.compute.manager [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: eada8790-de2a-4bfd-954c-55627e554a84] Took 6.87 seconds to build instance.
Nov 14 23:46:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e18bc7ba-5ff8-4710-93d5-a1ea212a2111 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "eada8790-de2a-4bfd-954c-55627e554a84" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.986s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:47:00 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Acquiring lock "defae731-4191-4526-99cc-a301cf5b3355" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:47:00 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "defae731-4191-4526-99cc-a301cf5b3355" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:47:00 user nova-compute[75341]: DEBUG nova.compute.manager [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: defae731-4191-4526-99cc-a301cf5b3355] Starting instance... {{(pid=75341) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 23:47:00 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:47:00 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:47:00 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75341) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 23:47:00 user nova-compute[75341]: INFO nova.compute.claims [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: defae731-4191-4526-99cc-a301cf5b3355] Claim successful on node user
Nov 14 23:47:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:00 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:47:00 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:47:00 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.417s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:47:00 user nova-compute[75341]: DEBUG nova.compute.manager [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: defae731-4191-4526-99cc-a301cf5b3355] Start building networks asynchronously for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 23:47:00 user nova-compute[75341]: DEBUG nova.compute.manager [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: defae731-4191-4526-99cc-a301cf5b3355] Allocating IP information in the background. {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 23:47:01 user nova-compute[75341]: DEBUG nova.network.neutron [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: defae731-4191-4526-99cc-a301cf5b3355] allocate_for_instance() {{(pid=75341) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 23:47:01 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: defae731-4191-4526-99cc-a301cf5b3355] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 23:47:01 user nova-compute[75341]: DEBUG nova.compute.manager [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: defae731-4191-4526-99cc-a301cf5b3355] Start building block device mappings for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 23:47:01 user nova-compute[75341]: DEBUG nova.policy [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '442aae0161f347d0a79b168a1b60286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c69a942b4f4b97a1a3152dea86c7fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75341) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 23:47:01 user nova-compute[75341]: DEBUG nova.compute.manager [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: defae731-4191-4526-99cc-a301cf5b3355] Start spawning the instance on the hypervisor. {{(pid=75341) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 23:47:01 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: defae731-4191-4526-99cc-a301cf5b3355] Creating instance directory {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 23:47:01 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: defae731-4191-4526-99cc-a301cf5b3355] Creating image(s)
Nov 14 23:47:01 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Acquiring lock "/opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:47:01 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "/opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:47:01 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "/opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:47:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:47:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.187s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:47:01 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Acquiring lock "4754efee9a6d73d3647f2add2cfe86c291949740" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:47:01 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:47:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:47:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.208s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:47:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk 1073741824 {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:47:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk 1073741824" returned: 0 in 0.053s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:47:01 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:47:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:47:01 user nova-compute[75341]: DEBUG nova.network.neutron [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: defae731-4191-4526-99cc-a301cf5b3355] Successfully created port: 10b83231-0b39-4dee-95db-bb6a03d70fc0 {{(pid=75341) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 23:47:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.200s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:47:01 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Checking if we can resize image /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk. size=1073741824 {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 23:47:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:47:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:47:02 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Cannot resize image /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk to a smaller size. {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 23:47:02 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: defae731-4191-4526-99cc-a301cf5b3355] Created local disks {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 23:47:02 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: defae731-4191-4526-99cc-a301cf5b3355] Ensure instance console log exists: /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/console.log {{(pid=75341) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 23:47:02 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:47:02 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:47:02 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:47:02 user nova-compute[75341]: DEBUG nova.network.neutron [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: defae731-4191-4526-99cc-a301cf5b3355] Successfully updated port: 10b83231-0b39-4dee-95db-bb6a03d70fc0 {{(pid=75341) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 23:47:02 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Acquiring lock "refresh_cache-defae731-4191-4526-99cc-a301cf5b3355" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:47:02 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Acquired lock "refresh_cache-defae731-4191-4526-99cc-a301cf5b3355" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:47:02 user nova-compute[75341]: DEBUG nova.network.neutron [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: defae731-4191-4526-99cc-a301cf5b3355] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 23:47:02 user nova-compute[75341]: DEBUG nova.compute.manager [req-77bba4de-1bcc-4a57-827c-528738de1a3e req-a5d1b7ac-347a-4b05-8e16-6897933212a0 service nova] [instance: defae731-4191-4526-99cc-a301cf5b3355] Received event network-changed-10b83231-0b39-4dee-95db-bb6a03d70fc0 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:47:02 user nova-compute[75341]: DEBUG nova.compute.manager [req-77bba4de-1bcc-4a57-827c-528738de1a3e req-a5d1b7ac-347a-4b05-8e16-6897933212a0 service nova] [instance: defae731-4191-4526-99cc-a301cf5b3355] Refreshing instance network info cache due to event network-changed-10b83231-0b39-4dee-95db-bb6a03d70fc0. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:47:02 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-77bba4de-1bcc-4a57-827c-528738de1a3e req-a5d1b7ac-347a-4b05-8e16-6897933212a0 service nova] Acquiring lock "refresh_cache-defae731-4191-4526-99cc-a301cf5b3355" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:47:02 user nova-compute[75341]: DEBUG nova.network.neutron [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: defae731-4191-4526-99cc-a301cf5b3355] Instance cache missing network info. {{(pid=75341) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 23:47:02 user nova-compute[75341]: DEBUG nova.network.neutron [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: defae731-4191-4526-99cc-a301cf5b3355] Updating instance_info_cache with network_info: [{"id": "10b83231-0b39-4dee-95db-bb6a03d70fc0", "address": "fa:16:3e:b7:3a:83", "network": {"id": "d86a8e7f-6658-4994-9a13-eb3163bd3865", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-635863702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c69a942b4f4b97a1a3152dea86c7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10b83231-0b", "ovs_interfaceid": "10b83231-0b39-4dee-95db-bb6a03d70fc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:47:02 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Releasing lock "refresh_cache-defae731-4191-4526-99cc-a301cf5b3355" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:47:02 user nova-compute[75341]: DEBUG nova.compute.manager [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: defae731-4191-4526-99cc-a301cf5b3355] Instance network_info: |[{"id": "10b83231-0b39-4dee-95db-bb6a03d70fc0", "address": "fa:16:3e:b7:3a:83", "network": {"id": "d86a8e7f-6658-4994-9a13-eb3163bd3865", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-635863702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c69a942b4f4b97a1a3152dea86c7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10b83231-0b", "ovs_interfaceid": "10b83231-0b39-4dee-95db-bb6a03d70fc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 23:47:02 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-77bba4de-1bcc-4a57-827c-528738de1a3e req-a5d1b7ac-347a-4b05-8e16-6897933212a0 service nova] Acquired lock "refresh_cache-defae731-4191-4526-99cc-a301cf5b3355" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:47:02 user nova-compute[75341]: DEBUG nova.network.neutron [req-77bba4de-1bcc-4a57-827c-528738de1a3e req-a5d1b7ac-347a-4b05-8e16-6897933212a0 service nova] [instance: defae731-4191-4526-99cc-a301cf5b3355] Refreshing network info cache for port 10b83231-0b39-4dee-95db-bb6a03d70fc0 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:47:02 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: defae731-4191-4526-99cc-a301cf5b3355] Start _get_guest_xml network_info=[{"id": "10b83231-0b39-4dee-95db-bb6a03d70fc0", "address": "fa:16:3e:b7:3a:83", "network": {"id": "d86a8e7f-6658-4994-9a13-eb3163bd3865", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-635863702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c69a942b4f4b97a1a3152dea86c7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10b83231-0b", "ovs_interfaceid": "10b83231-0b39-4dee-95db-bb6a03d70fc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encrypted': False, 'image_id': 'e46abb82-b810-490e-a8a1-ccdc5fa1a796'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 23:47:02 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:47:02 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:47:02 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 23:47:02 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 23:47:02 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 23:47:02 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 23:47:02 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 23:47:02 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 23:47:02 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 23:47:02 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 23:47:02 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 23:47:02 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 23:47:02 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 23:47:02 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 23:47:02 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 23:47:02 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 23:47:02 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 23:47:02 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 23:47:02 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:46:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-285831932',display_name='tempest-ServerActionsTestOtherA-server-285831932',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-285831932',id=25,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTmBE+Takjbl0ZrUdtoD/FDS2CHZC4n75Y/1LCLwXLZHE8J0GqhfVD/envyBMKYWUkAGQH/bKcOVnVKa4qF07KOQ/PvMrk+gG45OxOvZ8A6PGkmy0qPqzF8MOOmxhYzVQ==',key_name='tempest-keypair-1744456340',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4c69a942b4f4b97a1a3152dea86c7fb',ramdisk_id='',reservation_id='r-p3i0uwft',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1796396043',owner_user_name='tempest-ServerActionsTestOtherA-1796396043-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:47:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='442aae0161f347d0a79b168a1b60286a',uuid=defae731-4191-4526-99cc-a301cf5b3355,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10b83231-0b39-4dee-95db-bb6a03d70fc0", "address": "fa:16:3e:b7:3a:83", "network": {"id": "d86a8e7f-6658-4994-9a13-eb3163bd3865", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-635863702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c69a942b4f4b97a1a3152dea86c7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10b83231-0b", "ovs_interfaceid": "10b83231-0b39-4dee-95db-bb6a03d70fc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:47:02 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Converting VIF {"id": "10b83231-0b39-4dee-95db-bb6a03d70fc0", "address": "fa:16:3e:b7:3a:83", "network": {"id": "d86a8e7f-6658-4994-9a13-eb3163bd3865", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-635863702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c69a942b4f4b97a1a3152dea86c7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10b83231-0b", "ovs_interfaceid": "10b83231-0b39-4dee-95db-bb6a03d70fc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:47:02 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:3a:83,bridge_name='br-int',has_traffic_filtering=True,id=10b83231-0b39-4dee-95db-bb6a03d70fc0,network=Network(d86a8e7f-6658-4994-9a13-eb3163bd3865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10b83231-0b') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:47:02 user nova-compute[75341]: DEBUG nova.objects.instance [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lazy-loading 'pci_devices' on Instance uuid defae731-4191-4526-99cc-a301cf5b3355 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:47:02 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: defae731-4191-4526-99cc-a301cf5b3355] End _get_guest_xml xml=<domain type="kvm">
Nov 14 23:47:02 user nova-compute[75341]:   <uuid>defae731-4191-4526-99cc-a301cf5b3355</uuid>
Nov 14 23:47:02 user nova-compute[75341]:   <name>instance-00000019</name>
Nov 14 23:47:02 user nova-compute[75341]:   <memory>524288</memory>
Nov 14 23:47:02 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 14 23:47:02 user nova-compute[75341]:   <metadata>
Nov 14 23:47:02 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 23:47:02 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 14 23:47:02 user nova-compute[75341]:       <nova:name>tempest-ServerActionsTestOtherA-server-285831932</nova:name>
Nov 14 23:47:02 user nova-compute[75341]:       <nova:creationTime>2023-11-14 23:47:02</nova:creationTime>
Nov 14 23:47:02 user nova-compute[75341]:       <nova:flavor name="m1.tiny">
Nov 14 23:47:02 user nova-compute[75341]:         <nova:memory>512</nova:memory>
Nov 14 23:47:02 user nova-compute[75341]:         <nova:disk>1</nova:disk>
Nov 14 23:47:02 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 14 23:47:02 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 23:47:02 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 14 23:47:02 user nova-compute[75341]:       </nova:flavor>
Nov 14 23:47:02 user nova-compute[75341]:       <nova:owner>
Nov 14 23:47:02 user nova-compute[75341]:         <nova:user uuid="442aae0161f347d0a79b168a1b60286a">tempest-ServerActionsTestOtherA-1796396043-project-member</nova:user>
Nov 14 23:47:02 user nova-compute[75341]:         <nova:project uuid="f4c69a942b4f4b97a1a3152dea86c7fb">tempest-ServerActionsTestOtherA-1796396043</nova:project>
Nov 14 23:47:02 user nova-compute[75341]:       </nova:owner>
Nov 14 23:47:02 user nova-compute[75341]:       <nova:root type="image" uuid="e46abb82-b810-490e-a8a1-ccdc5fa1a796"/>
Nov 14 23:47:02 user nova-compute[75341]:       <nova:ports>
Nov 14 23:47:02 user nova-compute[75341]:         <nova:port uuid="10b83231-0b39-4dee-95db-bb6a03d70fc0">
Nov 14 23:47:02 user nova-compute[75341]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 23:47:02 user nova-compute[75341]:         </nova:port>
Nov 14 23:47:02 user nova-compute[75341]:       </nova:ports>
Nov 14 23:47:02 user nova-compute[75341]:     </nova:instance>
Nov 14 23:47:02 user nova-compute[75341]:   </metadata>
Nov 14 23:47:02 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 14 23:47:02 user nova-compute[75341]:     <system>
Nov 14 23:47:02 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 23:47:02 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 14 23:47:02 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 14 23:47:02 user nova-compute[75341]:       <entry name="serial">defae731-4191-4526-99cc-a301cf5b3355</entry>
Nov 14 23:47:02 user nova-compute[75341]:       <entry name="uuid">defae731-4191-4526-99cc-a301cf5b3355</entry>
Nov 14 23:47:02 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 14 23:47:02 user nova-compute[75341]:     </system>
Nov 14 23:47:02 user nova-compute[75341]:   </sysinfo>
Nov 14 23:47:02 user nova-compute[75341]:   <os>
Nov 14 23:47:02 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 23:47:02 user nova-compute[75341]:     <boot dev="hd"/>
Nov 14 23:47:02 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 14 23:47:02 user nova-compute[75341]:   </os>
Nov 14 23:47:02 user nova-compute[75341]:   <features>
Nov 14 23:47:02 user nova-compute[75341]:     <acpi/>
Nov 14 23:47:02 user nova-compute[75341]:     <apic/>
Nov 14 23:47:02 user nova-compute[75341]:     <vmcoreinfo/>
Nov 14 23:47:02 user nova-compute[75341]:   </features>
Nov 14 23:47:02 user nova-compute[75341]:   <clock offset="utc">
Nov 14 23:47:02 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 23:47:02 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 23:47:02 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 14 23:47:02 user nova-compute[75341]:   </clock>
Nov 14 23:47:02 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 14 23:47:02 user nova-compute[75341]:     <model>Nehalem</model>
Nov 14 23:47:02 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 23:47:02 user nova-compute[75341]:   </cpu>
Nov 14 23:47:02 user nova-compute[75341]:   <devices>
Nov 14 23:47:02 user nova-compute[75341]:     <disk type="file" device="disk">
Nov 14 23:47:02 user nova-compute[75341]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 23:47:02 user nova-compute[75341]:       <source file="/opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk"/>
Nov 14 23:47:02 user nova-compute[75341]:       <target dev="vda" bus="virtio"/>
Nov 14 23:47:02 user nova-compute[75341]:     </disk>
Nov 14 23:47:02 user nova-compute[75341]:     <interface type="ethernet">
Nov 14 23:47:02 user nova-compute[75341]:       <mac address="fa:16:3e:b7:3a:83"/>
Nov 14 23:47:02 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:47:02 user nova-compute[75341]:       <mtu size="1442"/>
Nov 14 23:47:02 user nova-compute[75341]:       <target dev="tap10b83231-0b"/>
Nov 14 23:47:02 user nova-compute[75341]:     </interface>
Nov 14 23:47:02 user nova-compute[75341]:     <serial type="pty">
Nov 14 23:47:02 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/console.log" append="off"/>
Nov 14 23:47:02 user nova-compute[75341]:     </serial>
Nov 14 23:47:02 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 23:47:02 user nova-compute[75341]:     <video>
Nov 14 23:47:02 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:47:02 user nova-compute[75341]:     </video>
Nov 14 23:47:02 user nova-compute[75341]:     <rng model="virtio">
Nov 14 23:47:02 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 14 23:47:02 user nova-compute[75341]:     </rng>
Nov 14 23:47:02 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 14 23:47:02 user nova-compute[75341]:     <memballoon model="virtio">
Nov 14 23:47:02 user nova-compute[75341]:       <stats period="10"/>
Nov 14 23:47:02 user nova-compute[75341]:     </memballoon>
Nov 14 23:47:02 user nova-compute[75341]:   </devices>
Nov 14 23:47:02 user nova-compute[75341]: </domain>
Nov 14 23:47:02 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 23:47:02 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:46:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-285831932',display_name='tempest-ServerActionsTestOtherA-server-285831932',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-285831932',id=25,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTmBE+Takjbl0ZrUdtoD/FDS2CHZC4n75Y/1LCLwXLZHE8J0GqhfVD/envyBMKYWUkAGQH/bKcOVnVKa4qF07KOQ/PvMrk+gG45OxOvZ8A6PGkmy0qPqzF8MOOmxhYzVQ==',key_name='tempest-keypair-1744456340',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4c69a942b4f4b97a1a3152dea86c7fb',ramdisk_id='',reservation_id='r-p3i0uwft',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1796396043',owner_user_name='tempest-ServerActionsTestOtherA-1796396043-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:47:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='442aae0161f347d0a79b168a1b60286a',uuid=defae731-4191-4526-99cc-a301cf5b3355,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10b83231-0b39-4dee-95db-bb6a03d70fc0", "address": "fa:16:3e:b7:3a:83", "network": {"id": "d86a8e7f-6658-4994-9a13-eb3163bd3865", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-635863702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c69a942b4f4b97a1a3152dea86c7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10b83231-0b", "ovs_interfaceid": "10b83231-0b39-4dee-95db-bb6a03d70fc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 23:47:02 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Converting VIF {"id": "10b83231-0b39-4dee-95db-bb6a03d70fc0", "address": "fa:16:3e:b7:3a:83", "network": {"id": "d86a8e7f-6658-4994-9a13-eb3163bd3865", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-635863702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c69a942b4f4b97a1a3152dea86c7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10b83231-0b", "ovs_interfaceid": "10b83231-0b39-4dee-95db-bb6a03d70fc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:47:02 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:3a:83,bridge_name='br-int',has_traffic_filtering=True,id=10b83231-0b39-4dee-95db-bb6a03d70fc0,network=Network(d86a8e7f-6658-4994-9a13-eb3163bd3865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10b83231-0b') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:47:02 user nova-compute[75341]: DEBUG os_vif [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:3a:83,bridge_name='br-int',has_traffic_filtering=True,id=10b83231-0b39-4dee-95db-bb6a03d70fc0,network=Network(d86a8e7f-6658-4994-9a13-eb3163bd3865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10b83231-0b') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 23:47:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:47:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 23:47:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0553e1db-0dd4-5ff6-80bc-400d4764d121', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:47:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap10b83231-0b, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:47:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap10b83231-0b, col_values=(('qos', UUID('8eab567d-9e4c-4a01-811f-e036218258e5')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:47:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap10b83231-0b, col_values=(('external_ids', {'iface-id': '10b83231-0b39-4dee-95db-bb6a03d70fc0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:3a:83', 'vm-uuid': 'defae731-4191-4526-99cc-a301cf5b3355'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:47:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:47:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:02 user nova-compute[75341]: INFO os_vif [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:3a:83,bridge_name='br-int',has_traffic_filtering=True,id=10b83231-0b39-4dee-95db-bb6a03d70fc0,network=Network(d86a8e7f-6658-4994-9a13-eb3163bd3865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10b83231-0b')
Nov 14 23:47:02 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:47:02 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] No VIF found with MAC fa:16:3e:b7:3a:83, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:47:03 user nova-compute[75341]: DEBUG nova.network.neutron [req-77bba4de-1bcc-4a57-827c-528738de1a3e req-a5d1b7ac-347a-4b05-8e16-6897933212a0 service nova] [instance: defae731-4191-4526-99cc-a301cf5b3355] Updated VIF entry in instance network info cache for port 10b83231-0b39-4dee-95db-bb6a03d70fc0. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:47:03 user nova-compute[75341]: DEBUG nova.network.neutron [req-77bba4de-1bcc-4a57-827c-528738de1a3e req-a5d1b7ac-347a-4b05-8e16-6897933212a0 service nova] [instance: defae731-4191-4526-99cc-a301cf5b3355] Updating instance_info_cache with network_info: [{"id": "10b83231-0b39-4dee-95db-bb6a03d70fc0", "address": "fa:16:3e:b7:3a:83", "network": {"id": "d86a8e7f-6658-4994-9a13-eb3163bd3865", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-635863702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c69a942b4f4b97a1a3152dea86c7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10b83231-0b", "ovs_interfaceid": "10b83231-0b39-4dee-95db-bb6a03d70fc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:47:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-77bba4de-1bcc-4a57-827c-528738de1a3e req-a5d1b7ac-347a-4b05-8e16-6897933212a0 service nova] Releasing lock "refresh_cache-defae731-4191-4526-99cc-a301cf5b3355" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:47:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:04 user nova-compute[75341]: DEBUG nova.compute.manager [req-4de8ff15-65a2-41d1-a29f-61678c2d2c2e req-45cf1c9a-9545-4a86-b657-61237dcbd45b service nova] [instance: defae731-4191-4526-99cc-a301cf5b3355] Received event network-vif-plugged-10b83231-0b39-4dee-95db-bb6a03d70fc0 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:47:04 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4de8ff15-65a2-41d1-a29f-61678c2d2c2e req-45cf1c9a-9545-4a86-b657-61237dcbd45b service nova] Acquiring lock "defae731-4191-4526-99cc-a301cf5b3355-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:47:04 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4de8ff15-65a2-41d1-a29f-61678c2d2c2e req-45cf1c9a-9545-4a86-b657-61237dcbd45b service nova] Lock "defae731-4191-4526-99cc-a301cf5b3355-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:47:04 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4de8ff15-65a2-41d1-a29f-61678c2d2c2e req-45cf1c9a-9545-4a86-b657-61237dcbd45b service nova] Lock "defae731-4191-4526-99cc-a301cf5b3355-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:47:04 user nova-compute[75341]: DEBUG nova.compute.manager [req-4de8ff15-65a2-41d1-a29f-61678c2d2c2e req-45cf1c9a-9545-4a86-b657-61237dcbd45b service nova] [instance: defae731-4191-4526-99cc-a301cf5b3355] No waiting events found dispatching network-vif-plugged-10b83231-0b39-4dee-95db-bb6a03d70fc0 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:47:04 user nova-compute[75341]: WARNING nova.compute.manager [req-4de8ff15-65a2-41d1-a29f-61678c2d2c2e req-45cf1c9a-9545-4a86-b657-61237dcbd45b service nova] [instance: defae731-4191-4526-99cc-a301cf5b3355] Received unexpected event network-vif-plugged-10b83231-0b39-4dee-95db-bb6a03d70fc0 for instance with vm_state building and task_state spawning.
Nov 14 23:47:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:06 user nova-compute[75341]: DEBUG nova.compute.manager [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: defae731-4191-4526-99cc-a301cf5b3355] Instance event wait completed in 0 seconds for  {{(pid=75341) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 23:47:06 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: defae731-4191-4526-99cc-a301cf5b3355] Guest created on hypervisor {{(pid=75341) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 23:47:06 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: defae731-4191-4526-99cc-a301cf5b3355] Instance spawned successfully.
Nov 14 23:47:06 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: defae731-4191-4526-99cc-a301cf5b3355] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 23:47:06 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: defae731-4191-4526-99cc-a301cf5b3355] Found default for hw_cdrom_bus of ide {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:47:06 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: defae731-4191-4526-99cc-a301cf5b3355] Found default for hw_disk_bus of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:47:06 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: defae731-4191-4526-99cc-a301cf5b3355] Found default for hw_input_bus of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:47:06 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: defae731-4191-4526-99cc-a301cf5b3355] Found default for hw_pointer_model of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:47:06 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: defae731-4191-4526-99cc-a301cf5b3355] Found default for hw_video_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:47:06 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: defae731-4191-4526-99cc-a301cf5b3355] Found default for hw_vif_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:47:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:06 user nova-compute[75341]: INFO nova.compute.manager [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: defae731-4191-4526-99cc-a301cf5b3355] Took 5.34 seconds to spawn the instance on the hypervisor.
Nov 14 23:47:06 user nova-compute[75341]: DEBUG nova.compute.manager [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: defae731-4191-4526-99cc-a301cf5b3355] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 23:47:06 user nova-compute[75341]: DEBUG nova.compute.manager [req-cb738c0c-e10b-4fb1-b125-f509a325fa37 req-9556b3c1-533a-480e-984d-01d842a9b63d service nova] [instance: defae731-4191-4526-99cc-a301cf5b3355] Received event network-vif-plugged-10b83231-0b39-4dee-95db-bb6a03d70fc0 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:47:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-cb738c0c-e10b-4fb1-b125-f509a325fa37 req-9556b3c1-533a-480e-984d-01d842a9b63d service nova] Acquiring lock "defae731-4191-4526-99cc-a301cf5b3355-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:47:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-cb738c0c-e10b-4fb1-b125-f509a325fa37 req-9556b3c1-533a-480e-984d-01d842a9b63d service nova] Lock "defae731-4191-4526-99cc-a301cf5b3355-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:47:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-cb738c0c-e10b-4fb1-b125-f509a325fa37 req-9556b3c1-533a-480e-984d-01d842a9b63d service nova] Lock "defae731-4191-4526-99cc-a301cf5b3355-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:47:06 user nova-compute[75341]: DEBUG nova.compute.manager [req-cb738c0c-e10b-4fb1-b125-f509a325fa37 req-9556b3c1-533a-480e-984d-01d842a9b63d service nova] [instance: defae731-4191-4526-99cc-a301cf5b3355] No waiting events found dispatching network-vif-plugged-10b83231-0b39-4dee-95db-bb6a03d70fc0 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:47:06 user nova-compute[75341]: WARNING nova.compute.manager [req-cb738c0c-e10b-4fb1-b125-f509a325fa37 req-9556b3c1-533a-480e-984d-01d842a9b63d service nova] [instance: defae731-4191-4526-99cc-a301cf5b3355] Received unexpected event network-vif-plugged-10b83231-0b39-4dee-95db-bb6a03d70fc0 for instance with vm_state building and task_state spawning.
Nov 14 23:47:06 user nova-compute[75341]: INFO nova.compute.manager [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: defae731-4191-4526-99cc-a301cf5b3355] Took 6.09 seconds to build instance.
Nov 14 23:47:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cac06349-4b7f-4f24-8522-8917eb8f5f50 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "defae731-4191-4526-99cc-a301cf5b3355" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.188s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:47:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:11 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Acquiring lock "5950ba70-e7c0-4b5f-839c-569e0a27b625" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:47:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "5950ba70-e7c0-4b5f-839c-569e0a27b625" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:47:13 user nova-compute[75341]: DEBUG nova.compute.manager [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Starting instance... {{(pid=75341) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 23:47:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:47:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:47:13 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75341) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 23:47:13 user nova-compute[75341]: INFO nova.compute.claims [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Claim successful on node user
Nov 14 23:47:13 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:47:13 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:47:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.439s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:47:13 user nova-compute[75341]: DEBUG nova.compute.manager [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Start building networks asynchronously for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 23:47:13 user nova-compute[75341]: DEBUG nova.compute.manager [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Allocating IP information in the background. {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 23:47:13 user nova-compute[75341]: DEBUG nova.network.neutron [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] allocate_for_instance() {{(pid=75341) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 23:47:13 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 23:47:13 user nova-compute[75341]: DEBUG nova.compute.manager [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Start building block device mappings for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 23:47:13 user nova-compute[75341]: DEBUG nova.policy [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '38acd33ad6754965a53017185f473f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f27e41f4cc1451291b8aca34544867b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75341) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 23:47:13 user nova-compute[75341]: DEBUG nova.compute.manager [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Start spawning the instance on the hypervisor. {{(pid=75341) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 23:47:13 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Creating instance directory {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 23:47:13 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Creating image(s)
Nov 14 23:47:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Acquiring lock "/opt/stack/data/nova/instances/5950ba70-e7c0-4b5f-839c-569e0a27b625/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:47:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "/opt/stack/data/nova/instances/5950ba70-e7c0-4b5f-839c-569e0a27b625/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:47:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "/opt/stack/data/nova/instances/5950ba70-e7c0-4b5f-839c-569e0a27b625/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:47:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:47:14 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.195s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:47:14 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Acquiring lock "4754efee9a6d73d3647f2add2cfe86c291949740" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:47:14 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:47:14 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:47:14 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.192s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:47:14 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/5950ba70-e7c0-4b5f-839c-569e0a27b625/disk 1073741824 {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:47:14 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/5950ba70-e7c0-4b5f-839c-569e0a27b625/disk 1073741824" returned: 0 in 0.069s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:47:14 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:47:14 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:47:14 user nova-compute[75341]: DEBUG nova.network.neutron [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Successfully created port: 6df0f48f-1a94-42ec-b540-0aee55dc6b70 {{(pid=75341) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 23:47:14 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.189s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:47:14 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5950ba70-e7c0-4b5f-839c-569e0a27b625/disk. size=1073741824 {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 23:47:14 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5950ba70-e7c0-4b5f-839c-569e0a27b625/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:47:14 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5950ba70-e7c0-4b5f-839c-569e0a27b625/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:47:14 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Cannot resize image /opt/stack/data/nova/instances/5950ba70-e7c0-4b5f-839c-569e0a27b625/disk to a smaller size. {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 23:47:14 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Created local disks {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 23:47:14 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Ensure instance console log exists: /opt/stack/data/nova/instances/5950ba70-e7c0-4b5f-839c-569e0a27b625/console.log {{(pid=75341) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 23:47:14 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:47:14 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:47:14 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:47:15 user nova-compute[75341]: DEBUG nova.network.neutron [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Successfully updated port: 6df0f48f-1a94-42ec-b540-0aee55dc6b70 {{(pid=75341) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 23:47:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Acquiring lock "refresh_cache-5950ba70-e7c0-4b5f-839c-569e0a27b625" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:47:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Acquired lock "refresh_cache-5950ba70-e7c0-4b5f-839c-569e0a27b625" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:47:15 user nova-compute[75341]: DEBUG nova.network.neutron [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 23:47:15 user nova-compute[75341]: DEBUG nova.compute.manager [req-838c9689-e21b-404e-9160-ce2fac1d84eb req-22b54908-b9a7-40fa-bd55-72a1df7d4886 service nova] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Received event network-changed-6df0f48f-1a94-42ec-b540-0aee55dc6b70 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:47:15 user nova-compute[75341]: DEBUG nova.compute.manager [req-838c9689-e21b-404e-9160-ce2fac1d84eb req-22b54908-b9a7-40fa-bd55-72a1df7d4886 service nova] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Refreshing instance network info cache due to event network-changed-6df0f48f-1a94-42ec-b540-0aee55dc6b70. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:47:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-838c9689-e21b-404e-9160-ce2fac1d84eb req-22b54908-b9a7-40fa-bd55-72a1df7d4886 service nova] Acquiring lock "refresh_cache-5950ba70-e7c0-4b5f-839c-569e0a27b625" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:47:15 user nova-compute[75341]: DEBUG nova.network.neutron [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Instance cache missing network info. {{(pid=75341) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 23:47:15 user nova-compute[75341]: DEBUG nova.network.neutron [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Updating instance_info_cache with network_info: [{"id": "6df0f48f-1a94-42ec-b540-0aee55dc6b70", "address": "fa:16:3e:67:d4:76", "network": {"id": "e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-64240219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f27e41f4cc1451291b8aca34544867b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df0f48f-1a", "ovs_interfaceid": "6df0f48f-1a94-42ec-b540-0aee55dc6b70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:47:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Releasing lock "refresh_cache-5950ba70-e7c0-4b5f-839c-569e0a27b625" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:47:15 user nova-compute[75341]: DEBUG nova.compute.manager [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Instance network_info: |[{"id": "6df0f48f-1a94-42ec-b540-0aee55dc6b70", "address": "fa:16:3e:67:d4:76", "network": {"id": "e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-64240219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f27e41f4cc1451291b8aca34544867b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df0f48f-1a", "ovs_interfaceid": "6df0f48f-1a94-42ec-b540-0aee55dc6b70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 23:47:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-838c9689-e21b-404e-9160-ce2fac1d84eb req-22b54908-b9a7-40fa-bd55-72a1df7d4886 service nova] Acquired lock "refresh_cache-5950ba70-e7c0-4b5f-839c-569e0a27b625" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:47:15 user nova-compute[75341]: DEBUG nova.network.neutron [req-838c9689-e21b-404e-9160-ce2fac1d84eb req-22b54908-b9a7-40fa-bd55-72a1df7d4886 service nova] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Refreshing network info cache for port 6df0f48f-1a94-42ec-b540-0aee55dc6b70 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:47:15 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Start _get_guest_xml network_info=[{"id": "6df0f48f-1a94-42ec-b540-0aee55dc6b70", "address": "fa:16:3e:67:d4:76", "network": {"id": "e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-64240219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f27e41f4cc1451291b8aca34544867b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df0f48f-1a", "ovs_interfaceid": "6df0f48f-1a94-42ec-b540-0aee55dc6b70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encrypted': False, 'image_id': 'e46abb82-b810-490e-a8a1-ccdc5fa1a796'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 23:47:15 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:47:15 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:47:15 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 23:47:15 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 23:47:15 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 23:47:15 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 23:47:15 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 23:47:15 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 23:47:15 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 23:47:15 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 23:47:15 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 23:47:15 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 23:47:15 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 23:47:15 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 23:47:15 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 23:47:15 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 23:47:15 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 23:47:15 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 23:47:15 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1777010379',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1777010379',id=26,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFD/gQIk9sUxqytzFW+oIEoqeanqxhZ0nToGQHLSMfBJMBwXTQoqiqkjX7C2tOIZAKXm6CkDxugybhl1fVd4nRFiiiLCvqiflsVfW4bdFOB/z4735jWpOaIZAnYZPVxHVw==',key_name='tempest-keypair-1640023904',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f27e41f4cc1451291b8aca34544867b',ramdisk_id='',reservation_id='r-5jpqwdpl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-946394493',owner_user_name='tempest-AttachVolumeShelveTestJSON-946394493-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:47:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38acd33ad6754965a53017185f473f8a',uuid=5950ba70-e7c0-4b5f-839c-569e0a27b625,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6df0f48f-1a94-42ec-b540-0aee55dc6b70", "address": "fa:16:3e:67:d4:76", "network": {"id": "e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-64240219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f27e41f4cc1451291b8aca34544867b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df0f48f-1a", "ovs_interfaceid": "6df0f48f-1a94-42ec-b540-0aee55dc6b70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:47:15 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Converting VIF {"id": "6df0f48f-1a94-42ec-b540-0aee55dc6b70", "address": "fa:16:3e:67:d4:76", "network": {"id": "e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-64240219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f27e41f4cc1451291b8aca34544867b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df0f48f-1a", "ovs_interfaceid": "6df0f48f-1a94-42ec-b540-0aee55dc6b70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:47:15 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:d4:76,bridge_name='br-int',has_traffic_filtering=True,id=6df0f48f-1a94-42ec-b540-0aee55dc6b70,network=Network(e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6df0f48f-1a') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:47:15 user nova-compute[75341]: DEBUG nova.objects.instance [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lazy-loading 'pci_devices' on Instance uuid 5950ba70-e7c0-4b5f-839c-569e0a27b625 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:47:15 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] End _get_guest_xml xml=<domain type="kvm">
Nov 14 23:47:15 user nova-compute[75341]:   <uuid>5950ba70-e7c0-4b5f-839c-569e0a27b625</uuid>
Nov 14 23:47:15 user nova-compute[75341]:   <name>instance-0000001a</name>
Nov 14 23:47:15 user nova-compute[75341]:   <memory>524288</memory>
Nov 14 23:47:15 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 14 23:47:15 user nova-compute[75341]:   <metadata>
Nov 14 23:47:15 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 23:47:15 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 14 23:47:15 user nova-compute[75341]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1777010379</nova:name>
Nov 14 23:47:15 user nova-compute[75341]:       <nova:creationTime>2023-11-14 23:47:15</nova:creationTime>
Nov 14 23:47:15 user nova-compute[75341]:       <nova:flavor name="m1.tiny">
Nov 14 23:47:15 user nova-compute[75341]:         <nova:memory>512</nova:memory>
Nov 14 23:47:15 user nova-compute[75341]:         <nova:disk>1</nova:disk>
Nov 14 23:47:15 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 14 23:47:15 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 23:47:15 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 14 23:47:15 user nova-compute[75341]:       </nova:flavor>
Nov 14 23:47:15 user nova-compute[75341]:       <nova:owner>
Nov 14 23:47:15 user nova-compute[75341]:         <nova:user uuid="38acd33ad6754965a53017185f473f8a">tempest-AttachVolumeShelveTestJSON-946394493-project-member</nova:user>
Nov 14 23:47:15 user nova-compute[75341]:         <nova:project uuid="5f27e41f4cc1451291b8aca34544867b">tempest-AttachVolumeShelveTestJSON-946394493</nova:project>
Nov 14 23:47:15 user nova-compute[75341]:       </nova:owner>
Nov 14 23:47:15 user nova-compute[75341]:       <nova:root type="image" uuid="e46abb82-b810-490e-a8a1-ccdc5fa1a796"/>
Nov 14 23:47:15 user nova-compute[75341]:       <nova:ports>
Nov 14 23:47:15 user nova-compute[75341]:         <nova:port uuid="6df0f48f-1a94-42ec-b540-0aee55dc6b70">
Nov 14 23:47:15 user nova-compute[75341]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 23:47:15 user nova-compute[75341]:         </nova:port>
Nov 14 23:47:15 user nova-compute[75341]:       </nova:ports>
Nov 14 23:47:15 user nova-compute[75341]:     </nova:instance>
Nov 14 23:47:15 user nova-compute[75341]:   </metadata>
Nov 14 23:47:15 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 14 23:47:15 user nova-compute[75341]:     <system>
Nov 14 23:47:15 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 23:47:15 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 14 23:47:15 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 14 23:47:15 user nova-compute[75341]:       <entry name="serial">5950ba70-e7c0-4b5f-839c-569e0a27b625</entry>
Nov 14 23:47:15 user nova-compute[75341]:       <entry name="uuid">5950ba70-e7c0-4b5f-839c-569e0a27b625</entry>
Nov 14 23:47:15 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 14 23:47:15 user nova-compute[75341]:     </system>
Nov 14 23:47:15 user nova-compute[75341]:   </sysinfo>
Nov 14 23:47:15 user nova-compute[75341]:   <os>
Nov 14 23:47:15 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 23:47:15 user nova-compute[75341]:     <boot dev="hd"/>
Nov 14 23:47:15 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 14 23:47:15 user nova-compute[75341]:   </os>
Nov 14 23:47:15 user nova-compute[75341]:   <features>
Nov 14 23:47:15 user nova-compute[75341]:     <acpi/>
Nov 14 23:47:15 user nova-compute[75341]:     <apic/>
Nov 14 23:47:15 user nova-compute[75341]:     <vmcoreinfo/>
Nov 14 23:47:15 user nova-compute[75341]:   </features>
Nov 14 23:47:15 user nova-compute[75341]:   <clock offset="utc">
Nov 14 23:47:15 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 23:47:15 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 23:47:15 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 14 23:47:15 user nova-compute[75341]:   </clock>
Nov 14 23:47:15 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 14 23:47:15 user nova-compute[75341]:     <model>Nehalem</model>
Nov 14 23:47:15 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 23:47:15 user nova-compute[75341]:   </cpu>
Nov 14 23:47:15 user nova-compute[75341]:   <devices>
Nov 14 23:47:15 user nova-compute[75341]:     <disk type="file" device="disk">
Nov 14 23:47:15 user nova-compute[75341]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 23:47:15 user nova-compute[75341]:       <source file="/opt/stack/data/nova/instances/5950ba70-e7c0-4b5f-839c-569e0a27b625/disk"/>
Nov 14 23:47:15 user nova-compute[75341]:       <target dev="vda" bus="virtio"/>
Nov 14 23:47:15 user nova-compute[75341]:     </disk>
Nov 14 23:47:15 user nova-compute[75341]:     <interface type="ethernet">
Nov 14 23:47:15 user nova-compute[75341]:       <mac address="fa:16:3e:67:d4:76"/>
Nov 14 23:47:15 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:47:15 user nova-compute[75341]:       <mtu size="1442"/>
Nov 14 23:47:15 user nova-compute[75341]:       <target dev="tap6df0f48f-1a"/>
Nov 14 23:47:15 user nova-compute[75341]:     </interface>
Nov 14 23:47:15 user nova-compute[75341]:     <serial type="pty">
Nov 14 23:47:15 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/5950ba70-e7c0-4b5f-839c-569e0a27b625/console.log" append="off"/>
Nov 14 23:47:15 user nova-compute[75341]:     </serial>
Nov 14 23:47:15 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 23:47:15 user nova-compute[75341]:     <video>
Nov 14 23:47:15 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:47:15 user nova-compute[75341]:     </video>
Nov 14 23:47:15 user nova-compute[75341]:     <rng model="virtio">
Nov 14 23:47:15 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 14 23:47:15 user nova-compute[75341]:     </rng>
Nov 14 23:47:15 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 14 23:47:15 user nova-compute[75341]:     <memballoon model="virtio">
Nov 14 23:47:15 user nova-compute[75341]:       <stats period="10"/>
Nov 14 23:47:15 user nova-compute[75341]:     </memballoon>
Nov 14 23:47:15 user nova-compute[75341]:   </devices>
Nov 14 23:47:15 user nova-compute[75341]: </domain>
Nov 14 23:47:15 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 23:47:15 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1777010379',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1777010379',id=26,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFD/gQIk9sUxqytzFW+oIEoqeanqxhZ0nToGQHLSMfBJMBwXTQoqiqkjX7C2tOIZAKXm6CkDxugybhl1fVd4nRFiiiLCvqiflsVfW4bdFOB/z4735jWpOaIZAnYZPVxHVw==',key_name='tempest-keypair-1640023904',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f27e41f4cc1451291b8aca34544867b',ramdisk_id='',reservation_id='r-5jpqwdpl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-946394493',owner_user_name='tempest-AttachVolumeShelveTestJSON-946394493-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:47:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38acd33ad6754965a53017185f473f8a',uuid=5950ba70-e7c0-4b5f-839c-569e0a27b625,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6df0f48f-1a94-42ec-b540-0aee55dc6b70", "address": "fa:16:3e:67:d4:76", "network": {"id": "e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-64240219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f27e41f4cc1451291b8aca34544867b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df0f48f-1a", "ovs_interfaceid": "6df0f48f-1a94-42ec-b540-0aee55dc6b70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 23:47:15 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Converting VIF {"id": "6df0f48f-1a94-42ec-b540-0aee55dc6b70", "address": "fa:16:3e:67:d4:76", "network": {"id": "e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-64240219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f27e41f4cc1451291b8aca34544867b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df0f48f-1a", "ovs_interfaceid": "6df0f48f-1a94-42ec-b540-0aee55dc6b70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:47:15 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:d4:76,bridge_name='br-int',has_traffic_filtering=True,id=6df0f48f-1a94-42ec-b540-0aee55dc6b70,network=Network(e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6df0f48f-1a') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:47:15 user nova-compute[75341]: DEBUG os_vif [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:d4:76,bridge_name='br-int',has_traffic_filtering=True,id=6df0f48f-1a94-42ec-b540-0aee55dc6b70,network=Network(e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6df0f48f-1a') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 23:47:15 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:15 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:47:15 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 23:47:15 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:15 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3a618fe9-580e-5c2a-8f1b-d91898c8fd72', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:47:15 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:15 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:47:15 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:15 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6df0f48f-1a, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:47:15 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6df0f48f-1a, col_values=(('qos', UUID('9cbb8a7f-1b7e-4919-96f7-f2cf06839449')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:47:15 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6df0f48f-1a, col_values=(('external_ids', {'iface-id': '6df0f48f-1a94-42ec-b540-0aee55dc6b70', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:d4:76', 'vm-uuid': '5950ba70-e7c0-4b5f-839c-569e0a27b625'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:47:15 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:15 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:47:15 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:15 user nova-compute[75341]: INFO os_vif [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:d4:76,bridge_name='br-int',has_traffic_filtering=True,id=6df0f48f-1a94-42ec-b540-0aee55dc6b70,network=Network(e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6df0f48f-1a')
Nov 14 23:47:15 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:47:15 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] No VIF found with MAC fa:16:3e:67:d4:76, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:47:15 user nova-compute[75341]: DEBUG nova.network.neutron [req-838c9689-e21b-404e-9160-ce2fac1d84eb req-22b54908-b9a7-40fa-bd55-72a1df7d4886 service nova] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Updated VIF entry in instance network info cache for port 6df0f48f-1a94-42ec-b540-0aee55dc6b70. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:47:15 user nova-compute[75341]: DEBUG nova.network.neutron [req-838c9689-e21b-404e-9160-ce2fac1d84eb req-22b54908-b9a7-40fa-bd55-72a1df7d4886 service nova] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Updating instance_info_cache with network_info: [{"id": "6df0f48f-1a94-42ec-b540-0aee55dc6b70", "address": "fa:16:3e:67:d4:76", "network": {"id": "e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-64240219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f27e41f4cc1451291b8aca34544867b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df0f48f-1a", "ovs_interfaceid": "6df0f48f-1a94-42ec-b540-0aee55dc6b70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:47:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-838c9689-e21b-404e-9160-ce2fac1d84eb req-22b54908-b9a7-40fa-bd55-72a1df7d4886 service nova] Releasing lock "refresh_cache-5950ba70-e7c0-4b5f-839c-569e0a27b625" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:47:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:17 user nova-compute[75341]: DEBUG nova.compute.manager [req-3caeb1cc-1615-4f46-923b-458cb900c383 req-b55abb79-ed87-4008-a9bf-f67953e73d6f service nova] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Received event network-vif-plugged-6df0f48f-1a94-42ec-b540-0aee55dc6b70 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:47:17 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-3caeb1cc-1615-4f46-923b-458cb900c383 req-b55abb79-ed87-4008-a9bf-f67953e73d6f service nova] Acquiring lock "5950ba70-e7c0-4b5f-839c-569e0a27b625-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:47:17 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-3caeb1cc-1615-4f46-923b-458cb900c383 req-b55abb79-ed87-4008-a9bf-f67953e73d6f service nova] Lock "5950ba70-e7c0-4b5f-839c-569e0a27b625-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:47:17 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-3caeb1cc-1615-4f46-923b-458cb900c383 req-b55abb79-ed87-4008-a9bf-f67953e73d6f service nova] Lock "5950ba70-e7c0-4b5f-839c-569e0a27b625-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:47:17 user nova-compute[75341]: DEBUG nova.compute.manager [req-3caeb1cc-1615-4f46-923b-458cb900c383 req-b55abb79-ed87-4008-a9bf-f67953e73d6f service nova] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] No waiting events found dispatching network-vif-plugged-6df0f48f-1a94-42ec-b540-0aee55dc6b70 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:47:17 user nova-compute[75341]: WARNING nova.compute.manager [req-3caeb1cc-1615-4f46-923b-458cb900c383 req-b55abb79-ed87-4008-a9bf-f67953e73d6f service nova] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Received unexpected event network-vif-plugged-6df0f48f-1a94-42ec-b540-0aee55dc6b70 for instance with vm_state building and task_state spawning.
Nov 14 23:47:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:19 user nova-compute[75341]: DEBUG nova.compute.manager [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Instance event wait completed in 0 seconds for  {{(pid=75341) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 23:47:19 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Guest created on hypervisor {{(pid=75341) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 23:47:19 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Instance spawned successfully.
Nov 14 23:47:19 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 23:47:19 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Found default for hw_cdrom_bus of ide {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:47:19 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Found default for hw_disk_bus of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:47:19 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Found default for hw_input_bus of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:47:19 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Found default for hw_pointer_model of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:47:19 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Found default for hw_video_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:47:19 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Found default for hw_vif_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:47:19 user nova-compute[75341]: INFO nova.compute.manager [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Took 5.37 seconds to spawn the instance on the hypervisor.
Nov 14 23:47:19 user nova-compute[75341]: DEBUG nova.compute.manager [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 23:47:19 user nova-compute[75341]: INFO nova.compute.manager [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Took 6.23 seconds to build instance.
Nov 14 23:47:19 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b41ce891-5a8b-4a05-a321-ebbc231fb958 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "5950ba70-e7c0-4b5f-839c-569e0a27b625" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.330s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:47:19 user nova-compute[75341]: DEBUG nova.compute.manager [req-c469aec4-de78-4701-93ea-d895487e9ce8 req-d7da4c55-d3d0-46f3-a1cd-c342219deabb service nova] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Received event network-vif-plugged-6df0f48f-1a94-42ec-b540-0aee55dc6b70 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:47:19 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-c469aec4-de78-4701-93ea-d895487e9ce8 req-d7da4c55-d3d0-46f3-a1cd-c342219deabb service nova] Acquiring lock "5950ba70-e7c0-4b5f-839c-569e0a27b625-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:47:19 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-c469aec4-de78-4701-93ea-d895487e9ce8 req-d7da4c55-d3d0-46f3-a1cd-c342219deabb service nova] Lock "5950ba70-e7c0-4b5f-839c-569e0a27b625-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:47:19 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-c469aec4-de78-4701-93ea-d895487e9ce8 req-d7da4c55-d3d0-46f3-a1cd-c342219deabb service nova] Lock "5950ba70-e7c0-4b5f-839c-569e0a27b625-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:47:19 user nova-compute[75341]: DEBUG nova.compute.manager [req-c469aec4-de78-4701-93ea-d895487e9ce8 req-d7da4c55-d3d0-46f3-a1cd-c342219deabb service nova] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] No waiting events found dispatching network-vif-plugged-6df0f48f-1a94-42ec-b540-0aee55dc6b70 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:47:19 user nova-compute[75341]: WARNING nova.compute.manager [req-c469aec4-de78-4701-93ea-d895487e9ce8 req-d7da4c55-d3d0-46f3-a1cd-c342219deabb service nova] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Received unexpected event network-vif-plugged-6df0f48f-1a94-42ec-b540-0aee55dc6b70 for instance with vm_state active and task_state None.
Nov 14 23:47:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:21 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:23 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-76e94930-95c5-4f5b-8d4f-1b26f1f2a1d1 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Acquiring lock "896ee337-80bf-47c3-9530-861c941a2fc6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:47:23 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-76e94930-95c5-4f5b-8d4f-1b26f1f2a1d1 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "896ee337-80bf-47c3-9530-861c941a2fc6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:47:23 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-76e94930-95c5-4f5b-8d4f-1b26f1f2a1d1 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Acquiring lock "896ee337-80bf-47c3-9530-861c941a2fc6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:47:23 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-76e94930-95c5-4f5b-8d4f-1b26f1f2a1d1 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "896ee337-80bf-47c3-9530-861c941a2fc6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:47:23 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-76e94930-95c5-4f5b-8d4f-1b26f1f2a1d1 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "896ee337-80bf-47c3-9530-861c941a2fc6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:47:23 user nova-compute[75341]: INFO nova.compute.manager [None req-76e94930-95c5-4f5b-8d4f-1b26f1f2a1d1 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] Terminating instance
Nov 14 23:47:23 user nova-compute[75341]: DEBUG nova.compute.manager [None req-76e94930-95c5-4f5b-8d4f-1b26f1f2a1d1 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] Start destroying the instance on the hypervisor. {{(pid=75341) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 23:47:23 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:23 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:23 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:23 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:23 user nova-compute[75341]: DEBUG nova.compute.manager [req-ead68e21-b315-4d88-99a4-24378011f25a req-0ee75190-2b43-473e-a07f-4e1fd2173688 service nova] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] Received event network-vif-unplugged-88af4d1e-2d6c-4e86-906e-159a733ab307 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:47:23 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ead68e21-b315-4d88-99a4-24378011f25a req-0ee75190-2b43-473e-a07f-4e1fd2173688 service nova] Acquiring lock "896ee337-80bf-47c3-9530-861c941a2fc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:47:23 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ead68e21-b315-4d88-99a4-24378011f25a req-0ee75190-2b43-473e-a07f-4e1fd2173688 service nova] Lock "896ee337-80bf-47c3-9530-861c941a2fc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:47:23 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ead68e21-b315-4d88-99a4-24378011f25a req-0ee75190-2b43-473e-a07f-4e1fd2173688 service nova] Lock "896ee337-80bf-47c3-9530-861c941a2fc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:47:23 user nova-compute[75341]: DEBUG nova.compute.manager [req-ead68e21-b315-4d88-99a4-24378011f25a req-0ee75190-2b43-473e-a07f-4e1fd2173688 service nova] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] No waiting events found dispatching network-vif-unplugged-88af4d1e-2d6c-4e86-906e-159a733ab307 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:47:23 user nova-compute[75341]: DEBUG nova.compute.manager [req-ead68e21-b315-4d88-99a4-24378011f25a req-0ee75190-2b43-473e-a07f-4e1fd2173688 service nova] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] Received event network-vif-unplugged-88af4d1e-2d6c-4e86-906e-159a733ab307 for instance with task_state deleting. {{(pid=75341) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 23:47:24 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] Instance destroyed successfully.
Nov 14 23:47:24 user nova-compute[75341]: DEBUG nova.objects.instance [None req-76e94930-95c5-4f5b-8d4f-1b26f1f2a1d1 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lazy-loading 'resources' on Instance uuid 896ee337-80bf-47c3-9530-861c941a2fc6 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:47:24 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-76e94930-95c5-4f5b-8d4f-1b26f1f2a1d1 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:45:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-466449092',display_name='tempest-TestVolumeBootPattern-server-466449092',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-466449092',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:45:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='96674073965642f1af11221b4add8a6d',ramdisk_id='',reservation_id='r-6uxj85qf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-320933673',owner_user_name='tempest-TestVolumeBootPattern-320933673-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:45:51Z,user_data=None,user_id='b08f7ddf6c2f4fd596e214d6ca56c234',uuid=896ee337-80bf-47c3-9530-861c941a2fc6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "88af4d1e-2d6c-4e86-906e-159a733ab307", "address": "fa:16:3e:ce:0b:42", "network": {"id": "227eb779-a064-477d-8447-45862017ae7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-3827253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96674073965642f1af11221b4add8a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88af4d1e-2d", "ovs_interfaceid": "88af4d1e-2d6c-4e86-906e-159a733ab307", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 23:47:24 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-76e94930-95c5-4f5b-8d4f-1b26f1f2a1d1 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Converting VIF {"id": "88af4d1e-2d6c-4e86-906e-159a733ab307", "address": "fa:16:3e:ce:0b:42", "network": {"id": "227eb779-a064-477d-8447-45862017ae7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-3827253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96674073965642f1af11221b4add8a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88af4d1e-2d", "ovs_interfaceid": "88af4d1e-2d6c-4e86-906e-159a733ab307", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:47:24 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-76e94930-95c5-4f5b-8d4f-1b26f1f2a1d1 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:0b:42,bridge_name='br-int',has_traffic_filtering=True,id=88af4d1e-2d6c-4e86-906e-159a733ab307,network=Network(227eb779-a064-477d-8447-45862017ae7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88af4d1e-2d') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:47:24 user nova-compute[75341]: DEBUG os_vif [None req-76e94930-95c5-4f5b-8d4f-1b26f1f2a1d1 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:0b:42,bridge_name='br-int',has_traffic_filtering=True,id=88af4d1e-2d6c-4e86-906e-159a733ab307,network=Network(227eb779-a064-477d-8447-45862017ae7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88af4d1e-2d') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 23:47:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap88af4d1e-2d, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:47:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:47:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5371a54d-78f2-4123-86dd-ce1b40ca3f66) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:47:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:47:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:24 user nova-compute[75341]: INFO os_vif [None req-76e94930-95c5-4f5b-8d4f-1b26f1f2a1d1 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:0b:42,bridge_name='br-int',has_traffic_filtering=True,id=88af4d1e-2d6c-4e86-906e-159a733ab307,network=Network(227eb779-a064-477d-8447-45862017ae7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88af4d1e-2d')
Nov 14 23:47:24 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76e94930-95c5-4f5b-8d4f-1b26f1f2a1d1 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] calling os-brick to detach iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 23:47:24 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e94930-95c5-4f5b-8d4f-1b26f1f2a1d1 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, {'target_iqn': 'iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aeXonyjL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:47:24 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-76e94930-95c5-4f5b-8d4f-1b26f1f2a1d1 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:47:24 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-76e94930-95c5-4f5b-8d4f-1b26f1f2a1d1 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:47:24 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-76e94930-95c5-4f5b-8d4f-1b26f1f2a1d1 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:47:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:47:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:47:24 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57e5000-c002-4dde-82aa-4dbb3d9f6c24]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:47:24 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e94930-95c5-4f5b-8d4f-1b26f1f2a1d1 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 23:47:24 user nova-compute[75341]: No targets found.
Nov 14 23:47:24 user nova-compute[75341]: iSNS:
Nov 14 23:47:24 user nova-compute[75341]: No targets found.
Nov 14 23:47:24 user nova-compute[75341]: STATIC:
Nov 14 23:47:24 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3
Nov 14 23:47:24 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:47:24 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:47:24 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d
Nov 14 23:47:24 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:47:24 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:47:24 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774
Nov 14 23:47:24 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:47:24 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:47:24 user nova-compute[75341]: FIRMWARE:
Nov 14 23:47:24 user nova-compute[75341]: No targets found.
Nov 14 23:47:24 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:47:24 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e94930-95c5-4f5b-8d4f-1b26f1f2a1d1 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 23:47:24 user nova-compute[75341]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 23:47:24 user nova-compute[75341]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75341) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 23:47:24 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e94930-95c5-4f5b-8d4f-1b26f1f2a1d1 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d', 0)] {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 23:47:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:47:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:47:24 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[b803aa93-c0a8-431e-a597-f4da19c055cb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:47:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:47:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:47:24 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe5e910-b8c6-4dd5-9c35-40a9170f2685]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:47:24 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e94930-95c5-4f5b-8d4f-1b26f1f2a1d1 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)
Nov 14 23:47:24 user nova-compute[75341]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d (non-flash)
Nov 14 23:47:24 user nova-compute[75341]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774 (non-flash)
Nov 14 23:47:24 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:47:24 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e94930-95c5-4f5b-8d4f-1b26f1f2a1d1 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)
Nov 14 23:47:24 user nova-compute[75341]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d (non-flash)
Nov 14 23:47:24 user nova-compute[75341]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774 (non-flash)
Nov 14 23:47:24 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:47:24 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e94930-95c5-4f5b-8d4f-1b26f1f2a1d1 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1890156950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d'): ({'sdi'}, set())}) {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 23:47:24 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-76e94930-95c5-4f5b-8d4f-1b26f1f2a1d1 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Removing single pathed devices sdi {{(pid=75341) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 23:47:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:47:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:47:24 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0b35f5-43d5-49f1-b379-5f2ccf1a7dcc]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:47:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:47:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:47:24 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c061b5a-1ec1-41a9-9bca-74160fe52c06]: (4, ('ok\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:47:24 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-76e94930-95c5-4f5b-8d4f-1b26f1f2a1d1 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Flushing IO for device /dev/sdi {{(pid=75341) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 23:47:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:47:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.014s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:47:24 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[29125f56-1946-4434-a066-1d0c83074f68]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:47:24 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-76e94930-95c5-4f5b-8d4f-1b26f1f2a1d1 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75341) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 23:47:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:47:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.047s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:47:24 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ee9b43-09c4-4317-ad60-cdefcce3e567]: (4, ('1', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:47:24 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-76e94930-95c5-4f5b-8d4f-1b26f1f2a1d1 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 23:47:24 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-76e94930-95c5-4f5b-8d4f-1b26f1f2a1d1 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] SCSI volumes sdi have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 23:47:24 user nova-compute[75341]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_bebbc100', '/dev/disk/by-id/scsi-1SCST_BIObebbc100-21fcba8d16e06ccf', '/dev/disk/by-id/scsi-23231666362613864') {{(pid=86063) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 23:47:24 user nova-compute[75341]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_bebbc100
Nov 14 23:47:24 user nova-compute[75341]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIObebbc100-21fcba8d16e06ccf
Nov 14 23:47:24 user nova-compute[75341]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23231666362613864
Nov 14 23:47:24 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bba35cc-4bf8-4c5c-8fb1-5a82562608f1]: (4, None) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:47:24 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e94930-95c5-4f5b-8d4f-1b26f1f2a1d1 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d')] {{(pid=75341) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 23:47:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:47:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:47:24 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c7465a-78ea-4443-9cb3-a9b09467f00b]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:47:24 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e94930-95c5-4f5b-8d4f-1b26f1f2a1d1 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:47:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d -p 172.16.0.220:3260 --logout {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:47:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:47:24 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[a208e4cc-c2d4-4160-92a3-8651cb3d383e]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:47:24 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e94930-95c5-4f5b-8d4f-1b26f1f2a1d1 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d, portal: 172.16.0.220,3260]
Nov 14 23:47:24 user nova-compute[75341]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d, portal: 172.16.0.220,3260] successful.
Nov 14 23:47:24 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:47:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d -p 172.16.0.220:3260 --op delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:47:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0223eb95-57f1-4e16-b903-bdd690fba90d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:47:24 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[39681346-eeea-4773-a34f-604d05d78fb7]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:47:24 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e94930-95c5-4f5b-8d4f-1b26f1f2a1d1 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:47:24 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-76e94930-95c5-4f5b-8d4f-1b26f1f2a1d1 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:47:24 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e94930-95c5-4f5b-8d4f-1b26f1f2a1d1 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] <== disconnect_volume: return (318ms) None {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:47:24 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76e94930-95c5-4f5b-8d4f-1b26f1f2a1d1 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] Disconnected iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 23:47:24 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-76e94930-95c5-4f5b-8d4f-1b26f1f2a1d1 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] Deleting instance files /opt/stack/data/nova/instances/896ee337-80bf-47c3-9530-861c941a2fc6_del
Nov 14 23:47:24 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-76e94930-95c5-4f5b-8d4f-1b26f1f2a1d1 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] Deletion of /opt/stack/data/nova/instances/896ee337-80bf-47c3-9530-861c941a2fc6_del complete
Nov 14 23:47:24 user nova-compute[75341]: INFO nova.compute.manager [None req-76e94930-95c5-4f5b-8d4f-1b26f1f2a1d1 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 14 23:47:24 user nova-compute[75341]: DEBUG oslo.service.loopingcall [None req-76e94930-95c5-4f5b-8d4f-1b26f1f2a1d1 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75341) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 23:47:24 user nova-compute[75341]: DEBUG nova.compute.manager [-] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] Deallocating network for instance {{(pid=75341) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 23:47:24 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] deallocate_for_instance() {{(pid=75341) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 23:47:25 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:47:25 user nova-compute[75341]: INFO nova.compute.manager [-] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] Took 0.44 seconds to deallocate network for instance.
Nov 14 23:47:25 user nova-compute[75341]: DEBUG nova.compute.manager [req-48e1f0d2-495c-432e-a7cd-83af0714b821 req-52af77b6-ccaa-4bc3-923e-3bb439fe340c service nova] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] Received event network-vif-plugged-88af4d1e-2d6c-4e86-906e-159a733ab307 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:47:25 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-48e1f0d2-495c-432e-a7cd-83af0714b821 req-52af77b6-ccaa-4bc3-923e-3bb439fe340c service nova] Acquiring lock "896ee337-80bf-47c3-9530-861c941a2fc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:47:25 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-48e1f0d2-495c-432e-a7cd-83af0714b821 req-52af77b6-ccaa-4bc3-923e-3bb439fe340c service nova] Lock "896ee337-80bf-47c3-9530-861c941a2fc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:47:25 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-48e1f0d2-495c-432e-a7cd-83af0714b821 req-52af77b6-ccaa-4bc3-923e-3bb439fe340c service nova] Lock "896ee337-80bf-47c3-9530-861c941a2fc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:47:25 user nova-compute[75341]: DEBUG nova.compute.manager [req-48e1f0d2-495c-432e-a7cd-83af0714b821 req-52af77b6-ccaa-4bc3-923e-3bb439fe340c service nova] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] No waiting events found dispatching network-vif-plugged-88af4d1e-2d6c-4e86-906e-159a733ab307 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:47:25 user nova-compute[75341]: WARNING nova.compute.manager [req-48e1f0d2-495c-432e-a7cd-83af0714b821 req-52af77b6-ccaa-4bc3-923e-3bb439fe340c service nova] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] Received unexpected event network-vif-plugged-88af4d1e-2d6c-4e86-906e-159a733ab307 for instance with vm_state active and task_state deleting.
Nov 14 23:47:25 user nova-compute[75341]: DEBUG nova.compute.manager [req-48e1f0d2-495c-432e-a7cd-83af0714b821 req-52af77b6-ccaa-4bc3-923e-3bb439fe340c service nova] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] Received event network-vif-deleted-88af4d1e-2d6c-4e86-906e-159a733ab307 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:47:26 user nova-compute[75341]: INFO nova.compute.manager [None req-76e94930-95c5-4f5b-8d4f-1b26f1f2a1d1 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] Took 1.09 seconds to detach 1 volumes for instance.
Nov 14 23:47:26 user nova-compute[75341]: DEBUG nova.compute.manager [None req-76e94930-95c5-4f5b-8d4f-1b26f1f2a1d1 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 896ee337-80bf-47c3-9530-861c941a2fc6] Deleting volume: 0223eb95-57f1-4e16-b903-bdd690fba90d {{(pid=75341) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 23:47:26 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-76e94930-95c5-4f5b-8d4f-1b26f1f2a1d1 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:47:26 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-76e94930-95c5-4f5b-8d4f-1b26f1f2a1d1 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:47:26 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:26 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-76e94930-95c5-4f5b-8d4f-1b26f1f2a1d1 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:47:26 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-76e94930-95c5-4f5b-8d4f-1b26f1f2a1d1 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:47:26 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-76e94930-95c5-4f5b-8d4f-1b26f1f2a1d1 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.394s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:47:26 user nova-compute[75341]: INFO nova.scheduler.client.report [None req-76e94930-95c5-4f5b-8d4f-1b26f1f2a1d1 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Deleted allocations for instance 896ee337-80bf-47c3-9530-861c941a2fc6
Nov 14 23:47:26 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-76e94930-95c5-4f5b-8d4f-1b26f1f2a1d1 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "896ee337-80bf-47c3-9530-861c941a2fc6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.445s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:47:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6f02dbaf-eb26-4764-b911-42e2f76322af tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Acquiring lock "c8aa0b26-4099-4a8d-afce-a1e990e5b1f7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:47:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6f02dbaf-eb26-4764-b911-42e2f76322af tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Lock "c8aa0b26-4099-4a8d-afce-a1e990e5b1f7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:47:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6f02dbaf-eb26-4764-b911-42e2f76322af tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Acquiring lock "c8aa0b26-4099-4a8d-afce-a1e990e5b1f7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:47:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6f02dbaf-eb26-4764-b911-42e2f76322af tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Lock "c8aa0b26-4099-4a8d-afce-a1e990e5b1f7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:47:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6f02dbaf-eb26-4764-b911-42e2f76322af tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Lock "c8aa0b26-4099-4a8d-afce-a1e990e5b1f7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:47:27 user nova-compute[75341]: INFO nova.compute.manager [None req-6f02dbaf-eb26-4764-b911-42e2f76322af tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: c8aa0b26-4099-4a8d-afce-a1e990e5b1f7] Terminating instance
Nov 14 23:47:27 user nova-compute[75341]: DEBUG nova.compute.manager [None req-6f02dbaf-eb26-4764-b911-42e2f76322af tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: c8aa0b26-4099-4a8d-afce-a1e990e5b1f7] Start destroying the instance on the hypervisor. {{(pid=75341) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 23:47:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:28 user nova-compute[75341]: DEBUG nova.compute.manager [req-68e1b552-f910-43d6-af2e-97b8fffe85dd req-2a9d3b09-c042-4c91-9c35-46c7eda83454 service nova] [instance: c8aa0b26-4099-4a8d-afce-a1e990e5b1f7] Received event network-vif-unplugged-6c946423-6beb-4e8a-b041-5919bf2ca256 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:47:28 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-68e1b552-f910-43d6-af2e-97b8fffe85dd req-2a9d3b09-c042-4c91-9c35-46c7eda83454 service nova] Acquiring lock "c8aa0b26-4099-4a8d-afce-a1e990e5b1f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:47:28 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-68e1b552-f910-43d6-af2e-97b8fffe85dd req-2a9d3b09-c042-4c91-9c35-46c7eda83454 service nova] Lock "c8aa0b26-4099-4a8d-afce-a1e990e5b1f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:47:28 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-68e1b552-f910-43d6-af2e-97b8fffe85dd req-2a9d3b09-c042-4c91-9c35-46c7eda83454 service nova] Lock "c8aa0b26-4099-4a8d-afce-a1e990e5b1f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:47:28 user nova-compute[75341]: DEBUG nova.compute.manager [req-68e1b552-f910-43d6-af2e-97b8fffe85dd req-2a9d3b09-c042-4c91-9c35-46c7eda83454 service nova] [instance: c8aa0b26-4099-4a8d-afce-a1e990e5b1f7] No waiting events found dispatching network-vif-unplugged-6c946423-6beb-4e8a-b041-5919bf2ca256 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:47:28 user nova-compute[75341]: DEBUG nova.compute.manager [req-68e1b552-f910-43d6-af2e-97b8fffe85dd req-2a9d3b09-c042-4c91-9c35-46c7eda83454 service nova] [instance: c8aa0b26-4099-4a8d-afce-a1e990e5b1f7] Received event network-vif-unplugged-6c946423-6beb-4e8a-b041-5919bf2ca256 for instance with task_state deleting. {{(pid=75341) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 23:47:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:28 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: c8aa0b26-4099-4a8d-afce-a1e990e5b1f7] Instance destroyed successfully.
Nov 14 23:47:28 user nova-compute[75341]: DEBUG nova.objects.instance [None req-6f02dbaf-eb26-4764-b911-42e2f76322af tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Lazy-loading 'resources' on Instance uuid c8aa0b26-4099-4a8d-afce-a1e990e5b1f7 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:47:28 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-6f02dbaf-eb26-4764-b911-42e2f76322af tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:45:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1811583981',display_name='tempest-ServersNegativeTestJSON-server-1811583981',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1811583981',id=22,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:45:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d86dc7dc1b6b41bf874f1a25d7bca91d',ramdisk_id='',reservation_id='r-xegwthf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-2018102579',owner_user_name='tempest-ServersNegativeTestJSON-2018102579-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:45:45Z,user_data=None,user_id='c449c68aafa04accb8f06dbf87371f2d',uuid=c8aa0b26-4099-4a8d-afce-a1e990e5b1f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6c946423-6beb-4e8a-b041-5919bf2ca256", "address": "fa:16:3e:0b:1c:fe", "network": {"id": "7673016a-86f3-4643-a21f-148adc2a96dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-89785556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d86dc7dc1b6b41bf874f1a25d7bca91d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c946423-6b", "ovs_interfaceid": "6c946423-6beb-4e8a-b041-5919bf2ca256", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 23:47:28 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-6f02dbaf-eb26-4764-b911-42e2f76322af tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Converting VIF {"id": "6c946423-6beb-4e8a-b041-5919bf2ca256", "address": "fa:16:3e:0b:1c:fe", "network": {"id": "7673016a-86f3-4643-a21f-148adc2a96dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-89785556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d86dc7dc1b6b41bf874f1a25d7bca91d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c946423-6b", "ovs_interfaceid": "6c946423-6beb-4e8a-b041-5919bf2ca256", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:47:28 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-6f02dbaf-eb26-4764-b911-42e2f76322af tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:1c:fe,bridge_name='br-int',has_traffic_filtering=True,id=6c946423-6beb-4e8a-b041-5919bf2ca256,network=Network(7673016a-86f3-4643-a21f-148adc2a96dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c946423-6b') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:47:28 user nova-compute[75341]: DEBUG os_vif [None req-6f02dbaf-eb26-4764-b911-42e2f76322af tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:1c:fe,bridge_name='br-int',has_traffic_filtering=True,id=6c946423-6beb-4e8a-b041-5919bf2ca256,network=Network(7673016a-86f3-4643-a21f-148adc2a96dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c946423-6b') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 23:47:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6c946423-6b, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:47:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:47:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=20e6364c-c71d-4dcb-8e2e-64ce6d439734) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:47:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:28 user nova-compute[75341]: INFO os_vif [None req-6f02dbaf-eb26-4764-b911-42e2f76322af tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:1c:fe,bridge_name='br-int',has_traffic_filtering=True,id=6c946423-6beb-4e8a-b041-5919bf2ca256,network=Network(7673016a-86f3-4643-a21f-148adc2a96dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c946423-6b')
Nov 14 23:47:28 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-6f02dbaf-eb26-4764-b911-42e2f76322af tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: c8aa0b26-4099-4a8d-afce-a1e990e5b1f7] Deleting instance files /opt/stack/data/nova/instances/c8aa0b26-4099-4a8d-afce-a1e990e5b1f7_del
Nov 14 23:47:28 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-6f02dbaf-eb26-4764-b911-42e2f76322af tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: c8aa0b26-4099-4a8d-afce-a1e990e5b1f7] Deletion of /opt/stack/data/nova/instances/c8aa0b26-4099-4a8d-afce-a1e990e5b1f7_del complete
Nov 14 23:47:28 user nova-compute[75341]: INFO nova.compute.manager [None req-6f02dbaf-eb26-4764-b911-42e2f76322af tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: c8aa0b26-4099-4a8d-afce-a1e990e5b1f7] Took 0.68 seconds to destroy the instance on the hypervisor.
Nov 14 23:47:28 user nova-compute[75341]: DEBUG oslo.service.loopingcall [None req-6f02dbaf-eb26-4764-b911-42e2f76322af tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75341) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 23:47:28 user nova-compute[75341]: DEBUG nova.compute.manager [-] [instance: c8aa0b26-4099-4a8d-afce-a1e990e5b1f7] Deallocating network for instance {{(pid=75341) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 23:47:28 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: c8aa0b26-4099-4a8d-afce-a1e990e5b1f7] deallocate_for_instance() {{(pid=75341) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 23:47:29 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: c8aa0b26-4099-4a8d-afce-a1e990e5b1f7] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:47:29 user nova-compute[75341]: INFO nova.compute.manager [-] [instance: c8aa0b26-4099-4a8d-afce-a1e990e5b1f7] Took 0.46 seconds to deallocate network for instance.
Nov 14 23:47:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6f02dbaf-eb26-4764-b911-42e2f76322af tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:47:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6f02dbaf-eb26-4764-b911-42e2f76322af tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:47:29 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-6f02dbaf-eb26-4764-b911-42e2f76322af tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:47:29 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-6f02dbaf-eb26-4764-b911-42e2f76322af tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:47:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6f02dbaf-eb26-4764-b911-42e2f76322af tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.326s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:47:29 user nova-compute[75341]: INFO nova.scheduler.client.report [None req-6f02dbaf-eb26-4764-b911-42e2f76322af tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Deleted allocations for instance c8aa0b26-4099-4a8d-afce-a1e990e5b1f7
Nov 14 23:47:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6f02dbaf-eb26-4764-b911-42e2f76322af tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Lock "c8aa0b26-4099-4a8d-afce-a1e990e5b1f7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.643s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:47:30 user nova-compute[75341]: DEBUG nova.compute.manager [req-9815506d-0d56-45e8-aa7d-0d8386bbfba1 req-9d908dcb-9ebe-4693-9220-7014e024fa11 service nova] [instance: c8aa0b26-4099-4a8d-afce-a1e990e5b1f7] Received event network-vif-plugged-6c946423-6beb-4e8a-b041-5919bf2ca256 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:47:30 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-9815506d-0d56-45e8-aa7d-0d8386bbfba1 req-9d908dcb-9ebe-4693-9220-7014e024fa11 service nova] Acquiring lock "c8aa0b26-4099-4a8d-afce-a1e990e5b1f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:47:30 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-9815506d-0d56-45e8-aa7d-0d8386bbfba1 req-9d908dcb-9ebe-4693-9220-7014e024fa11 service nova] Lock "c8aa0b26-4099-4a8d-afce-a1e990e5b1f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:47:30 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-9815506d-0d56-45e8-aa7d-0d8386bbfba1 req-9d908dcb-9ebe-4693-9220-7014e024fa11 service nova] Lock "c8aa0b26-4099-4a8d-afce-a1e990e5b1f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:47:30 user nova-compute[75341]: DEBUG nova.compute.manager [req-9815506d-0d56-45e8-aa7d-0d8386bbfba1 req-9d908dcb-9ebe-4693-9220-7014e024fa11 service nova] [instance: c8aa0b26-4099-4a8d-afce-a1e990e5b1f7] No waiting events found dispatching network-vif-plugged-6c946423-6beb-4e8a-b041-5919bf2ca256 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:47:30 user nova-compute[75341]: WARNING nova.compute.manager [req-9815506d-0d56-45e8-aa7d-0d8386bbfba1 req-9d908dcb-9ebe-4693-9220-7014e024fa11 service nova] [instance: c8aa0b26-4099-4a8d-afce-a1e990e5b1f7] Received unexpected event network-vif-plugged-6c946423-6beb-4e8a-b041-5919bf2ca256 for instance with vm_state deleted and task_state None.
Nov 14 23:47:30 user nova-compute[75341]: DEBUG nova.compute.manager [req-9815506d-0d56-45e8-aa7d-0d8386bbfba1 req-9d908dcb-9ebe-4693-9220-7014e024fa11 service nova] [instance: c8aa0b26-4099-4a8d-afce-a1e990e5b1f7] Received event network-vif-deleted-6c946423-6beb-4e8a-b041-5919bf2ca256 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:47:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:33 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:35 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:36 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:38 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:41 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Acquiring lock "680f66a5-e813-4c49-ad05-def95be9d0b7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:47:41 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Lock "680f66a5-e813-4c49-ad05-def95be9d0b7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:47:41 user nova-compute[75341]: DEBUG nova.compute.manager [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 680f66a5-e813-4c49-ad05-def95be9d0b7] Starting instance... {{(pid=75341) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 23:47:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:41 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:47:41 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:47:41 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75341) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 23:47:41 user nova-compute[75341]: INFO nova.compute.claims [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 680f66a5-e813-4c49-ad05-def95be9d0b7] Claim successful on node user
Nov 14 23:47:41 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:47:41 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:47:42 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.500s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:47:42 user nova-compute[75341]: DEBUG nova.compute.manager [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 680f66a5-e813-4c49-ad05-def95be9d0b7] Start building networks asynchronously for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 23:47:42 user nova-compute[75341]: DEBUG nova.compute.manager [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 680f66a5-e813-4c49-ad05-def95be9d0b7] Allocating IP information in the background. {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 23:47:42 user nova-compute[75341]: DEBUG nova.network.neutron [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 680f66a5-e813-4c49-ad05-def95be9d0b7] allocate_for_instance() {{(pid=75341) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 23:47:42 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 680f66a5-e813-4c49-ad05-def95be9d0b7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 23:47:42 user nova-compute[75341]: DEBUG nova.compute.manager [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 680f66a5-e813-4c49-ad05-def95be9d0b7] Start building block device mappings for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 23:47:42 user nova-compute[75341]: DEBUG nova.compute.manager [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 680f66a5-e813-4c49-ad05-def95be9d0b7] Start spawning the instance on the hypervisor. {{(pid=75341) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 23:47:42 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 680f66a5-e813-4c49-ad05-def95be9d0b7] Creating instance directory {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 23:47:42 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 680f66a5-e813-4c49-ad05-def95be9d0b7] Creating image(s)
Nov 14 23:47:42 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Acquiring lock "/opt/stack/data/nova/instances/680f66a5-e813-4c49-ad05-def95be9d0b7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:47:42 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Lock "/opt/stack/data/nova/instances/680f66a5-e813-4c49-ad05-def95be9d0b7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:47:42 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Lock "/opt/stack/data/nova/instances/680f66a5-e813-4c49-ad05-def95be9d0b7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:47:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:47:42 user nova-compute[75341]: DEBUG nova.policy [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aff47f00e24e461787b1224fa6e697fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24aa6f705262457e95f2f3f47c0ee709', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75341) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 23:47:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.192s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:47:42 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Acquiring lock "4754efee9a6d73d3647f2add2cfe86c291949740" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:47:42 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:47:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:47:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.217s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:47:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/680f66a5-e813-4c49-ad05-def95be9d0b7/disk 1073741824 {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:47:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/680f66a5-e813-4c49-ad05-def95be9d0b7/disk 1073741824" returned: 0 in 0.060s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:47:42 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.291s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:47:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:47:43 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.222s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:47:43 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Checking if we can resize image /opt/stack/data/nova/instances/680f66a5-e813-4c49-ad05-def95be9d0b7/disk. size=1073741824 {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 23:47:43 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/680f66a5-e813-4c49-ad05-def95be9d0b7/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:47:43 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/680f66a5-e813-4c49-ad05-def95be9d0b7/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:47:43 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Cannot resize image /opt/stack/data/nova/instances/680f66a5-e813-4c49-ad05-def95be9d0b7/disk to a smaller size. {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 23:47:43 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 680f66a5-e813-4c49-ad05-def95be9d0b7] Created local disks {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 23:47:43 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 680f66a5-e813-4c49-ad05-def95be9d0b7] Ensure instance console log exists: /opt/stack/data/nova/instances/680f66a5-e813-4c49-ad05-def95be9d0b7/console.log {{(pid=75341) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 23:47:43 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:47:43 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:47:43 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:47:43 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:43 user nova-compute[75341]: DEBUG nova.network.neutron [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 680f66a5-e813-4c49-ad05-def95be9d0b7] Successfully created port: e6391bae-e60b-4d29-95da-60d4643e6928 {{(pid=75341) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 23:47:43 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:44 user nova-compute[75341]: DEBUG nova.network.neutron [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 680f66a5-e813-4c49-ad05-def95be9d0b7] Successfully updated port: e6391bae-e60b-4d29-95da-60d4643e6928 {{(pid=75341) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 23:47:44 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Acquiring lock "refresh_cache-680f66a5-e813-4c49-ad05-def95be9d0b7" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:47:44 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Acquired lock "refresh_cache-680f66a5-e813-4c49-ad05-def95be9d0b7" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:47:44 user nova-compute[75341]: DEBUG nova.network.neutron [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 680f66a5-e813-4c49-ad05-def95be9d0b7] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 23:47:45 user nova-compute[75341]: DEBUG nova.compute.manager [req-9e6969bc-c214-499a-b91f-a4c7783d5648 req-3783d6fb-1b6f-49f7-a46e-b9d81cc5418e service nova] [instance: 680f66a5-e813-4c49-ad05-def95be9d0b7] Received event network-changed-e6391bae-e60b-4d29-95da-60d4643e6928 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:47:45 user nova-compute[75341]: DEBUG nova.compute.manager [req-9e6969bc-c214-499a-b91f-a4c7783d5648 req-3783d6fb-1b6f-49f7-a46e-b9d81cc5418e service nova] [instance: 680f66a5-e813-4c49-ad05-def95be9d0b7] Refreshing instance network info cache due to event network-changed-e6391bae-e60b-4d29-95da-60d4643e6928. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:47:45 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-9e6969bc-c214-499a-b91f-a4c7783d5648 req-3783d6fb-1b6f-49f7-a46e-b9d81cc5418e service nova] Acquiring lock "refresh_cache-680f66a5-e813-4c49-ad05-def95be9d0b7" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:47:45 user nova-compute[75341]: DEBUG nova.network.neutron [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 680f66a5-e813-4c49-ad05-def95be9d0b7] Instance cache missing network info. {{(pid=75341) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 23:47:45 user nova-compute[75341]: DEBUG nova.network.neutron [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 680f66a5-e813-4c49-ad05-def95be9d0b7] Updating instance_info_cache with network_info: [{"id": "e6391bae-e60b-4d29-95da-60d4643e6928", "address": "fa:16:3e:d5:75:b6", "network": {"id": "b87c269d-b129-4bd0-b995-e9a9657dbd1a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1162722602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24aa6f705262457e95f2f3f47c0ee709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6391bae-e6", "ovs_interfaceid": "e6391bae-e60b-4d29-95da-60d4643e6928", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:47:45 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Releasing lock "refresh_cache-680f66a5-e813-4c49-ad05-def95be9d0b7" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:47:45 user nova-compute[75341]: DEBUG nova.compute.manager [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 680f66a5-e813-4c49-ad05-def95be9d0b7] Instance network_info: |[{"id": "e6391bae-e60b-4d29-95da-60d4643e6928", "address": "fa:16:3e:d5:75:b6", "network": {"id": "b87c269d-b129-4bd0-b995-e9a9657dbd1a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1162722602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24aa6f705262457e95f2f3f47c0ee709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6391bae-e6", "ovs_interfaceid": "e6391bae-e60b-4d29-95da-60d4643e6928", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 23:47:45 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-9e6969bc-c214-499a-b91f-a4c7783d5648 req-3783d6fb-1b6f-49f7-a46e-b9d81cc5418e service nova] Acquired lock "refresh_cache-680f66a5-e813-4c49-ad05-def95be9d0b7" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:47:45 user nova-compute[75341]: DEBUG nova.network.neutron [req-9e6969bc-c214-499a-b91f-a4c7783d5648 req-3783d6fb-1b6f-49f7-a46e-b9d81cc5418e service nova] [instance: 680f66a5-e813-4c49-ad05-def95be9d0b7] Refreshing network info cache for port e6391bae-e60b-4d29-95da-60d4643e6928 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:47:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 680f66a5-e813-4c49-ad05-def95be9d0b7] Start _get_guest_xml network_info=[{"id": "e6391bae-e60b-4d29-95da-60d4643e6928", "address": "fa:16:3e:d5:75:b6", "network": {"id": "b87c269d-b129-4bd0-b995-e9a9657dbd1a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1162722602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24aa6f705262457e95f2f3f47c0ee709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6391bae-e6", "ovs_interfaceid": "e6391bae-e60b-4d29-95da-60d4643e6928", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encrypted': False, 'image_id': 'e46abb82-b810-490e-a8a1-ccdc5fa1a796'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 23:47:45 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:47:45 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:47:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 23:47:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 23:47:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 23:47:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 23:47:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 23:47:45 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 23:47:45 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 23:47:45 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 23:47:45 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 23:47:45 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 23:47:45 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 23:47:45 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 23:47:45 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 23:47:45 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 23:47:45 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 23:47:45 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 23:47:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:47:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-354716180',display_name='tempest-VolumesActionsTest-instance-354716180',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-354716180',id=27,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='24aa6f705262457e95f2f3f47c0ee709',ramdisk_id='',reservation_id='r-fefa02ks',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1514431738',owner_user_name='tempest-VolumesActionsTest-1514431738-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:47:42Z,user_data=None,user_id='aff47f00e24e461787b1224fa6e697fa',uuid=680f66a5-e813-4c49-ad05-def95be9d0b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6391bae-e60b-4d29-95da-60d4643e6928", "address": "fa:16:3e:d5:75:b6", "network": {"id": "b87c269d-b129-4bd0-b995-e9a9657dbd1a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1162722602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24aa6f705262457e95f2f3f47c0ee709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6391bae-e6", "ovs_interfaceid": "e6391bae-e60b-4d29-95da-60d4643e6928", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:47:45 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Converting VIF {"id": "e6391bae-e60b-4d29-95da-60d4643e6928", "address": "fa:16:3e:d5:75:b6", "network": {"id": "b87c269d-b129-4bd0-b995-e9a9657dbd1a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1162722602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24aa6f705262457e95f2f3f47c0ee709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6391bae-e6", "ovs_interfaceid": "e6391bae-e60b-4d29-95da-60d4643e6928", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:47:45 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:75:b6,bridge_name='br-int',has_traffic_filtering=True,id=e6391bae-e60b-4d29-95da-60d4643e6928,network=Network(b87c269d-b129-4bd0-b995-e9a9657dbd1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6391bae-e6') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:47:45 user nova-compute[75341]: DEBUG nova.objects.instance [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Lazy-loading 'pci_devices' on Instance uuid 680f66a5-e813-4c49-ad05-def95be9d0b7 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:47:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 680f66a5-e813-4c49-ad05-def95be9d0b7] End _get_guest_xml xml=<domain type="kvm">
Nov 14 23:47:45 user nova-compute[75341]:   <uuid>680f66a5-e813-4c49-ad05-def95be9d0b7</uuid>
Nov 14 23:47:45 user nova-compute[75341]:   <name>instance-0000001b</name>
Nov 14 23:47:45 user nova-compute[75341]:   <memory>524288</memory>
Nov 14 23:47:45 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 14 23:47:45 user nova-compute[75341]:   <metadata>
Nov 14 23:47:45 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 23:47:45 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 14 23:47:45 user nova-compute[75341]:       <nova:name>tempest-VolumesActionsTest-instance-354716180</nova:name>
Nov 14 23:47:45 user nova-compute[75341]:       <nova:creationTime>2023-11-14 23:47:45</nova:creationTime>
Nov 14 23:47:45 user nova-compute[75341]:       <nova:flavor name="m1.tiny">
Nov 14 23:47:45 user nova-compute[75341]:         <nova:memory>512</nova:memory>
Nov 14 23:47:45 user nova-compute[75341]:         <nova:disk>1</nova:disk>
Nov 14 23:47:45 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 14 23:47:45 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 23:47:45 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 14 23:47:45 user nova-compute[75341]:       </nova:flavor>
Nov 14 23:47:45 user nova-compute[75341]:       <nova:owner>
Nov 14 23:47:45 user nova-compute[75341]:         <nova:user uuid="aff47f00e24e461787b1224fa6e697fa">tempest-VolumesActionsTest-1514431738-project-member</nova:user>
Nov 14 23:47:45 user nova-compute[75341]:         <nova:project uuid="24aa6f705262457e95f2f3f47c0ee709">tempest-VolumesActionsTest-1514431738</nova:project>
Nov 14 23:47:45 user nova-compute[75341]:       </nova:owner>
Nov 14 23:47:45 user nova-compute[75341]:       <nova:root type="image" uuid="e46abb82-b810-490e-a8a1-ccdc5fa1a796"/>
Nov 14 23:47:45 user nova-compute[75341]:       <nova:ports>
Nov 14 23:47:45 user nova-compute[75341]:         <nova:port uuid="e6391bae-e60b-4d29-95da-60d4643e6928">
Nov 14 23:47:45 user nova-compute[75341]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 23:47:45 user nova-compute[75341]:         </nova:port>
Nov 14 23:47:45 user nova-compute[75341]:       </nova:ports>
Nov 14 23:47:45 user nova-compute[75341]:     </nova:instance>
Nov 14 23:47:45 user nova-compute[75341]:   </metadata>
Nov 14 23:47:45 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 14 23:47:45 user nova-compute[75341]:     <system>
Nov 14 23:47:45 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 23:47:45 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 14 23:47:45 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 14 23:47:45 user nova-compute[75341]:       <entry name="serial">680f66a5-e813-4c49-ad05-def95be9d0b7</entry>
Nov 14 23:47:45 user nova-compute[75341]:       <entry name="uuid">680f66a5-e813-4c49-ad05-def95be9d0b7</entry>
Nov 14 23:47:45 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 14 23:47:45 user nova-compute[75341]:     </system>
Nov 14 23:47:45 user nova-compute[75341]:   </sysinfo>
Nov 14 23:47:45 user nova-compute[75341]:   <os>
Nov 14 23:47:45 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 23:47:45 user nova-compute[75341]:     <boot dev="hd"/>
Nov 14 23:47:45 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 14 23:47:45 user nova-compute[75341]:   </os>
Nov 14 23:47:45 user nova-compute[75341]:   <features>
Nov 14 23:47:45 user nova-compute[75341]:     <acpi/>
Nov 14 23:47:45 user nova-compute[75341]:     <apic/>
Nov 14 23:47:45 user nova-compute[75341]:     <vmcoreinfo/>
Nov 14 23:47:45 user nova-compute[75341]:   </features>
Nov 14 23:47:45 user nova-compute[75341]:   <clock offset="utc">
Nov 14 23:47:45 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 23:47:45 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 23:47:45 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 14 23:47:45 user nova-compute[75341]:   </clock>
Nov 14 23:47:45 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 14 23:47:45 user nova-compute[75341]:     <model>Nehalem</model>
Nov 14 23:47:45 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 23:47:45 user nova-compute[75341]:   </cpu>
Nov 14 23:47:45 user nova-compute[75341]:   <devices>
Nov 14 23:47:45 user nova-compute[75341]:     <disk type="file" device="disk">
Nov 14 23:47:45 user nova-compute[75341]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 23:47:45 user nova-compute[75341]:       <source file="/opt/stack/data/nova/instances/680f66a5-e813-4c49-ad05-def95be9d0b7/disk"/>
Nov 14 23:47:45 user nova-compute[75341]:       <target dev="vda" bus="virtio"/>
Nov 14 23:47:45 user nova-compute[75341]:     </disk>
Nov 14 23:47:45 user nova-compute[75341]:     <interface type="ethernet">
Nov 14 23:47:45 user nova-compute[75341]:       <mac address="fa:16:3e:d5:75:b6"/>
Nov 14 23:47:45 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:47:45 user nova-compute[75341]:       <mtu size="1442"/>
Nov 14 23:47:45 user nova-compute[75341]:       <target dev="tape6391bae-e6"/>
Nov 14 23:47:45 user nova-compute[75341]:     </interface>
Nov 14 23:47:45 user nova-compute[75341]:     <serial type="pty">
Nov 14 23:47:45 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/680f66a5-e813-4c49-ad05-def95be9d0b7/console.log" append="off"/>
Nov 14 23:47:45 user nova-compute[75341]:     </serial>
Nov 14 23:47:45 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 23:47:45 user nova-compute[75341]:     <video>
Nov 14 23:47:45 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:47:45 user nova-compute[75341]:     </video>
Nov 14 23:47:45 user nova-compute[75341]:     <rng model="virtio">
Nov 14 23:47:45 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 14 23:47:45 user nova-compute[75341]:     </rng>
Nov 14 23:47:45 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 14 23:47:45 user nova-compute[75341]:     <memballoon model="virtio">
Nov 14 23:47:45 user nova-compute[75341]:       <stats period="10"/>
Nov 14 23:47:45 user nova-compute[75341]:     </memballoon>
Nov 14 23:47:45 user nova-compute[75341]:   </devices>
Nov 14 23:47:45 user nova-compute[75341]: </domain>
Nov 14 23:47:45 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 23:47:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:47:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-354716180',display_name='tempest-VolumesActionsTest-instance-354716180',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-354716180',id=27,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='24aa6f705262457e95f2f3f47c0ee709',ramdisk_id='',reservation_id='r-fefa02ks',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1514431738',owner_user_name='tempest-VolumesActionsTest-1514431738-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:47:42Z,user_data=None,user_id='aff47f00e24e461787b1224fa6e697fa',uuid=680f66a5-e813-4c49-ad05-def95be9d0b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6391bae-e60b-4d29-95da-60d4643e6928", "address": "fa:16:3e:d5:75:b6", "network": {"id": "b87c269d-b129-4bd0-b995-e9a9657dbd1a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1162722602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24aa6f705262457e95f2f3f47c0ee709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6391bae-e6", "ovs_interfaceid": "e6391bae-e60b-4d29-95da-60d4643e6928", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 23:47:45 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Converting VIF {"id": "e6391bae-e60b-4d29-95da-60d4643e6928", "address": "fa:16:3e:d5:75:b6", "network": {"id": "b87c269d-b129-4bd0-b995-e9a9657dbd1a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1162722602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24aa6f705262457e95f2f3f47c0ee709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6391bae-e6", "ovs_interfaceid": "e6391bae-e60b-4d29-95da-60d4643e6928", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:47:45 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:75:b6,bridge_name='br-int',has_traffic_filtering=True,id=e6391bae-e60b-4d29-95da-60d4643e6928,network=Network(b87c269d-b129-4bd0-b995-e9a9657dbd1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6391bae-e6') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:47:45 user nova-compute[75341]: DEBUG os_vif [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:75:b6,bridge_name='br-int',has_traffic_filtering=True,id=e6391bae-e60b-4d29-95da-60d4643e6928,network=Network(b87c269d-b129-4bd0-b995-e9a9657dbd1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6391bae-e6') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 23:47:45 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:45 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:47:45 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 23:47:45 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:45 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '68811f97-0fa3-56a3-a7e0-fe937cbf3979', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:47:45 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:45 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:47:45 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:45 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape6391bae-e6, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:47:45 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape6391bae-e6, col_values=(('qos', UUID('4e64bf18-3a88-4fb7-bc35-5b86b6d511ff')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:47:45 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape6391bae-e6, col_values=(('external_ids', {'iface-id': 'e6391bae-e60b-4d29-95da-60d4643e6928', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:75:b6', 'vm-uuid': '680f66a5-e813-4c49-ad05-def95be9d0b7'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:47:45 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:45 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:47:45 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:45 user nova-compute[75341]: INFO os_vif [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:75:b6,bridge_name='br-int',has_traffic_filtering=True,id=e6391bae-e60b-4d29-95da-60d4643e6928,network=Network(b87c269d-b129-4bd0-b995-e9a9657dbd1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6391bae-e6')
Nov 14 23:47:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:47:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] No VIF found with MAC fa:16:3e:d5:75:b6, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:47:45 user nova-compute[75341]: DEBUG nova.network.neutron [req-9e6969bc-c214-499a-b91f-a4c7783d5648 req-3783d6fb-1b6f-49f7-a46e-b9d81cc5418e service nova] [instance: 680f66a5-e813-4c49-ad05-def95be9d0b7] Updated VIF entry in instance network info cache for port e6391bae-e60b-4d29-95da-60d4643e6928. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:47:45 user nova-compute[75341]: DEBUG nova.network.neutron [req-9e6969bc-c214-499a-b91f-a4c7783d5648 req-3783d6fb-1b6f-49f7-a46e-b9d81cc5418e service nova] [instance: 680f66a5-e813-4c49-ad05-def95be9d0b7] Updating instance_info_cache with network_info: [{"id": "e6391bae-e60b-4d29-95da-60d4643e6928", "address": "fa:16:3e:d5:75:b6", "network": {"id": "b87c269d-b129-4bd0-b995-e9a9657dbd1a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1162722602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24aa6f705262457e95f2f3f47c0ee709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6391bae-e6", "ovs_interfaceid": "e6391bae-e60b-4d29-95da-60d4643e6928", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:47:45 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-9e6969bc-c214-499a-b91f-a4c7783d5648 req-3783d6fb-1b6f-49f7-a46e-b9d81cc5418e service nova] Releasing lock "refresh_cache-680f66a5-e813-4c49-ad05-def95be9d0b7" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:47:46 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:46 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:46 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:46 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:46 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:46 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:47:47 user nova-compute[75341]: DEBUG nova.compute.manager [req-6b1564fe-050b-4de5-9580-d1ce10f92178 req-df3848be-c6fa-448e-b43a-9b8889d6d04d service nova] [instance: 680f66a5-e813-4c49-ad05-def95be9d0b7] Received event network-vif-plugged-e6391bae-e60b-4d29-95da-60d4643e6928 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:47:47 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6b1564fe-050b-4de5-9580-d1ce10f92178 req-df3848be-c6fa-448e-b43a-9b8889d6d04d service nova] Acquiring lock "680f66a5-e813-4c49-ad05-def95be9d0b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:47:47 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6b1564fe-050b-4de5-9580-d1ce10f92178 req-df3848be-c6fa-448e-b43a-9b8889d6d04d service nova] Lock "680f66a5-e813-4c49-ad05-def95be9d0b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:47:47 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6b1564fe-050b-4de5-9580-d1ce10f92178 req-df3848be-c6fa-448e-b43a-9b8889d6d04d service nova] Lock "680f66a5-e813-4c49-ad05-def95be9d0b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:47:47 user nova-compute[75341]: DEBUG nova.compute.manager [req-6b1564fe-050b-4de5-9580-d1ce10f92178 req-df3848be-c6fa-448e-b43a-9b8889d6d04d service nova] [instance: 680f66a5-e813-4c49-ad05-def95be9d0b7] No waiting events found dispatching network-vif-plugged-e6391bae-e60b-4d29-95da-60d4643e6928 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:47:47 user nova-compute[75341]: WARNING nova.compute.manager [req-6b1564fe-050b-4de5-9580-d1ce10f92178 req-df3848be-c6fa-448e-b43a-9b8889d6d04d service nova] [instance: 680f66a5-e813-4c49-ad05-def95be9d0b7] Received unexpected event network-vif-plugged-e6391bae-e60b-4d29-95da-60d4643e6928 for instance with vm_state building and task_state spawning.
Nov 14 23:47:47 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:47 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:47 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:47 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:47 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:47 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:47:48 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:47:48 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Starting heal instance info cache {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 23:47:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "refresh_cache-51045050-c7c6-49c5-acd4-2a76be0f466f" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:47:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquired lock "refresh_cache-51045050-c7c6-49c5-acd4-2a76be0f466f" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:47:49 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Forcefully refreshing network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 23:47:49 user nova-compute[75341]: DEBUG nova.compute.manager [req-c4caa562-c355-42c3-b9f9-928f17a5c4aa req-69bffc6e-69c3-4173-aaf1-781b80342d5d service nova] [instance: 680f66a5-e813-4c49-ad05-def95be9d0b7] Received event network-vif-plugged-e6391bae-e60b-4d29-95da-60d4643e6928 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:47:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-c4caa562-c355-42c3-b9f9-928f17a5c4aa req-69bffc6e-69c3-4173-aaf1-781b80342d5d service nova] Acquiring lock "680f66a5-e813-4c49-ad05-def95be9d0b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:47:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-c4caa562-c355-42c3-b9f9-928f17a5c4aa req-69bffc6e-69c3-4173-aaf1-781b80342d5d service nova] Lock "680f66a5-e813-4c49-ad05-def95be9d0b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:47:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-c4caa562-c355-42c3-b9f9-928f17a5c4aa req-69bffc6e-69c3-4173-aaf1-781b80342d5d service nova] Lock "680f66a5-e813-4c49-ad05-def95be9d0b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:47:49 user nova-compute[75341]: DEBUG nova.compute.manager [req-c4caa562-c355-42c3-b9f9-928f17a5c4aa req-69bffc6e-69c3-4173-aaf1-781b80342d5d service nova] [instance: 680f66a5-e813-4c49-ad05-def95be9d0b7] No waiting events found dispatching network-vif-plugged-e6391bae-e60b-4d29-95da-60d4643e6928 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:47:49 user nova-compute[75341]: WARNING nova.compute.manager [req-c4caa562-c355-42c3-b9f9-928f17a5c4aa req-69bffc6e-69c3-4173-aaf1-781b80342d5d service nova] [instance: 680f66a5-e813-4c49-ad05-def95be9d0b7] Received unexpected event network-vif-plugged-e6391bae-e60b-4d29-95da-60d4643e6928 for instance with vm_state building and task_state spawning.
Nov 14 23:47:49 user nova-compute[75341]: DEBUG nova.compute.manager [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 680f66a5-e813-4c49-ad05-def95be9d0b7] Instance event wait completed in 0 seconds for  {{(pid=75341) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 23:47:49 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 680f66a5-e813-4c49-ad05-def95be9d0b7] Guest created on hypervisor {{(pid=75341) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 23:47:49 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 680f66a5-e813-4c49-ad05-def95be9d0b7] Instance spawned successfully.
Nov 14 23:47:49 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 680f66a5-e813-4c49-ad05-def95be9d0b7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 23:47:49 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 680f66a5-e813-4c49-ad05-def95be9d0b7] Found default for hw_cdrom_bus of ide {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:47:49 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 680f66a5-e813-4c49-ad05-def95be9d0b7] Found default for hw_disk_bus of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:47:49 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 680f66a5-e813-4c49-ad05-def95be9d0b7] Found default for hw_input_bus of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:47:49 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 680f66a5-e813-4c49-ad05-def95be9d0b7] Found default for hw_pointer_model of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:47:49 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 680f66a5-e813-4c49-ad05-def95be9d0b7] Found default for hw_video_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:47:49 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 680f66a5-e813-4c49-ad05-def95be9d0b7] Found default for hw_vif_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:47:49 user nova-compute[75341]: INFO nova.compute.manager [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 680f66a5-e813-4c49-ad05-def95be9d0b7] Took 7.00 seconds to spawn the instance on the hypervisor.
Nov 14 23:47:49 user nova-compute[75341]: DEBUG nova.compute.manager [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 680f66a5-e813-4c49-ad05-def95be9d0b7] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 23:47:49 user nova-compute[75341]: INFO nova.compute.manager [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 680f66a5-e813-4c49-ad05-def95be9d0b7] Took 7.91 seconds to build instance.
Nov 14 23:47:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8573147a-fb4f-4f9c-92d1-111c39d48b33 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Lock "680f66a5-e813-4c49-ad05-def95be9d0b7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.039s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:47:49 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Updating instance_info_cache with network_info: [{"id": "64ebe5e6-0c81-41fd-b49e-75bed11e40df", "address": "fa:16:3e:44:63:f2", "network": {"id": "fcd22da6-016e-4872-a84c-4d82601c48d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-550677181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44bb8b1415c14bb59c4c35cc2b830875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ebe5e6-0c", "ovs_interfaceid": "64ebe5e6-0c81-41fd-b49e-75bed11e40df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:47:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Releasing lock "refresh_cache-51045050-c7c6-49c5-acd4-2a76be0f466f" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:47:49 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Updated the network info_cache for instance {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 23:47:49 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:47:49 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:47:49 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75341) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 23:47:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Acquiring lock "f8e73e44-9d2e-4b15-836c-738398adc685" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:47:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lock "f8e73e44-9d2e-4b15-836c-738398adc685" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:47:50 user nova-compute[75341]: DEBUG nova.compute.manager [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Starting instance... {{(pid=75341) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 23:47:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:47:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:47:50 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75341) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 23:47:50 user nova-compute[75341]: INFO nova.compute.claims [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Claim successful on node user
Nov 14 23:47:50 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:47:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:51 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:47:51 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:47:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.698s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:47:51 user nova-compute[75341]: DEBUG nova.compute.manager [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Start building networks asynchronously for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 23:47:51 user nova-compute[75341]: DEBUG nova.compute.manager [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Allocating IP information in the background. {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 23:47:51 user nova-compute[75341]: DEBUG nova.network.neutron [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] allocate_for_instance() {{(pid=75341) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 23:47:51 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 23:47:51 user nova-compute[75341]: DEBUG nova.compute.manager [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Start building block device mappings for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 23:47:51 user nova-compute[75341]: DEBUG nova.policy [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '526fe3083ac541b79d7dbfb9b5abaf7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f694dc021a9442a49bbde9f367fbefc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75341) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 23:47:51 user nova-compute[75341]: DEBUG nova.compute.manager [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Start spawning the instance on the hypervisor. {{(pid=75341) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 23:47:51 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Creating instance directory {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 23:47:51 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Creating image(s)
Nov 14 23:47:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Acquiring lock "/opt/stack/data/nova/instances/f8e73e44-9d2e-4b15-836c-738398adc685/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:47:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lock "/opt/stack/data/nova/instances/f8e73e44-9d2e-4b15-836c-738398adc685/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:47:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lock "/opt/stack/data/nova/instances/f8e73e44-9d2e-4b15-836c-738398adc685/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:47:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:47:52 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.208s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:47:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Acquiring lock "4754efee9a6d73d3647f2add2cfe86c291949740" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:47:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:47:52 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:47:52 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.180s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:47:52 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/f8e73e44-9d2e-4b15-836c-738398adc685/disk 1073741824 {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:47:52 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/f8e73e44-9d2e-4b15-836c-738398adc685/disk 1073741824" returned: 0 in 0.061s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:47:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:47:52 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:47:52 user nova-compute[75341]: DEBUG nova.network.neutron [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Successfully created port: beb17cbc-97e3-43ed-ba83-d364cec9b619 {{(pid=75341) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 23:47:52 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.195s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:47:52 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f8e73e44-9d2e-4b15-836c-738398adc685/disk. size=1073741824 {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 23:47:52 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8e73e44-9d2e-4b15-836c-738398adc685/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:47:52 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8e73e44-9d2e-4b15-836c-738398adc685/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:47:52 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Cannot resize image /opt/stack/data/nova/instances/f8e73e44-9d2e-4b15-836c-738398adc685/disk to a smaller size. {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 23:47:52 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Created local disks {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 23:47:52 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Ensure instance console log exists: /opt/stack/data/nova/instances/f8e73e44-9d2e-4b15-836c-738398adc685/console.log {{(pid=75341) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 23:47:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:47:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:47:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:47:52 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:47:52 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:47:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:47:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:47:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:47:52 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75341) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 23:47:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5070fb03-8f40-426c-8c3e-192f6517f7c3/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:47:53 user nova-compute[75341]: DEBUG nova.network.neutron [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Successfully updated port: beb17cbc-97e3-43ed-ba83-d364cec9b619 {{(pid=75341) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 23:47:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Acquiring lock "refresh_cache-f8e73e44-9d2e-4b15-836c-738398adc685" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:47:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Acquired lock "refresh_cache-f8e73e44-9d2e-4b15-836c-738398adc685" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:47:53 user nova-compute[75341]: DEBUG nova.network.neutron [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 23:47:53 user nova-compute[75341]: DEBUG nova.compute.manager [req-dbdf4448-4ec0-4383-950d-2862fe6f969b req-083bdb66-143b-4842-a2a2-c9704d36a15f service nova] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Received event network-changed-beb17cbc-97e3-43ed-ba83-d364cec9b619 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:47:53 user nova-compute[75341]: DEBUG nova.compute.manager [req-dbdf4448-4ec0-4383-950d-2862fe6f969b req-083bdb66-143b-4842-a2a2-c9704d36a15f service nova] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Refreshing instance network info cache due to event network-changed-beb17cbc-97e3-43ed-ba83-d364cec9b619. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:47:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-dbdf4448-4ec0-4383-950d-2862fe6f969b req-083bdb66-143b-4842-a2a2-c9704d36a15f service nova] Acquiring lock "refresh_cache-f8e73e44-9d2e-4b15-836c-738398adc685" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:47:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5070fb03-8f40-426c-8c3e-192f6517f7c3/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:47:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5070fb03-8f40-426c-8c3e-192f6517f7c3/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:47:53 user nova-compute[75341]: DEBUG nova.network.neutron [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Instance cache missing network info. {{(pid=75341) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 23:47:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5070fb03-8f40-426c-8c3e-192f6517f7c3/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:47:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5950ba70-e7c0-4b5f-839c-569e0a27b625/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:47:53 user nova-compute[75341]: DEBUG nova.network.neutron [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Updating instance_info_cache with network_info: [{"id": "beb17cbc-97e3-43ed-ba83-d364cec9b619", "address": "fa:16:3e:56:69:7a", "network": {"id": "a1cc71d9-4161-4044-ad08-02aa4a7aef1c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-73156846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f694dc021a9442a49bbde9f367fbefc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeb17cbc-97", "ovs_interfaceid": "beb17cbc-97e3-43ed-ba83-d364cec9b619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:47:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Releasing lock "refresh_cache-f8e73e44-9d2e-4b15-836c-738398adc685" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:47:53 user nova-compute[75341]: DEBUG nova.compute.manager [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Instance network_info: |[{"id": "beb17cbc-97e3-43ed-ba83-d364cec9b619", "address": "fa:16:3e:56:69:7a", "network": {"id": "a1cc71d9-4161-4044-ad08-02aa4a7aef1c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-73156846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f694dc021a9442a49bbde9f367fbefc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeb17cbc-97", "ovs_interfaceid": "beb17cbc-97e3-43ed-ba83-d364cec9b619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 23:47:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-dbdf4448-4ec0-4383-950d-2862fe6f969b req-083bdb66-143b-4842-a2a2-c9704d36a15f service nova] Acquired lock "refresh_cache-f8e73e44-9d2e-4b15-836c-738398adc685" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:47:53 user nova-compute[75341]: DEBUG nova.network.neutron [req-dbdf4448-4ec0-4383-950d-2862fe6f969b req-083bdb66-143b-4842-a2a2-c9704d36a15f service nova] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Refreshing network info cache for port beb17cbc-97e3-43ed-ba83-d364cec9b619 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:47:53 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Start _get_guest_xml network_info=[{"id": "beb17cbc-97e3-43ed-ba83-d364cec9b619", "address": "fa:16:3e:56:69:7a", "network": {"id": "a1cc71d9-4161-4044-ad08-02aa4a7aef1c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-73156846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f694dc021a9442a49bbde9f367fbefc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeb17cbc-97", "ovs_interfaceid": "beb17cbc-97e3-43ed-ba83-d364cec9b619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encrypted': False, 'image_id': 'e46abb82-b810-490e-a8a1-ccdc5fa1a796'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 23:47:53 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:47:53 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:47:53 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 23:47:53 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 23:47:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5950ba70-e7c0-4b5f-839c-569e0a27b625/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:47:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5950ba70-e7c0-4b5f-839c-569e0a27b625/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:47:53 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 23:47:53 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 23:47:53 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 23:47:53 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 23:47:53 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 23:47:53 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 23:47:53 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 23:47:53 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 23:47:53 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 23:47:53 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 23:47:53 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 23:47:53 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 23:47:53 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 23:47:53 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 23:47:53 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:47:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1377634340',display_name='tempest-VolumesSnapshotTestJSON-instance-1377634340',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1377634340',id=28,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPcoRmBlwrfNIh/bYaD1M0bqkJ7ZLGnc/U6vN0SXIbeIMK5uPuwQ1wlJtEWX6niXVGSbAMQ5E+v6JhU6G7Az5nOwiJp8slWFBKgYtVVIpdItzOBmIDmm0FG62oPIFhlYQ==',key_name='tempest-keypair-2084827374',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f694dc021a9442a49bbde9f367fbefc6',ramdisk_id='',reservation_id='r-fplvcwvt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1856831414',owner_user_name='tempest-VolumesSnapshotTestJSON-1856831414-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:47:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='526fe3083ac541b79d7dbfb9b5abaf7c',uuid=f8e73e44-9d2e-4b15-836c-738398adc685,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "beb17cbc-97e3-43ed-ba83-d364cec9b619", "address": "fa:16:3e:56:69:7a", "network": {"id": "a1cc71d9-4161-4044-ad08-02aa4a7aef1c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-73156846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f694dc021a9442a49bbde9f367fbefc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeb17cbc-97", "ovs_interfaceid": "beb17cbc-97e3-43ed-ba83-d364cec9b619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:47:53 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Converting VIF {"id": "beb17cbc-97e3-43ed-ba83-d364cec9b619", "address": "fa:16:3e:56:69:7a", "network": {"id": "a1cc71d9-4161-4044-ad08-02aa4a7aef1c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-73156846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f694dc021a9442a49bbde9f367fbefc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeb17cbc-97", "ovs_interfaceid": "beb17cbc-97e3-43ed-ba83-d364cec9b619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:47:53 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:69:7a,bridge_name='br-int',has_traffic_filtering=True,id=beb17cbc-97e3-43ed-ba83-d364cec9b619,network=Network(a1cc71d9-4161-4044-ad08-02aa4a7aef1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbeb17cbc-97') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:47:53 user nova-compute[75341]: DEBUG nova.objects.instance [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lazy-loading 'pci_devices' on Instance uuid f8e73e44-9d2e-4b15-836c-738398adc685 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:47:53 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] End _get_guest_xml xml=<domain type="kvm">
Nov 14 23:47:53 user nova-compute[75341]:   <uuid>f8e73e44-9d2e-4b15-836c-738398adc685</uuid>
Nov 14 23:47:53 user nova-compute[75341]:   <name>instance-0000001c</name>
Nov 14 23:47:53 user nova-compute[75341]:   <memory>524288</memory>
Nov 14 23:47:53 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 14 23:47:53 user nova-compute[75341]:   <metadata>
Nov 14 23:47:53 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 23:47:53 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 14 23:47:53 user nova-compute[75341]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1377634340</nova:name>
Nov 14 23:47:53 user nova-compute[75341]:       <nova:creationTime>2023-11-14 23:47:53</nova:creationTime>
Nov 14 23:47:53 user nova-compute[75341]:       <nova:flavor name="m1.tiny">
Nov 14 23:47:53 user nova-compute[75341]:         <nova:memory>512</nova:memory>
Nov 14 23:47:53 user nova-compute[75341]:         <nova:disk>1</nova:disk>
Nov 14 23:47:53 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 14 23:47:53 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 23:47:53 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 14 23:47:53 user nova-compute[75341]:       </nova:flavor>
Nov 14 23:47:53 user nova-compute[75341]:       <nova:owner>
Nov 14 23:47:53 user nova-compute[75341]:         <nova:user uuid="526fe3083ac541b79d7dbfb9b5abaf7c">tempest-VolumesSnapshotTestJSON-1856831414-project-member</nova:user>
Nov 14 23:47:53 user nova-compute[75341]:         <nova:project uuid="f694dc021a9442a49bbde9f367fbefc6">tempest-VolumesSnapshotTestJSON-1856831414</nova:project>
Nov 14 23:47:53 user nova-compute[75341]:       </nova:owner>
Nov 14 23:47:53 user nova-compute[75341]:       <nova:root type="image" uuid="e46abb82-b810-490e-a8a1-ccdc5fa1a796"/>
Nov 14 23:47:53 user nova-compute[75341]:       <nova:ports>
Nov 14 23:47:53 user nova-compute[75341]:         <nova:port uuid="beb17cbc-97e3-43ed-ba83-d364cec9b619">
Nov 14 23:47:53 user nova-compute[75341]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 23:47:53 user nova-compute[75341]:         </nova:port>
Nov 14 23:47:53 user nova-compute[75341]:       </nova:ports>
Nov 14 23:47:53 user nova-compute[75341]:     </nova:instance>
Nov 14 23:47:53 user nova-compute[75341]:   </metadata>
Nov 14 23:47:53 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 14 23:47:53 user nova-compute[75341]:     <system>
Nov 14 23:47:53 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 23:47:53 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 14 23:47:53 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 14 23:47:53 user nova-compute[75341]:       <entry name="serial">f8e73e44-9d2e-4b15-836c-738398adc685</entry>
Nov 14 23:47:53 user nova-compute[75341]:       <entry name="uuid">f8e73e44-9d2e-4b15-836c-738398adc685</entry>
Nov 14 23:47:53 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 14 23:47:53 user nova-compute[75341]:     </system>
Nov 14 23:47:53 user nova-compute[75341]:   </sysinfo>
Nov 14 23:47:53 user nova-compute[75341]:   <os>
Nov 14 23:47:53 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 23:47:53 user nova-compute[75341]:     <boot dev="hd"/>
Nov 14 23:47:53 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 14 23:47:53 user nova-compute[75341]:   </os>
Nov 14 23:47:53 user nova-compute[75341]:   <features>
Nov 14 23:47:53 user nova-compute[75341]:     <acpi/>
Nov 14 23:47:53 user nova-compute[75341]:     <apic/>
Nov 14 23:47:53 user nova-compute[75341]:     <vmcoreinfo/>
Nov 14 23:47:53 user nova-compute[75341]:   </features>
Nov 14 23:47:53 user nova-compute[75341]:   <clock offset="utc">
Nov 14 23:47:53 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 23:47:53 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 23:47:53 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 14 23:47:53 user nova-compute[75341]:   </clock>
Nov 14 23:47:53 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 14 23:47:53 user nova-compute[75341]:     <model>Nehalem</model>
Nov 14 23:47:53 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 23:47:53 user nova-compute[75341]:   </cpu>
Nov 14 23:47:53 user nova-compute[75341]:   <devices>
Nov 14 23:47:53 user nova-compute[75341]:     <disk type="file" device="disk">
Nov 14 23:47:53 user nova-compute[75341]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 23:47:53 user nova-compute[75341]:       <source file="/opt/stack/data/nova/instances/f8e73e44-9d2e-4b15-836c-738398adc685/disk"/>
Nov 14 23:47:53 user nova-compute[75341]:       <target dev="vda" bus="virtio"/>
Nov 14 23:47:53 user nova-compute[75341]:     </disk>
Nov 14 23:47:53 user nova-compute[75341]:     <interface type="ethernet">
Nov 14 23:47:53 user nova-compute[75341]:       <mac address="fa:16:3e:56:69:7a"/>
Nov 14 23:47:53 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:47:53 user nova-compute[75341]:       <mtu size="1442"/>
Nov 14 23:47:53 user nova-compute[75341]:       <target dev="tapbeb17cbc-97"/>
Nov 14 23:47:53 user nova-compute[75341]:     </interface>
Nov 14 23:47:53 user nova-compute[75341]:     <serial type="pty">
Nov 14 23:47:53 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/f8e73e44-9d2e-4b15-836c-738398adc685/console.log" append="off"/>
Nov 14 23:47:53 user nova-compute[75341]:     </serial>
Nov 14 23:47:53 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 23:47:53 user nova-compute[75341]:     <video>
Nov 14 23:47:53 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:47:53 user nova-compute[75341]:     </video>
Nov 14 23:47:53 user nova-compute[75341]:     <rng model="virtio">
Nov 14 23:47:53 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 14 23:47:53 user nova-compute[75341]:     </rng>
Nov 14 23:47:53 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 14 23:47:53 user nova-compute[75341]:     <memballoon model="virtio">
Nov 14 23:47:53 user nova-compute[75341]:       <stats period="10"/>
Nov 14 23:47:53 user nova-compute[75341]:     </memballoon>
Nov 14 23:47:53 user nova-compute[75341]:   </devices>
Nov 14 23:47:53 user nova-compute[75341]: </domain>
Nov 14 23:47:53 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 23:47:53 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:47:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1377634340',display_name='tempest-VolumesSnapshotTestJSON-instance-1377634340',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1377634340',id=28,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPcoRmBlwrfNIh/bYaD1M0bqkJ7ZLGnc/U6vN0SXIbeIMK5uPuwQ1wlJtEWX6niXVGSbAMQ5E+v6JhU6G7Az5nOwiJp8slWFBKgYtVVIpdItzOBmIDmm0FG62oPIFhlYQ==',key_name='tempest-keypair-2084827374',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f694dc021a9442a49bbde9f367fbefc6',ramdisk_id='',reservation_id='r-fplvcwvt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1856831414',owner_user_name='tempest-VolumesSnapshotTestJSON-1856831414-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:47:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='526fe3083ac541b79d7dbfb9b5abaf7c',uuid=f8e73e44-9d2e-4b15-836c-738398adc685,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "beb17cbc-97e3-43ed-ba83-d364cec9b619", "address": "fa:16:3e:56:69:7a", "network": {"id": "a1cc71d9-4161-4044-ad08-02aa4a7aef1c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-73156846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f694dc021a9442a49bbde9f367fbefc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeb17cbc-97", "ovs_interfaceid": "beb17cbc-97e3-43ed-ba83-d364cec9b619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 23:47:53 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Converting VIF {"id": "beb17cbc-97e3-43ed-ba83-d364cec9b619", "address": "fa:16:3e:56:69:7a", "network": {"id": "a1cc71d9-4161-4044-ad08-02aa4a7aef1c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-73156846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f694dc021a9442a49bbde9f367fbefc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeb17cbc-97", "ovs_interfaceid": "beb17cbc-97e3-43ed-ba83-d364cec9b619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:47:53 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:69:7a,bridge_name='br-int',has_traffic_filtering=True,id=beb17cbc-97e3-43ed-ba83-d364cec9b619,network=Network(a1cc71d9-4161-4044-ad08-02aa4a7aef1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbeb17cbc-97') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:47:53 user nova-compute[75341]: DEBUG os_vif [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:69:7a,bridge_name='br-int',has_traffic_filtering=True,id=beb17cbc-97e3-43ed-ba83-d364cec9b619,network=Network(a1cc71d9-4161-4044-ad08-02aa4a7aef1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbeb17cbc-97') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 23:47:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:47:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 23:47:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c6dcdfba-f67f-5e82-869e-30e96fe6d603', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:47:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:47:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbeb17cbc-97, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:47:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbeb17cbc-97, col_values=(('qos', UUID('1a9cfe09-8953-441b-b178-a29112127c39')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:47:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbeb17cbc-97, col_values=(('external_ids', {'iface-id': 'beb17cbc-97e3-43ed-ba83-d364cec9b619', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:69:7a', 'vm-uuid': 'f8e73e44-9d2e-4b15-836c-738398adc685'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:47:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:47:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:54 user nova-compute[75341]: INFO os_vif [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:69:7a,bridge_name='br-int',has_traffic_filtering=True,id=beb17cbc-97e3-43ed-ba83-d364cec9b619,network=Network(a1cc71d9-4161-4044-ad08-02aa4a7aef1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbeb17cbc-97')
Nov 14 23:47:54 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:47:54 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] No VIF found with MAC fa:16:3e:56:69:7a, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:47:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5950ba70-e7c0-4b5f-839c-569e0a27b625/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:47:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a141d7ee-3f77-4fdc-85ec-2cbd5af17646/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:47:54 user nova-compute[75341]: DEBUG nova.network.neutron [req-dbdf4448-4ec0-4383-950d-2862fe6f969b req-083bdb66-143b-4842-a2a2-c9704d36a15f service nova] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Updated VIF entry in instance network info cache for port beb17cbc-97e3-43ed-ba83-d364cec9b619. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:47:54 user nova-compute[75341]: DEBUG nova.network.neutron [req-dbdf4448-4ec0-4383-950d-2862fe6f969b req-083bdb66-143b-4842-a2a2-c9704d36a15f service nova] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Updating instance_info_cache with network_info: [{"id": "beb17cbc-97e3-43ed-ba83-d364cec9b619", "address": "fa:16:3e:56:69:7a", "network": {"id": "a1cc71d9-4161-4044-ad08-02aa4a7aef1c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-73156846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f694dc021a9442a49bbde9f367fbefc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeb17cbc-97", "ovs_interfaceid": "beb17cbc-97e3-43ed-ba83-d364cec9b619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:47:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a141d7ee-3f77-4fdc-85ec-2cbd5af17646/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:47:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a141d7ee-3f77-4fdc-85ec-2cbd5af17646/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:47:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-dbdf4448-4ec0-4383-950d-2862fe6f969b req-083bdb66-143b-4842-a2a2-c9704d36a15f service nova] Releasing lock "refresh_cache-f8e73e44-9d2e-4b15-836c-738398adc685" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:47:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a141d7ee-3f77-4fdc-85ec-2cbd5af17646/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:47:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d92ba9df-c739-414d-a701-ddba04563427/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:47:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d92ba9df-c739-414d-a701-ddba04563427/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:47:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d92ba9df-c739-414d-a701-ddba04563427/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:47:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d92ba9df-c739-414d-a701-ddba04563427/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:47:54 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 23:47:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:47:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:47:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:47:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:47:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk.rescue --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:47:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:47:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk.rescue --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:47:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk.rescue --force-share --output=json" returned: 0 in 0.236s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:47:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:47:55 user nova-compute[75341]: DEBUG nova.compute.manager [req-3885f631-2ca1-4aa0-a317-67a3e24aa80d req-c928c0ea-70cc-4f95-b9f7-0c491a22047a service nova] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Received event network-vif-plugged-beb17cbc-97e3-43ed-ba83-d364cec9b619 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:47:55 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-3885f631-2ca1-4aa0-a317-67a3e24aa80d req-c928c0ea-70cc-4f95-b9f7-0c491a22047a service nova] Acquiring lock "f8e73e44-9d2e-4b15-836c-738398adc685-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:47:55 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-3885f631-2ca1-4aa0-a317-67a3e24aa80d req-c928c0ea-70cc-4f95-b9f7-0c491a22047a service nova] Lock "f8e73e44-9d2e-4b15-836c-738398adc685-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:47:55 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-3885f631-2ca1-4aa0-a317-67a3e24aa80d req-c928c0ea-70cc-4f95-b9f7-0c491a22047a service nova] Lock "f8e73e44-9d2e-4b15-836c-738398adc685-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:47:55 user nova-compute[75341]: DEBUG nova.compute.manager [req-3885f631-2ca1-4aa0-a317-67a3e24aa80d req-c928c0ea-70cc-4f95-b9f7-0c491a22047a service nova] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] No waiting events found dispatching network-vif-plugged-beb17cbc-97e3-43ed-ba83-d364cec9b619 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:47:55 user nova-compute[75341]: WARNING nova.compute.manager [req-3885f631-2ca1-4aa0-a317-67a3e24aa80d req-c928c0ea-70cc-4f95-b9f7-0c491a22047a service nova] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Received unexpected event network-vif-plugged-beb17cbc-97e3-43ed-ba83-d364cec9b619 for instance with vm_state building and task_state spawning.
Nov 14 23:47:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:47:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:47:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:47:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eada8790-de2a-4bfd-954c-55627e554a84/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:47:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eada8790-de2a-4bfd-954c-55627e554a84/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:47:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eada8790-de2a-4bfd-954c-55627e554a84/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:47:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eada8790-de2a-4bfd-954c-55627e554a84/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:47:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:47:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:47:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:47:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:47:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/680f66a5-e813-4c49-ad05-def95be9d0b7/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:47:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/680f66a5-e813-4c49-ad05-def95be9d0b7/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:47:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/680f66a5-e813-4c49-ad05-def95be9d0b7/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:47:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/680f66a5-e813-4c49-ad05-def95be9d0b7/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:47:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:47:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:47:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:47:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:47:57 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 23:47:58 user nova-compute[75341]: DEBUG nova.compute.manager [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Instance event wait completed in 0 seconds for  {{(pid=75341) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 23:47:58 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Guest created on hypervisor {{(pid=75341) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 23:47:58 user nova-compute[75341]: DEBUG nova.compute.manager [req-e190ffc5-d335-4d6f-98fb-d8299afd67ec req-e97e7794-8c93-4da3-8d78-940a2ea27f01 service nova] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Received event network-vif-plugged-beb17cbc-97e3-43ed-ba83-d364cec9b619 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:47:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-e190ffc5-d335-4d6f-98fb-d8299afd67ec req-e97e7794-8c93-4da3-8d78-940a2ea27f01 service nova] Acquiring lock "f8e73e44-9d2e-4b15-836c-738398adc685-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:47:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-e190ffc5-d335-4d6f-98fb-d8299afd67ec req-e97e7794-8c93-4da3-8d78-940a2ea27f01 service nova] Lock "f8e73e44-9d2e-4b15-836c-738398adc685-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:47:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-e190ffc5-d335-4d6f-98fb-d8299afd67ec req-e97e7794-8c93-4da3-8d78-940a2ea27f01 service nova] Lock "f8e73e44-9d2e-4b15-836c-738398adc685-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:47:58 user nova-compute[75341]: DEBUG nova.compute.manager [req-e190ffc5-d335-4d6f-98fb-d8299afd67ec req-e97e7794-8c93-4da3-8d78-940a2ea27f01 service nova] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] No waiting events found dispatching network-vif-plugged-beb17cbc-97e3-43ed-ba83-d364cec9b619 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:47:58 user nova-compute[75341]: WARNING nova.compute.manager [req-e190ffc5-d335-4d6f-98fb-d8299afd67ec req-e97e7794-8c93-4da3-8d78-940a2ea27f01 service nova] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Received unexpected event network-vif-plugged-beb17cbc-97e3-43ed-ba83-d364cec9b619 for instance with vm_state building and task_state spawning.
Nov 14 23:47:58 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:47:58 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:47:58 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Hypervisor/Node resource view: name=user free_ram=7247MB free_disk=25.521541595458984GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75341) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 23:47:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:47:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:47:58 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Instance spawned successfully.
Nov 14 23:47:58 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 23:47:58 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Found default for hw_cdrom_bus of ide {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:47:58 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Found default for hw_disk_bus of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:47:58 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Found default for hw_input_bus of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:47:58 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Found default for hw_pointer_model of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:47:58 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Found default for hw_video_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:47:58 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Found default for hw_vif_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:47:58 user nova-compute[75341]: INFO nova.compute.manager [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Took 6.47 seconds to spawn the instance on the hypervisor.
Nov 14 23:47:58 user nova-compute[75341]: DEBUG nova.compute.manager [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 23:47:58 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 881351d7-31f9-44f4-8571-8f540bbec29c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:47:58 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance a141d7ee-3f77-4fdc-85ec-2cbd5af17646 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:47:58 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 51045050-c7c6-49c5-acd4-2a76be0f466f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:47:58 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 6382e432-838f-4d89-a743-cbaa37f50ab5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:47:58 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance d92ba9df-c739-414d-a701-ddba04563427 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:47:58 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 5070fb03-8f40-426c-8c3e-192f6517f7c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:47:58 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance eada8790-de2a-4bfd-954c-55627e554a84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:47:58 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance defae731-4191-4526-99cc-a301cf5b3355 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:47:58 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 5950ba70-e7c0-4b5f-839c-569e0a27b625 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:47:58 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 680f66a5-e813-4c49-ad05-def95be9d0b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:47:58 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance f8e73e44-9d2e-4b15-836c-738398adc685 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:47:58 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 23:47:58 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 23:47:58 user nova-compute[75341]: INFO nova.compute.manager [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Took 7.57 seconds to build instance.
Nov 14 23:47:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-2ce5086c-efb3-4156-960e-85a1953a0d3e tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lock "f8e73e44-9d2e-4b15-836c-738398adc685" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.713s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:47:58 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:47:58 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:47:58 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Compute_service record updated for user:user {{(pid=75341) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 23:47:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.600s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:47:59 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:47:59 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:47:59 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:48:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:03 user nova-compute[75341]: DEBUG nova.compute.manager [req-e1cc999e-42e9-49b2-8f20-28b29245d512 req-1d8e992b-2fcd-46ea-ac99-8980da1b5956 service nova] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Received event network-changed-59640fb6-107f-4eec-90ec-730997028287 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:48:03 user nova-compute[75341]: DEBUG nova.compute.manager [req-e1cc999e-42e9-49b2-8f20-28b29245d512 req-1d8e992b-2fcd-46ea-ac99-8980da1b5956 service nova] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Refreshing instance network info cache due to event network-changed-59640fb6-107f-4eec-90ec-730997028287. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:48:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-e1cc999e-42e9-49b2-8f20-28b29245d512 req-1d8e992b-2fcd-46ea-ac99-8980da1b5956 service nova] Acquiring lock "refresh_cache-5070fb03-8f40-426c-8c3e-192f6517f7c3" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:48:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-e1cc999e-42e9-49b2-8f20-28b29245d512 req-1d8e992b-2fcd-46ea-ac99-8980da1b5956 service nova] Acquired lock "refresh_cache-5070fb03-8f40-426c-8c3e-192f6517f7c3" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:48:03 user nova-compute[75341]: DEBUG nova.network.neutron [req-e1cc999e-42e9-49b2-8f20-28b29245d512 req-1d8e992b-2fcd-46ea-ac99-8980da1b5956 service nova] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Refreshing network info cache for port 59640fb6-107f-4eec-90ec-730997028287 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:48:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-65df9a3e-1898-4afd-bd95-84c6c70bc216 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Acquiring lock "5070fb03-8f40-426c-8c3e-192f6517f7c3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:48:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-65df9a3e-1898-4afd-bd95-84c6c70bc216 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Lock "5070fb03-8f40-426c-8c3e-192f6517f7c3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:48:03 user nova-compute[75341]: DEBUG nova.objects.instance [None req-65df9a3e-1898-4afd-bd95-84c6c70bc216 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Lazy-loading 'flavor' on Instance uuid 5070fb03-8f40-426c-8c3e-192f6517f7c3 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:48:03 user nova-compute[75341]: DEBUG nova.network.neutron [req-e1cc999e-42e9-49b2-8f20-28b29245d512 req-1d8e992b-2fcd-46ea-ac99-8980da1b5956 service nova] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Updated VIF entry in instance network info cache for port 59640fb6-107f-4eec-90ec-730997028287. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:48:03 user nova-compute[75341]: DEBUG nova.network.neutron [req-e1cc999e-42e9-49b2-8f20-28b29245d512 req-1d8e992b-2fcd-46ea-ac99-8980da1b5956 service nova] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Updating instance_info_cache with network_info: [{"id": "59640fb6-107f-4eec-90ec-730997028287", "address": "fa:16:3e:9e:2f:c0", "network": {"id": "e9abba2c-7994-4781-a3ca-07e8e4be7825", "bridge": "br-int", "label": "tempest-TestStampPattern-1410971761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af462be688d4127a8368ee3dcb2a340", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59640fb6-10", "ovs_interfaceid": "59640fb6-107f-4eec-90ec-730997028287", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:48:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-e1cc999e-42e9-49b2-8f20-28b29245d512 req-1d8e992b-2fcd-46ea-ac99-8980da1b5956 service nova] Releasing lock "refresh_cache-5070fb03-8f40-426c-8c3e-192f6517f7c3" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:48:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-65df9a3e-1898-4afd-bd95-84c6c70bc216 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Lock "5070fb03-8f40-426c-8c3e-192f6517f7c3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:48:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:04 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-65df9a3e-1898-4afd-bd95-84c6c70bc216 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Acquiring lock "5070fb03-8f40-426c-8c3e-192f6517f7c3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:48:04 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-65df9a3e-1898-4afd-bd95-84c6c70bc216 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Lock "5070fb03-8f40-426c-8c3e-192f6517f7c3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:48:04 user nova-compute[75341]: INFO nova.compute.manager [None req-65df9a3e-1898-4afd-bd95-84c6c70bc216 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Attaching volume ae34dfde-f1c8-4657-8145-8caa2c8b153f to /dev/vdb
Nov 14 23:48:04 user nova-compute[75341]: DEBUG os_brick.utils [None req-65df9a3e-1898-4afd-bd95-84c6c70bc216 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:48:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:04 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30d332c-cd39-4d68-9d58-d9e2098bbc84]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6d1cfca09c9\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:48:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:04 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[d736064d-be2e-475b-b397-2fa93afed60b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:48:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:04 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[24005dd5-5044-46a5-9a0f-165acb8979f5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:48:04 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ffa3e93-a5fa-4f8a-addd-8445d21da988]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:48:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-65df9a3e-1898-4afd-bd95-84c6c70bc216 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Running cmd (subprocess): nvme version {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-65df9a3e-1898-4afd-bd95-84c6c70bc216 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] 'nvme version' failed. Not Retrying. {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:48:04 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.nvmeof [None req-65df9a3e-1898-4afd-bd95-84c6c70bc216 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] nvme not present on system {{(pid=75341) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 23:48:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:48:04 user nova-compute[75341]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 23:48:04 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8f7461-8960-4fcf-b31a-49654c139227]: (4, '') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:48:04 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-65df9a3e-1898-4afd-bd95-84c6c70bc216 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75341) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 23:48:04 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-65df9a3e-1898-4afd-bd95-84c6c70bc216 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 23:48:04 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-65df9a3e-1898-4afd-bd95-84c6c70bc216 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] LIGHTOS: no hostnqn found. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 23:48:04 user nova-compute[75341]: DEBUG os_brick.utils [None req-65df9a3e-1898-4afd-bd95-84c6c70bc216 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6d1cfca09c9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:48:04 user nova-compute[75341]: DEBUG nova.virt.block_device [None req-65df9a3e-1898-4afd-bd95-84c6c70bc216 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Updating existing volume attachment record: bfd04239-ceb1-4f6e-ac95-c7fa3971ac08 {{(pid=75341) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 23:48:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:09 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65df9a3e-1898-4afd-bd95-84c6c70bc216 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Calling os-brick to attach iSCSI Volume {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 23:48:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-65df9a3e-1898-4afd-bd95-84c6c70bc216 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ae34dfde-f1c8-4657-8145-8caa2c8b153f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vUekjQCW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:48:09 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-65df9a3e-1898-4afd-bd95-84c6c70bc216 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:48:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-65df9a3e-1898-4afd-bd95-84c6c70bc216 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:48:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-65df9a3e-1898-4afd-bd95-84c6c70bc216 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:48:09 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-65df9a3e-1898-4afd-bd95-84c6c70bc216 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:48:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-65df9a3e-1898-4afd-bd95-84c6c70bc216 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae34dfde-f1c8-4657-8145-8caa2c8b153f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:48:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-65df9a3e-1898-4afd-bd95-84c6c70bc216 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae34dfde-f1c8-4657-8145-8caa2c8b153f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:48:09 user nova-compute[75341]: INFO os_brick.initiator.connectors.iscsi [None req-65df9a3e-1898-4afd-bd95-84c6c70bc216 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 23:48:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae34dfde-f1c8-4657-8145-8caa2c8b153f -p 172.16.0.220:3260 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae34dfde-f1c8-4657-8145-8caa2c8b153f -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:09 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd77b57-e82c-489e-b166-0da77bf05800]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:48:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-65df9a3e-1898-4afd-bd95-84c6c70bc216 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 23:48:09 user nova-compute[75341]:  {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:48:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae34dfde-f1c8-4657-8145-8caa2c8b153f -p 172.16.0.220:3260 --interface default --op new {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae34dfde-f1c8-4657-8145-8caa2c8b153f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:09 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1143d1-97b7-47ba-82ef-4598237d64d3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae34dfde-f1c8-4657-8145-8caa2c8b153f] added\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:48:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-65df9a3e-1898-4afd-bd95-84c6c70bc216 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae34dfde-f1c8-4657-8145-8caa2c8b153f] added
Nov 14 23:48:09 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:48:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae34dfde-f1c8-4657-8145-8caa2c8b153f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae34dfde-f1c8-4657-8145-8caa2c8b153f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:09 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[e761dd15-5397-4e19-b98b-79151b7f9a7f]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:48:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-65df9a3e-1898-4afd-bd95-84c6c70bc216 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:48:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae34dfde-f1c8-4657-8145-8caa2c8b153f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae34dfde-f1c8-4657-8145-8caa2c8b153f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:09 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[67bb5c4c-cefb-4140-85d8-862b70083698]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:48:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-65df9a3e-1898-4afd-bd95-84c6c70bc216 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:48:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae34dfde-f1c8-4657-8145-8caa2c8b153f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vUekjQCW {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae34dfde-f1c8-4657-8145-8caa2c8b153f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vUekjQCW" returned: 0 in 0.023s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:09 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c2f1522-0017-40fc-a2bb-97b5ebdd51a0]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:48:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-65df9a3e-1898-4afd-bd95-84c6c70bc216 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vUekjQCW'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:48:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae34dfde-f1c8-4657-8145-8caa2c8b153f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae34dfde-f1c8-4657-8145-8caa2c8b153f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:09 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[40bb792f-2315-471d-882c-ade72b46b60d]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:48:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-65df9a3e-1898-4afd-bd95-84c6c70bc216 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:48:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:09 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7eda16a-368c-4bf8-9406-d8ffa88ffa81]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:48:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-65df9a3e-1898-4afd-bd95-84c6c70bc216 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)
Nov 14 23:48:09 user nova-compute[75341]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774 (non-flash)
Nov 14 23:48:09 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:48:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-65df9a3e-1898-4afd-bd95-84c6c70bc216 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)
Nov 14 23:48:09 user nova-compute[75341]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774 (non-flash)
Nov 14 23:48:09 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:48:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae34dfde-f1c8-4657-8145-8caa2c8b153f -p 172.16.0.220:3260 --login {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae34dfde-f1c8-4657-8145-8caa2c8b153f -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:09 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb10e86a-0e28-4513-8970-89ea912fe3f1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae34dfde-f1c8-4657-8145-8caa2c8b153f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ae34dfde-f1c8-4657-8145-8caa2c8b153f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:48:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-65df9a3e-1898-4afd-bd95-84c6c70bc216 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae34dfde-f1c8-4657-8145-8caa2c8b153f, portal: 172.16.0.220,3260]
Nov 14 23:48:09 user nova-compute[75341]: Login to [iface: default, target: iqn.2010-10.org.openstack:ae34dfde-f1c8-4657-8145-8caa2c8b153f, portal: 172.16.0.220,3260] successful.
Nov 14 23:48:09 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:48:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae34dfde-f1c8-4657-8145-8caa2c8b153f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae34dfde-f1c8-4657-8145-8caa2c8b153f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:09 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[9baa5d98-de01-46dd-80fe-f9b35c4696ae]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:48:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-65df9a3e-1898-4afd-bd95-84c6c70bc216 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:48:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:09 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddab0782-8c6f-4649-814b-ae7aa0d35a94]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae34dfde-f1c8-4657-8145-8caa2c8b153f (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:48:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-65df9a3e-1898-4afd-bd95-84c6c70bc216 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)
Nov 14 23:48:09 user nova-compute[75341]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774 (non-flash)
Nov 14 23:48:09 user nova-compute[75341]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae34dfde-f1c8-4657-8145-8caa2c8b153f (non-flash)
Nov 14 23:48:09 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:48:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-65df9a3e-1898-4afd-bd95-84c6c70bc216 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)
Nov 14 23:48:09 user nova-compute[75341]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774 (non-flash)
Nov 14 23:48:09 user nova-compute[75341]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae34dfde-f1c8-4657-8145-8caa2c8b153f (non-flash)
Nov 14 23:48:09 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:48:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-65df9a3e-1898-4afd-bd95-84c6c70bc216 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae34dfde-f1c8-4657-8145-8caa2c8b153f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:48:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-65df9a3e-1898-4afd-bd95-84c6c70bc216 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Connected to 172.16.0.220:3260 {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 23:48:09 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-65df9a3e-1898-4afd-bd95-84c6c70bc216 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] HCTL ('34', '-', '-', 0) found on session 30 with lun 0 {{(pid=75341) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 23:48:09 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-65df9a3e-1898-4afd-bd95-84c6c70bc216 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75341) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 23:48:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.014s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:09 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[3773e17d-8f5b-4c02-952f-fed6cba962e6]: (4, ('- - 0', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:48:09 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-65df9a3e-1898-4afd-bd95-84c6c70bc216 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: None {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 23:48:10 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-65df9a3e-1898-4afd-bd95-84c6c70bc216 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 23:48:10 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-65df9a3e-1898-4afd-bd95-84c6c70bc216 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ae34dfde-f1c8-4657-8145-8caa2c8b153f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vUekjQCW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 23:48:10 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-65df9a3e-1898-4afd-bd95-84c6c70bc216 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:48:10 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-65df9a3e-1898-4afd-bd95-84c6c70bc216 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '23039633762343737', 'path': '/dev/sdc'} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:48:10 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65df9a3e-1898-4afd-bd95-84c6c70bc216 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039633762343737', 'path': '/dev/sdc'} {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 23:48:10 user nova-compute[75341]: DEBUG nova.objects.instance [None req-65df9a3e-1898-4afd-bd95-84c6c70bc216 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Lazy-loading 'flavor' on Instance uuid 5070fb03-8f40-426c-8c3e-192f6517f7c3 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:48:10 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-65df9a3e-1898-4afd-bd95-84c6c70bc216 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 23:48:10 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:48:10 user nova-compute[75341]:   <source dev="/dev/sdc"/>
Nov 14 23:48:10 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:48:10 user nova-compute[75341]:   <serial>ae34dfde-f1c8-4657-8145-8caa2c8b153f</serial>
Nov 14 23:48:10 user nova-compute[75341]: </disk>
Nov 14 23:48:10 user nova-compute[75341]:  {{(pid=75341) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 23:48:10 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-65df9a3e-1898-4afd-bd95-84c6c70bc216 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:48:10 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-65df9a3e-1898-4afd-bd95-84c6c70bc216 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:48:10 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-65df9a3e-1898-4afd-bd95-84c6c70bc216 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] No VIF found with MAC fa:16:3e:9e:2f:c0, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:48:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-65df9a3e-1898-4afd-bd95-84c6c70bc216 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Lock "5070fb03-8f40-426c-8c3e-192f6517f7c3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.936s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:48:11 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e6347eac-53fb-4950-9074-b1cb997f9e86 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Acquiring lock "5070fb03-8f40-426c-8c3e-192f6517f7c3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:48:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e6347eac-53fb-4950-9074-b1cb997f9e86 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Lock "5070fb03-8f40-426c-8c3e-192f6517f7c3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:48:13 user nova-compute[75341]: INFO nova.compute.manager [None req-e6347eac-53fb-4950-9074-b1cb997f9e86 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Detaching volume ae34dfde-f1c8-4657-8145-8caa2c8b153f
Nov 14 23:48:13 user nova-compute[75341]: INFO nova.virt.block_device [None req-e6347eac-53fb-4950-9074-b1cb997f9e86 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Attempting to driver detach volume ae34dfde-f1c8-4657-8145-8caa2c8b153f from mountpoint /dev/vdb
Nov 14 23:48:13 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-e6347eac-53fb-4950-9074-b1cb997f9e86 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Attempting to detach device vdb from instance 5070fb03-8f40-426c-8c3e-192f6517f7c3 from the persistent domain config. {{(pid=75341) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 23:48:13 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-e6347eac-53fb-4950-9074-b1cb997f9e86 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 23:48:13 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:48:13 user nova-compute[75341]:   <source dev="/dev/sdc"/>
Nov 14 23:48:13 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:48:13 user nova-compute[75341]:   <serial>ae34dfde-f1c8-4657-8145-8caa2c8b153f</serial>
Nov 14 23:48:13 user nova-compute[75341]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 23:48:13 user nova-compute[75341]: </disk>
Nov 14 23:48:13 user nova-compute[75341]:  {{(pid=75341) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 23:48:13 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-e6347eac-53fb-4950-9074-b1cb997f9e86 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Successfully detached device vdb from instance 5070fb03-8f40-426c-8c3e-192f6517f7c3 from the persistent domain config.
Nov 14 23:48:13 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-e6347eac-53fb-4950-9074-b1cb997f9e86 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5070fb03-8f40-426c-8c3e-192f6517f7c3 from the live domain config. {{(pid=75341) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 23:48:13 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-e6347eac-53fb-4950-9074-b1cb997f9e86 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 23:48:13 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:48:13 user nova-compute[75341]:   <source dev="/dev/sdc"/>
Nov 14 23:48:13 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:48:13 user nova-compute[75341]:   <serial>ae34dfde-f1c8-4657-8145-8caa2c8b153f</serial>
Nov 14 23:48:13 user nova-compute[75341]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 23:48:13 user nova-compute[75341]: </disk>
Nov 14 23:48:13 user nova-compute[75341]:  {{(pid=75341) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 23:48:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:14 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-e6347eac-53fb-4950-9074-b1cb997f9e86 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5070fb03-8f40-426c-8c3e-192f6517f7c3 {{(pid=75341) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 23:48:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:19 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:21 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-496a7450-0b2b-4578-906e-c66602016702 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Acquiring lock "881351d7-31f9-44f4-8571-8f540bbec29c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:48:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-496a7450-0b2b-4578-906e-c66602016702 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Lock "881351d7-31f9-44f4-8571-8f540bbec29c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:48:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-496a7450-0b2b-4578-906e-c66602016702 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Acquiring lock "881351d7-31f9-44f4-8571-8f540bbec29c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:48:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-496a7450-0b2b-4578-906e-c66602016702 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Lock "881351d7-31f9-44f4-8571-8f540bbec29c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:48:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-496a7450-0b2b-4578-906e-c66602016702 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Lock "881351d7-31f9-44f4-8571-8f540bbec29c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:48:21 user nova-compute[75341]: INFO nova.compute.manager [None req-496a7450-0b2b-4578-906e-c66602016702 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Terminating instance
Nov 14 23:48:21 user nova-compute[75341]: DEBUG nova.compute.manager [None req-496a7450-0b2b-4578-906e-c66602016702 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Start destroying the instance on the hypervisor. {{(pid=75341) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 23:48:21 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:21 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:21 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:21 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG nova.compute.manager [req-2201f9cb-1853-4df1-ab16-a0455558872c req-ab619be7-69f6-4417-8e06-6d092aebbcfc service nova] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Received event network-vif-unplugged-dcc0edd5-582a-499a-beaf-6de23ff1537c {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-2201f9cb-1853-4df1-ab16-a0455558872c req-ab619be7-69f6-4417-8e06-6d092aebbcfc service nova] Acquiring lock "881351d7-31f9-44f4-8571-8f540bbec29c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-2201f9cb-1853-4df1-ab16-a0455558872c req-ab619be7-69f6-4417-8e06-6d092aebbcfc service nova] Lock "881351d7-31f9-44f4-8571-8f540bbec29c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-2201f9cb-1853-4df1-ab16-a0455558872c req-ab619be7-69f6-4417-8e06-6d092aebbcfc service nova] Lock "881351d7-31f9-44f4-8571-8f540bbec29c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG nova.compute.manager [req-2201f9cb-1853-4df1-ab16-a0455558872c req-ab619be7-69f6-4417-8e06-6d092aebbcfc service nova] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] No waiting events found dispatching network-vif-unplugged-dcc0edd5-582a-499a-beaf-6de23ff1537c {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG nova.compute.manager [req-2201f9cb-1853-4df1-ab16-a0455558872c req-ab619be7-69f6-4417-8e06-6d092aebbcfc service nova] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Received event network-vif-unplugged-dcc0edd5-582a-499a-beaf-6de23ff1537c for instance with task_state deleting. {{(pid=75341) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 23:48:22 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Instance destroyed successfully.
Nov 14 23:48:22 user nova-compute[75341]: DEBUG nova.objects.instance [None req-496a7450-0b2b-4578-906e-c66602016702 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Lazy-loading 'resources' on Instance uuid 881351d7-31f9-44f4-8571-8f540bbec29c {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-496a7450-0b2b-4578-906e-c66602016702 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:39:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1731707158',display_name='tempest-ServerActionsTestOtherB-server-1731707158',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1731707158',id=1,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPcpkEsQSTpmH5o8Wvimru34qoMLk4crSEJeEz6XFBwMyGlgEqVH+eZU8RhCkfXTyDuMId//yiBmA84BMG1N70mUPHjpTANep7Y1Hwo1CNlTldBrdW9Ccxs8yCQLXA8Fw==',key_name='tempest-keypair-500318648',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:45:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eff8d64949254c7eb3dd8685ca7447b1',ramdisk_id='',reservation_id='r-505keefc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1632747205',owner_user_name='tempest-ServerActionsTestOtherB-1632747205-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:45:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='512d2ce7a01c4ffb924f9476a5c4b946',uuid=881351d7-31f9-44f4-8571-8f540bbec29c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dcc0edd5-582a-499a-beaf-6de23ff1537c", "address": "fa:16:3e:83:5b:7a", "network": {"id": "139c86e9-e6ea-4307-9f78-7f41ab7a6d8c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-487359378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eff8d64949254c7eb3dd8685ca7447b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc0edd5-58", "ovs_interfaceid": "dcc0edd5-582a-499a-beaf-6de23ff1537c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-496a7450-0b2b-4578-906e-c66602016702 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Converting VIF {"id": "dcc0edd5-582a-499a-beaf-6de23ff1537c", "address": "fa:16:3e:83:5b:7a", "network": {"id": "139c86e9-e6ea-4307-9f78-7f41ab7a6d8c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-487359378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eff8d64949254c7eb3dd8685ca7447b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc0edd5-58", "ovs_interfaceid": "dcc0edd5-582a-499a-beaf-6de23ff1537c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-496a7450-0b2b-4578-906e-c66602016702 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:5b:7a,bridge_name='br-int',has_traffic_filtering=True,id=dcc0edd5-582a-499a-beaf-6de23ff1537c,network=Network(139c86e9-e6ea-4307-9f78-7f41ab7a6d8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcc0edd5-58') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG os_vif [None req-496a7450-0b2b-4578-906e-c66602016702 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:5b:7a,bridge_name='br-int',has_traffic_filtering=True,id=dcc0edd5-582a-499a-beaf-6de23ff1537c,network=Network(139c86e9-e6ea-4307-9f78-7f41ab7a6d8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcc0edd5-58') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdcc0edd5-58, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ba24ecde-703c-4524-b8f1-772a9e8cbddc) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:22 user nova-compute[75341]: INFO os_vif [None req-496a7450-0b2b-4578-906e-c66602016702 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:5b:7a,bridge_name='br-int',has_traffic_filtering=True,id=dcc0edd5-582a-499a-beaf-6de23ff1537c,network=Network(139c86e9-e6ea-4307-9f78-7f41ab7a6d8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcc0edd5-58')
Nov 14 23:48:22 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-496a7450-0b2b-4578-906e-c66602016702 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] calling os-brick to detach iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-496a7450-0b2b-4578-906e-c66602016702 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, {'target_iqn': 'iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pzdvecEm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:48:22 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-496a7450-0b2b-4578-906e-c66602016702 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:48:22 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-496a7450-0b2b-4578-906e-c66602016702 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-496a7450-0b2b-4578-906e-c66602016702 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24bb556-5dd9-4410-866f-42dbf8b31d35]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae34dfde-f1c8-4657-8145-8caa2c8b153f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-496a7450-0b2b-4578-906e-c66602016702 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 23:48:22 user nova-compute[75341]: No targets found.
Nov 14 23:48:22 user nova-compute[75341]: iSNS:
Nov 14 23:48:22 user nova-compute[75341]: No targets found.
Nov 14 23:48:22 user nova-compute[75341]: STATIC:
Nov 14 23:48:22 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3
Nov 14 23:48:22 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:48:22 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:48:22 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:ae34dfde-f1c8-4657-8145-8caa2c8b153f
Nov 14 23:48:22 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:48:22 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:48:22 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774
Nov 14 23:48:22 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:48:22 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:48:22 user nova-compute[75341]: FIRMWARE:
Nov 14 23:48:22 user nova-compute[75341]: No targets found.
Nov 14 23:48:22 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-496a7450-0b2b-4578-906e-c66602016702 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 23:48:22 user nova-compute[75341]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 23:48:22 user nova-compute[75341]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75341) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-496a7450-0b2b-4578-906e-c66602016702 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3', 0)] {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[60cd1631-b9d0-49a0-971f-e38e252b5290]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae34dfde-f1c8-4657-8145-8caa2c8b153f\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b60ac92-bf33-4c78-8815-fed854ed0d08]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae34dfde-f1c8-4657-8145-8caa2c8b153f (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-496a7450-0b2b-4578-906e-c66602016702 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)
Nov 14 23:48:22 user nova-compute[75341]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774 (non-flash)
Nov 14 23:48:22 user nova-compute[75341]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae34dfde-f1c8-4657-8145-8caa2c8b153f (non-flash)
Nov 14 23:48:22 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-496a7450-0b2b-4578-906e-c66602016702 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 (non-flash)
Nov 14 23:48:22 user nova-compute[75341]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774 (non-flash)
Nov 14 23:48:22 user nova-compute[75341]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae34dfde-f1c8-4657-8145-8caa2c8b153f (non-flash)
Nov 14 23:48:22 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-496a7450-0b2b-4578-906e-c66602016702 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18507ab250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3'): ({'sde'}, set())}) {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-496a7450-0b2b-4578-906e-c66602016702 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Removing single pathed devices sde {{(pid=75341) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[958abecf-062d-4e64-84aa-a5ba8481af32]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[384001e0-40b0-4a4e-9bc5-5664b8779bf2]: (4, ('ok\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-496a7450-0b2b-4578-906e-c66602016702 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Flushing IO for device /dev/sde {{(pid=75341) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[04019260-f899-414c-beda-f83970bf6333]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-496a7450-0b2b-4578-906e-c66602016702 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75341) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[80dffeb1-8335-4e80-805c-962243e1689e]: (4, ('1', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-496a7450-0b2b-4578-906e-c66602016702 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-496a7450-0b2b-4578-906e-c66602016702 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] SCSI volumes sde have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-496a7450-0b2b-4578-906e-c66602016702 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3')] {{(pid=75341) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1665e8-fbce-4f88-b301-d592de993cff]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-496a7450-0b2b-4578-906e-c66602016702 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 -p 172.16.0.220:3260 --logout {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[355c8136-fc5d-4564-a440-3a1373e079aa]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-496a7450-0b2b-4578-906e-c66602016702 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3, portal: 172.16.0.220,3260]
Nov 14 23:48:22 user nova-compute[75341]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3, portal: 172.16.0.220,3260] successful.
Nov 14 23:48:22 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 -p 172.16.0.220:3260 --op delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7f71d9-c5f2-4ecc-a92e-cf292dad7fa3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16ea918-06bd-4664-aef0-1fb7551457c7]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-496a7450-0b2b-4578-906e-c66602016702 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-496a7450-0b2b-4578-906e-c66602016702 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-496a7450-0b2b-4578-906e-c66602016702 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] <== disconnect_volume: return (321ms) None {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-496a7450-0b2b-4578-906e-c66602016702 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Disconnected iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 23:48:22 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-496a7450-0b2b-4578-906e-c66602016702 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Deleting instance files /opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c_del
Nov 14 23:48:22 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-496a7450-0b2b-4578-906e-c66602016702 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Deletion of /opt/stack/data/nova/instances/881351d7-31f9-44f4-8571-8f540bbec29c_del complete
Nov 14 23:48:22 user nova-compute[75341]: INFO nova.compute.manager [None req-496a7450-0b2b-4578-906e-c66602016702 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Took 1.27 seconds to destroy the instance on the hypervisor.
Nov 14 23:48:22 user nova-compute[75341]: DEBUG oslo.service.loopingcall [None req-496a7450-0b2b-4578-906e-c66602016702 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75341) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG nova.compute.manager [-] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Deallocating network for instance {{(pid=75341) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 23:48:22 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] deallocate_for_instance() {{(pid=75341) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 23:48:23 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Acquiring lock "9996fc26-f3ad-40e2-91a5-51178c0194ef" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:48:23 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "9996fc26-f3ad-40e2-91a5-51178c0194ef" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:48:23 user nova-compute[75341]: DEBUG nova.compute.manager [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] Starting instance... {{(pid=75341) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 23:48:23 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:48:23 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:48:23 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75341) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 23:48:23 user nova-compute[75341]: INFO nova.compute.claims [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] Claim successful on node user
Nov 14 23:48:24 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:48:24 user nova-compute[75341]: INFO nova.compute.manager [-] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Took 1.03 seconds to deallocate network for instance.
Nov 14 23:48:24 user nova-compute[75341]: DEBUG nova.compute.manager [req-e62179da-d4ff-49e8-b227-cb9657947bbc req-ab594c1f-a2ae-45ec-8fec-d42dab8256e4 service nova] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Received event network-vif-deleted-dcc0edd5-582a-499a-beaf-6de23ff1537c {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:48:24 user nova-compute[75341]: INFO nova.compute.manager [req-e62179da-d4ff-49e8-b227-cb9657947bbc req-ab594c1f-a2ae-45ec-8fec-d42dab8256e4 service nova] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Neutron deleted interface dcc0edd5-582a-499a-beaf-6de23ff1537c; detaching it from the instance and deleting it from the info cache
Nov 14 23:48:24 user nova-compute[75341]: DEBUG nova.network.neutron [req-e62179da-d4ff-49e8-b227-cb9657947bbc req-ab594c1f-a2ae-45ec-8fec-d42dab8256e4 service nova] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:48:24 user nova-compute[75341]: DEBUG nova.compute.manager [req-e62179da-d4ff-49e8-b227-cb9657947bbc req-ab594c1f-a2ae-45ec-8fec-d42dab8256e4 service nova] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Detach interface failed, port_id=dcc0edd5-582a-499a-beaf-6de23ff1537c, reason: Instance 881351d7-31f9-44f4-8571-8f540bbec29c could not be found. {{(pid=75341) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 23:48:24 user nova-compute[75341]: DEBUG nova.compute.manager [req-47b4d762-f0ab-4e2f-9086-14a1723db866 req-44a9f0b5-32f8-4e8f-b889-7e60c6568a00 service nova] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Received event network-vif-plugged-dcc0edd5-582a-499a-beaf-6de23ff1537c {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:48:24 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-47b4d762-f0ab-4e2f-9086-14a1723db866 req-44a9f0b5-32f8-4e8f-b889-7e60c6568a00 service nova] Acquiring lock "881351d7-31f9-44f4-8571-8f540bbec29c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:48:24 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-47b4d762-f0ab-4e2f-9086-14a1723db866 req-44a9f0b5-32f8-4e8f-b889-7e60c6568a00 service nova] Lock "881351d7-31f9-44f4-8571-8f540bbec29c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:48:24 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-47b4d762-f0ab-4e2f-9086-14a1723db866 req-44a9f0b5-32f8-4e8f-b889-7e60c6568a00 service nova] Lock "881351d7-31f9-44f4-8571-8f540bbec29c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:48:24 user nova-compute[75341]: DEBUG nova.compute.manager [req-47b4d762-f0ab-4e2f-9086-14a1723db866 req-44a9f0b5-32f8-4e8f-b889-7e60c6568a00 service nova] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] No waiting events found dispatching network-vif-plugged-dcc0edd5-582a-499a-beaf-6de23ff1537c {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:48:24 user nova-compute[75341]: WARNING nova.compute.manager [req-47b4d762-f0ab-4e2f-9086-14a1723db866 req-44a9f0b5-32f8-4e8f-b889-7e60c6568a00 service nova] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Received unexpected event network-vif-plugged-dcc0edd5-582a-499a-beaf-6de23ff1537c for instance with vm_state active and task_state deleting.
Nov 14 23:48:24 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:48:24 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:48:24 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.508s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:48:24 user nova-compute[75341]: DEBUG nova.compute.manager [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] Start building networks asynchronously for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 23:48:24 user nova-compute[75341]: DEBUG nova.compute.manager [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] Allocating IP information in the background. {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 23:48:24 user nova-compute[75341]: DEBUG nova.network.neutron [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] allocate_for_instance() {{(pid=75341) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 23:48:24 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 23:48:24 user nova-compute[75341]: DEBUG nova.compute.manager [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] Start building block device mappings for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 23:48:24 user nova-compute[75341]: DEBUG nova.policy [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b08f7ddf6c2f4fd596e214d6ca56c234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96674073965642f1af11221b4add8a6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75341) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 23:48:24 user nova-compute[75341]: INFO nova.virt.block_device [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] Booting with volume 4d0580f2-e5df-4402-84ac-78a7ba95c0c9 at /dev/vda
Nov 14 23:48:24 user nova-compute[75341]: DEBUG os_brick.utils [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:48:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:24 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[db93e2e3-f46f-4cc1-8507-81e6966a858c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6d1cfca09c9\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:48:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:24 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26c018e-2e12-49ce-a0ef-cfe9bb244260]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:48:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:24 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b3feda-657b-4196-8586-4f3702d6c8a6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:48:24 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e64f966-10a7-4cd0-a4f4-b87395e0ba44]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:48:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Running cmd (subprocess): nvme version {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] 'nvme version' failed. Not Retrying. {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:48:24 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] nvme not present on system {{(pid=75341) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 23:48:24 user nova-compute[75341]: INFO nova.compute.manager [None req-496a7450-0b2b-4578-906e-c66602016702 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] [instance: 881351d7-31f9-44f4-8571-8f540bbec29c] Took 0.77 seconds to detach 1 volumes for instance.
Nov 14 23:48:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:48:24 user nova-compute[75341]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 23:48:24 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bcb7588-670f-4f9b-99d4-652a6a3c6039]: (4, '') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:48:24 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75341) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 23:48:24 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 23:48:24 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] LIGHTOS: no hostnqn found. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 23:48:24 user nova-compute[75341]: DEBUG os_brick.utils [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6d1cfca09c9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:48:24 user nova-compute[75341]: DEBUG nova.virt.block_device [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] Updating existing volume attachment record: dacf7243-8aeb-49c8-b5b9-c02a40b16586 {{(pid=75341) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 23:48:24 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-496a7450-0b2b-4578-906e-c66602016702 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:48:24 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-496a7450-0b2b-4578-906e-c66602016702 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:48:25 user nova-compute[75341]: DEBUG nova.network.neutron [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] Successfully created port: 1bb06e1a-0451-48ae-b964-93c0cce50a0a {{(pid=75341) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 23:48:25 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-496a7450-0b2b-4578-906e-c66602016702 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:48:25 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-496a7450-0b2b-4578-906e-c66602016702 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:48:25 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-496a7450-0b2b-4578-906e-c66602016702 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.595s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:48:25 user nova-compute[75341]: INFO nova.scheduler.client.report [None req-496a7450-0b2b-4578-906e-c66602016702 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Deleted allocations for instance 881351d7-31f9-44f4-8571-8f540bbec29c
Nov 14 23:48:25 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-496a7450-0b2b-4578-906e-c66602016702 tempest-ServerActionsTestOtherB-1632747205 tempest-ServerActionsTestOtherB-1632747205-project-member] Lock "881351d7-31f9-44f4-8571-8f540bbec29c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.977s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:48:26 user nova-compute[75341]: DEBUG nova.network.neutron [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] Successfully updated port: 1bb06e1a-0451-48ae-b964-93c0cce50a0a {{(pid=75341) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 23:48:26 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Acquiring lock "refresh_cache-9996fc26-f3ad-40e2-91a5-51178c0194ef" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:48:26 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Acquired lock "refresh_cache-9996fc26-f3ad-40e2-91a5-51178c0194ef" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:48:26 user nova-compute[75341]: DEBUG nova.network.neutron [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 23:48:26 user nova-compute[75341]: DEBUG nova.compute.manager [req-a9d309d4-7ded-4d60-b9be-6a93e89b43f4 req-596cf954-d631-4dbe-aa99-0f9111df49bf service nova] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] Received event network-changed-1bb06e1a-0451-48ae-b964-93c0cce50a0a {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:48:26 user nova-compute[75341]: DEBUG nova.compute.manager [req-a9d309d4-7ded-4d60-b9be-6a93e89b43f4 req-596cf954-d631-4dbe-aa99-0f9111df49bf service nova] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] Refreshing instance network info cache due to event network-changed-1bb06e1a-0451-48ae-b964-93c0cce50a0a. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:48:26 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a9d309d4-7ded-4d60-b9be-6a93e89b43f4 req-596cf954-d631-4dbe-aa99-0f9111df49bf service nova] Acquiring lock "refresh_cache-9996fc26-f3ad-40e2-91a5-51178c0194ef" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:48:26 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] Acquiring lock "223825d6-841d-4169-9c9b-f0ddf50b4d94" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:48:26 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] Lock "223825d6-841d-4169-9c9b-f0ddf50b4d94" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:48:26 user nova-compute[75341]: DEBUG nova.compute.manager [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] [instance: 223825d6-841d-4169-9c9b-f0ddf50b4d94] Starting instance... {{(pid=75341) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 23:48:26 user nova-compute[75341]: DEBUG nova.network.neutron [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] Instance cache missing network info. {{(pid=75341) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 23:48:26 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:48:26 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:48:26 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75341) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 23:48:26 user nova-compute[75341]: INFO nova.compute.claims [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] [instance: 223825d6-841d-4169-9c9b-f0ddf50b4d94] Claim successful on node user
Nov 14 23:48:26 user nova-compute[75341]: DEBUG nova.network.neutron [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] Updating instance_info_cache with network_info: [{"id": "1bb06e1a-0451-48ae-b964-93c0cce50a0a", "address": "fa:16:3e:15:5d:17", "network": {"id": "227eb779-a064-477d-8447-45862017ae7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-3827253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96674073965642f1af11221b4add8a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb06e1a-04", "ovs_interfaceid": "1bb06e1a-0451-48ae-b964-93c0cce50a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:48:26 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:26 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Releasing lock "refresh_cache-9996fc26-f3ad-40e2-91a5-51178c0194ef" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:48:26 user nova-compute[75341]: DEBUG nova.compute.manager [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] Instance network_info: |[{"id": "1bb06e1a-0451-48ae-b964-93c0cce50a0a", "address": "fa:16:3e:15:5d:17", "network": {"id": "227eb779-a064-477d-8447-45862017ae7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-3827253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96674073965642f1af11221b4add8a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb06e1a-04", "ovs_interfaceid": "1bb06e1a-0451-48ae-b964-93c0cce50a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 23:48:26 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a9d309d4-7ded-4d60-b9be-6a93e89b43f4 req-596cf954-d631-4dbe-aa99-0f9111df49bf service nova] Acquired lock "refresh_cache-9996fc26-f3ad-40e2-91a5-51178c0194ef" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:48:26 user nova-compute[75341]: DEBUG nova.network.neutron [req-a9d309d4-7ded-4d60-b9be-6a93e89b43f4 req-596cf954-d631-4dbe-aa99-0f9111df49bf service nova] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] Refreshing network info cache for port 1bb06e1a-0451-48ae-b964-93c0cce50a0a {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:48:26 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:48:26 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:48:26 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.543s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:48:26 user nova-compute[75341]: DEBUG nova.compute.manager [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] [instance: 223825d6-841d-4169-9c9b-f0ddf50b4d94] Start building networks asynchronously for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 23:48:26 user nova-compute[75341]: DEBUG nova.compute.manager [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] [instance: 223825d6-841d-4169-9c9b-f0ddf50b4d94] Allocating IP information in the background. {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 23:48:26 user nova-compute[75341]: DEBUG nova.network.neutron [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] [instance: 223825d6-841d-4169-9c9b-f0ddf50b4d94] allocate_for_instance() {{(pid=75341) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 23:48:26 user nova-compute[75341]: DEBUG nova.network.neutron [req-a9d309d4-7ded-4d60-b9be-6a93e89b43f4 req-596cf954-d631-4dbe-aa99-0f9111df49bf service nova] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] Updated VIF entry in instance network info cache for port 1bb06e1a-0451-48ae-b964-93c0cce50a0a. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:48:26 user nova-compute[75341]: DEBUG nova.network.neutron [req-a9d309d4-7ded-4d60-b9be-6a93e89b43f4 req-596cf954-d631-4dbe-aa99-0f9111df49bf service nova] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] Updating instance_info_cache with network_info: [{"id": "1bb06e1a-0451-48ae-b964-93c0cce50a0a", "address": "fa:16:3e:15:5d:17", "network": {"id": "227eb779-a064-477d-8447-45862017ae7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-3827253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96674073965642f1af11221b4add8a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb06e1a-04", "ovs_interfaceid": "1bb06e1a-0451-48ae-b964-93c0cce50a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:48:26 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] [instance: 223825d6-841d-4169-9c9b-f0ddf50b4d94] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 23:48:26 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a9d309d4-7ded-4d60-b9be-6a93e89b43f4 req-596cf954-d631-4dbe-aa99-0f9111df49bf service nova] Releasing lock "refresh_cache-9996fc26-f3ad-40e2-91a5-51178c0194ef" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:48:26 user nova-compute[75341]: DEBUG nova.compute.manager [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] [instance: 223825d6-841d-4169-9c9b-f0ddf50b4d94] Start building block device mappings for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 23:48:27 user nova-compute[75341]: DEBUG nova.policy [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9ee88737d6ae4ea5b6e086040b10ef5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f387630e6a954bb180ebe9b0ea2b42a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75341) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 23:48:27 user nova-compute[75341]: DEBUG nova.compute.manager [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] [instance: 223825d6-841d-4169-9c9b-f0ddf50b4d94] Start spawning the instance on the hypervisor. {{(pid=75341) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 23:48:27 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] [instance: 223825d6-841d-4169-9c9b-f0ddf50b4d94] Creating instance directory {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 23:48:27 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] [instance: 223825d6-841d-4169-9c9b-f0ddf50b4d94] Creating image(s)
Nov 14 23:48:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] Acquiring lock "/opt/stack/data/nova/instances/223825d6-841d-4169-9c9b-f0ddf50b4d94/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:48:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] Lock "/opt/stack/data/nova/instances/223825d6-841d-4169-9c9b-f0ddf50b4d94/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:48:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] Lock "/opt/stack/data/nova/instances/223825d6-841d-4169-9c9b-f0ddf50b4d94/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:48:27 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:27 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.198s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] Acquiring lock "4754efee9a6d73d3647f2add2cfe86c291949740" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:48:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:48:27 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:27 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.190s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:27 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/223825d6-841d-4169-9c9b-f0ddf50b4d94/disk 1073741824 {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:27 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/223825d6-841d-4169-9c9b-f0ddf50b4d94/disk 1073741824" returned: 0 in 0.049s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:48:27 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:27 user nova-compute[75341]: DEBUG nova.network.neutron [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] [instance: 223825d6-841d-4169-9c9b-f0ddf50b4d94] Successfully created port: cd795c93-66a7-4861-8ce6-e7b4f5c17ae5 {{(pid=75341) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 23:48:28 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.188s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:28 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] Checking if we can resize image /opt/stack/data/nova/instances/223825d6-841d-4169-9c9b-f0ddf50b4d94/disk. size=1073741824 {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 23:48:28 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/223825d6-841d-4169-9c9b-f0ddf50b4d94/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:28 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/223825d6-841d-4169-9c9b-f0ddf50b4d94/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:28 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] Cannot resize image /opt/stack/data/nova/instances/223825d6-841d-4169-9c9b-f0ddf50b4d94/disk to a smaller size. {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 23:48:28 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] [instance: 223825d6-841d-4169-9c9b-f0ddf50b4d94] Created local disks {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 23:48:28 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] [instance: 223825d6-841d-4169-9c9b-f0ddf50b4d94] Ensure instance console log exists: /opt/stack/data/nova/instances/223825d6-841d-4169-9c9b-f0ddf50b4d94/console.log {{(pid=75341) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 23:48:28 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:48:28 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:48:28 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:48:28 user nova-compute[75341]: DEBUG nova.network.neutron [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] [instance: 223825d6-841d-4169-9c9b-f0ddf50b4d94] Successfully updated port: cd795c93-66a7-4861-8ce6-e7b4f5c17ae5 {{(pid=75341) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 23:48:28 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] Acquiring lock "refresh_cache-223825d6-841d-4169-9c9b-f0ddf50b4d94" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:48:28 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] Acquired lock "refresh_cache-223825d6-841d-4169-9c9b-f0ddf50b4d94" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:48:28 user nova-compute[75341]: DEBUG nova.network.neutron [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] [instance: 223825d6-841d-4169-9c9b-f0ddf50b4d94] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 23:48:28 user nova-compute[75341]: DEBUG nova.compute.manager [req-0361bdf4-b3f3-4d8e-ba68-4a076f2c7799 req-c3c22291-d8e9-4ae8-bbec-50ed674ad2e2 service nova] [instance: 223825d6-841d-4169-9c9b-f0ddf50b4d94] Received event network-changed-cd795c93-66a7-4861-8ce6-e7b4f5c17ae5 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:48:28 user nova-compute[75341]: DEBUG nova.compute.manager [req-0361bdf4-b3f3-4d8e-ba68-4a076f2c7799 req-c3c22291-d8e9-4ae8-bbec-50ed674ad2e2 service nova] [instance: 223825d6-841d-4169-9c9b-f0ddf50b4d94] Refreshing instance network info cache due to event network-changed-cd795c93-66a7-4861-8ce6-e7b4f5c17ae5. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:48:28 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-0361bdf4-b3f3-4d8e-ba68-4a076f2c7799 req-c3c22291-d8e9-4ae8-bbec-50ed674ad2e2 service nova] Acquiring lock "refresh_cache-223825d6-841d-4169-9c9b-f0ddf50b4d94" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:48:28 user nova-compute[75341]: DEBUG nova.network.neutron [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] [instance: 223825d6-841d-4169-9c9b-f0ddf50b4d94] Instance cache missing network info. {{(pid=75341) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG nova.network.neutron [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] [instance: 223825d6-841d-4169-9c9b-f0ddf50b4d94] Updating instance_info_cache with network_info: [{"id": "cd795c93-66a7-4861-8ce6-e7b4f5c17ae5", "address": "fa:16:3e:8c:e6:55", "network": {"id": "e7850045-e26c-4fff-a226-6118b062a26e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "81b1e55661954a999e9fc78dcda9950b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd795c93-66", "ovs_interfaceid": "cd795c93-66a7-4861-8ce6-e7b4f5c17ae5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] Releasing lock "refresh_cache-223825d6-841d-4169-9c9b-f0ddf50b4d94" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG nova.compute.manager [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] [instance: 223825d6-841d-4169-9c9b-f0ddf50b4d94] Instance network_info: |[{"id": "cd795c93-66a7-4861-8ce6-e7b4f5c17ae5", "address": "fa:16:3e:8c:e6:55", "network": {"id": "e7850045-e26c-4fff-a226-6118b062a26e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "81b1e55661954a999e9fc78dcda9950b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd795c93-66", "ovs_interfaceid": "cd795c93-66a7-4861-8ce6-e7b4f5c17ae5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-0361bdf4-b3f3-4d8e-ba68-4a076f2c7799 req-c3c22291-d8e9-4ae8-bbec-50ed674ad2e2 service nova] Acquired lock "refresh_cache-223825d6-841d-4169-9c9b-f0ddf50b4d94" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG nova.network.neutron [req-0361bdf4-b3f3-4d8e-ba68-4a076f2c7799 req-c3c22291-d8e9-4ae8-bbec-50ed674ad2e2 service nova] [instance: 223825d6-841d-4169-9c9b-f0ddf50b4d94] Refreshing network info cache for port cd795c93-66a7-4861-8ce6-e7b4f5c17ae5 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] [instance: 223825d6-841d-4169-9c9b-f0ddf50b4d94] Start _get_guest_xml network_info=[{"id": "cd795c93-66a7-4861-8ce6-e7b4f5c17ae5", "address": "fa:16:3e:8c:e6:55", "network": {"id": "e7850045-e26c-4fff-a226-6118b062a26e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "81b1e55661954a999e9fc78dcda9950b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd795c93-66", "ovs_interfaceid": "cd795c93-66a7-4861-8ce6-e7b4f5c17ae5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encrypted': False, 'image_id': 'e46abb82-b810-490e-a8a1-ccdc5fa1a796'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 23:48:29 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:48:29 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:48:29 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:48:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1286313774',display_name='tempest-VolumesNegativeTest-instance-1286313774',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1286313774',id=30,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f387630e6a954bb180ebe9b0ea2b42a3',ramdisk_id='',reservation_id='r-dcmns2hh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-806213437',owner_user_name='tempest-VolumesNegativeTest-806213437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:48:27Z,user_data=None,user_id='9ee88737d6ae4ea5b6e086040b10ef5a',uuid=223825d6-841d-4169-9c9b-f0ddf50b4d94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd795c93-66a7-4861-8ce6-e7b4f5c17ae5", "address": "fa:16:3e:8c:e6:55", "network": {"id": "e7850045-e26c-4fff-a226-6118b062a26e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "81b1e55661954a999e9fc78dcda9950b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd795c93-66", "ovs_interfaceid": "cd795c93-66a7-4861-8ce6-e7b4f5c17ae5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] Converting VIF {"id": "cd795c93-66a7-4861-8ce6-e7b4f5c17ae5", "address": "fa:16:3e:8c:e6:55", "network": {"id": "e7850045-e26c-4fff-a226-6118b062a26e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "81b1e55661954a999e9fc78dcda9950b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd795c93-66", "ovs_interfaceid": "cd795c93-66a7-4861-8ce6-e7b4f5c17ae5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:e6:55,bridge_name='br-int',has_traffic_filtering=True,id=cd795c93-66a7-4861-8ce6-e7b4f5c17ae5,network=Network(e7850045-e26c-4fff-a226-6118b062a26e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd795c93-66') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG nova.objects.instance [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] Lazy-loading 'pci_devices' on Instance uuid 223825d6-841d-4169-9c9b-f0ddf50b4d94 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] [instance: 223825d6-841d-4169-9c9b-f0ddf50b4d94] End _get_guest_xml xml=<domain type="kvm">
Nov 14 23:48:29 user nova-compute[75341]:   <uuid>223825d6-841d-4169-9c9b-f0ddf50b4d94</uuid>
Nov 14 23:48:29 user nova-compute[75341]:   <name>instance-0000001e</name>
Nov 14 23:48:29 user nova-compute[75341]:   <memory>524288</memory>
Nov 14 23:48:29 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 14 23:48:29 user nova-compute[75341]:   <metadata>
Nov 14 23:48:29 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 23:48:29 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 14 23:48:29 user nova-compute[75341]:       <nova:name>tempest-VolumesNegativeTest-instance-1286313774</nova:name>
Nov 14 23:48:29 user nova-compute[75341]:       <nova:creationTime>2023-11-14 23:48:29</nova:creationTime>
Nov 14 23:48:29 user nova-compute[75341]:       <nova:flavor name="m1.tiny">
Nov 14 23:48:29 user nova-compute[75341]:         <nova:memory>512</nova:memory>
Nov 14 23:48:29 user nova-compute[75341]:         <nova:disk>1</nova:disk>
Nov 14 23:48:29 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 14 23:48:29 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 23:48:29 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 14 23:48:29 user nova-compute[75341]:       </nova:flavor>
Nov 14 23:48:29 user nova-compute[75341]:       <nova:owner>
Nov 14 23:48:29 user nova-compute[75341]:         <nova:user uuid="9ee88737d6ae4ea5b6e086040b10ef5a">tempest-VolumesNegativeTest-806213437-project-member</nova:user>
Nov 14 23:48:29 user nova-compute[75341]:         <nova:project uuid="f387630e6a954bb180ebe9b0ea2b42a3">tempest-VolumesNegativeTest-806213437</nova:project>
Nov 14 23:48:29 user nova-compute[75341]:       </nova:owner>
Nov 14 23:48:29 user nova-compute[75341]:       <nova:root type="image" uuid="e46abb82-b810-490e-a8a1-ccdc5fa1a796"/>
Nov 14 23:48:29 user nova-compute[75341]:       <nova:ports>
Nov 14 23:48:29 user nova-compute[75341]:         <nova:port uuid="cd795c93-66a7-4861-8ce6-e7b4f5c17ae5">
Nov 14 23:48:29 user nova-compute[75341]:           <nova:ip type="fixed" address="192.168.233.176" ipVersion="4"/>
Nov 14 23:48:29 user nova-compute[75341]:         </nova:port>
Nov 14 23:48:29 user nova-compute[75341]:       </nova:ports>
Nov 14 23:48:29 user nova-compute[75341]:     </nova:instance>
Nov 14 23:48:29 user nova-compute[75341]:   </metadata>
Nov 14 23:48:29 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 14 23:48:29 user nova-compute[75341]:     <system>
Nov 14 23:48:29 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 23:48:29 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 14 23:48:29 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 14 23:48:29 user nova-compute[75341]:       <entry name="serial">223825d6-841d-4169-9c9b-f0ddf50b4d94</entry>
Nov 14 23:48:29 user nova-compute[75341]:       <entry name="uuid">223825d6-841d-4169-9c9b-f0ddf50b4d94</entry>
Nov 14 23:48:29 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 14 23:48:29 user nova-compute[75341]:     </system>
Nov 14 23:48:29 user nova-compute[75341]:   </sysinfo>
Nov 14 23:48:29 user nova-compute[75341]:   <os>
Nov 14 23:48:29 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 23:48:29 user nova-compute[75341]:     <boot dev="hd"/>
Nov 14 23:48:29 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 14 23:48:29 user nova-compute[75341]:   </os>
Nov 14 23:48:29 user nova-compute[75341]:   <features>
Nov 14 23:48:29 user nova-compute[75341]:     <acpi/>
Nov 14 23:48:29 user nova-compute[75341]:     <apic/>
Nov 14 23:48:29 user nova-compute[75341]:     <vmcoreinfo/>
Nov 14 23:48:29 user nova-compute[75341]:   </features>
Nov 14 23:48:29 user nova-compute[75341]:   <clock offset="utc">
Nov 14 23:48:29 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 23:48:29 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 23:48:29 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 14 23:48:29 user nova-compute[75341]:   </clock>
Nov 14 23:48:29 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 14 23:48:29 user nova-compute[75341]:     <model>Nehalem</model>
Nov 14 23:48:29 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 23:48:29 user nova-compute[75341]:   </cpu>
Nov 14 23:48:29 user nova-compute[75341]:   <devices>
Nov 14 23:48:29 user nova-compute[75341]:     <disk type="file" device="disk">
Nov 14 23:48:29 user nova-compute[75341]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 23:48:29 user nova-compute[75341]:       <source file="/opt/stack/data/nova/instances/223825d6-841d-4169-9c9b-f0ddf50b4d94/disk"/>
Nov 14 23:48:29 user nova-compute[75341]:       <target dev="vda" bus="virtio"/>
Nov 14 23:48:29 user nova-compute[75341]:     </disk>
Nov 14 23:48:29 user nova-compute[75341]:     <interface type="ethernet">
Nov 14 23:48:29 user nova-compute[75341]:       <mac address="fa:16:3e:8c:e6:55"/>
Nov 14 23:48:29 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:48:29 user nova-compute[75341]:       <mtu size="1442"/>
Nov 14 23:48:29 user nova-compute[75341]:       <target dev="tapcd795c93-66"/>
Nov 14 23:48:29 user nova-compute[75341]:     </interface>
Nov 14 23:48:29 user nova-compute[75341]:     <serial type="pty">
Nov 14 23:48:29 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/223825d6-841d-4169-9c9b-f0ddf50b4d94/console.log" append="off"/>
Nov 14 23:48:29 user nova-compute[75341]:     </serial>
Nov 14 23:48:29 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 23:48:29 user nova-compute[75341]:     <video>
Nov 14 23:48:29 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:48:29 user nova-compute[75341]:     </video>
Nov 14 23:48:29 user nova-compute[75341]:     <rng model="virtio">
Nov 14 23:48:29 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 14 23:48:29 user nova-compute[75341]:     </rng>
Nov 14 23:48:29 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 14 23:48:29 user nova-compute[75341]:     <memballoon model="virtio">
Nov 14 23:48:29 user nova-compute[75341]:       <stats period="10"/>
Nov 14 23:48:29 user nova-compute[75341]:     </memballoon>
Nov 14 23:48:29 user nova-compute[75341]:   </devices>
Nov 14 23:48:29 user nova-compute[75341]: </domain>
Nov 14 23:48:29 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:48:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1286313774',display_name='tempest-VolumesNegativeTest-instance-1286313774',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1286313774',id=30,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f387630e6a954bb180ebe9b0ea2b42a3',ramdisk_id='',reservation_id='r-dcmns2hh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-806213437',owner_user_name='tempest-VolumesNegativeTest-806213437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:48:27Z,user_data=None,user_id='9ee88737d6ae4ea5b6e086040b10ef5a',uuid=223825d6-841d-4169-9c9b-f0ddf50b4d94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd795c93-66a7-4861-8ce6-e7b4f5c17ae5", "address": "fa:16:3e:8c:e6:55", "network": {"id": "e7850045-e26c-4fff-a226-6118b062a26e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "81b1e55661954a999e9fc78dcda9950b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd795c93-66", "ovs_interfaceid": "cd795c93-66a7-4861-8ce6-e7b4f5c17ae5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] Converting VIF {"id": "cd795c93-66a7-4861-8ce6-e7b4f5c17ae5", "address": "fa:16:3e:8c:e6:55", "network": {"id": "e7850045-e26c-4fff-a226-6118b062a26e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "81b1e55661954a999e9fc78dcda9950b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd795c93-66", "ovs_interfaceid": "cd795c93-66a7-4861-8ce6-e7b4f5c17ae5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:e6:55,bridge_name='br-int',has_traffic_filtering=True,id=cd795c93-66a7-4861-8ce6-e7b4f5c17ae5,network=Network(e7850045-e26c-4fff-a226-6118b062a26e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd795c93-66') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG os_vif [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:e6:55,bridge_name='br-int',has_traffic_filtering=True,id=cd795c93-66a7-4861-8ce6-e7b4f5c17ae5,network=Network(e7850045-e26c-4fff-a226-6118b062a26e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd795c93-66') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd9d6ad1f-ce57-599c-b310-e3978960e7cf', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcd795c93-66, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcd795c93-66, col_values=(('qos', UUID('dbba15c1-9cc0-4cef-a7c5-e8b7043d487c')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcd795c93-66, col_values=(('external_ids', {'iface-id': 'cd795c93-66a7-4861-8ce6-e7b4f5c17ae5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:e6:55', 'vm-uuid': '223825d6-841d-4169-9c9b-f0ddf50b4d94'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:29 user nova-compute[75341]: INFO os_vif [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:e6:55,bridge_name='br-int',has_traffic_filtering=True,id=cd795c93-66a7-4861-8ce6-e7b4f5c17ae5,network=Network(e7850045-e26c-4fff-a226-6118b062a26e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd795c93-66')
Nov 14 23:48:29 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] No VIF found with MAC fa:16:3e:8c:e6:55, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG nova.network.neutron [req-0361bdf4-b3f3-4d8e-ba68-4a076f2c7799 req-c3c22291-d8e9-4ae8-bbec-50ed674ad2e2 service nova] [instance: 223825d6-841d-4169-9c9b-f0ddf50b4d94] Updated VIF entry in instance network info cache for port cd795c93-66a7-4861-8ce6-e7b4f5c17ae5. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG nova.network.neutron [req-0361bdf4-b3f3-4d8e-ba68-4a076f2c7799 req-c3c22291-d8e9-4ae8-bbec-50ed674ad2e2 service nova] [instance: 223825d6-841d-4169-9c9b-f0ddf50b4d94] Updating instance_info_cache with network_info: [{"id": "cd795c93-66a7-4861-8ce6-e7b4f5c17ae5", "address": "fa:16:3e:8c:e6:55", "network": {"id": "e7850045-e26c-4fff-a226-6118b062a26e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "81b1e55661954a999e9fc78dcda9950b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd795c93-66", "ovs_interfaceid": "cd795c93-66a7-4861-8ce6-e7b4f5c17ae5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-0361bdf4-b3f3-4d8e-ba68-4a076f2c7799 req-c3c22291-d8e9-4ae8-bbec-50ed674ad2e2 service nova] Releasing lock "refresh_cache-223825d6-841d-4169-9c9b-f0ddf50b4d94" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG nova.compute.manager [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] Start spawning the instance on the hypervisor. {{(pid=75341) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] Creating instance directory {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 23:48:29 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] Creating image(s)
Nov 14 23:48:29 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] Did not create local disks {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] Ensure instance console log exists: /opt/stack/data/nova/instances/9996fc26-f3ad-40e2-91a5-51178c0194ef/console.log {{(pid=75341) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] Start _get_guest_xml network_info=[{"id": "1bb06e1a-0451-48ae-b964-93c0cce50a0a", "address": "fa:16:3e:15:5d:17", "network": {"id": "227eb779-a064-477d-8447-45862017ae7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-3827253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96674073965642f1af11221b4add8a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb06e1a-04", "ovs_interfaceid": "1bb06e1a-0451-48ae-b964-93c0cce50a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'dacf7243-8aeb-49c8-b5b9-c02a40b16586', 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lTqdQVAF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9996fc26-f3ad-40e2-91a5-51178c0194ef', 'attached_at': '', 'detached_at': '', 'volume_id': '4d0580f2-e5df-4402-84ac-78a7ba95c0c9', 'serial': '4d0580f2-e5df-4402-84ac-78a7ba95c0c9'}, 'delete_on_termination': True, 'volume_type': None} {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 23:48:29 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:48:29 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:48:29 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] Calling os-brick to attach iSCSI Volume {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lTqdQVAF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:48:29 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:48:29 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:48:29 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:48:29 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:48:29 user nova-compute[75341]: INFO os_brick.initiator.connectors.iscsi [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 23:48:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 -p 172.16.0.220:3260 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b9a719-7df6-4fd7-a132-8c7d5decb485]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 23:48:29 user nova-compute[75341]:  {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f7395f3-fe4c-442b-8438-bb2eb886a478]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9] added\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9] added
Nov 14 23:48:29 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[be61dbdf-1a06-418a-84c4-f66967cb58e8]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[878ac537-8fea-4142-9f28-d3672b44301a]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lTqdQVAF {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lTqdQVAF" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fab0156-e591-4c7c-9a3a-4de783cd2298]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lTqdQVAF'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d2e753-69ad-4a3f-aa0a-7d791c1d0e3e]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[828d9d4f-ff18-4a35-a368-937abe596991]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae34dfde-f1c8-4657-8145-8caa2c8b153f (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774 (non-flash)
Nov 14 23:48:29 user nova-compute[75341]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae34dfde-f1c8-4657-8145-8caa2c8b153f (non-flash)
Nov 14 23:48:29 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774 (non-flash)
Nov 14 23:48:29 user nova-compute[75341]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae34dfde-f1c8-4657-8145-8caa2c8b153f (non-flash)
Nov 14 23:48:29 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 -p 172.16.0.220:3260 --login {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74bce77-25d6-490c-8de1-9e63789e8d5e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9, portal: 172.16.0.220,3260]
Nov 14 23:48:29 user nova-compute[75341]: Login to [iface: default, target: iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9, portal: 172.16.0.220,3260] successful.
Nov 14 23:48:29 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21a4ba2-5bdc-43f9-bedf-d9522a4f18ee]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ff9cba-0b72-4984-bd70-68512d5e5989]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae34dfde-f1c8-4657-8145-8caa2c8b153f (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774 (non-flash)
Nov 14 23:48:29 user nova-compute[75341]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae34dfde-f1c8-4657-8145-8caa2c8b153f (non-flash)
Nov 14 23:48:29 user nova-compute[75341]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)
Nov 14 23:48:29 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774 (non-flash)
Nov 14 23:48:29 user nova-compute[75341]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae34dfde-f1c8-4657-8145-8caa2c8b153f (non-flash)
Nov 14 23:48:29 user nova-compute[75341]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)
Nov 14 23:48:29 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Connected to 172.16.0.220:3260 {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] HCTL ('35', '-', '-', 0) found on session 31 with lun 0 {{(pid=75341) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75341) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 23:48:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:30 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:30 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[56cf5436-28b7-4121-91f0-52882d8d8cf4]: (4, ('- - 0', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:48:30 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: None {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 23:48:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:30 user nova-compute[75341]: DEBUG nova.compute.manager [req-fc78cc09-d5b8-4e49-bd3e-54fca9788d4d req-8933a606-bc33-4875-bd16-fbf6dfc0953d service nova] [instance: 223825d6-841d-4169-9c9b-f0ddf50b4d94] Received event network-vif-plugged-cd795c93-66a7-4861-8ce6-e7b4f5c17ae5 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:48:30 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-fc78cc09-d5b8-4e49-bd3e-54fca9788d4d req-8933a606-bc33-4875-bd16-fbf6dfc0953d service nova] Acquiring lock "223825d6-841d-4169-9c9b-f0ddf50b4d94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:48:30 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-fc78cc09-d5b8-4e49-bd3e-54fca9788d4d req-8933a606-bc33-4875-bd16-fbf6dfc0953d service nova] Lock "223825d6-841d-4169-9c9b-f0ddf50b4d94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:48:30 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-fc78cc09-d5b8-4e49-bd3e-54fca9788d4d req-8933a606-bc33-4875-bd16-fbf6dfc0953d service nova] Lock "223825d6-841d-4169-9c9b-f0ddf50b4d94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:48:30 user nova-compute[75341]: DEBUG nova.compute.manager [req-fc78cc09-d5b8-4e49-bd3e-54fca9788d4d req-8933a606-bc33-4875-bd16-fbf6dfc0953d service nova] [instance: 223825d6-841d-4169-9c9b-f0ddf50b4d94] No waiting events found dispatching network-vif-plugged-cd795c93-66a7-4861-8ce6-e7b4f5c17ae5 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:48:30 user nova-compute[75341]: WARNING nova.compute.manager [req-fc78cc09-d5b8-4e49-bd3e-54fca9788d4d req-8933a606-bc33-4875-bd16-fbf6dfc0953d service nova] [instance: 223825d6-841d-4169-9c9b-f0ddf50b4d94] Received unexpected event network-vif-plugged-cd795c93-66a7-4861-8ce6-e7b4f5c17ae5 for instance with vm_state building and task_state spawning.
Nov 14 23:48:31 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 23:48:31 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lTqdQVAF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 23:48:31 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:48:31 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '26362663730626362', 'path': '/dev/sdd'} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:48:31 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362663730626362', 'path': '/dev/sdd'} {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 23:48:31 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:48:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-21916805',display_name='tempest-TestVolumeBootPattern-volume-backed-server-21916805',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-21916805',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE4MZMWtIjuL8yZaIeHkrVx8VbbGzvBlRNbdew4mw+ozZV3QmI4vaa34OgjOosbw9r7xfhbJWz5DQgr7o8XqXL9po5mlyDeUpkdHZKoj3USMO1GDNKjQ9rNtUs8mVH6cuQ==',key_name='tempest-keypair-103389545',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96674073965642f1af11221b4add8a6d',ramdisk_id='',reservation_id='r-a7czp6db',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-320933673',owner_user_name='tempest-TestVolumeBootPattern-320933673-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:48:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b08f7ddf6c2f4fd596e214d6ca56c234',uuid=9996fc26-f3ad-40e2-91a5-51178c0194ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1bb06e1a-0451-48ae-b964-93c0cce50a0a", "address": "fa:16:3e:15:5d:17", "network": {"id": "227eb779-a064-477d-8447-45862017ae7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-3827253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96674073965642f1af11221b4add8a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb06e1a-04", "ovs_interfaceid": "1bb06e1a-0451-48ae-b964-93c0cce50a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:48:31 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Converting VIF {"id": "1bb06e1a-0451-48ae-b964-93c0cce50a0a", "address": "fa:16:3e:15:5d:17", "network": {"id": "227eb779-a064-477d-8447-45862017ae7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-3827253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96674073965642f1af11221b4add8a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb06e1a-04", "ovs_interfaceid": "1bb06e1a-0451-48ae-b964-93c0cce50a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:48:31 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:5d:17,bridge_name='br-int',has_traffic_filtering=True,id=1bb06e1a-0451-48ae-b964-93c0cce50a0a,network=Network(227eb779-a064-477d-8447-45862017ae7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bb06e1a-04') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:48:31 user nova-compute[75341]: DEBUG nova.objects.instance [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lazy-loading 'pci_devices' on Instance uuid 9996fc26-f3ad-40e2-91a5-51178c0194ef {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:48:31 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] End _get_guest_xml xml=<domain type="kvm">
Nov 14 23:48:31 user nova-compute[75341]:   <uuid>9996fc26-f3ad-40e2-91a5-51178c0194ef</uuid>
Nov 14 23:48:31 user nova-compute[75341]:   <name>instance-0000001d</name>
Nov 14 23:48:31 user nova-compute[75341]:   <memory>524288</memory>
Nov 14 23:48:31 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 14 23:48:31 user nova-compute[75341]:   <metadata>
Nov 14 23:48:31 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 23:48:31 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 14 23:48:31 user nova-compute[75341]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-21916805</nova:name>
Nov 14 23:48:31 user nova-compute[75341]:       <nova:creationTime>2023-11-14 23:48:29</nova:creationTime>
Nov 14 23:48:31 user nova-compute[75341]:       <nova:flavor name="m1.tiny">
Nov 14 23:48:31 user nova-compute[75341]:         <nova:memory>512</nova:memory>
Nov 14 23:48:31 user nova-compute[75341]:         <nova:disk>1</nova:disk>
Nov 14 23:48:31 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 14 23:48:31 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 23:48:31 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 14 23:48:31 user nova-compute[75341]:       </nova:flavor>
Nov 14 23:48:31 user nova-compute[75341]:       <nova:owner>
Nov 14 23:48:31 user nova-compute[75341]:         <nova:user uuid="b08f7ddf6c2f4fd596e214d6ca56c234">tempest-TestVolumeBootPattern-320933673-project-member</nova:user>
Nov 14 23:48:31 user nova-compute[75341]:         <nova:project uuid="96674073965642f1af11221b4add8a6d">tempest-TestVolumeBootPattern-320933673</nova:project>
Nov 14 23:48:31 user nova-compute[75341]:       </nova:owner>
Nov 14 23:48:31 user nova-compute[75341]:       <nova:ports>
Nov 14 23:48:31 user nova-compute[75341]:         <nova:port uuid="1bb06e1a-0451-48ae-b964-93c0cce50a0a">
Nov 14 23:48:31 user nova-compute[75341]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 23:48:31 user nova-compute[75341]:         </nova:port>
Nov 14 23:48:31 user nova-compute[75341]:       </nova:ports>
Nov 14 23:48:31 user nova-compute[75341]:     </nova:instance>
Nov 14 23:48:31 user nova-compute[75341]:   </metadata>
Nov 14 23:48:31 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 14 23:48:31 user nova-compute[75341]:     <system>
Nov 14 23:48:31 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 23:48:31 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 14 23:48:31 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 14 23:48:31 user nova-compute[75341]:       <entry name="serial">9996fc26-f3ad-40e2-91a5-51178c0194ef</entry>
Nov 14 23:48:31 user nova-compute[75341]:       <entry name="uuid">9996fc26-f3ad-40e2-91a5-51178c0194ef</entry>
Nov 14 23:48:31 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 14 23:48:31 user nova-compute[75341]:     </system>
Nov 14 23:48:31 user nova-compute[75341]:   </sysinfo>
Nov 14 23:48:31 user nova-compute[75341]:   <os>
Nov 14 23:48:31 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 23:48:31 user nova-compute[75341]:     <boot dev="hd"/>
Nov 14 23:48:31 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 14 23:48:31 user nova-compute[75341]:   </os>
Nov 14 23:48:31 user nova-compute[75341]:   <features>
Nov 14 23:48:31 user nova-compute[75341]:     <acpi/>
Nov 14 23:48:31 user nova-compute[75341]:     <apic/>
Nov 14 23:48:31 user nova-compute[75341]:     <vmcoreinfo/>
Nov 14 23:48:31 user nova-compute[75341]:   </features>
Nov 14 23:48:31 user nova-compute[75341]:   <clock offset="utc">
Nov 14 23:48:31 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 23:48:31 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 23:48:31 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 14 23:48:31 user nova-compute[75341]:   </clock>
Nov 14 23:48:31 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 14 23:48:31 user nova-compute[75341]:     <model>Nehalem</model>
Nov 14 23:48:31 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 23:48:31 user nova-compute[75341]:   </cpu>
Nov 14 23:48:31 user nova-compute[75341]:   <devices>
Nov 14 23:48:31 user nova-compute[75341]:     <disk type="block" device="disk">
Nov 14 23:48:31 user nova-compute[75341]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:48:31 user nova-compute[75341]:       <source dev="/dev/sdd"/>
Nov 14 23:48:31 user nova-compute[75341]:       <target dev="vda" bus="virtio"/>
Nov 14 23:48:31 user nova-compute[75341]:       <serial>4d0580f2-e5df-4402-84ac-78a7ba95c0c9</serial>
Nov 14 23:48:31 user nova-compute[75341]:     </disk>
Nov 14 23:48:31 user nova-compute[75341]:     <interface type="ethernet">
Nov 14 23:48:31 user nova-compute[75341]:       <mac address="fa:16:3e:15:5d:17"/>
Nov 14 23:48:31 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:48:31 user nova-compute[75341]:       <mtu size="1442"/>
Nov 14 23:48:31 user nova-compute[75341]:       <target dev="tap1bb06e1a-04"/>
Nov 14 23:48:31 user nova-compute[75341]:     </interface>
Nov 14 23:48:31 user nova-compute[75341]:     <serial type="pty">
Nov 14 23:48:31 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/9996fc26-f3ad-40e2-91a5-51178c0194ef/console.log" append="off"/>
Nov 14 23:48:31 user nova-compute[75341]:     </serial>
Nov 14 23:48:31 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 23:48:31 user nova-compute[75341]:     <video>
Nov 14 23:48:31 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:48:31 user nova-compute[75341]:     </video>
Nov 14 23:48:31 user nova-compute[75341]:     <rng model="virtio">
Nov 14 23:48:31 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 14 23:48:31 user nova-compute[75341]:     </rng>
Nov 14 23:48:31 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 14 23:48:31 user nova-compute[75341]:     <memballoon model="virtio">
Nov 14 23:48:31 user nova-compute[75341]:       <stats period="10"/>
Nov 14 23:48:31 user nova-compute[75341]:     </memballoon>
Nov 14 23:48:31 user nova-compute[75341]:   </devices>
Nov 14 23:48:31 user nova-compute[75341]: </domain>
Nov 14 23:48:31 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 23:48:31 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:48:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-21916805',display_name='tempest-TestVolumeBootPattern-volume-backed-server-21916805',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-21916805',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE4MZMWtIjuL8yZaIeHkrVx8VbbGzvBlRNbdew4mw+ozZV3QmI4vaa34OgjOosbw9r7xfhbJWz5DQgr7o8XqXL9po5mlyDeUpkdHZKoj3USMO1GDNKjQ9rNtUs8mVH6cuQ==',key_name='tempest-keypair-103389545',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96674073965642f1af11221b4add8a6d',ramdisk_id='',reservation_id='r-a7czp6db',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-320933673',owner_user_name='tempest-TestVolumeBootPattern-320933673-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:48:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b08f7ddf6c2f4fd596e214d6ca56c234',uuid=9996fc26-f3ad-40e2-91a5-51178c0194ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1bb06e1a-0451-48ae-b964-93c0cce50a0a", "address": "fa:16:3e:15:5d:17", "network": {"id": "227eb779-a064-477d-8447-45862017ae7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-3827253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96674073965642f1af11221b4add8a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb06e1a-04", "ovs_interfaceid": "1bb06e1a-0451-48ae-b964-93c0cce50a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 23:48:31 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Converting VIF {"id": "1bb06e1a-0451-48ae-b964-93c0cce50a0a", "address": "fa:16:3e:15:5d:17", "network": {"id": "227eb779-a064-477d-8447-45862017ae7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-3827253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96674073965642f1af11221b4add8a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb06e1a-04", "ovs_interfaceid": "1bb06e1a-0451-48ae-b964-93c0cce50a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:48:31 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:5d:17,bridge_name='br-int',has_traffic_filtering=True,id=1bb06e1a-0451-48ae-b964-93c0cce50a0a,network=Network(227eb779-a064-477d-8447-45862017ae7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bb06e1a-04') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:48:31 user nova-compute[75341]: DEBUG os_vif [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:5d:17,bridge_name='br-int',has_traffic_filtering=True,id=1bb06e1a-0451-48ae-b964-93c0cce50a0a,network=Network(227eb779-a064-477d-8447-45862017ae7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bb06e1a-04') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 23:48:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:48:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 23:48:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1f5aa1cd-023e-5d12-83fa-09916b61bfc7', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:48:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1bb06e1a-04, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:48:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1bb06e1a-04, col_values=(('qos', UUID('a8928bc5-0030-4fba-8f78-e7dd52a48235')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:48:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1bb06e1a-04, col_values=(('external_ids', {'iface-id': '1bb06e1a-0451-48ae-b964-93c0cce50a0a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:5d:17', 'vm-uuid': '9996fc26-f3ad-40e2-91a5-51178c0194ef'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:48:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:48:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:31 user nova-compute[75341]: INFO os_vif [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:5d:17,bridge_name='br-int',has_traffic_filtering=True,id=1bb06e1a-0451-48ae-b964-93c0cce50a0a,network=Network(227eb779-a064-477d-8447-45862017ae7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bb06e1a-04')
Nov 14 23:48:31 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:48:31 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] No VIF found with MAC fa:16:3e:15:5d:17, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:48:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:32 user nova-compute[75341]: DEBUG nova.compute.manager [req-2e03608e-8797-46d9-b22f-c2cc66544d5f req-07dafa9c-5504-41d9-85ff-a5f3155a1ea9 service nova] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] Received event network-vif-plugged-1bb06e1a-0451-48ae-b964-93c0cce50a0a {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:48:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-2e03608e-8797-46d9-b22f-c2cc66544d5f req-07dafa9c-5504-41d9-85ff-a5f3155a1ea9 service nova] Acquiring lock "9996fc26-f3ad-40e2-91a5-51178c0194ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:48:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-2e03608e-8797-46d9-b22f-c2cc66544d5f req-07dafa9c-5504-41d9-85ff-a5f3155a1ea9 service nova] Lock "9996fc26-f3ad-40e2-91a5-51178c0194ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:48:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-2e03608e-8797-46d9-b22f-c2cc66544d5f req-07dafa9c-5504-41d9-85ff-a5f3155a1ea9 service nova] Lock "9996fc26-f3ad-40e2-91a5-51178c0194ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:48:32 user nova-compute[75341]: DEBUG nova.compute.manager [req-2e03608e-8797-46d9-b22f-c2cc66544d5f req-07dafa9c-5504-41d9-85ff-a5f3155a1ea9 service nova] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] No waiting events found dispatching network-vif-plugged-1bb06e1a-0451-48ae-b964-93c0cce50a0a {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:48:32 user nova-compute[75341]: WARNING nova.compute.manager [req-2e03608e-8797-46d9-b22f-c2cc66544d5f req-07dafa9c-5504-41d9-85ff-a5f3155a1ea9 service nova] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] Received unexpected event network-vif-plugged-1bb06e1a-0451-48ae-b964-93c0cce50a0a for instance with vm_state building and task_state spawning.
Nov 14 23:48:32 user nova-compute[75341]: DEBUG nova.compute.manager [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] [instance: 223825d6-841d-4169-9c9b-f0ddf50b4d94] Instance event wait completed in 0 seconds for  {{(pid=75341) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 23:48:32 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] [instance: 223825d6-841d-4169-9c9b-f0ddf50b4d94] Guest created on hypervisor {{(pid=75341) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 23:48:32 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 223825d6-841d-4169-9c9b-f0ddf50b4d94] Instance spawned successfully.
Nov 14 23:48:32 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] [instance: 223825d6-841d-4169-9c9b-f0ddf50b4d94] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 23:48:32 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] [instance: 223825d6-841d-4169-9c9b-f0ddf50b4d94] Found default for hw_cdrom_bus of ide {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:48:32 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] [instance: 223825d6-841d-4169-9c9b-f0ddf50b4d94] Found default for hw_disk_bus of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:48:32 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] [instance: 223825d6-841d-4169-9c9b-f0ddf50b4d94] Found default for hw_input_bus of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:48:32 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] [instance: 223825d6-841d-4169-9c9b-f0ddf50b4d94] Found default for hw_pointer_model of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:48:32 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] [instance: 223825d6-841d-4169-9c9b-f0ddf50b4d94] Found default for hw_video_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:48:32 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] [instance: 223825d6-841d-4169-9c9b-f0ddf50b4d94] Found default for hw_vif_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:48:32 user nova-compute[75341]: INFO nova.compute.manager [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] [instance: 223825d6-841d-4169-9c9b-f0ddf50b4d94] Took 5.50 seconds to spawn the instance on the hypervisor.
Nov 14 23:48:32 user nova-compute[75341]: DEBUG nova.compute.manager [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] [instance: 223825d6-841d-4169-9c9b-f0ddf50b4d94] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 23:48:32 user nova-compute[75341]: DEBUG nova.compute.manager [req-cdcf7ff2-5358-4b68-a203-24c96e6f648d req-3e93f4d3-b0b6-4de2-bd04-52ccbc9b28df service nova] [instance: 223825d6-841d-4169-9c9b-f0ddf50b4d94] Received event network-vif-plugged-cd795c93-66a7-4861-8ce6-e7b4f5c17ae5 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:48:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-cdcf7ff2-5358-4b68-a203-24c96e6f648d req-3e93f4d3-b0b6-4de2-bd04-52ccbc9b28df service nova] Acquiring lock "223825d6-841d-4169-9c9b-f0ddf50b4d94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:48:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-cdcf7ff2-5358-4b68-a203-24c96e6f648d req-3e93f4d3-b0b6-4de2-bd04-52ccbc9b28df service nova] Lock "223825d6-841d-4169-9c9b-f0ddf50b4d94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:48:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-cdcf7ff2-5358-4b68-a203-24c96e6f648d req-3e93f4d3-b0b6-4de2-bd04-52ccbc9b28df service nova] Lock "223825d6-841d-4169-9c9b-f0ddf50b4d94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:48:32 user nova-compute[75341]: DEBUG nova.compute.manager [req-cdcf7ff2-5358-4b68-a203-24c96e6f648d req-3e93f4d3-b0b6-4de2-bd04-52ccbc9b28df service nova] [instance: 223825d6-841d-4169-9c9b-f0ddf50b4d94] No waiting events found dispatching network-vif-plugged-cd795c93-66a7-4861-8ce6-e7b4f5c17ae5 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:48:32 user nova-compute[75341]: WARNING nova.compute.manager [req-cdcf7ff2-5358-4b68-a203-24c96e6f648d req-3e93f4d3-b0b6-4de2-bd04-52ccbc9b28df service nova] [instance: 223825d6-841d-4169-9c9b-f0ddf50b4d94] Received unexpected event network-vif-plugged-cd795c93-66a7-4861-8ce6-e7b4f5c17ae5 for instance with vm_state building and task_state spawning.
Nov 14 23:48:32 user nova-compute[75341]: INFO nova.compute.manager [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] [instance: 223825d6-841d-4169-9c9b-f0ddf50b4d94] Took 6.68 seconds to build instance.
Nov 14 23:48:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-91b9a04c-6beb-4656-97be-02331e726310 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] Lock "223825d6-841d-4169-9c9b-f0ddf50b4d94" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.793s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:48:33 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:33 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:33 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:33 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:34 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-e6347eac-53fb-4950-9074-b1cb997f9e86 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5070fb03-8f40-426c-8c3e-192f6517f7c3 is timed out.
Nov 14 23:48:34 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-e6347eac-53fb-4950-9074-b1cb997f9e86 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Successfully detached device vdb from instance 5070fb03-8f40-426c-8c3e-192f6517f7c3 from the live domain config.
Nov 14 23:48:34 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6347eac-53fb-4950-9074-b1cb997f9e86 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] calling os-brick to detach iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 23:48:34 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6347eac-53fb-4950-9074-b1cb997f9e86 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, {'target_iqn': 'iqn.2010-10.org.openstack:ae34dfde-f1c8-4657-8145-8caa2c8b153f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vUekjQCW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:48:34 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-e6347eac-53fb-4950-9074-b1cb997f9e86 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:48:34 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-e6347eac-53fb-4950-9074-b1cb997f9e86 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:48:34 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-e6347eac-53fb-4950-9074-b1cb997f9e86 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:48:34 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:34 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:34 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[95598bc3-fa21-4b08-8a29-d1b42be9d3bb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae34dfde-f1c8-4657-8145-8caa2c8b153f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:48:34 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6347eac-53fb-4950-9074-b1cb997f9e86 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 23:48:34 user nova-compute[75341]: No targets found.
Nov 14 23:48:34 user nova-compute[75341]: iSNS:
Nov 14 23:48:34 user nova-compute[75341]: No targets found.
Nov 14 23:48:34 user nova-compute[75341]: STATIC:
Nov 14 23:48:34 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9
Nov 14 23:48:34 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:48:34 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:48:34 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:ae34dfde-f1c8-4657-8145-8caa2c8b153f
Nov 14 23:48:34 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:48:34 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:48:34 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774
Nov 14 23:48:34 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:48:34 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:48:34 user nova-compute[75341]: FIRMWARE:
Nov 14 23:48:34 user nova-compute[75341]: No targets found.
Nov 14 23:48:34 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:48:34 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6347eac-53fb-4950-9074-b1cb997f9e86 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 23:48:34 user nova-compute[75341]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 23:48:34 user nova-compute[75341]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75341) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 23:48:34 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6347eac-53fb-4950-9074-b1cb997f9e86 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae34dfde-f1c8-4657-8145-8caa2c8b153f', 0)] {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 23:48:34 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:34 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:34 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[233e650f-9d64-4c74-856c-db55e54d2470]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae34dfde-f1c8-4657-8145-8caa2c8b153f\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:48:34 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:34 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:34 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[03992eeb-b9da-4c58-bd5b-7e9ee867c819]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae34dfde-f1c8-4657-8145-8caa2c8b153f (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:48:34 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6347eac-53fb-4950-9074-b1cb997f9e86 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774 (non-flash)
Nov 14 23:48:34 user nova-compute[75341]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae34dfde-f1c8-4657-8145-8caa2c8b153f (non-flash)
Nov 14 23:48:34 user nova-compute[75341]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)
Nov 14 23:48:34 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:48:34 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6347eac-53fb-4950-9074-b1cb997f9e86 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774 (non-flash)
Nov 14 23:48:34 user nova-compute[75341]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae34dfde-f1c8-4657-8145-8caa2c8b153f (non-flash)
Nov 14 23:48:34 user nova-compute[75341]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)
Nov 14 23:48:34 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:48:34 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6347eac-53fb-4950-9074-b1cb997f9e86 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18704d09d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae34dfde-f1c8-4657-8145-8caa2c8b153f'): ({'sdc'}, set())}) {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 23:48:34 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-e6347eac-53fb-4950-9074-b1cb997f9e86 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Removing single pathed devices sdc {{(pid=75341) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 23:48:34 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:34 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:34 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed96de0-c5f0-4985-b8d1-edba82a2c2c6]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:48:34 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:34 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:34 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[6142afda-6899-42df-9e96-ece93b9750f0]: (4, ('ok\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:48:34 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-e6347eac-53fb-4950-9074-b1cb997f9e86 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Flushing IO for device /dev/sdc {{(pid=75341) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 23:48:34 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:34 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:34 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac6e49d-8622-4b10-929d-4ea5e4ef0c63]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:48:34 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-e6347eac-53fb-4950-9074-b1cb997f9e86 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75341) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 23:48:34 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:34 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:34 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[e738017c-709b-4989-a9c5-40c7bc5bd9ff]: (4, ('1', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:48:34 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-e6347eac-53fb-4950-9074-b1cb997f9e86 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 23:48:34 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-e6347eac-53fb-4950-9074-b1cb997f9e86 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] SCSI volumes sdc have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 23:48:34 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6347eac-53fb-4950-9074-b1cb997f9e86 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae34dfde-f1c8-4657-8145-8caa2c8b153f')] {{(pid=75341) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 23:48:34 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae34dfde-f1c8-4657-8145-8caa2c8b153f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:34 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae34dfde-f1c8-4657-8145-8caa2c8b153f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:34 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[74dca935-62e1-4fd8-88df-d9c613e53c44]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:48:34 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6347eac-53fb-4950-9074-b1cb997f9e86 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:48:34 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae34dfde-f1c8-4657-8145-8caa2c8b153f -p 172.16.0.220:3260 --logout {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:34 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae34dfde-f1c8-4657-8145-8caa2c8b153f -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:34 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d374db-79d1-45b9-aa14-5c6bb8c6259f]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:ae34dfde-f1c8-4657-8145-8caa2c8b153f, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:ae34dfde-f1c8-4657-8145-8caa2c8b153f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:48:34 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6347eac-53fb-4950-9074-b1cb997f9e86 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:ae34dfde-f1c8-4657-8145-8caa2c8b153f, portal: 172.16.0.220,3260]
Nov 14 23:48:34 user nova-compute[75341]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:ae34dfde-f1c8-4657-8145-8caa2c8b153f, portal: 172.16.0.220,3260] successful.
Nov 14 23:48:34 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:48:34 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae34dfde-f1c8-4657-8145-8caa2c8b153f -p 172.16.0.220:3260 --op delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:34 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae34dfde-f1c8-4657-8145-8caa2c8b153f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:34 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5409fd-49f4-4dc8-b53e-2f5ff7097730]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:48:34 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6347eac-53fb-4950-9074-b1cb997f9e86 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:48:34 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-e6347eac-53fb-4950-9074-b1cb997f9e86 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:48:34 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6347eac-53fb-4950-9074-b1cb997f9e86 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] <== disconnect_volume: return (306ms) None {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:48:34 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6347eac-53fb-4950-9074-b1cb997f9e86 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Disconnected iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 23:48:34 user nova-compute[75341]: DEBUG nova.compute.manager [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] Instance event wait completed in 0 seconds for  {{(pid=75341) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 23:48:34 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] Guest created on hypervisor {{(pid=75341) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 23:48:34 user nova-compute[75341]: DEBUG nova.compute.manager [req-034380ad-4b12-49a9-a9d7-c7fd1bb417d4 req-a22e7148-1162-4742-802b-674090f75622 service nova] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] Received event network-vif-plugged-1bb06e1a-0451-48ae-b964-93c0cce50a0a {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:48:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-034380ad-4b12-49a9-a9d7-c7fd1bb417d4 req-a22e7148-1162-4742-802b-674090f75622 service nova] Acquiring lock "9996fc26-f3ad-40e2-91a5-51178c0194ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:48:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-034380ad-4b12-49a9-a9d7-c7fd1bb417d4 req-a22e7148-1162-4742-802b-674090f75622 service nova] Lock "9996fc26-f3ad-40e2-91a5-51178c0194ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:48:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-034380ad-4b12-49a9-a9d7-c7fd1bb417d4 req-a22e7148-1162-4742-802b-674090f75622 service nova] Lock "9996fc26-f3ad-40e2-91a5-51178c0194ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:48:34 user nova-compute[75341]: DEBUG nova.compute.manager [req-034380ad-4b12-49a9-a9d7-c7fd1bb417d4 req-a22e7148-1162-4742-802b-674090f75622 service nova] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] No waiting events found dispatching network-vif-plugged-1bb06e1a-0451-48ae-b964-93c0cce50a0a {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:48:34 user nova-compute[75341]: WARNING nova.compute.manager [req-034380ad-4b12-49a9-a9d7-c7fd1bb417d4 req-a22e7148-1162-4742-802b-674090f75622 service nova] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] Received unexpected event network-vif-plugged-1bb06e1a-0451-48ae-b964-93c0cce50a0a for instance with vm_state building and task_state spawning.
Nov 14 23:48:34 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] Instance spawned successfully.
Nov 14 23:48:34 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 23:48:34 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] Found default for hw_cdrom_bus of ide {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:48:34 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] Found default for hw_disk_bus of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:48:34 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] Found default for hw_input_bus of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:48:34 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] Found default for hw_pointer_model of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:48:34 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] Found default for hw_video_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:48:34 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] Found default for hw_vif_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:48:34 user nova-compute[75341]: INFO nova.compute.manager [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] Took 5.13 seconds to spawn the instance on the hypervisor.
Nov 14 23:48:34 user nova-compute[75341]: DEBUG nova.compute.manager [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 23:48:34 user nova-compute[75341]: INFO nova.compute.manager [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] Took 11.00 seconds to build instance.
Nov 14 23:48:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-9ccefc0c-95d8-44c1-9ab9-d0be35ab8284 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "9996fc26-f3ad-40e2-91a5-51178c0194ef" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.105s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:48:35 user nova-compute[75341]: DEBUG nova.objects.instance [None req-e6347eac-53fb-4950-9074-b1cb997f9e86 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Lazy-loading 'flavor' on Instance uuid 5070fb03-8f40-426c-8c3e-192f6517f7c3 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:48:35 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e6347eac-53fb-4950-9074-b1cb997f9e86 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Lock "5070fb03-8f40-426c-8c3e-192f6517f7c3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.778s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:48:36 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:36 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:43 user nova-compute[75341]: DEBUG nova.compute.manager [req-45677d57-040d-4585-8610-b60e1188dd39 req-c715397c-bee2-42df-8611-74f294fbdab8 service nova] [instance: eada8790-de2a-4bfd-954c-55627e554a84] Received event network-changed-b261a90f-503d-4ba7-839a-67203bb28e65 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:48:43 user nova-compute[75341]: DEBUG nova.compute.manager [req-45677d57-040d-4585-8610-b60e1188dd39 req-c715397c-bee2-42df-8611-74f294fbdab8 service nova] [instance: eada8790-de2a-4bfd-954c-55627e554a84] Refreshing instance network info cache due to event network-changed-b261a90f-503d-4ba7-839a-67203bb28e65. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:48:43 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-45677d57-040d-4585-8610-b60e1188dd39 req-c715397c-bee2-42df-8611-74f294fbdab8 service nova] Acquiring lock "refresh_cache-eada8790-de2a-4bfd-954c-55627e554a84" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:48:43 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-45677d57-040d-4585-8610-b60e1188dd39 req-c715397c-bee2-42df-8611-74f294fbdab8 service nova] Acquired lock "refresh_cache-eada8790-de2a-4bfd-954c-55627e554a84" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:48:43 user nova-compute[75341]: DEBUG nova.network.neutron [req-45677d57-040d-4585-8610-b60e1188dd39 req-c715397c-bee2-42df-8611-74f294fbdab8 service nova] [instance: eada8790-de2a-4bfd-954c-55627e554a84] Refreshing network info cache for port b261a90f-503d-4ba7-839a-67203bb28e65 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:48:43 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0e1319a0-a27e-4c52-bb4b-26af68d8ecb0 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Acquiring lock "eada8790-de2a-4bfd-954c-55627e554a84" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:48:43 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0e1319a0-a27e-4c52-bb4b-26af68d8ecb0 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "eada8790-de2a-4bfd-954c-55627e554a84" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:48:43 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0e1319a0-a27e-4c52-bb4b-26af68d8ecb0 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Acquiring lock "eada8790-de2a-4bfd-954c-55627e554a84-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:48:43 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0e1319a0-a27e-4c52-bb4b-26af68d8ecb0 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "eada8790-de2a-4bfd-954c-55627e554a84-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:48:43 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0e1319a0-a27e-4c52-bb4b-26af68d8ecb0 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "eada8790-de2a-4bfd-954c-55627e554a84-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:48:43 user nova-compute[75341]: DEBUG nova.network.neutron [req-45677d57-040d-4585-8610-b60e1188dd39 req-c715397c-bee2-42df-8611-74f294fbdab8 service nova] [instance: eada8790-de2a-4bfd-954c-55627e554a84] Updated VIF entry in instance network info cache for port b261a90f-503d-4ba7-839a-67203bb28e65. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:48:43 user nova-compute[75341]: DEBUG nova.network.neutron [req-45677d57-040d-4585-8610-b60e1188dd39 req-c715397c-bee2-42df-8611-74f294fbdab8 service nova] [instance: eada8790-de2a-4bfd-954c-55627e554a84] Updating instance_info_cache with network_info: [{"id": "b261a90f-503d-4ba7-839a-67203bb28e65", "address": "fa:16:3e:e2:ae:53", "network": {"id": "9ad7204e-07f5-4676-b2de-09e036a92e61", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-718201239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542a85b3a6d14c77872f1957120ba655", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb261a90f-50", "ovs_interfaceid": "b261a90f-503d-4ba7-839a-67203bb28e65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:48:43 user nova-compute[75341]: INFO nova.compute.manager [None req-0e1319a0-a27e-4c52-bb4b-26af68d8ecb0 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: eada8790-de2a-4bfd-954c-55627e554a84] Terminating instance
Nov 14 23:48:43 user nova-compute[75341]: DEBUG nova.compute.manager [None req-0e1319a0-a27e-4c52-bb4b-26af68d8ecb0 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: eada8790-de2a-4bfd-954c-55627e554a84] Start destroying the instance on the hypervisor. {{(pid=75341) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 23:48:43 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-45677d57-040d-4585-8610-b60e1188dd39 req-c715397c-bee2-42df-8611-74f294fbdab8 service nova] Releasing lock "refresh_cache-eada8790-de2a-4bfd-954c-55627e554a84" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:48:43 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:43 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:44 user nova-compute[75341]: DEBUG nova.compute.manager [req-e65b82ce-f4bb-4003-8fb1-436e9ff9bedc req-a517a94e-2b6a-4574-a741-bf1cf62d57b6 service nova] [instance: eada8790-de2a-4bfd-954c-55627e554a84] Received event network-vif-unplugged-b261a90f-503d-4ba7-839a-67203bb28e65 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:48:44 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-e65b82ce-f4bb-4003-8fb1-436e9ff9bedc req-a517a94e-2b6a-4574-a741-bf1cf62d57b6 service nova] Acquiring lock "eada8790-de2a-4bfd-954c-55627e554a84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:48:44 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-e65b82ce-f4bb-4003-8fb1-436e9ff9bedc req-a517a94e-2b6a-4574-a741-bf1cf62d57b6 service nova] Lock "eada8790-de2a-4bfd-954c-55627e554a84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:48:44 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-e65b82ce-f4bb-4003-8fb1-436e9ff9bedc req-a517a94e-2b6a-4574-a741-bf1cf62d57b6 service nova] Lock "eada8790-de2a-4bfd-954c-55627e554a84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:48:44 user nova-compute[75341]: DEBUG nova.compute.manager [req-e65b82ce-f4bb-4003-8fb1-436e9ff9bedc req-a517a94e-2b6a-4574-a741-bf1cf62d57b6 service nova] [instance: eada8790-de2a-4bfd-954c-55627e554a84] No waiting events found dispatching network-vif-unplugged-b261a90f-503d-4ba7-839a-67203bb28e65 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:48:44 user nova-compute[75341]: DEBUG nova.compute.manager [req-e65b82ce-f4bb-4003-8fb1-436e9ff9bedc req-a517a94e-2b6a-4574-a741-bf1cf62d57b6 service nova] [instance: eada8790-de2a-4bfd-954c-55627e554a84] Received event network-vif-unplugged-b261a90f-503d-4ba7-839a-67203bb28e65 for instance with task_state deleting. {{(pid=75341) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 23:48:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:44 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: eada8790-de2a-4bfd-954c-55627e554a84] Instance destroyed successfully.
Nov 14 23:48:44 user nova-compute[75341]: DEBUG nova.objects.instance [None req-0e1319a0-a27e-4c52-bb4b-26af68d8ecb0 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lazy-loading 'resources' on Instance uuid eada8790-de2a-4bfd-954c-55627e554a84 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:48:44 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-0e1319a0-a27e-4c52-bb4b-26af68d8ecb0 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:46:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1996063953',display_name='tempest-AttachVolumeNegativeTest-server-1996063953',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1996063953',id=24,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDsI/+Jm9ziTKZZ63fwRKNxVrhKSKgFpH2Jq/ejIMTfRjOynsKPylcTJbZUom3nh8LxLpyC2SuC26uYF0v06JsmfPVRX8vy1vg5bOXpqVzYzAHFjlh5QKm/wErEHzZI0HQ==',key_name='tempest-keypair-708836602',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:46:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='542a85b3a6d14c77872f1957120ba655',ramdisk_id='',reservation_id='r-7x7895p9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-802469934',owner_user_name='tempest-AttachVolumeNegativeTest-802469934-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:46:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d0b6eae0d3124f70982781555ccc7ec0',uuid=eada8790-de2a-4bfd-954c-55627e554a84,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b261a90f-503d-4ba7-839a-67203bb28e65", "address": "fa:16:3e:e2:ae:53", "network": {"id": "9ad7204e-07f5-4676-b2de-09e036a92e61", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-718201239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542a85b3a6d14c77872f1957120ba655", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb261a90f-50", "ovs_interfaceid": "b261a90f-503d-4ba7-839a-67203bb28e65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 23:48:44 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-0e1319a0-a27e-4c52-bb4b-26af68d8ecb0 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Converting VIF {"id": "b261a90f-503d-4ba7-839a-67203bb28e65", "address": "fa:16:3e:e2:ae:53", "network": {"id": "9ad7204e-07f5-4676-b2de-09e036a92e61", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-718201239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542a85b3a6d14c77872f1957120ba655", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb261a90f-50", "ovs_interfaceid": "b261a90f-503d-4ba7-839a-67203bb28e65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:48:44 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-0e1319a0-a27e-4c52-bb4b-26af68d8ecb0 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:ae:53,bridge_name='br-int',has_traffic_filtering=True,id=b261a90f-503d-4ba7-839a-67203bb28e65,network=Network(9ad7204e-07f5-4676-b2de-09e036a92e61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb261a90f-50') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:48:44 user nova-compute[75341]: DEBUG os_vif [None req-0e1319a0-a27e-4c52-bb4b-26af68d8ecb0 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:ae:53,bridge_name='br-int',has_traffic_filtering=True,id=b261a90f-503d-4ba7-839a-67203bb28e65,network=Network(9ad7204e-07f5-4676-b2de-09e036a92e61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb261a90f-50') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 23:48:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb261a90f-50, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:48:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:48:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b606b3ba-caa8-40a5-900e-b7a0df71ca57) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:48:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:48:44 user nova-compute[75341]: INFO os_vif [None req-0e1319a0-a27e-4c52-bb4b-26af68d8ecb0 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:ae:53,bridge_name='br-int',has_traffic_filtering=True,id=b261a90f-503d-4ba7-839a-67203bb28e65,network=Network(9ad7204e-07f5-4676-b2de-09e036a92e61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb261a90f-50')
Nov 14 23:48:44 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-0e1319a0-a27e-4c52-bb4b-26af68d8ecb0 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: eada8790-de2a-4bfd-954c-55627e554a84] Deleting instance files /opt/stack/data/nova/instances/eada8790-de2a-4bfd-954c-55627e554a84_del
Nov 14 23:48:44 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-0e1319a0-a27e-4c52-bb4b-26af68d8ecb0 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: eada8790-de2a-4bfd-954c-55627e554a84] Deletion of /opt/stack/data/nova/instances/eada8790-de2a-4bfd-954c-55627e554a84_del complete
Nov 14 23:48:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:44 user nova-compute[75341]: INFO nova.compute.manager [None req-0e1319a0-a27e-4c52-bb4b-26af68d8ecb0 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: eada8790-de2a-4bfd-954c-55627e554a84] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 14 23:48:44 user nova-compute[75341]: DEBUG oslo.service.loopingcall [None req-0e1319a0-a27e-4c52-bb4b-26af68d8ecb0 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75341) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 23:48:44 user nova-compute[75341]: DEBUG nova.compute.manager [-] [instance: eada8790-de2a-4bfd-954c-55627e554a84] Deallocating network for instance {{(pid=75341) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 23:48:44 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: eada8790-de2a-4bfd-954c-55627e554a84] deallocate_for_instance() {{(pid=75341) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 23:48:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:45 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:45 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:45 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:45 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: eada8790-de2a-4bfd-954c-55627e554a84] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:48:45 user nova-compute[75341]: INFO nova.compute.manager [-] [instance: eada8790-de2a-4bfd-954c-55627e554a84] Took 0.70 seconds to deallocate network for instance.
Nov 14 23:48:45 user nova-compute[75341]: DEBUG nova.compute.manager [req-5dc310e8-122e-4396-8a4c-ab2e3886a60b req-553f8e8d-c934-4ac4-a87f-1b78e9a64d2d service nova] [instance: eada8790-de2a-4bfd-954c-55627e554a84] Received event network-vif-deleted-b261a90f-503d-4ba7-839a-67203bb28e65 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:48:45 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0e1319a0-a27e-4c52-bb4b-26af68d8ecb0 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:48:45 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0e1319a0-a27e-4c52-bb4b-26af68d8ecb0 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:48:45 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-0e1319a0-a27e-4c52-bb4b-26af68d8ecb0 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:48:45 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-0e1319a0-a27e-4c52-bb4b-26af68d8ecb0 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:48:45 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0e1319a0-a27e-4c52-bb4b-26af68d8ecb0 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.343s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:48:45 user nova-compute[75341]: INFO nova.scheduler.client.report [None req-0e1319a0-a27e-4c52-bb4b-26af68d8ecb0 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Deleted allocations for instance eada8790-de2a-4bfd-954c-55627e554a84
Nov 14 23:48:45 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0e1319a0-a27e-4c52-bb4b-26af68d8ecb0 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "eada8790-de2a-4bfd-954c-55627e554a84" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.171s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:48:46 user nova-compute[75341]: DEBUG nova.compute.manager [req-834e66b5-fb4f-46bd-b72a-f3918077de90 req-0bea9d35-ef59-4a21-bc20-112336d3730f service nova] [instance: eada8790-de2a-4bfd-954c-55627e554a84] Received event network-vif-plugged-b261a90f-503d-4ba7-839a-67203bb28e65 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:48:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-834e66b5-fb4f-46bd-b72a-f3918077de90 req-0bea9d35-ef59-4a21-bc20-112336d3730f service nova] Acquiring lock "eada8790-de2a-4bfd-954c-55627e554a84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:48:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-834e66b5-fb4f-46bd-b72a-f3918077de90 req-0bea9d35-ef59-4a21-bc20-112336d3730f service nova] Lock "eada8790-de2a-4bfd-954c-55627e554a84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:48:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-834e66b5-fb4f-46bd-b72a-f3918077de90 req-0bea9d35-ef59-4a21-bc20-112336d3730f service nova] Lock "eada8790-de2a-4bfd-954c-55627e554a84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:48:46 user nova-compute[75341]: DEBUG nova.compute.manager [req-834e66b5-fb4f-46bd-b72a-f3918077de90 req-0bea9d35-ef59-4a21-bc20-112336d3730f service nova] [instance: eada8790-de2a-4bfd-954c-55627e554a84] No waiting events found dispatching network-vif-plugged-b261a90f-503d-4ba7-839a-67203bb28e65 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:48:46 user nova-compute[75341]: WARNING nova.compute.manager [req-834e66b5-fb4f-46bd-b72a-f3918077de90 req-0bea9d35-ef59-4a21-bc20-112336d3730f service nova] [instance: eada8790-de2a-4bfd-954c-55627e554a84] Received unexpected event network-vif-plugged-b261a90f-503d-4ba7-839a-67203bb28e65 for instance with vm_state deleted and task_state None.
Nov 14 23:48:46 user nova-compute[75341]: DEBUG nova.compute.manager [req-834e66b5-fb4f-46bd-b72a-f3918077de90 req-0bea9d35-ef59-4a21-bc20-112336d3730f service nova] [instance: eada8790-de2a-4bfd-954c-55627e554a84] Received event network-vif-plugged-b261a90f-503d-4ba7-839a-67203bb28e65 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:48:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-834e66b5-fb4f-46bd-b72a-f3918077de90 req-0bea9d35-ef59-4a21-bc20-112336d3730f service nova] Acquiring lock "eada8790-de2a-4bfd-954c-55627e554a84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:48:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-834e66b5-fb4f-46bd-b72a-f3918077de90 req-0bea9d35-ef59-4a21-bc20-112336d3730f service nova] Lock "eada8790-de2a-4bfd-954c-55627e554a84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:48:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-834e66b5-fb4f-46bd-b72a-f3918077de90 req-0bea9d35-ef59-4a21-bc20-112336d3730f service nova] Lock "eada8790-de2a-4bfd-954c-55627e554a84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:48:46 user nova-compute[75341]: DEBUG nova.compute.manager [req-834e66b5-fb4f-46bd-b72a-f3918077de90 req-0bea9d35-ef59-4a21-bc20-112336d3730f service nova] [instance: eada8790-de2a-4bfd-954c-55627e554a84] No waiting events found dispatching network-vif-plugged-b261a90f-503d-4ba7-839a-67203bb28e65 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:48:46 user nova-compute[75341]: WARNING nova.compute.manager [req-834e66b5-fb4f-46bd-b72a-f3918077de90 req-0bea9d35-ef59-4a21-bc20-112336d3730f service nova] [instance: eada8790-de2a-4bfd-954c-55627e554a84] Received unexpected event network-vif-plugged-b261a90f-503d-4ba7-839a-67203bb28e65 for instance with vm_state deleted and task_state None.
Nov 14 23:48:46 user nova-compute[75341]: DEBUG nova.compute.manager [req-834e66b5-fb4f-46bd-b72a-f3918077de90 req-0bea9d35-ef59-4a21-bc20-112336d3730f service nova] [instance: eada8790-de2a-4bfd-954c-55627e554a84] Received event network-vif-plugged-b261a90f-503d-4ba7-839a-67203bb28e65 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:48:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-834e66b5-fb4f-46bd-b72a-f3918077de90 req-0bea9d35-ef59-4a21-bc20-112336d3730f service nova] Acquiring lock "eada8790-de2a-4bfd-954c-55627e554a84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:48:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-834e66b5-fb4f-46bd-b72a-f3918077de90 req-0bea9d35-ef59-4a21-bc20-112336d3730f service nova] Lock "eada8790-de2a-4bfd-954c-55627e554a84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:48:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-834e66b5-fb4f-46bd-b72a-f3918077de90 req-0bea9d35-ef59-4a21-bc20-112336d3730f service nova] Lock "eada8790-de2a-4bfd-954c-55627e554a84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:48:46 user nova-compute[75341]: DEBUG nova.compute.manager [req-834e66b5-fb4f-46bd-b72a-f3918077de90 req-0bea9d35-ef59-4a21-bc20-112336d3730f service nova] [instance: eada8790-de2a-4bfd-954c-55627e554a84] No waiting events found dispatching network-vif-plugged-b261a90f-503d-4ba7-839a-67203bb28e65 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:48:46 user nova-compute[75341]: WARNING nova.compute.manager [req-834e66b5-fb4f-46bd-b72a-f3918077de90 req-0bea9d35-ef59-4a21-bc20-112336d3730f service nova] [instance: eada8790-de2a-4bfd-954c-55627e554a84] Received unexpected event network-vif-plugged-b261a90f-503d-4ba7-839a-67203bb28e65 for instance with vm_state deleted and task_state None.
Nov 14 23:48:46 user nova-compute[75341]: DEBUG nova.compute.manager [req-834e66b5-fb4f-46bd-b72a-f3918077de90 req-0bea9d35-ef59-4a21-bc20-112336d3730f service nova] [instance: eada8790-de2a-4bfd-954c-55627e554a84] Received event network-vif-unplugged-b261a90f-503d-4ba7-839a-67203bb28e65 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:48:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-834e66b5-fb4f-46bd-b72a-f3918077de90 req-0bea9d35-ef59-4a21-bc20-112336d3730f service nova] Acquiring lock "eada8790-de2a-4bfd-954c-55627e554a84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:48:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-834e66b5-fb4f-46bd-b72a-f3918077de90 req-0bea9d35-ef59-4a21-bc20-112336d3730f service nova] Lock "eada8790-de2a-4bfd-954c-55627e554a84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:48:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-834e66b5-fb4f-46bd-b72a-f3918077de90 req-0bea9d35-ef59-4a21-bc20-112336d3730f service nova] Lock "eada8790-de2a-4bfd-954c-55627e554a84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:48:46 user nova-compute[75341]: DEBUG nova.compute.manager [req-834e66b5-fb4f-46bd-b72a-f3918077de90 req-0bea9d35-ef59-4a21-bc20-112336d3730f service nova] [instance: eada8790-de2a-4bfd-954c-55627e554a84] No waiting events found dispatching network-vif-unplugged-b261a90f-503d-4ba7-839a-67203bb28e65 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:48:46 user nova-compute[75341]: WARNING nova.compute.manager [req-834e66b5-fb4f-46bd-b72a-f3918077de90 req-0bea9d35-ef59-4a21-bc20-112336d3730f service nova] [instance: eada8790-de2a-4bfd-954c-55627e554a84] Received unexpected event network-vif-unplugged-b261a90f-503d-4ba7-839a-67203bb28e65 for instance with vm_state deleted and task_state None.
Nov 14 23:48:46 user nova-compute[75341]: DEBUG nova.compute.manager [req-834e66b5-fb4f-46bd-b72a-f3918077de90 req-0bea9d35-ef59-4a21-bc20-112336d3730f service nova] [instance: eada8790-de2a-4bfd-954c-55627e554a84] Received event network-vif-plugged-b261a90f-503d-4ba7-839a-67203bb28e65 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:48:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-834e66b5-fb4f-46bd-b72a-f3918077de90 req-0bea9d35-ef59-4a21-bc20-112336d3730f service nova] Acquiring lock "eada8790-de2a-4bfd-954c-55627e554a84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:48:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-834e66b5-fb4f-46bd-b72a-f3918077de90 req-0bea9d35-ef59-4a21-bc20-112336d3730f service nova] Lock "eada8790-de2a-4bfd-954c-55627e554a84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:48:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-834e66b5-fb4f-46bd-b72a-f3918077de90 req-0bea9d35-ef59-4a21-bc20-112336d3730f service nova] Lock "eada8790-de2a-4bfd-954c-55627e554a84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:48:46 user nova-compute[75341]: DEBUG nova.compute.manager [req-834e66b5-fb4f-46bd-b72a-f3918077de90 req-0bea9d35-ef59-4a21-bc20-112336d3730f service nova] [instance: eada8790-de2a-4bfd-954c-55627e554a84] No waiting events found dispatching network-vif-plugged-b261a90f-503d-4ba7-839a-67203bb28e65 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:48:46 user nova-compute[75341]: WARNING nova.compute.manager [req-834e66b5-fb4f-46bd-b72a-f3918077de90 req-0bea9d35-ef59-4a21-bc20-112336d3730f service nova] [instance: eada8790-de2a-4bfd-954c-55627e554a84] Received unexpected event network-vif-plugged-b261a90f-503d-4ba7-839a-67203bb28e65 for instance with vm_state deleted and task_state None.
Nov 14 23:48:46 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:47 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:48:48 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:48:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:49 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:48:49 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75341) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 23:48:50 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:48:50 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Starting heal instance info cache {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 23:48:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "refresh_cache-6382e432-838f-4d89-a743-cbaa37f50ab5" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:48:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquired lock "refresh_cache-6382e432-838f-4d89-a743-cbaa37f50ab5" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:48:51 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Forcefully refreshing network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 23:48:51 user nova-compute[75341]: DEBUG nova.compute.manager [req-ab38ed6c-b5af-4372-a12c-499335e73b7b req-cc6de730-6ae6-4660-92e2-5792f6c88554 service nova] [instance: defae731-4191-4526-99cc-a301cf5b3355] Received event network-changed-10b83231-0b39-4dee-95db-bb6a03d70fc0 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:48:51 user nova-compute[75341]: DEBUG nova.compute.manager [req-ab38ed6c-b5af-4372-a12c-499335e73b7b req-cc6de730-6ae6-4660-92e2-5792f6c88554 service nova] [instance: defae731-4191-4526-99cc-a301cf5b3355] Refreshing instance network info cache due to event network-changed-10b83231-0b39-4dee-95db-bb6a03d70fc0. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:48:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ab38ed6c-b5af-4372-a12c-499335e73b7b req-cc6de730-6ae6-4660-92e2-5792f6c88554 service nova] Acquiring lock "refresh_cache-defae731-4191-4526-99cc-a301cf5b3355" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:48:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ab38ed6c-b5af-4372-a12c-499335e73b7b req-cc6de730-6ae6-4660-92e2-5792f6c88554 service nova] Acquired lock "refresh_cache-defae731-4191-4526-99cc-a301cf5b3355" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:48:51 user nova-compute[75341]: DEBUG nova.network.neutron [req-ab38ed6c-b5af-4372-a12c-499335e73b7b req-cc6de730-6ae6-4660-92e2-5792f6c88554 service nova] [instance: defae731-4191-4526-99cc-a301cf5b3355] Refreshing network info cache for port 10b83231-0b39-4dee-95db-bb6a03d70fc0 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:48:51 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Updating instance_info_cache with network_info: [{"id": "61a9a4a7-170b-4ed9-8d52-8cb4defd1cae", "address": "fa:16:3e:0c:42:07", "network": {"id": "fcd22da6-016e-4872-a84c-4d82601c48d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-550677181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44bb8b1415c14bb59c4c35cc2b830875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61a9a4a7-17", "ovs_interfaceid": "61a9a4a7-170b-4ed9-8d52-8cb4defd1cae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:48:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Releasing lock "refresh_cache-6382e432-838f-4d89-a743-cbaa37f50ab5" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:48:51 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Updated the network info_cache for instance {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 23:48:51 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:48:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:51 user nova-compute[75341]: DEBUG nova.network.neutron [req-ab38ed6c-b5af-4372-a12c-499335e73b7b req-cc6de730-6ae6-4660-92e2-5792f6c88554 service nova] [instance: defae731-4191-4526-99cc-a301cf5b3355] Updated VIF entry in instance network info cache for port 10b83231-0b39-4dee-95db-bb6a03d70fc0. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:48:51 user nova-compute[75341]: DEBUG nova.network.neutron [req-ab38ed6c-b5af-4372-a12c-499335e73b7b req-cc6de730-6ae6-4660-92e2-5792f6c88554 service nova] [instance: defae731-4191-4526-99cc-a301cf5b3355] Updating instance_info_cache with network_info: [{"id": "10b83231-0b39-4dee-95db-bb6a03d70fc0", "address": "fa:16:3e:b7:3a:83", "network": {"id": "d86a8e7f-6658-4994-9a13-eb3163bd3865", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-635863702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c69a942b4f4b97a1a3152dea86c7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10b83231-0b", "ovs_interfaceid": "10b83231-0b39-4dee-95db-bb6a03d70fc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:48:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ab38ed6c-b5af-4372-a12c-499335e73b7b req-cc6de730-6ae6-4660-92e2-5792f6c88554 service nova] Releasing lock "refresh_cache-defae731-4191-4526-99cc-a301cf5b3355" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:48:51 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:48:52 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:48:52 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:48:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:48:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:48:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:48:52 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75341) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 23:48:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8e73e44-9d2e-4b15-836c-738398adc685/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8e73e44-9d2e-4b15-836c-738398adc685/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8e73e44-9d2e-4b15-836c-738398adc685/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8e73e44-9d2e-4b15-836c-738398adc685/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/223825d6-841d-4169-9c9b-f0ddf50b4d94/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/223825d6-841d-4169-9c9b-f0ddf50b4d94/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/223825d6-841d-4169-9c9b-f0ddf50b4d94/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/223825d6-841d-4169-9c9b-f0ddf50b4d94/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5070fb03-8f40-426c-8c3e-192f6517f7c3/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5070fb03-8f40-426c-8c3e-192f6517f7c3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5070fb03-8f40-426c-8c3e-192f6517f7c3/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5070fb03-8f40-426c-8c3e-192f6517f7c3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5950ba70-e7c0-4b5f-839c-569e0a27b625/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5950ba70-e7c0-4b5f-839c-569e0a27b625/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5950ba70-e7c0-4b5f-839c-569e0a27b625/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5950ba70-e7c0-4b5f-839c-569e0a27b625/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a141d7ee-3f77-4fdc-85ec-2cbd5af17646/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a141d7ee-3f77-4fdc-85ec-2cbd5af17646/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a141d7ee-3f77-4fdc-85ec-2cbd5af17646/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a141d7ee-3f77-4fdc-85ec-2cbd5af17646/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d92ba9df-c739-414d-a701-ddba04563427/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d92ba9df-c739-414d-a701-ddba04563427/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d92ba9df-c739-414d-a701-ddba04563427/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d92ba9df-c739-414d-a701-ddba04563427/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 23:48:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk.rescue --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk.rescue --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:48:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/680f66a5-e813-4c49-ad05-def95be9d0b7/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/680f66a5-e813-4c49-ad05-def95be9d0b7/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/680f66a5-e813-4c49-ad05-def95be9d0b7/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:48:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/680f66a5-e813-4c49-ad05-def95be9d0b7/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:48:57 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 23:48:57 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:48:57 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:48:57 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Hypervisor/Node resource view: name=user free_ram=7108MB free_disk=25.480697631835938GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75341) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 23:48:57 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:48:57 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:48:57 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance a141d7ee-3f77-4fdc-85ec-2cbd5af17646 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:48:57 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 51045050-c7c6-49c5-acd4-2a76be0f466f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:48:57 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 6382e432-838f-4d89-a743-cbaa37f50ab5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:48:57 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance d92ba9df-c739-414d-a701-ddba04563427 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:48:57 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 5070fb03-8f40-426c-8c3e-192f6517f7c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:48:57 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance defae731-4191-4526-99cc-a301cf5b3355 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:48:57 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 5950ba70-e7c0-4b5f-839c-569e0a27b625 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:48:57 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 680f66a5-e813-4c49-ad05-def95be9d0b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:48:57 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance f8e73e44-9d2e-4b15-836c-738398adc685 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:48:57 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 9996fc26-f3ad-40e2-91a5-51178c0194ef actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:48:57 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 223825d6-841d-4169-9c9b-f0ddf50b4d94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:48:57 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 23:48:57 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 23:48:57 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:48:57 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:48:58 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Compute_service record updated for user:user {{(pid=75341) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 23:48:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.475s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:48:59 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:00 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:49:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:04 user nova-compute[75341]: DEBUG nova.compute.manager [req-963e459f-be5b-4443-916d-f35928c1b77e req-6bbdb582-3981-4e0c-91fd-141a5d65cd45 service nova] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Received event network-changed-6df0f48f-1a94-42ec-b540-0aee55dc6b70 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:49:04 user nova-compute[75341]: DEBUG nova.compute.manager [req-963e459f-be5b-4443-916d-f35928c1b77e req-6bbdb582-3981-4e0c-91fd-141a5d65cd45 service nova] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Refreshing instance network info cache due to event network-changed-6df0f48f-1a94-42ec-b540-0aee55dc6b70. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:49:04 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-963e459f-be5b-4443-916d-f35928c1b77e req-6bbdb582-3981-4e0c-91fd-141a5d65cd45 service nova] Acquiring lock "refresh_cache-5950ba70-e7c0-4b5f-839c-569e0a27b625" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:49:04 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-963e459f-be5b-4443-916d-f35928c1b77e req-6bbdb582-3981-4e0c-91fd-141a5d65cd45 service nova] Acquired lock "refresh_cache-5950ba70-e7c0-4b5f-839c-569e0a27b625" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:49:04 user nova-compute[75341]: DEBUG nova.network.neutron [req-963e459f-be5b-4443-916d-f35928c1b77e req-6bbdb582-3981-4e0c-91fd-141a5d65cd45 service nova] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Refreshing network info cache for port 6df0f48f-1a94-42ec-b540-0aee55dc6b70 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:49:04 user nova-compute[75341]: INFO nova.compute.manager [None req-df5a52fd-2694-4938-b6de-7e2d5c7fa059 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Rescuing
Nov 14 23:49:04 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-df5a52fd-2694-4938-b6de-7e2d5c7fa059 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Acquiring lock "refresh_cache-51045050-c7c6-49c5-acd4-2a76be0f466f" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:49:04 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-df5a52fd-2694-4938-b6de-7e2d5c7fa059 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Acquired lock "refresh_cache-51045050-c7c6-49c5-acd4-2a76be0f466f" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:49:04 user nova-compute[75341]: DEBUG nova.network.neutron [None req-df5a52fd-2694-4938-b6de-7e2d5c7fa059 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 23:49:04 user nova-compute[75341]: DEBUG nova.network.neutron [req-963e459f-be5b-4443-916d-f35928c1b77e req-6bbdb582-3981-4e0c-91fd-141a5d65cd45 service nova] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Updated VIF entry in instance network info cache for port 6df0f48f-1a94-42ec-b540-0aee55dc6b70. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:49:04 user nova-compute[75341]: DEBUG nova.network.neutron [req-963e459f-be5b-4443-916d-f35928c1b77e req-6bbdb582-3981-4e0c-91fd-141a5d65cd45 service nova] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Updating instance_info_cache with network_info: [{"id": "6df0f48f-1a94-42ec-b540-0aee55dc6b70", "address": "fa:16:3e:67:d4:76", "network": {"id": "e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-64240219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f27e41f4cc1451291b8aca34544867b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df0f48f-1a", "ovs_interfaceid": "6df0f48f-1a94-42ec-b540-0aee55dc6b70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:49:04 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-963e459f-be5b-4443-916d-f35928c1b77e req-6bbdb582-3981-4e0c-91fd-141a5d65cd45 service nova] Releasing lock "refresh_cache-5950ba70-e7c0-4b5f-839c-569e0a27b625" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:49:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:05 user nova-compute[75341]: DEBUG nova.network.neutron [None req-df5a52fd-2694-4938-b6de-7e2d5c7fa059 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Updating instance_info_cache with network_info: [{"id": "64ebe5e6-0c81-41fd-b49e-75bed11e40df", "address": "fa:16:3e:44:63:f2", "network": {"id": "fcd22da6-016e-4872-a84c-4d82601c48d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-550677181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44bb8b1415c14bb59c4c35cc2b830875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ebe5e6-0c", "ovs_interfaceid": "64ebe5e6-0c81-41fd-b49e-75bed11e40df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:49:05 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-df5a52fd-2694-4938-b6de-7e2d5c7fa059 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Releasing lock "refresh_cache-51045050-c7c6-49c5-acd4-2a76be0f466f" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:49:05 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:05 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:05 user nova-compute[75341]: DEBUG nova.compute.manager [req-fe5c0930-41ad-4e12-bb3a-5c94b828a161 req-45df76af-559b-4a48-b8f7-c12c0e290a2a service nova] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Received event network-vif-unplugged-64ebe5e6-0c81-41fd-b49e-75bed11e40df {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:49:05 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-fe5c0930-41ad-4e12-bb3a-5c94b828a161 req-45df76af-559b-4a48-b8f7-c12c0e290a2a service nova] Acquiring lock "51045050-c7c6-49c5-acd4-2a76be0f466f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:49:05 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-fe5c0930-41ad-4e12-bb3a-5c94b828a161 req-45df76af-559b-4a48-b8f7-c12c0e290a2a service nova] Lock "51045050-c7c6-49c5-acd4-2a76be0f466f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:49:05 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-fe5c0930-41ad-4e12-bb3a-5c94b828a161 req-45df76af-559b-4a48-b8f7-c12c0e290a2a service nova] Lock "51045050-c7c6-49c5-acd4-2a76be0f466f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:49:05 user nova-compute[75341]: DEBUG nova.compute.manager [req-fe5c0930-41ad-4e12-bb3a-5c94b828a161 req-45df76af-559b-4a48-b8f7-c12c0e290a2a service nova] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] No waiting events found dispatching network-vif-unplugged-64ebe5e6-0c81-41fd-b49e-75bed11e40df {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:49:05 user nova-compute[75341]: WARNING nova.compute.manager [req-fe5c0930-41ad-4e12-bb3a-5c94b828a161 req-45df76af-559b-4a48-b8f7-c12c0e290a2a service nova] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Received unexpected event network-vif-unplugged-64ebe5e6-0c81-41fd-b49e-75bed11e40df for instance with vm_state active and task_state rescuing.
Nov 14 23:49:05 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:05 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:05 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Instance destroyed successfully.
Nov 14 23:49:05 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-df5a52fd-2694-4938-b6de-7e2d5c7fa059 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Attempting rescue
Nov 14 23:49:05 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-df5a52fd-2694-4938-b6de-7e2d5c7fa059 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75341) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 23:49:05 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-df5a52fd-2694-4938-b6de-7e2d5c7fa059 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Instance directory exists: not creating {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 23:49:05 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-df5a52fd-2694-4938-b6de-7e2d5c7fa059 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Creating image(s)
Nov 14 23:49:05 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-df5a52fd-2694-4938-b6de-7e2d5c7fa059 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Acquiring lock "/opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:49:05 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-df5a52fd-2694-4938-b6de-7e2d5c7fa059 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "/opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:49:05 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-df5a52fd-2694-4938-b6de-7e2d5c7fa059 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "/opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:49:05 user nova-compute[75341]: DEBUG nova.objects.instance [None req-df5a52fd-2694-4938-b6de-7e2d5c7fa059 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lazy-loading 'trusted_certs' on Instance uuid 51045050-c7c6-49c5-acd4-2a76be0f466f {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:49:05 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-df5a52fd-2694-4938-b6de-7e2d5c7fa059 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Acquiring lock "4754efee9a6d73d3647f2add2cfe86c291949740" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:49:05 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-df5a52fd-2694-4938-b6de-7e2d5c7fa059 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:49:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-df5a52fd-2694-4938-b6de-7e2d5c7fa059 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-df5a52fd-2694-4938-b6de-7e2d5c7fa059 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.182s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:49:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-df5a52fd-2694-4938-b6de-7e2d5c7fa059 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk.rescue {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-df5a52fd-2694-4938-b6de-7e2d5c7fa059 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk.rescue" returned: 0 in 0.058s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:49:05 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-df5a52fd-2694-4938-b6de-7e2d5c7fa059 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:49:05 user nova-compute[75341]: DEBUG nova.objects.instance [None req-df5a52fd-2694-4938-b6de-7e2d5c7fa059 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lazy-loading 'migration_context' on Instance uuid 51045050-c7c6-49c5-acd4-2a76be0f466f {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:49:05 user nova-compute[75341]: DEBUG nova.objects.base [None req-df5a52fd-2694-4938-b6de-7e2d5c7fa059 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Object Instance<51045050-c7c6-49c5-acd4-2a76be0f466f> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75341) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 23:49:05 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-df5a52fd-2694-4938-b6de-7e2d5c7fa059 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Created local disks {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 23:49:05 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-df5a52fd-2694-4938-b6de-7e2d5c7fa059 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Start _get_guest_xml network_info=[{"id": "64ebe5e6-0c81-41fd-b49e-75bed11e40df", "address": "fa:16:3e:44:63:f2", "network": {"id": "fcd22da6-016e-4872-a84c-4d82601c48d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-550677181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-550677181-network", "vif_mac": "fa:16:3e:44:63:f2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44bb8b1415c14bb59c4c35cc2b830875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ebe5e6-0c", "ovs_interfaceid": "64ebe5e6-0c81-41fd-b49e-75bed11e40df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e46abb82-b810-490e-a8a1-ccdc5fa1a796', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 23:49:05 user nova-compute[75341]: DEBUG nova.objects.instance [None req-df5a52fd-2694-4938-b6de-7e2d5c7fa059 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lazy-loading 'resources' on Instance uuid 51045050-c7c6-49c5-acd4-2a76be0f466f {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:49:05 user nova-compute[75341]: DEBUG nova.objects.base [None req-df5a52fd-2694-4938-b6de-7e2d5c7fa059 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Object Instance<51045050-c7c6-49c5-acd4-2a76be0f466f> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75341) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 23:49:05 user nova-compute[75341]: DEBUG nova.objects.instance [None req-df5a52fd-2694-4938-b6de-7e2d5c7fa059 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lazy-loading 'numa_topology' on Instance uuid 51045050-c7c6-49c5-acd4-2a76be0f466f {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:49:06 user nova-compute[75341]: DEBUG nova.objects.base [None req-df5a52fd-2694-4938-b6de-7e2d5c7fa059 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Object Instance<51045050-c7c6-49c5-acd4-2a76be0f466f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75341) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 23:49:06 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-df5a52fd-2694-4938-b6de-7e2d5c7fa059 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:49:06 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-df5a52fd-2694-4938-b6de-7e2d5c7fa059 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:49:06 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-df5a52fd-2694-4938-b6de-7e2d5c7fa059 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 23:49:06 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-df5a52fd-2694-4938-b6de-7e2d5c7fa059 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 23:49:06 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-df5a52fd-2694-4938-b6de-7e2d5c7fa059 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 23:49:06 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-df5a52fd-2694-4938-b6de-7e2d5c7fa059 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 23:49:06 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-df5a52fd-2694-4938-b6de-7e2d5c7fa059 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 23:49:06 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-df5a52fd-2694-4938-b6de-7e2d5c7fa059 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 23:49:06 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-df5a52fd-2694-4938-b6de-7e2d5c7fa059 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 23:49:06 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-df5a52fd-2694-4938-b6de-7e2d5c7fa059 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 23:49:06 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-df5a52fd-2694-4938-b6de-7e2d5c7fa059 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 23:49:06 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-df5a52fd-2694-4938-b6de-7e2d5c7fa059 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 23:49:06 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-df5a52fd-2694-4938-b6de-7e2d5c7fa059 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 23:49:06 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-df5a52fd-2694-4938-b6de-7e2d5c7fa059 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 23:49:06 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-df5a52fd-2694-4938-b6de-7e2d5c7fa059 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 23:49:06 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-df5a52fd-2694-4938-b6de-7e2d5c7fa059 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 23:49:06 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-df5a52fd-2694-4938-b6de-7e2d5c7fa059 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 23:49:06 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-df5a52fd-2694-4938-b6de-7e2d5c7fa059 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 23:49:06 user nova-compute[75341]: DEBUG nova.objects.instance [None req-df5a52fd-2694-4938-b6de-7e2d5c7fa059 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lazy-loading 'vcpu_model' on Instance uuid 51045050-c7c6-49c5-acd4-2a76be0f466f {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:49:06 user nova-compute[75341]: DEBUG nova.objects.base [None req-df5a52fd-2694-4938-b6de-7e2d5c7fa059 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Object Instance<51045050-c7c6-49c5-acd4-2a76be0f466f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75341) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 23:49:06 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-df5a52fd-2694-4938-b6de-7e2d5c7fa059 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:44:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-498055834',display_name='tempest-ServerRescueNegativeTestJSON-server-498055834',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-498055834',id=17,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:44:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='44bb8b1415c14bb59c4c35cc2b830875',ramdisk_id='',reservation_id='r-jta0uzo0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1956631656',owner_user_name='tempest-ServerRescueNegativeTestJSON-1956631656-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:44:31Z,user_data=None,user_id='3c49a358e2f942f3a9777910ee755575',uuid=51045050-c7c6-49c5-acd4-2a76be0f466f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "64ebe5e6-0c81-41fd-b49e-75bed11e40df", "address": "fa:16:3e:44:63:f2", "network": {"id": "fcd22da6-016e-4872-a84c-4d82601c48d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-550677181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-550677181-network", "vif_mac": "fa:16:3e:44:63:f2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44bb8b1415c14bb59c4c35cc2b830875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ebe5e6-0c", "ovs_interfaceid": "64ebe5e6-0c81-41fd-b49e-75bed11e40df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:49:06 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-df5a52fd-2694-4938-b6de-7e2d5c7fa059 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Converting VIF {"id": "64ebe5e6-0c81-41fd-b49e-75bed11e40df", "address": "fa:16:3e:44:63:f2", "network": {"id": "fcd22da6-016e-4872-a84c-4d82601c48d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-550677181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-550677181-network", "vif_mac": "fa:16:3e:44:63:f2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44bb8b1415c14bb59c4c35cc2b830875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ebe5e6-0c", "ovs_interfaceid": "64ebe5e6-0c81-41fd-b49e-75bed11e40df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:49:06 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-df5a52fd-2694-4938-b6de-7e2d5c7fa059 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:63:f2,bridge_name='br-int',has_traffic_filtering=True,id=64ebe5e6-0c81-41fd-b49e-75bed11e40df,network=Network(fcd22da6-016e-4872-a84c-4d82601c48d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64ebe5e6-0c') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:49:06 user nova-compute[75341]: DEBUG nova.objects.instance [None req-df5a52fd-2694-4938-b6de-7e2d5c7fa059 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lazy-loading 'pci_devices' on Instance uuid 51045050-c7c6-49c5-acd4-2a76be0f466f {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:49:06 user nova-compute[75341]: DEBUG nova.objects.base [None req-df5a52fd-2694-4938-b6de-7e2d5c7fa059 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Object Instance<51045050-c7c6-49c5-acd4-2a76be0f466f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75341) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 23:49:06 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-df5a52fd-2694-4938-b6de-7e2d5c7fa059 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] End _get_guest_xml xml=<domain type="kvm">
Nov 14 23:49:06 user nova-compute[75341]:   <uuid>51045050-c7c6-49c5-acd4-2a76be0f466f</uuid>
Nov 14 23:49:06 user nova-compute[75341]:   <name>instance-00000011</name>
Nov 14 23:49:06 user nova-compute[75341]:   <memory>524288</memory>
Nov 14 23:49:06 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 14 23:49:06 user nova-compute[75341]:   <metadata>
Nov 14 23:49:06 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 23:49:06 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 14 23:49:06 user nova-compute[75341]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-498055834</nova:name>
Nov 14 23:49:06 user nova-compute[75341]:       <nova:creationTime>2023-11-14 23:49:06</nova:creationTime>
Nov 14 23:49:06 user nova-compute[75341]:       <nova:flavor name="m1.tiny">
Nov 14 23:49:06 user nova-compute[75341]:         <nova:memory>512</nova:memory>
Nov 14 23:49:06 user nova-compute[75341]:         <nova:disk>1</nova:disk>
Nov 14 23:49:06 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 14 23:49:06 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 23:49:06 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 14 23:49:06 user nova-compute[75341]:       </nova:flavor>
Nov 14 23:49:06 user nova-compute[75341]:       <nova:owner>
Nov 14 23:49:06 user nova-compute[75341]:         <nova:user uuid="3c49a358e2f942f3a9777910ee755575">tempest-ServerRescueNegativeTestJSON-1956631656-project-member</nova:user>
Nov 14 23:49:06 user nova-compute[75341]:         <nova:project uuid="44bb8b1415c14bb59c4c35cc2b830875">tempest-ServerRescueNegativeTestJSON-1956631656</nova:project>
Nov 14 23:49:06 user nova-compute[75341]:       </nova:owner>
Nov 14 23:49:06 user nova-compute[75341]:       <nova:root type="image" uuid="e46abb82-b810-490e-a8a1-ccdc5fa1a796"/>
Nov 14 23:49:06 user nova-compute[75341]:       <nova:ports>
Nov 14 23:49:06 user nova-compute[75341]:         <nova:port uuid="64ebe5e6-0c81-41fd-b49e-75bed11e40df">
Nov 14 23:49:06 user nova-compute[75341]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 23:49:06 user nova-compute[75341]:         </nova:port>
Nov 14 23:49:06 user nova-compute[75341]:       </nova:ports>
Nov 14 23:49:06 user nova-compute[75341]:     </nova:instance>
Nov 14 23:49:06 user nova-compute[75341]:   </metadata>
Nov 14 23:49:06 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 14 23:49:06 user nova-compute[75341]:     <system>
Nov 14 23:49:06 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 23:49:06 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 14 23:49:06 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 14 23:49:06 user nova-compute[75341]:       <entry name="serial">51045050-c7c6-49c5-acd4-2a76be0f466f</entry>
Nov 14 23:49:06 user nova-compute[75341]:       <entry name="uuid">51045050-c7c6-49c5-acd4-2a76be0f466f</entry>
Nov 14 23:49:06 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 14 23:49:06 user nova-compute[75341]:     </system>
Nov 14 23:49:06 user nova-compute[75341]:   </sysinfo>
Nov 14 23:49:06 user nova-compute[75341]:   <os>
Nov 14 23:49:06 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 23:49:06 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 14 23:49:06 user nova-compute[75341]:   </os>
Nov 14 23:49:06 user nova-compute[75341]:   <features>
Nov 14 23:49:06 user nova-compute[75341]:     <acpi/>
Nov 14 23:49:06 user nova-compute[75341]:     <apic/>
Nov 14 23:49:06 user nova-compute[75341]:     <vmcoreinfo/>
Nov 14 23:49:06 user nova-compute[75341]:   </features>
Nov 14 23:49:06 user nova-compute[75341]:   <clock offset="utc">
Nov 14 23:49:06 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 23:49:06 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 23:49:06 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 14 23:49:06 user nova-compute[75341]:   </clock>
Nov 14 23:49:06 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 14 23:49:06 user nova-compute[75341]:     <model>Nehalem</model>
Nov 14 23:49:06 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 23:49:06 user nova-compute[75341]:   </cpu>
Nov 14 23:49:06 user nova-compute[75341]:   <devices>
Nov 14 23:49:06 user nova-compute[75341]:     <disk type="file" device="disk">
Nov 14 23:49:06 user nova-compute[75341]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 23:49:06 user nova-compute[75341]:       <source file="/opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk.rescue"/>
Nov 14 23:49:06 user nova-compute[75341]:       <target dev="vda" bus="virtio"/>
Nov 14 23:49:06 user nova-compute[75341]:     </disk>
Nov 14 23:49:06 user nova-compute[75341]:     <disk type="file" device="disk">
Nov 14 23:49:06 user nova-compute[75341]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 23:49:06 user nova-compute[75341]:       <source file="/opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk"/>
Nov 14 23:49:06 user nova-compute[75341]:       <target dev="vdb" bus="virtio"/>
Nov 14 23:49:06 user nova-compute[75341]:     </disk>
Nov 14 23:49:06 user nova-compute[75341]:     <interface type="ethernet">
Nov 14 23:49:06 user nova-compute[75341]:       <mac address="fa:16:3e:44:63:f2"/>
Nov 14 23:49:06 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:49:06 user nova-compute[75341]:       <mtu size="1442"/>
Nov 14 23:49:06 user nova-compute[75341]:       <target dev="tap64ebe5e6-0c"/>
Nov 14 23:49:06 user nova-compute[75341]:     </interface>
Nov 14 23:49:06 user nova-compute[75341]:     <serial type="pty">
Nov 14 23:49:06 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/console.log" append="off"/>
Nov 14 23:49:06 user nova-compute[75341]:     </serial>
Nov 14 23:49:06 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 23:49:06 user nova-compute[75341]:     <video>
Nov 14 23:49:06 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:49:06 user nova-compute[75341]:     </video>
Nov 14 23:49:06 user nova-compute[75341]:     <rng model="virtio">
Nov 14 23:49:06 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 14 23:49:06 user nova-compute[75341]:     </rng>
Nov 14 23:49:06 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 14 23:49:06 user nova-compute[75341]:     <memballoon model="virtio">
Nov 14 23:49:06 user nova-compute[75341]:       <stats period="10"/>
Nov 14 23:49:06 user nova-compute[75341]:     </memballoon>
Nov 14 23:49:06 user nova-compute[75341]:   </devices>
Nov 14 23:49:06 user nova-compute[75341]: </domain>
Nov 14 23:49:06 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 23:49:06 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Instance destroyed successfully.
Nov 14 23:49:06 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-df5a52fd-2694-4938-b6de-7e2d5c7fa059 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:49:06 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-df5a52fd-2694-4938-b6de-7e2d5c7fa059 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:49:06 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-df5a52fd-2694-4938-b6de-7e2d5c7fa059 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] No VIF found with MAC fa:16:3e:44:63:f2, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:49:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-2df1dc42-3961-4121-be40-5df3e63a3d3d tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Acquiring lock "5950ba70-e7c0-4b5f-839c-569e0a27b625" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:49:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-2df1dc42-3961-4121-be40-5df3e63a3d3d tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "5950ba70-e7c0-4b5f-839c-569e0a27b625" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:49:06 user nova-compute[75341]: INFO nova.compute.manager [None req-2df1dc42-3961-4121-be40-5df3e63a3d3d tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Shelving
Nov 14 23:49:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:07 user nova-compute[75341]: DEBUG nova.compute.manager [req-6a52ece3-02c8-4f78-b615-c3acc0b04d33 req-4e96fa5c-4370-4edb-b5e6-8e3d3797b54c service nova] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Received event network-vif-unplugged-6df0f48f-1a94-42ec-b540-0aee55dc6b70 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:49:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6a52ece3-02c8-4f78-b615-c3acc0b04d33 req-4e96fa5c-4370-4edb-b5e6-8e3d3797b54c service nova] Acquiring lock "5950ba70-e7c0-4b5f-839c-569e0a27b625-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:49:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6a52ece3-02c8-4f78-b615-c3acc0b04d33 req-4e96fa5c-4370-4edb-b5e6-8e3d3797b54c service nova] Lock "5950ba70-e7c0-4b5f-839c-569e0a27b625-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:49:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6a52ece3-02c8-4f78-b615-c3acc0b04d33 req-4e96fa5c-4370-4edb-b5e6-8e3d3797b54c service nova] Lock "5950ba70-e7c0-4b5f-839c-569e0a27b625-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:49:07 user nova-compute[75341]: DEBUG nova.compute.manager [req-6a52ece3-02c8-4f78-b615-c3acc0b04d33 req-4e96fa5c-4370-4edb-b5e6-8e3d3797b54c service nova] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] No waiting events found dispatching network-vif-unplugged-6df0f48f-1a94-42ec-b540-0aee55dc6b70 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:49:07 user nova-compute[75341]: WARNING nova.compute.manager [req-6a52ece3-02c8-4f78-b615-c3acc0b04d33 req-4e96fa5c-4370-4edb-b5e6-8e3d3797b54c service nova] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Received unexpected event network-vif-unplugged-6df0f48f-1a94-42ec-b540-0aee55dc6b70 for instance with vm_state active and task_state shelving.
Nov 14 23:49:07 user nova-compute[75341]: DEBUG nova.compute.manager [None req-1e0a9189-d292-467e-b277-a2c0290ec5da tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 23:49:07 user nova-compute[75341]: INFO nova.compute.manager [None req-1e0a9189-d292-467e-b277-a2c0290ec5da tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] instance snapshotting
Nov 14 23:49:07 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-1e0a9189-d292-467e-b277-a2c0290ec5da tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Beginning live snapshot process
Nov 14 23:49:07 user nova-compute[75341]: DEBUG nova.compute.manager [req-261ec167-3d4f-4b0c-af78-00368033831f req-e84519bb-760e-463c-b5d5-4ed36eb69159 service nova] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Received event network-vif-plugged-64ebe5e6-0c81-41fd-b49e-75bed11e40df {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:49:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-261ec167-3d4f-4b0c-af78-00368033831f req-e84519bb-760e-463c-b5d5-4ed36eb69159 service nova] Acquiring lock "51045050-c7c6-49c5-acd4-2a76be0f466f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:49:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-261ec167-3d4f-4b0c-af78-00368033831f req-e84519bb-760e-463c-b5d5-4ed36eb69159 service nova] Lock "51045050-c7c6-49c5-acd4-2a76be0f466f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:49:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-261ec167-3d4f-4b0c-af78-00368033831f req-e84519bb-760e-463c-b5d5-4ed36eb69159 service nova] Lock "51045050-c7c6-49c5-acd4-2a76be0f466f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:49:07 user nova-compute[75341]: DEBUG nova.compute.manager [req-261ec167-3d4f-4b0c-af78-00368033831f req-e84519bb-760e-463c-b5d5-4ed36eb69159 service nova] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] No waiting events found dispatching network-vif-plugged-64ebe5e6-0c81-41fd-b49e-75bed11e40df {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:49:07 user nova-compute[75341]: WARNING nova.compute.manager [req-261ec167-3d4f-4b0c-af78-00368033831f req-e84519bb-760e-463c-b5d5-4ed36eb69159 service nova] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Received unexpected event network-vif-plugged-64ebe5e6-0c81-41fd-b49e-75bed11e40df for instance with vm_state active and task_state rescuing.
Nov 14 23:49:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-1e0a9189-d292-467e-b277-a2c0290ec5da tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5070fb03-8f40-426c-8c3e-192f6517f7c3/disk --force-share --output=json -f qcow2 {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-1e0a9189-d292-467e-b277-a2c0290ec5da tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5070fb03-8f40-426c-8c3e-192f6517f7c3/disk --force-share --output=json -f qcow2" returned: 0 in 0.173s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:49:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-1e0a9189-d292-467e-b277-a2c0290ec5da tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5070fb03-8f40-426c-8c3e-192f6517f7c3/disk --force-share --output=json -f qcow2 {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:07 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Instance destroyed successfully.
Nov 14 23:49:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-1e0a9189-d292-467e-b277-a2c0290ec5da tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5070fb03-8f40-426c-8c3e-192f6517f7c3/disk --force-share --output=json -f qcow2" returned: 0 in 0.175s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:49:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-1e0a9189-d292-467e-b277-a2c0290ec5da tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:07 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-2df1dc42-3961-4121-be40-5df3e63a3d3d tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Beginning cold snapshot process
Nov 14 23:49:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-1e0a9189-d292-467e-b277-a2c0290ec5da tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.177s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:49:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-1e0a9189-d292-467e-b277-a2c0290ec5da tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpnz99facy/866203d5915e44af857d37013675961d.delta 1073741824 {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:08 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-1e0a9189-d292-467e-b277-a2c0290ec5da tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpnz99facy/866203d5915e44af857d37013675961d.delta 1073741824" returned: 0 in 0.062s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:49:08 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-1e0a9189-d292-467e-b277-a2c0290ec5da tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 14 23:49:08 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:08 user nova-compute[75341]: DEBUG nova.privsep.utils [None req-2df1dc42-3961-4121-be40-5df3e63a3d3d tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75341) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 23:49:08 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-2df1dc42-3961-4121-be40-5df3e63a3d3d tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/5950ba70-e7c0-4b5f-839c-569e0a27b625/disk /opt/stack/data/nova/instances/snapshots/tmpr_6rtvdq/84fdd75f59d94036a692bd3a51a46446 {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:08 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:08 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-1e0a9189-d292-467e-b277-a2c0290ec5da tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75341) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 23:49:08 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-2df1dc42-3961-4121-be40-5df3e63a3d3d tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/5950ba70-e7c0-4b5f-839c-569e0a27b625/disk /opt/stack/data/nova/instances/snapshots/tmpr_6rtvdq/84fdd75f59d94036a692bd3a51a46446" returned: 0 in 0.764s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:49:08 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-2df1dc42-3961-4121-be40-5df3e63a3d3d tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Snapshot extracted, beginning image upload
Nov 14 23:49:09 user nova-compute[75341]: DEBUG nova.compute.manager [req-5a60d5eb-d743-488b-83d6-8bc55dd454a4 req-174417ae-6057-4136-9e8b-d81876a732ad service nova] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Received event network-vif-plugged-6df0f48f-1a94-42ec-b540-0aee55dc6b70 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:49:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-5a60d5eb-d743-488b-83d6-8bc55dd454a4 req-174417ae-6057-4136-9e8b-d81876a732ad service nova] Acquiring lock "5950ba70-e7c0-4b5f-839c-569e0a27b625-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:49:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-5a60d5eb-d743-488b-83d6-8bc55dd454a4 req-174417ae-6057-4136-9e8b-d81876a732ad service nova] Lock "5950ba70-e7c0-4b5f-839c-569e0a27b625-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:49:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-5a60d5eb-d743-488b-83d6-8bc55dd454a4 req-174417ae-6057-4136-9e8b-d81876a732ad service nova] Lock "5950ba70-e7c0-4b5f-839c-569e0a27b625-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:49:09 user nova-compute[75341]: DEBUG nova.compute.manager [req-5a60d5eb-d743-488b-83d6-8bc55dd454a4 req-174417ae-6057-4136-9e8b-d81876a732ad service nova] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] No waiting events found dispatching network-vif-plugged-6df0f48f-1a94-42ec-b540-0aee55dc6b70 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:49:09 user nova-compute[75341]: WARNING nova.compute.manager [req-5a60d5eb-d743-488b-83d6-8bc55dd454a4 req-174417ae-6057-4136-9e8b-d81876a732ad service nova] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Received unexpected event network-vif-plugged-6df0f48f-1a94-42ec-b540-0aee55dc6b70 for instance with vm_state active and task_state shelving_image_uploading.
Nov 14 23:49:09 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-1e0a9189-d292-467e-b277-a2c0290ec5da tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] COPY block job progress, current cursor: 75300864 final cursor: 75563008 {{(pid=75341) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 23:49:09 user nova-compute[75341]: DEBUG nova.compute.manager [req-ca4d22a2-ed95-4e6e-b951-69554a0db931 req-07b00078-8386-4ab5-b522-6086108abf2a service nova] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Received event network-vif-plugged-64ebe5e6-0c81-41fd-b49e-75bed11e40df {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:49:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ca4d22a2-ed95-4e6e-b951-69554a0db931 req-07b00078-8386-4ab5-b522-6086108abf2a service nova] Acquiring lock "51045050-c7c6-49c5-acd4-2a76be0f466f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:49:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ca4d22a2-ed95-4e6e-b951-69554a0db931 req-07b00078-8386-4ab5-b522-6086108abf2a service nova] Lock "51045050-c7c6-49c5-acd4-2a76be0f466f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:49:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ca4d22a2-ed95-4e6e-b951-69554a0db931 req-07b00078-8386-4ab5-b522-6086108abf2a service nova] Lock "51045050-c7c6-49c5-acd4-2a76be0f466f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:49:09 user nova-compute[75341]: DEBUG nova.compute.manager [req-ca4d22a2-ed95-4e6e-b951-69554a0db931 req-07b00078-8386-4ab5-b522-6086108abf2a service nova] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] No waiting events found dispatching network-vif-plugged-64ebe5e6-0c81-41fd-b49e-75bed11e40df {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:49:09 user nova-compute[75341]: WARNING nova.compute.manager [req-ca4d22a2-ed95-4e6e-b951-69554a0db931 req-07b00078-8386-4ab5-b522-6086108abf2a service nova] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Received unexpected event network-vif-plugged-64ebe5e6-0c81-41fd-b49e-75bed11e40df for instance with vm_state active and task_state rescuing.
Nov 14 23:49:09 user nova-compute[75341]: DEBUG nova.compute.manager [req-ca4d22a2-ed95-4e6e-b951-69554a0db931 req-07b00078-8386-4ab5-b522-6086108abf2a service nova] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Received event network-vif-plugged-64ebe5e6-0c81-41fd-b49e-75bed11e40df {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:49:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ca4d22a2-ed95-4e6e-b951-69554a0db931 req-07b00078-8386-4ab5-b522-6086108abf2a service nova] Acquiring lock "51045050-c7c6-49c5-acd4-2a76be0f466f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:49:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ca4d22a2-ed95-4e6e-b951-69554a0db931 req-07b00078-8386-4ab5-b522-6086108abf2a service nova] Lock "51045050-c7c6-49c5-acd4-2a76be0f466f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:49:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ca4d22a2-ed95-4e6e-b951-69554a0db931 req-07b00078-8386-4ab5-b522-6086108abf2a service nova] Lock "51045050-c7c6-49c5-acd4-2a76be0f466f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:49:09 user nova-compute[75341]: DEBUG nova.compute.manager [req-ca4d22a2-ed95-4e6e-b951-69554a0db931 req-07b00078-8386-4ab5-b522-6086108abf2a service nova] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] No waiting events found dispatching network-vif-plugged-64ebe5e6-0c81-41fd-b49e-75bed11e40df {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:49:09 user nova-compute[75341]: WARNING nova.compute.manager [req-ca4d22a2-ed95-4e6e-b951-69554a0db931 req-07b00078-8386-4ab5-b522-6086108abf2a service nova] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Received unexpected event network-vif-plugged-64ebe5e6-0c81-41fd-b49e-75bed11e40df for instance with vm_state active and task_state rescuing.
Nov 14 23:49:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:09 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-1e0a9189-d292-467e-b277-a2c0290ec5da tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75341) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 23:49:09 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-1e0a9189-d292-467e-b277-a2c0290ec5da tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 23:49:09 user nova-compute[75341]: DEBUG nova.privsep.utils [None req-1e0a9189-d292-467e-b277-a2c0290ec5da tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75341) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 23:49:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-1e0a9189-d292-467e-b277-a2c0290ec5da tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpnz99facy/866203d5915e44af857d37013675961d.delta /opt/stack/data/nova/instances/snapshots/tmpnz99facy/866203d5915e44af857d37013675961d {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:10 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-1e0a9189-d292-467e-b277-a2c0290ec5da tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpnz99facy/866203d5915e44af857d37013675961d.delta /opt/stack/data/nova/instances/snapshots/tmpnz99facy/866203d5915e44af857d37013675961d" returned: 0 in 0.281s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:49:10 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-1e0a9189-d292-467e-b277-a2c0290ec5da tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Snapshot extracted, beginning image upload
Nov 14 23:49:10 user nova-compute[75341]: DEBUG nova.compute.manager [None req-df5a52fd-2694-4938-b6de-7e2d5c7fa059 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 23:49:11 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-2df1dc42-3961-4121-be40-5df3e63a3d3d tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Snapshot image upload complete
Nov 14 23:49:11 user nova-compute[75341]: DEBUG nova.compute.manager [None req-2df1dc42-3961-4121-be40-5df3e63a3d3d tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 23:49:11 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:11 user nova-compute[75341]: INFO nova.compute.manager [None req-2df1dc42-3961-4121-be40-5df3e63a3d3d tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Shelve offloading
Nov 14 23:49:11 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Instance destroyed successfully.
Nov 14 23:49:11 user nova-compute[75341]: DEBUG nova.compute.manager [None req-2df1dc42-3961-4121-be40-5df3e63a3d3d tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 23:49:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-2df1dc42-3961-4121-be40-5df3e63a3d3d tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Acquiring lock "refresh_cache-5950ba70-e7c0-4b5f-839c-569e0a27b625" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:49:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-2df1dc42-3961-4121-be40-5df3e63a3d3d tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Acquired lock "refresh_cache-5950ba70-e7c0-4b5f-839c-569e0a27b625" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:49:11 user nova-compute[75341]: DEBUG nova.network.neutron [None req-2df1dc42-3961-4121-be40-5df3e63a3d3d tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 23:49:12 user nova-compute[75341]: DEBUG nova.network.neutron [None req-2df1dc42-3961-4121-be40-5df3e63a3d3d tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Updating instance_info_cache with network_info: [{"id": "6df0f48f-1a94-42ec-b540-0aee55dc6b70", "address": "fa:16:3e:67:d4:76", "network": {"id": "e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-64240219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f27e41f4cc1451291b8aca34544867b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df0f48f-1a", "ovs_interfaceid": "6df0f48f-1a94-42ec-b540-0aee55dc6b70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:49:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-2df1dc42-3961-4121-be40-5df3e63a3d3d tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Releasing lock "refresh_cache-5950ba70-e7c0-4b5f-839c-569e0a27b625" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:49:12 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Instance destroyed successfully.
Nov 14 23:49:12 user nova-compute[75341]: DEBUG nova.objects.instance [None req-2df1dc42-3961-4121-be40-5df3e63a3d3d tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lazy-loading 'resources' on Instance uuid 5950ba70-e7c0-4b5f-839c-569e0a27b625 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:49:12 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-2df1dc42-3961-4121-be40-5df3e63a3d3d tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1777010379',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1777010379',id=26,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFD/gQIk9sUxqytzFW+oIEoqeanqxhZ0nToGQHLSMfBJMBwXTQoqiqkjX7C2tOIZAKXm6CkDxugybhl1fVd4nRFiiiLCvqiflsVfW4bdFOB/z4735jWpOaIZAnYZPVxHVw==',key_name='tempest-keypair-1640023904',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:47:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5f27e41f4cc1451291b8aca34544867b',ramdisk_id='',reservation_id='r-5jpqwdpl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-946394493',owner_user_name='tempest-AttachVolumeShelveTestJSON-946394493-project-member',shelved_at='2023-11-14T23:49:11.542787',shelved_host='user',shelved_image_id='0dac51f9-c959-4cbf-949a-c63a3fbc3ace'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:49:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38acd33ad6754965a53017185f473f8a',uuid=5950ba70-e7c0-4b5f-839c-569e0a27b625,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "6df0f48f-1a94-42ec-b540-0aee55dc6b70", "address": "fa:16:3e:67:d4:76", "network": {"id": "e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-64240219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f27e41f4cc1451291b8aca34544867b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df0f48f-1a", "ovs_interfaceid": "6df0f48f-1a94-42ec-b540-0aee55dc6b70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 23:49:12 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-2df1dc42-3961-4121-be40-5df3e63a3d3d tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Converting VIF {"id": "6df0f48f-1a94-42ec-b540-0aee55dc6b70", "address": "fa:16:3e:67:d4:76", "network": {"id": "e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-64240219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f27e41f4cc1451291b8aca34544867b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df0f48f-1a", "ovs_interfaceid": "6df0f48f-1a94-42ec-b540-0aee55dc6b70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:49:12 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-2df1dc42-3961-4121-be40-5df3e63a3d3d tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:d4:76,bridge_name='br-int',has_traffic_filtering=True,id=6df0f48f-1a94-42ec-b540-0aee55dc6b70,network=Network(e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6df0f48f-1a') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:49:12 user nova-compute[75341]: DEBUG os_vif [None req-2df1dc42-3961-4121-be40-5df3e63a3d3d tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:d4:76,bridge_name='br-int',has_traffic_filtering=True,id=6df0f48f-1a94-42ec-b540-0aee55dc6b70,network=Network(e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6df0f48f-1a') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 23:49:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6df0f48f-1a, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:49:12 user nova-compute[75341]: DEBUG nova.compute.manager [req-19d0b337-50f9-4082-bb6c-a98197e19c48 req-91672c19-eda7-429a-8388-d57a7cc566e0 service nova] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Received event network-changed-6df0f48f-1a94-42ec-b540-0aee55dc6b70 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:49:12 user nova-compute[75341]: DEBUG nova.compute.manager [req-19d0b337-50f9-4082-bb6c-a98197e19c48 req-91672c19-eda7-429a-8388-d57a7cc566e0 service nova] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Refreshing instance network info cache due to event network-changed-6df0f48f-1a94-42ec-b540-0aee55dc6b70. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:49:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-19d0b337-50f9-4082-bb6c-a98197e19c48 req-91672c19-eda7-429a-8388-d57a7cc566e0 service nova] Acquiring lock "refresh_cache-5950ba70-e7c0-4b5f-839c-569e0a27b625" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:49:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-19d0b337-50f9-4082-bb6c-a98197e19c48 req-91672c19-eda7-429a-8388-d57a7cc566e0 service nova] Acquired lock "refresh_cache-5950ba70-e7c0-4b5f-839c-569e0a27b625" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:49:12 user nova-compute[75341]: DEBUG nova.network.neutron [req-19d0b337-50f9-4082-bb6c-a98197e19c48 req-91672c19-eda7-429a-8388-d57a7cc566e0 service nova] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Refreshing network info cache for port 6df0f48f-1a94-42ec-b540-0aee55dc6b70 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:49:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:49:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9cbb8a7f-1b7e-4919-96f7-f2cf06839449) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:49:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:12 user nova-compute[75341]: INFO os_vif [None req-2df1dc42-3961-4121-be40-5df3e63a3d3d tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:d4:76,bridge_name='br-int',has_traffic_filtering=True,id=6df0f48f-1a94-42ec-b540-0aee55dc6b70,network=Network(e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6df0f48f-1a')
Nov 14 23:49:12 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-2df1dc42-3961-4121-be40-5df3e63a3d3d tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Deleting instance files /opt/stack/data/nova/instances/5950ba70-e7c0-4b5f-839c-569e0a27b625_del
Nov 14 23:49:12 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-2df1dc42-3961-4121-be40-5df3e63a3d3d tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Deletion of /opt/stack/data/nova/instances/5950ba70-e7c0-4b5f-839c-569e0a27b625_del complete
Nov 14 23:49:12 user nova-compute[75341]: INFO nova.scheduler.client.report [None req-2df1dc42-3961-4121-be40-5df3e63a3d3d tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Deleted allocations for instance 5950ba70-e7c0-4b5f-839c-569e0a27b625
Nov 14 23:49:12 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-1e0a9189-d292-467e-b277-a2c0290ec5da tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Snapshot image upload complete
Nov 14 23:49:12 user nova-compute[75341]: INFO nova.compute.manager [None req-1e0a9189-d292-467e-b277-a2c0290ec5da tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Took 5.65 seconds to snapshot the instance on the hypervisor.
Nov 14 23:49:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-2df1dc42-3961-4121-be40-5df3e63a3d3d tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:49:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-2df1dc42-3961-4121-be40-5df3e63a3d3d tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:49:12 user nova-compute[75341]: DEBUG nova.objects.instance [None req-2df1dc42-3961-4121-be40-5df3e63a3d3d tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lazy-loading 'numa_topology' on Instance uuid 5950ba70-e7c0-4b5f-839c-569e0a27b625 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:49:12 user nova-compute[75341]: DEBUG nova.objects.base [None req-2df1dc42-3961-4121-be40-5df3e63a3d3d tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Object Instance<5950ba70-e7c0-4b5f-839c-569e0a27b625> lazy-loaded attributes: resources,numa_topology {{(pid=75341) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 23:49:13 user nova-compute[75341]: DEBUG nova.network.neutron [req-19d0b337-50f9-4082-bb6c-a98197e19c48 req-91672c19-eda7-429a-8388-d57a7cc566e0 service nova] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Updated VIF entry in instance network info cache for port 6df0f48f-1a94-42ec-b540-0aee55dc6b70. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:49:13 user nova-compute[75341]: DEBUG nova.network.neutron [req-19d0b337-50f9-4082-bb6c-a98197e19c48 req-91672c19-eda7-429a-8388-d57a7cc566e0 service nova] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Updating instance_info_cache with network_info: [{"id": "6df0f48f-1a94-42ec-b540-0aee55dc6b70", "address": "fa:16:3e:67:d4:76", "network": {"id": "e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-64240219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f27e41f4cc1451291b8aca34544867b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap6df0f48f-1a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:49:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-19d0b337-50f9-4082-bb6c-a98197e19c48 req-91672c19-eda7-429a-8388-d57a7cc566e0 service nova] Releasing lock "refresh_cache-5950ba70-e7c0-4b5f-839c-569e0a27b625" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:49:13 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-2df1dc42-3961-4121-be40-5df3e63a3d3d tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:49:13 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-2df1dc42-3961-4121-be40-5df3e63a3d3d tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:49:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-2df1dc42-3961-4121-be40-5df3e63a3d3d tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.401s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:49:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-2df1dc42-3961-4121-be40-5df3e63a3d3d tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "5950ba70-e7c0-4b5f-839c-569e0a27b625" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.491s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:49:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Acquiring lock "01b30e67-ac52-4cf6-9a31-30096f8b3344" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:49:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Lock "01b30e67-ac52-4cf6-9a31-30096f8b3344" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:49:15 user nova-compute[75341]: DEBUG nova.compute.manager [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Starting instance... {{(pid=75341) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 23:49:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:49:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:49:15 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75341) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 23:49:15 user nova-compute[75341]: INFO nova.compute.claims [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Claim successful on node user
Nov 14 23:49:15 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:49:15 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:49:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.429s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:49:15 user nova-compute[75341]: DEBUG nova.compute.manager [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Start building networks asynchronously for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 23:49:15 user nova-compute[75341]: DEBUG nova.compute.manager [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Allocating IP information in the background. {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 23:49:15 user nova-compute[75341]: DEBUG nova.network.neutron [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] allocate_for_instance() {{(pid=75341) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 23:49:15 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 23:49:15 user nova-compute[75341]: DEBUG nova.compute.manager [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Start building block device mappings for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 23:49:15 user nova-compute[75341]: DEBUG nova.compute.manager [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Start spawning the instance on the hypervisor. {{(pid=75341) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 23:49:15 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Creating instance directory {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 23:49:15 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Creating image(s)
Nov 14 23:49:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Acquiring lock "/opt/stack/data/nova/instances/01b30e67-ac52-4cf6-9a31-30096f8b3344/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:49:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Lock "/opt/stack/data/nova/instances/01b30e67-ac52-4cf6-9a31-30096f8b3344/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:49:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Lock "/opt/stack/data/nova/instances/01b30e67-ac52-4cf6-9a31-30096f8b3344/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:49:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Acquiring lock "f1eaa53cf8956265d1b6cfc1e10555dadeebb835" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:49:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Lock "f1eaa53cf8956265d1b6cfc1e10555dadeebb835" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:49:16 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f1eaa53cf8956265d1b6cfc1e10555dadeebb835.part --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:16 user nova-compute[75341]: DEBUG nova.policy [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1bea063034a84067bd8645aecfe3560d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af462be688d4127a8368ee3dcb2a340', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75341) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 23:49:16 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f1eaa53cf8956265d1b6cfc1e10555dadeebb835.part --force-share --output=json" returned: 0 in 0.188s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:49:16 user nova-compute[75341]: DEBUG nova.virt.images [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] f3499e18-1771-42ea-a76c-5e8cb7353617 was qcow2, converting to raw {{(pid=75341) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 23:49:16 user nova-compute[75341]: DEBUG nova.privsep.utils [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75341) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 23:49:16 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f1eaa53cf8956265d1b6cfc1e10555dadeebb835.part /opt/stack/data/nova/instances/_base/f1eaa53cf8956265d1b6cfc1e10555dadeebb835.converted {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f1eaa53cf8956265d1b6cfc1e10555dadeebb835.part /opt/stack/data/nova/instances/_base/f1eaa53cf8956265d1b6cfc1e10555dadeebb835.converted" returned: 0 in 0.156s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:49:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f1eaa53cf8956265d1b6cfc1e10555dadeebb835.converted --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f1eaa53cf8956265d1b6cfc1e10555dadeebb835.converted --force-share --output=json" returned: 0 in 0.172s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:49:17 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Lock "f1eaa53cf8956265d1b6cfc1e10555dadeebb835" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.378s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:49:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f1eaa53cf8956265d1b6cfc1e10555dadeebb835 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f1eaa53cf8956265d1b6cfc1e10555dadeebb835 --force-share --output=json" returned: 0 in 0.174s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:49:17 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Acquiring lock "f1eaa53cf8956265d1b6cfc1e10555dadeebb835" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:49:17 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Lock "f1eaa53cf8956265d1b6cfc1e10555dadeebb835" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:49:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f1eaa53cf8956265d1b6cfc1e10555dadeebb835 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:17 user nova-compute[75341]: DEBUG nova.network.neutron [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Successfully created port: 4eb44d3f-ff8b-4b03-aa6f-d257d1de66e4 {{(pid=75341) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 23:49:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f1eaa53cf8956265d1b6cfc1e10555dadeebb835 --force-share --output=json" returned: 0 in 0.181s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:49:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f1eaa53cf8956265d1b6cfc1e10555dadeebb835,backing_fmt=raw /opt/stack/data/nova/instances/01b30e67-ac52-4cf6-9a31-30096f8b3344/disk 1073741824 {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f1eaa53cf8956265d1b6cfc1e10555dadeebb835,backing_fmt=raw /opt/stack/data/nova/instances/01b30e67-ac52-4cf6-9a31-30096f8b3344/disk 1073741824" returned: 0 in 0.048s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:49:17 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Lock "f1eaa53cf8956265d1b6cfc1e10555dadeebb835" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:49:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f1eaa53cf8956265d1b6cfc1e10555dadeebb835 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f1eaa53cf8956265d1b6cfc1e10555dadeebb835 --force-share --output=json" returned: 0 in 0.178s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:49:17 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Created local disks {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 23:49:17 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Ensure instance console log exists: /opt/stack/data/nova/instances/01b30e67-ac52-4cf6-9a31-30096f8b3344/console.log {{(pid=75341) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 23:49:17 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:49:17 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:49:17 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:49:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:18 user nova-compute[75341]: DEBUG nova.network.neutron [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Successfully updated port: 4eb44d3f-ff8b-4b03-aa6f-d257d1de66e4 {{(pid=75341) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 23:49:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Acquiring lock "refresh_cache-01b30e67-ac52-4cf6-9a31-30096f8b3344" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:49:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Acquired lock "refresh_cache-01b30e67-ac52-4cf6-9a31-30096f8b3344" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:49:18 user nova-compute[75341]: DEBUG nova.network.neutron [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 23:49:18 user nova-compute[75341]: DEBUG nova.compute.manager [req-b62d08b0-6e99-4402-bac2-af35a69e263e req-0dc6b5ed-4df0-487f-b107-d9947bf27e33 service nova] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Received event network-changed-4eb44d3f-ff8b-4b03-aa6f-d257d1de66e4 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:49:18 user nova-compute[75341]: DEBUG nova.compute.manager [req-b62d08b0-6e99-4402-bac2-af35a69e263e req-0dc6b5ed-4df0-487f-b107-d9947bf27e33 service nova] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Refreshing instance network info cache due to event network-changed-4eb44d3f-ff8b-4b03-aa6f-d257d1de66e4. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:49:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-b62d08b0-6e99-4402-bac2-af35a69e263e req-0dc6b5ed-4df0-487f-b107-d9947bf27e33 service nova] Acquiring lock "refresh_cache-01b30e67-ac52-4cf6-9a31-30096f8b3344" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:49:18 user nova-compute[75341]: DEBUG nova.network.neutron [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Instance cache missing network info. {{(pid=75341) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 23:49:18 user nova-compute[75341]: DEBUG nova.network.neutron [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Updating instance_info_cache with network_info: [{"id": "4eb44d3f-ff8b-4b03-aa6f-d257d1de66e4", "address": "fa:16:3e:f4:cc:cd", "network": {"id": "e9abba2c-7994-4781-a3ca-07e8e4be7825", "bridge": "br-int", "label": "tempest-TestStampPattern-1410971761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af462be688d4127a8368ee3dcb2a340", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eb44d3f-ff", "ovs_interfaceid": "4eb44d3f-ff8b-4b03-aa6f-d257d1de66e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:49:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Releasing lock "refresh_cache-01b30e67-ac52-4cf6-9a31-30096f8b3344" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:49:18 user nova-compute[75341]: DEBUG nova.compute.manager [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Instance network_info: |[{"id": "4eb44d3f-ff8b-4b03-aa6f-d257d1de66e4", "address": "fa:16:3e:f4:cc:cd", "network": {"id": "e9abba2c-7994-4781-a3ca-07e8e4be7825", "bridge": "br-int", "label": "tempest-TestStampPattern-1410971761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af462be688d4127a8368ee3dcb2a340", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eb44d3f-ff", "ovs_interfaceid": "4eb44d3f-ff8b-4b03-aa6f-d257d1de66e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 23:49:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-b62d08b0-6e99-4402-bac2-af35a69e263e req-0dc6b5ed-4df0-487f-b107-d9947bf27e33 service nova] Acquired lock "refresh_cache-01b30e67-ac52-4cf6-9a31-30096f8b3344" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:49:18 user nova-compute[75341]: DEBUG nova.network.neutron [req-b62d08b0-6e99-4402-bac2-af35a69e263e req-0dc6b5ed-4df0-487f-b107-d9947bf27e33 service nova] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Refreshing network info cache for port 4eb44d3f-ff8b-4b03-aa6f-d257d1de66e4 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:49:18 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Start _get_guest_xml network_info=[{"id": "4eb44d3f-ff8b-4b03-aa6f-d257d1de66e4", "address": "fa:16:3e:f4:cc:cd", "network": {"id": "e9abba2c-7994-4781-a3ca-07e8e4be7825", "bridge": "br-int", "label": "tempest-TestStampPattern-1410971761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af462be688d4127a8368ee3dcb2a340", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eb44d3f-ff", "ovs_interfaceid": "4eb44d3f-ff8b-4b03-aa6f-d257d1de66e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='a4c9e6de5040a9f39469ba2d9c133447',container_format='bare',created_at=2023-11-14T23:49:07Z,direct_url=<?>,disk_format='qcow2',id=f3499e18-1771-42ea-a76c-5e8cb7353617,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1156539134',owner='0af462be688d4127a8368ee3dcb2a340',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-14T23:49:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encrypted': False, 'image_id': 'f3499e18-1771-42ea-a76c-5e8cb7353617'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 23:49:18 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:49:18 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:49:18 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 23:49:18 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 23:49:18 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 23:49:18 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 23:49:18 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 23:49:18 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='a4c9e6de5040a9f39469ba2d9c133447',container_format='bare',created_at=2023-11-14T23:49:07Z,direct_url=<?>,disk_format='qcow2',id=f3499e18-1771-42ea-a76c-5e8cb7353617,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1156539134',owner='0af462be688d4127a8368ee3dcb2a340',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-14T23:49:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 23:49:18 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 23:49:18 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 23:49:18 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 23:49:18 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 23:49:18 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 23:49:18 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 23:49:18 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 23:49:18 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 23:49:18 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 23:49:18 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 23:49:18 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:49:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1086505449',display_name='tempest-TestStampPattern-server-1086505449',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1086505449',id=31,image_ref='f3499e18-1771-42ea-a76c-5e8cb7353617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3k4a6947+jIKLvmTnCELFNO1dnVN6DgXq9Xj0CmQaSvYB0hJlJ042GniTnSgjACK17rkv4NlkLk+t1g4KrW1PNXrKxIcV24jCAaqde0p0EUk9jn7Pe6DP8ihh+nNZNxg==',key_name='tempest-TestStampPattern-1455376223',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0af462be688d4127a8368ee3dcb2a340',ramdisk_id='',reservation_id='r-5z5sfjpq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='5070fb03-8f40-426c-8c3e-192f6517f7c3',image_min_disk='1',image_min_ram='0',image_owner_id='0af462be688d4127a8368ee3dcb2a340',image_owner_project_name='tempest-TestStampPattern-1579449792',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1579449792-project-member',image_user_id='1bea063034a84067bd8645aecfe3560d',network_allocated='True',owner_project_name='tempest-TestStampPattern-1579449792',owner_user_name='tempest-TestStampPattern-1579449792-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:49:16Z,user_data=None,user_id='1bea063034a84067bd8645aecfe3560d',uuid=01b30e67-ac52-4cf6-9a31-30096f8b3344,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4eb44d3f-ff8b-4b03-aa6f-d257d1de66e4", "address": "fa:16:3e:f4:cc:cd", "network": {"id": "e9abba2c-7994-4781-a3ca-07e8e4be7825", "bridge": "br-int", "label": "tempest-TestStampPattern-1410971761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af462be688d4127a8368ee3dcb2a340", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eb44d3f-ff", "ovs_interfaceid": "4eb44d3f-ff8b-4b03-aa6f-d257d1de66e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:49:18 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Converting VIF {"id": "4eb44d3f-ff8b-4b03-aa6f-d257d1de66e4", "address": "fa:16:3e:f4:cc:cd", "network": {"id": "e9abba2c-7994-4781-a3ca-07e8e4be7825", "bridge": "br-int", "label": "tempest-TestStampPattern-1410971761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af462be688d4127a8368ee3dcb2a340", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eb44d3f-ff", "ovs_interfaceid": "4eb44d3f-ff8b-4b03-aa6f-d257d1de66e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:49:18 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:cc:cd,bridge_name='br-int',has_traffic_filtering=True,id=4eb44d3f-ff8b-4b03-aa6f-d257d1de66e4,network=Network(e9abba2c-7994-4781-a3ca-07e8e4be7825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4eb44d3f-ff') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:49:18 user nova-compute[75341]: DEBUG nova.objects.instance [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Lazy-loading 'pci_devices' on Instance uuid 01b30e67-ac52-4cf6-9a31-30096f8b3344 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:49:18 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] End _get_guest_xml xml=<domain type="kvm">
Nov 14 23:49:18 user nova-compute[75341]:   <uuid>01b30e67-ac52-4cf6-9a31-30096f8b3344</uuid>
Nov 14 23:49:18 user nova-compute[75341]:   <name>instance-0000001f</name>
Nov 14 23:49:18 user nova-compute[75341]:   <memory>524288</memory>
Nov 14 23:49:18 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 14 23:49:18 user nova-compute[75341]:   <metadata>
Nov 14 23:49:18 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 23:49:18 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 14 23:49:18 user nova-compute[75341]:       <nova:name>tempest-TestStampPattern-server-1086505449</nova:name>
Nov 14 23:49:18 user nova-compute[75341]:       <nova:creationTime>2023-11-14 23:49:18</nova:creationTime>
Nov 14 23:49:18 user nova-compute[75341]:       <nova:flavor name="m1.tiny">
Nov 14 23:49:18 user nova-compute[75341]:         <nova:memory>512</nova:memory>
Nov 14 23:49:18 user nova-compute[75341]:         <nova:disk>1</nova:disk>
Nov 14 23:49:18 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 14 23:49:18 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 23:49:18 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 14 23:49:18 user nova-compute[75341]:       </nova:flavor>
Nov 14 23:49:18 user nova-compute[75341]:       <nova:owner>
Nov 14 23:49:18 user nova-compute[75341]:         <nova:user uuid="1bea063034a84067bd8645aecfe3560d">tempest-TestStampPattern-1579449792-project-member</nova:user>
Nov 14 23:49:18 user nova-compute[75341]:         <nova:project uuid="0af462be688d4127a8368ee3dcb2a340">tempest-TestStampPattern-1579449792</nova:project>
Nov 14 23:49:18 user nova-compute[75341]:       </nova:owner>
Nov 14 23:49:18 user nova-compute[75341]:       <nova:root type="image" uuid="f3499e18-1771-42ea-a76c-5e8cb7353617"/>
Nov 14 23:49:18 user nova-compute[75341]:       <nova:ports>
Nov 14 23:49:18 user nova-compute[75341]:         <nova:port uuid="4eb44d3f-ff8b-4b03-aa6f-d257d1de66e4">
Nov 14 23:49:18 user nova-compute[75341]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 23:49:18 user nova-compute[75341]:         </nova:port>
Nov 14 23:49:18 user nova-compute[75341]:       </nova:ports>
Nov 14 23:49:18 user nova-compute[75341]:     </nova:instance>
Nov 14 23:49:18 user nova-compute[75341]:   </metadata>
Nov 14 23:49:18 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 14 23:49:18 user nova-compute[75341]:     <system>
Nov 14 23:49:18 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 23:49:18 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 14 23:49:18 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 14 23:49:18 user nova-compute[75341]:       <entry name="serial">01b30e67-ac52-4cf6-9a31-30096f8b3344</entry>
Nov 14 23:49:18 user nova-compute[75341]:       <entry name="uuid">01b30e67-ac52-4cf6-9a31-30096f8b3344</entry>
Nov 14 23:49:18 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 14 23:49:18 user nova-compute[75341]:     </system>
Nov 14 23:49:18 user nova-compute[75341]:   </sysinfo>
Nov 14 23:49:18 user nova-compute[75341]:   <os>
Nov 14 23:49:18 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 23:49:18 user nova-compute[75341]:     <boot dev="hd"/>
Nov 14 23:49:18 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 14 23:49:18 user nova-compute[75341]:   </os>
Nov 14 23:49:18 user nova-compute[75341]:   <features>
Nov 14 23:49:18 user nova-compute[75341]:     <acpi/>
Nov 14 23:49:18 user nova-compute[75341]:     <apic/>
Nov 14 23:49:18 user nova-compute[75341]:     <vmcoreinfo/>
Nov 14 23:49:18 user nova-compute[75341]:   </features>
Nov 14 23:49:18 user nova-compute[75341]:   <clock offset="utc">
Nov 14 23:49:18 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 23:49:18 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 23:49:18 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 14 23:49:18 user nova-compute[75341]:   </clock>
Nov 14 23:49:18 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 14 23:49:18 user nova-compute[75341]:     <model>Nehalem</model>
Nov 14 23:49:18 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 23:49:18 user nova-compute[75341]:   </cpu>
Nov 14 23:49:18 user nova-compute[75341]:   <devices>
Nov 14 23:49:18 user nova-compute[75341]:     <disk type="file" device="disk">
Nov 14 23:49:18 user nova-compute[75341]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 23:49:18 user nova-compute[75341]:       <source file="/opt/stack/data/nova/instances/01b30e67-ac52-4cf6-9a31-30096f8b3344/disk"/>
Nov 14 23:49:18 user nova-compute[75341]:       <target dev="vda" bus="virtio"/>
Nov 14 23:49:18 user nova-compute[75341]:     </disk>
Nov 14 23:49:18 user nova-compute[75341]:     <interface type="ethernet">
Nov 14 23:49:18 user nova-compute[75341]:       <mac address="fa:16:3e:f4:cc:cd"/>
Nov 14 23:49:18 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:49:18 user nova-compute[75341]:       <mtu size="1442"/>
Nov 14 23:49:18 user nova-compute[75341]:       <target dev="tap4eb44d3f-ff"/>
Nov 14 23:49:18 user nova-compute[75341]:     </interface>
Nov 14 23:49:18 user nova-compute[75341]:     <serial type="pty">
Nov 14 23:49:18 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/01b30e67-ac52-4cf6-9a31-30096f8b3344/console.log" append="off"/>
Nov 14 23:49:18 user nova-compute[75341]:     </serial>
Nov 14 23:49:18 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 23:49:18 user nova-compute[75341]:     <video>
Nov 14 23:49:18 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:49:18 user nova-compute[75341]:     </video>
Nov 14 23:49:18 user nova-compute[75341]:     <rng model="virtio">
Nov 14 23:49:18 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 14 23:49:18 user nova-compute[75341]:     </rng>
Nov 14 23:49:18 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 14 23:49:18 user nova-compute[75341]:     <memballoon model="virtio">
Nov 14 23:49:18 user nova-compute[75341]:       <stats period="10"/>
Nov 14 23:49:18 user nova-compute[75341]:     </memballoon>
Nov 14 23:49:18 user nova-compute[75341]:   </devices>
Nov 14 23:49:18 user nova-compute[75341]: </domain>
Nov 14 23:49:18 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 23:49:18 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:49:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1086505449',display_name='tempest-TestStampPattern-server-1086505449',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1086505449',id=31,image_ref='f3499e18-1771-42ea-a76c-5e8cb7353617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3k4a6947+jIKLvmTnCELFNO1dnVN6DgXq9Xj0CmQaSvYB0hJlJ042GniTnSgjACK17rkv4NlkLk+t1g4KrW1PNXrKxIcV24jCAaqde0p0EUk9jn7Pe6DP8ihh+nNZNxg==',key_name='tempest-TestStampPattern-1455376223',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0af462be688d4127a8368ee3dcb2a340',ramdisk_id='',reservation_id='r-5z5sfjpq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='5070fb03-8f40-426c-8c3e-192f6517f7c3',image_min_disk='1',image_min_ram='0',image_owner_id='0af462be688d4127a8368ee3dcb2a340',image_owner_project_name='tempest-TestStampPattern-1579449792',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1579449792-project-member',image_user_id='1bea063034a84067bd8645aecfe3560d',network_allocated='True',owner_project_name='tempest-TestStampPattern-1579449792',owner_user_name='tempest-TestStampPattern-1579449792-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:49:16Z,user_data=None,user_id='1bea063034a84067bd8645aecfe3560d',uuid=01b30e67-ac52-4cf6-9a31-30096f8b3344,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4eb44d3f-ff8b-4b03-aa6f-d257d1de66e4", "address": "fa:16:3e:f4:cc:cd", "network": {"id": "e9abba2c-7994-4781-a3ca-07e8e4be7825", "bridge": "br-int", "label": "tempest-TestStampPattern-1410971761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af462be688d4127a8368ee3dcb2a340", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eb44d3f-ff", "ovs_interfaceid": "4eb44d3f-ff8b-4b03-aa6f-d257d1de66e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 23:49:18 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Converting VIF {"id": "4eb44d3f-ff8b-4b03-aa6f-d257d1de66e4", "address": "fa:16:3e:f4:cc:cd", "network": {"id": "e9abba2c-7994-4781-a3ca-07e8e4be7825", "bridge": "br-int", "label": "tempest-TestStampPattern-1410971761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af462be688d4127a8368ee3dcb2a340", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eb44d3f-ff", "ovs_interfaceid": "4eb44d3f-ff8b-4b03-aa6f-d257d1de66e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:49:18 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:cc:cd,bridge_name='br-int',has_traffic_filtering=True,id=4eb44d3f-ff8b-4b03-aa6f-d257d1de66e4,network=Network(e9abba2c-7994-4781-a3ca-07e8e4be7825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4eb44d3f-ff') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:49:18 user nova-compute[75341]: DEBUG os_vif [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:cc:cd,bridge_name='br-int',has_traffic_filtering=True,id=4eb44d3f-ff8b-4b03-aa6f-d257d1de66e4,network=Network(e9abba2c-7994-4781-a3ca-07e8e4be7825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4eb44d3f-ff') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 23:49:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:49:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 23:49:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8f680165-587a-5c3f-9555-60b801dfca8f', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:49:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4eb44d3f-ff, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:49:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4eb44d3f-ff, col_values=(('qos', UUID('e72236c6-c149-48ae-93f4-b0c89be583a8')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:49:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4eb44d3f-ff, col_values=(('external_ids', {'iface-id': '4eb44d3f-ff8b-4b03-aa6f-d257d1de66e4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:cc:cd', 'vm-uuid': '01b30e67-ac52-4cf6-9a31-30096f8b3344'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:49:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:49:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:18 user nova-compute[75341]: INFO os_vif [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:cc:cd,bridge_name='br-int',has_traffic_filtering=True,id=4eb44d3f-ff8b-4b03-aa6f-d257d1de66e4,network=Network(e9abba2c-7994-4781-a3ca-07e8e4be7825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4eb44d3f-ff')
Nov 14 23:49:18 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:49:18 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] No VIF found with MAC fa:16:3e:f4:cc:cd, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:49:18 user nova-compute[75341]: DEBUG nova.network.neutron [req-b62d08b0-6e99-4402-bac2-af35a69e263e req-0dc6b5ed-4df0-487f-b107-d9947bf27e33 service nova] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Updated VIF entry in instance network info cache for port 4eb44d3f-ff8b-4b03-aa6f-d257d1de66e4. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:49:18 user nova-compute[75341]: DEBUG nova.network.neutron [req-b62d08b0-6e99-4402-bac2-af35a69e263e req-0dc6b5ed-4df0-487f-b107-d9947bf27e33 service nova] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Updating instance_info_cache with network_info: [{"id": "4eb44d3f-ff8b-4b03-aa6f-d257d1de66e4", "address": "fa:16:3e:f4:cc:cd", "network": {"id": "e9abba2c-7994-4781-a3ca-07e8e4be7825", "bridge": "br-int", "label": "tempest-TestStampPattern-1410971761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af462be688d4127a8368ee3dcb2a340", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eb44d3f-ff", "ovs_interfaceid": "4eb44d3f-ff8b-4b03-aa6f-d257d1de66e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:49:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-b62d08b0-6e99-4402-bac2-af35a69e263e req-0dc6b5ed-4df0-487f-b107-d9947bf27e33 service nova] Releasing lock "refresh_cache-01b30e67-ac52-4cf6-9a31-30096f8b3344" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:49:19 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:19 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:19 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:20 user nova-compute[75341]: DEBUG nova.compute.manager [req-0ce1c311-31c5-4c98-b658-4ffc1e03cffe req-2d8b09a4-679a-486d-99c5-8e892e664510 service nova] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Received event network-vif-plugged-4eb44d3f-ff8b-4b03-aa6f-d257d1de66e4 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:49:20 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-0ce1c311-31c5-4c98-b658-4ffc1e03cffe req-2d8b09a4-679a-486d-99c5-8e892e664510 service nova] Acquiring lock "01b30e67-ac52-4cf6-9a31-30096f8b3344-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:49:20 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-0ce1c311-31c5-4c98-b658-4ffc1e03cffe req-2d8b09a4-679a-486d-99c5-8e892e664510 service nova] Lock "01b30e67-ac52-4cf6-9a31-30096f8b3344-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:49:20 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-0ce1c311-31c5-4c98-b658-4ffc1e03cffe req-2d8b09a4-679a-486d-99c5-8e892e664510 service nova] Lock "01b30e67-ac52-4cf6-9a31-30096f8b3344-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:49:20 user nova-compute[75341]: DEBUG nova.compute.manager [req-0ce1c311-31c5-4c98-b658-4ffc1e03cffe req-2d8b09a4-679a-486d-99c5-8e892e664510 service nova] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] No waiting events found dispatching network-vif-plugged-4eb44d3f-ff8b-4b03-aa6f-d257d1de66e4 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:49:20 user nova-compute[75341]: WARNING nova.compute.manager [req-0ce1c311-31c5-4c98-b658-4ffc1e03cffe req-2d8b09a4-679a-486d-99c5-8e892e664510 service nova] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Received unexpected event network-vif-plugged-4eb44d3f-ff8b-4b03-aa6f-d257d1de66e4 for instance with vm_state building and task_state spawning.
Nov 14 23:49:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:21 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:22 user nova-compute[75341]: DEBUG nova.compute.manager [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Instance event wait completed in 0 seconds for  {{(pid=75341) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 23:49:22 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Guest created on hypervisor {{(pid=75341) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 23:49:22 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Instance spawned successfully.
Nov 14 23:49:22 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 23:49:22 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Found default for hw_input_bus of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:49:22 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Found default for hw_pointer_model of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:49:22 user nova-compute[75341]: DEBUG nova.compute.manager [req-389fb814-0aa6-4d5d-bdb8-521cc10ecf51 req-a49dc4c2-180a-44b2-97fd-fd8242c72d11 service nova] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Received event network-vif-plugged-4eb44d3f-ff8b-4b03-aa6f-d257d1de66e4 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:49:22 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-389fb814-0aa6-4d5d-bdb8-521cc10ecf51 req-a49dc4c2-180a-44b2-97fd-fd8242c72d11 service nova] Acquiring lock "01b30e67-ac52-4cf6-9a31-30096f8b3344-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:49:22 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-389fb814-0aa6-4d5d-bdb8-521cc10ecf51 req-a49dc4c2-180a-44b2-97fd-fd8242c72d11 service nova] Lock "01b30e67-ac52-4cf6-9a31-30096f8b3344-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:49:22 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-389fb814-0aa6-4d5d-bdb8-521cc10ecf51 req-a49dc4c2-180a-44b2-97fd-fd8242c72d11 service nova] Lock "01b30e67-ac52-4cf6-9a31-30096f8b3344-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:49:22 user nova-compute[75341]: DEBUG nova.compute.manager [req-389fb814-0aa6-4d5d-bdb8-521cc10ecf51 req-a49dc4c2-180a-44b2-97fd-fd8242c72d11 service nova] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] No waiting events found dispatching network-vif-plugged-4eb44d3f-ff8b-4b03-aa6f-d257d1de66e4 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:49:22 user nova-compute[75341]: WARNING nova.compute.manager [req-389fb814-0aa6-4d5d-bdb8-521cc10ecf51 req-a49dc4c2-180a-44b2-97fd-fd8242c72d11 service nova] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Received unexpected event network-vif-plugged-4eb44d3f-ff8b-4b03-aa6f-d257d1de66e4 for instance with vm_state building and task_state spawning.
Nov 14 23:49:22 user nova-compute[75341]: INFO nova.compute.manager [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Took 6.39 seconds to spawn the instance on the hypervisor.
Nov 14 23:49:22 user nova-compute[75341]: DEBUG nova.compute.manager [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 23:49:22 user nova-compute[75341]: INFO nova.compute.manager [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Took 7.18 seconds to build instance.
Nov 14 23:49:22 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0147905a-5c66-4aea-9500-38aec5160fb4 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Lock "01b30e67-ac52-4cf6-9a31-30096f8b3344" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.307s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:49:23 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:23 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:26 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:28 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Acquiring lock "2316aa9e-d4c9-43d0-9918-86265583aed1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:49:28 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "2316aa9e-d4c9-43d0-9918-86265583aed1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:49:28 user nova-compute[75341]: DEBUG nova.compute.manager [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Starting instance... {{(pid=75341) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 23:49:28 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:49:28 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:49:28 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75341) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 23:49:28 user nova-compute[75341]: INFO nova.compute.claims [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Claim successful on node user
Nov 14 23:49:29 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:49:29 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:49:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.443s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:49:29 user nova-compute[75341]: DEBUG nova.compute.manager [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Start building networks asynchronously for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 23:49:29 user nova-compute[75341]: DEBUG nova.compute.manager [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Allocating IP information in the background. {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 23:49:29 user nova-compute[75341]: DEBUG nova.network.neutron [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] allocate_for_instance() {{(pid=75341) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 23:49:29 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 23:49:29 user nova-compute[75341]: DEBUG nova.compute.manager [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Start building block device mappings for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 23:49:29 user nova-compute[75341]: DEBUG nova.policy [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aa84b131dff84566810c44b553b09ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e601d11e75d4ec4b7c05e615c67fe20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75341) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 23:49:29 user nova-compute[75341]: DEBUG nova.compute.manager [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Start spawning the instance on the hypervisor. {{(pid=75341) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 23:49:29 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Creating instance directory {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 23:49:29 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Creating image(s)
Nov 14 23:49:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Acquiring lock "/opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:49:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "/opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:49:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "/opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:49:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.181s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:49:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Acquiring lock "4754efee9a6d73d3647f2add2cfe86c291949740" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:49:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:49:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.187s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:49:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/disk 1073741824 {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/disk 1073741824" returned: 0 in 0.052s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:49:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:49:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:29 user nova-compute[75341]: DEBUG nova.network.neutron [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Successfully created port: 71caa935-899c-4716-9953-ae35733e691e {{(pid=75341) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 23:49:30 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.170s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:49:30 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/disk. size=1073741824 {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 23:49:30 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:30 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:49:30 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Cannot resize image /opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/disk to a smaller size. {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 23:49:30 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Created local disks {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 23:49:30 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Ensure instance console log exists: /opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/console.log {{(pid=75341) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 23:49:30 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:49:30 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:49:30 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:49:30 user nova-compute[75341]: DEBUG nova.network.neutron [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Successfully updated port: 71caa935-899c-4716-9953-ae35733e691e {{(pid=75341) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 23:49:30 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Acquiring lock "refresh_cache-2316aa9e-d4c9-43d0-9918-86265583aed1" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:49:30 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Acquired lock "refresh_cache-2316aa9e-d4c9-43d0-9918-86265583aed1" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:49:30 user nova-compute[75341]: DEBUG nova.network.neutron [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 23:49:30 user nova-compute[75341]: DEBUG nova.compute.manager [req-4792c394-fa75-465d-aa3e-6af49575e712 req-083c5135-fa23-4913-b39b-dde237d3e902 service nova] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Received event network-changed-71caa935-899c-4716-9953-ae35733e691e {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:49:30 user nova-compute[75341]: DEBUG nova.compute.manager [req-4792c394-fa75-465d-aa3e-6af49575e712 req-083c5135-fa23-4913-b39b-dde237d3e902 service nova] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Refreshing instance network info cache due to event network-changed-71caa935-899c-4716-9953-ae35733e691e. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:49:30 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4792c394-fa75-465d-aa3e-6af49575e712 req-083c5135-fa23-4913-b39b-dde237d3e902 service nova] Acquiring lock "refresh_cache-2316aa9e-d4c9-43d0-9918-86265583aed1" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:49:30 user nova-compute[75341]: DEBUG nova.network.neutron [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Instance cache missing network info. {{(pid=75341) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 23:49:31 user nova-compute[75341]: DEBUG nova.network.neutron [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Updating instance_info_cache with network_info: [{"id": "71caa935-899c-4716-9953-ae35733e691e", "address": "fa:16:3e:3d:1f:4a", "network": {"id": "167936c8-5f28-439e-9a1f-d9356b3a1ec9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374167607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e601d11e75d4ec4b7c05e615c67fe20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71caa935-89", "ovs_interfaceid": "71caa935-899c-4716-9953-ae35733e691e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:49:31 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Releasing lock "refresh_cache-2316aa9e-d4c9-43d0-9918-86265583aed1" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:49:31 user nova-compute[75341]: DEBUG nova.compute.manager [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Instance network_info: |[{"id": "71caa935-899c-4716-9953-ae35733e691e", "address": "fa:16:3e:3d:1f:4a", "network": {"id": "167936c8-5f28-439e-9a1f-d9356b3a1ec9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374167607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e601d11e75d4ec4b7c05e615c67fe20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71caa935-89", "ovs_interfaceid": "71caa935-899c-4716-9953-ae35733e691e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 23:49:31 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4792c394-fa75-465d-aa3e-6af49575e712 req-083c5135-fa23-4913-b39b-dde237d3e902 service nova] Acquired lock "refresh_cache-2316aa9e-d4c9-43d0-9918-86265583aed1" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:49:31 user nova-compute[75341]: DEBUG nova.network.neutron [req-4792c394-fa75-465d-aa3e-6af49575e712 req-083c5135-fa23-4913-b39b-dde237d3e902 service nova] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Refreshing network info cache for port 71caa935-899c-4716-9953-ae35733e691e {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:49:31 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Start _get_guest_xml network_info=[{"id": "71caa935-899c-4716-9953-ae35733e691e", "address": "fa:16:3e:3d:1f:4a", "network": {"id": "167936c8-5f28-439e-9a1f-d9356b3a1ec9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374167607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e601d11e75d4ec4b7c05e615c67fe20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71caa935-89", "ovs_interfaceid": "71caa935-899c-4716-9953-ae35733e691e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encrypted': False, 'image_id': 'e46abb82-b810-490e-a8a1-ccdc5fa1a796'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 23:49:31 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:49:31 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:49:31 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 23:49:31 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 23:49:31 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 23:49:31 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 23:49:31 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 23:49:31 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 23:49:31 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 23:49:31 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 23:49:31 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 23:49:31 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 23:49:31 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 23:49:31 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 23:49:31 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 23:49:31 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 23:49:31 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 23:49:31 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 23:49:31 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:49:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-154597700',display_name='tempest-AttachVolumeTestJSON-server-154597700',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-154597700',id=32,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaFgRJa61ME1XpWOzpNtbuqeAV1SySIMy7vrqCjTh61rgrkmD4lVtobnjyZbOLvU5WmBzUQHKYD/KyyedZ/uzEQoe71Auc/XFD5jRK6KaS6v9fK21UKVH1TMup4zwPhng==',key_name='tempest-keypair-1222319400',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e601d11e75d4ec4b7c05e615c67fe20',ramdisk_id='',reservation_id='r-2tbsxelf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1907700292',owner_user_name='tempest-AttachVolumeTestJSON-1907700292-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:49:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa84b131dff84566810c44b553b09ba8',uuid=2316aa9e-d4c9-43d0-9918-86265583aed1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71caa935-899c-4716-9953-ae35733e691e", "address": "fa:16:3e:3d:1f:4a", "network": {"id": "167936c8-5f28-439e-9a1f-d9356b3a1ec9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374167607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e601d11e75d4ec4b7c05e615c67fe20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71caa935-89", "ovs_interfaceid": "71caa935-899c-4716-9953-ae35733e691e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:49:31 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Converting VIF {"id": "71caa935-899c-4716-9953-ae35733e691e", "address": "fa:16:3e:3d:1f:4a", "network": {"id": "167936c8-5f28-439e-9a1f-d9356b3a1ec9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374167607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e601d11e75d4ec4b7c05e615c67fe20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71caa935-89", "ovs_interfaceid": "71caa935-899c-4716-9953-ae35733e691e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:49:31 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:1f:4a,bridge_name='br-int',has_traffic_filtering=True,id=71caa935-899c-4716-9953-ae35733e691e,network=Network(167936c8-5f28-439e-9a1f-d9356b3a1ec9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71caa935-89') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:49:31 user nova-compute[75341]: DEBUG nova.objects.instance [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lazy-loading 'pci_devices' on Instance uuid 2316aa9e-d4c9-43d0-9918-86265583aed1 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:49:31 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] End _get_guest_xml xml=<domain type="kvm">
Nov 14 23:49:31 user nova-compute[75341]:   <uuid>2316aa9e-d4c9-43d0-9918-86265583aed1</uuid>
Nov 14 23:49:31 user nova-compute[75341]:   <name>instance-00000020</name>
Nov 14 23:49:31 user nova-compute[75341]:   <memory>524288</memory>
Nov 14 23:49:31 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 14 23:49:31 user nova-compute[75341]:   <metadata>
Nov 14 23:49:31 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 23:49:31 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 14 23:49:31 user nova-compute[75341]:       <nova:name>tempest-AttachVolumeTestJSON-server-154597700</nova:name>
Nov 14 23:49:31 user nova-compute[75341]:       <nova:creationTime>2023-11-14 23:49:31</nova:creationTime>
Nov 14 23:49:31 user nova-compute[75341]:       <nova:flavor name="m1.tiny">
Nov 14 23:49:31 user nova-compute[75341]:         <nova:memory>512</nova:memory>
Nov 14 23:49:31 user nova-compute[75341]:         <nova:disk>1</nova:disk>
Nov 14 23:49:31 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 14 23:49:31 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 23:49:31 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 14 23:49:31 user nova-compute[75341]:       </nova:flavor>
Nov 14 23:49:31 user nova-compute[75341]:       <nova:owner>
Nov 14 23:49:31 user nova-compute[75341]:         <nova:user uuid="aa84b131dff84566810c44b553b09ba8">tempest-AttachVolumeTestJSON-1907700292-project-member</nova:user>
Nov 14 23:49:31 user nova-compute[75341]:         <nova:project uuid="0e601d11e75d4ec4b7c05e615c67fe20">tempest-AttachVolumeTestJSON-1907700292</nova:project>
Nov 14 23:49:31 user nova-compute[75341]:       </nova:owner>
Nov 14 23:49:31 user nova-compute[75341]:       <nova:root type="image" uuid="e46abb82-b810-490e-a8a1-ccdc5fa1a796"/>
Nov 14 23:49:31 user nova-compute[75341]:       <nova:ports>
Nov 14 23:49:31 user nova-compute[75341]:         <nova:port uuid="71caa935-899c-4716-9953-ae35733e691e">
Nov 14 23:49:31 user nova-compute[75341]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 23:49:31 user nova-compute[75341]:         </nova:port>
Nov 14 23:49:31 user nova-compute[75341]:       </nova:ports>
Nov 14 23:49:31 user nova-compute[75341]:     </nova:instance>
Nov 14 23:49:31 user nova-compute[75341]:   </metadata>
Nov 14 23:49:31 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 14 23:49:31 user nova-compute[75341]:     <system>
Nov 14 23:49:31 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 23:49:31 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 14 23:49:31 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 14 23:49:31 user nova-compute[75341]:       <entry name="serial">2316aa9e-d4c9-43d0-9918-86265583aed1</entry>
Nov 14 23:49:31 user nova-compute[75341]:       <entry name="uuid">2316aa9e-d4c9-43d0-9918-86265583aed1</entry>
Nov 14 23:49:31 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 14 23:49:31 user nova-compute[75341]:     </system>
Nov 14 23:49:31 user nova-compute[75341]:   </sysinfo>
Nov 14 23:49:31 user nova-compute[75341]:   <os>
Nov 14 23:49:31 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 23:49:31 user nova-compute[75341]:     <boot dev="hd"/>
Nov 14 23:49:31 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 14 23:49:31 user nova-compute[75341]:   </os>
Nov 14 23:49:31 user nova-compute[75341]:   <features>
Nov 14 23:49:31 user nova-compute[75341]:     <acpi/>
Nov 14 23:49:31 user nova-compute[75341]:     <apic/>
Nov 14 23:49:31 user nova-compute[75341]:     <vmcoreinfo/>
Nov 14 23:49:31 user nova-compute[75341]:   </features>
Nov 14 23:49:31 user nova-compute[75341]:   <clock offset="utc">
Nov 14 23:49:31 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 23:49:31 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 23:49:31 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 14 23:49:31 user nova-compute[75341]:   </clock>
Nov 14 23:49:31 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 14 23:49:31 user nova-compute[75341]:     <model>Nehalem</model>
Nov 14 23:49:31 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 23:49:31 user nova-compute[75341]:   </cpu>
Nov 14 23:49:31 user nova-compute[75341]:   <devices>
Nov 14 23:49:31 user nova-compute[75341]:     <disk type="file" device="disk">
Nov 14 23:49:31 user nova-compute[75341]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 23:49:31 user nova-compute[75341]:       <source file="/opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/disk"/>
Nov 14 23:49:31 user nova-compute[75341]:       <target dev="vda" bus="virtio"/>
Nov 14 23:49:31 user nova-compute[75341]:     </disk>
Nov 14 23:49:31 user nova-compute[75341]:     <interface type="ethernet">
Nov 14 23:49:31 user nova-compute[75341]:       <mac address="fa:16:3e:3d:1f:4a"/>
Nov 14 23:49:31 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:49:31 user nova-compute[75341]:       <mtu size="1442"/>
Nov 14 23:49:31 user nova-compute[75341]:       <target dev="tap71caa935-89"/>
Nov 14 23:49:31 user nova-compute[75341]:     </interface>
Nov 14 23:49:31 user nova-compute[75341]:     <serial type="pty">
Nov 14 23:49:31 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/console.log" append="off"/>
Nov 14 23:49:31 user nova-compute[75341]:     </serial>
Nov 14 23:49:31 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 23:49:31 user nova-compute[75341]:     <video>
Nov 14 23:49:31 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:49:31 user nova-compute[75341]:     </video>
Nov 14 23:49:31 user nova-compute[75341]:     <rng model="virtio">
Nov 14 23:49:31 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 14 23:49:31 user nova-compute[75341]:     </rng>
Nov 14 23:49:31 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 14 23:49:31 user nova-compute[75341]:     <memballoon model="virtio">
Nov 14 23:49:31 user nova-compute[75341]:       <stats period="10"/>
Nov 14 23:49:31 user nova-compute[75341]:     </memballoon>
Nov 14 23:49:31 user nova-compute[75341]:   </devices>
Nov 14 23:49:31 user nova-compute[75341]: </domain>
Nov 14 23:49:31 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 23:49:31 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:49:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-154597700',display_name='tempest-AttachVolumeTestJSON-server-154597700',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-154597700',id=32,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaFgRJa61ME1XpWOzpNtbuqeAV1SySIMy7vrqCjTh61rgrkmD4lVtobnjyZbOLvU5WmBzUQHKYD/KyyedZ/uzEQoe71Auc/XFD5jRK6KaS6v9fK21UKVH1TMup4zwPhng==',key_name='tempest-keypair-1222319400',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e601d11e75d4ec4b7c05e615c67fe20',ramdisk_id='',reservation_id='r-2tbsxelf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1907700292',owner_user_name='tempest-AttachVolumeTestJSON-1907700292-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:49:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa84b131dff84566810c44b553b09ba8',uuid=2316aa9e-d4c9-43d0-9918-86265583aed1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71caa935-899c-4716-9953-ae35733e691e", "address": "fa:16:3e:3d:1f:4a", "network": {"id": "167936c8-5f28-439e-9a1f-d9356b3a1ec9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374167607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e601d11e75d4ec4b7c05e615c67fe20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71caa935-89", "ovs_interfaceid": "71caa935-899c-4716-9953-ae35733e691e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 23:49:31 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Converting VIF {"id": "71caa935-899c-4716-9953-ae35733e691e", "address": "fa:16:3e:3d:1f:4a", "network": {"id": "167936c8-5f28-439e-9a1f-d9356b3a1ec9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374167607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e601d11e75d4ec4b7c05e615c67fe20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71caa935-89", "ovs_interfaceid": "71caa935-899c-4716-9953-ae35733e691e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:49:31 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:1f:4a,bridge_name='br-int',has_traffic_filtering=True,id=71caa935-899c-4716-9953-ae35733e691e,network=Network(167936c8-5f28-439e-9a1f-d9356b3a1ec9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71caa935-89') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:49:31 user nova-compute[75341]: DEBUG os_vif [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:1f:4a,bridge_name='br-int',has_traffic_filtering=True,id=71caa935-899c-4716-9953-ae35733e691e,network=Network(167936c8-5f28-439e-9a1f-d9356b3a1ec9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71caa935-89') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 23:49:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:49:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 23:49:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bacad1c4-5f95-5d0b-b16d-03bac3402380', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:49:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:49:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap71caa935-89, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:49:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap71caa935-89, col_values=(('qos', UUID('05abdd52-df10-4cd3-95b6-84557f31372f')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:49:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap71caa935-89, col_values=(('external_ids', {'iface-id': '71caa935-899c-4716-9953-ae35733e691e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:1f:4a', 'vm-uuid': '2316aa9e-d4c9-43d0-9918-86265583aed1'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:49:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:49:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:31 user nova-compute[75341]: INFO os_vif [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:1f:4a,bridge_name='br-int',has_traffic_filtering=True,id=71caa935-899c-4716-9953-ae35733e691e,network=Network(167936c8-5f28-439e-9a1f-d9356b3a1ec9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71caa935-89')
Nov 14 23:49:31 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:49:31 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] No VIF found with MAC fa:16:3e:3d:1f:4a, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:49:31 user nova-compute[75341]: DEBUG nova.network.neutron [req-4792c394-fa75-465d-aa3e-6af49575e712 req-083c5135-fa23-4913-b39b-dde237d3e902 service nova] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Updated VIF entry in instance network info cache for port 71caa935-899c-4716-9953-ae35733e691e. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:49:31 user nova-compute[75341]: DEBUG nova.network.neutron [req-4792c394-fa75-465d-aa3e-6af49575e712 req-083c5135-fa23-4913-b39b-dde237d3e902 service nova] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Updating instance_info_cache with network_info: [{"id": "71caa935-899c-4716-9953-ae35733e691e", "address": "fa:16:3e:3d:1f:4a", "network": {"id": "167936c8-5f28-439e-9a1f-d9356b3a1ec9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374167607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e601d11e75d4ec4b7c05e615c67fe20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71caa935-89", "ovs_interfaceid": "71caa935-899c-4716-9953-ae35733e691e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:49:31 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4792c394-fa75-465d-aa3e-6af49575e712 req-083c5135-fa23-4913-b39b-dde237d3e902 service nova] Releasing lock "refresh_cache-2316aa9e-d4c9-43d0-9918-86265583aed1" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:49:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:31 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-51dc82d4-6cff-43fc-96b5-4270c18db5d5 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Acquiring lock "680f66a5-e813-4c49-ad05-def95be9d0b7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:49:31 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-51dc82d4-6cff-43fc-96b5-4270c18db5d5 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Lock "680f66a5-e813-4c49-ad05-def95be9d0b7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:49:31 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-51dc82d4-6cff-43fc-96b5-4270c18db5d5 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Acquiring lock "680f66a5-e813-4c49-ad05-def95be9d0b7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:49:31 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-51dc82d4-6cff-43fc-96b5-4270c18db5d5 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Lock "680f66a5-e813-4c49-ad05-def95be9d0b7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:49:31 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-51dc82d4-6cff-43fc-96b5-4270c18db5d5 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Lock "680f66a5-e813-4c49-ad05-def95be9d0b7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:49:31 user nova-compute[75341]: INFO nova.compute.manager [None req-51dc82d4-6cff-43fc-96b5-4270c18db5d5 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 680f66a5-e813-4c49-ad05-def95be9d0b7] Terminating instance
Nov 14 23:49:31 user nova-compute[75341]: DEBUG nova.compute.manager [None req-51dc82d4-6cff-43fc-96b5-4270c18db5d5 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 680f66a5-e813-4c49-ad05-def95be9d0b7] Start destroying the instance on the hypervisor. {{(pid=75341) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 23:49:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:32 user nova-compute[75341]: DEBUG nova.compute.manager [req-3db5beb1-6208-46ee-87c7-d78bd3813257 req-ca27b392-85eb-4485-8530-a050d75cc99a service nova] [instance: 680f66a5-e813-4c49-ad05-def95be9d0b7] Received event network-vif-unplugged-e6391bae-e60b-4d29-95da-60d4643e6928 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:49:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-3db5beb1-6208-46ee-87c7-d78bd3813257 req-ca27b392-85eb-4485-8530-a050d75cc99a service nova] Acquiring lock "680f66a5-e813-4c49-ad05-def95be9d0b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:49:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-3db5beb1-6208-46ee-87c7-d78bd3813257 req-ca27b392-85eb-4485-8530-a050d75cc99a service nova] Lock "680f66a5-e813-4c49-ad05-def95be9d0b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:49:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-3db5beb1-6208-46ee-87c7-d78bd3813257 req-ca27b392-85eb-4485-8530-a050d75cc99a service nova] Lock "680f66a5-e813-4c49-ad05-def95be9d0b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:49:32 user nova-compute[75341]: DEBUG nova.compute.manager [req-3db5beb1-6208-46ee-87c7-d78bd3813257 req-ca27b392-85eb-4485-8530-a050d75cc99a service nova] [instance: 680f66a5-e813-4c49-ad05-def95be9d0b7] No waiting events found dispatching network-vif-unplugged-e6391bae-e60b-4d29-95da-60d4643e6928 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:49:32 user nova-compute[75341]: DEBUG nova.compute.manager [req-3db5beb1-6208-46ee-87c7-d78bd3813257 req-ca27b392-85eb-4485-8530-a050d75cc99a service nova] [instance: 680f66a5-e813-4c49-ad05-def95be9d0b7] Received event network-vif-unplugged-e6391bae-e60b-4d29-95da-60d4643e6928 for instance with task_state deleting. {{(pid=75341) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 23:49:32 user nova-compute[75341]: DEBUG nova.compute.manager [req-3db5beb1-6208-46ee-87c7-d78bd3813257 req-ca27b392-85eb-4485-8530-a050d75cc99a service nova] [instance: 680f66a5-e813-4c49-ad05-def95be9d0b7] Received event network-vif-plugged-e6391bae-e60b-4d29-95da-60d4643e6928 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:49:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-3db5beb1-6208-46ee-87c7-d78bd3813257 req-ca27b392-85eb-4485-8530-a050d75cc99a service nova] Acquiring lock "680f66a5-e813-4c49-ad05-def95be9d0b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:49:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-3db5beb1-6208-46ee-87c7-d78bd3813257 req-ca27b392-85eb-4485-8530-a050d75cc99a service nova] Lock "680f66a5-e813-4c49-ad05-def95be9d0b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:49:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-3db5beb1-6208-46ee-87c7-d78bd3813257 req-ca27b392-85eb-4485-8530-a050d75cc99a service nova] Lock "680f66a5-e813-4c49-ad05-def95be9d0b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:49:32 user nova-compute[75341]: DEBUG nova.compute.manager [req-3db5beb1-6208-46ee-87c7-d78bd3813257 req-ca27b392-85eb-4485-8530-a050d75cc99a service nova] [instance: 680f66a5-e813-4c49-ad05-def95be9d0b7] No waiting events found dispatching network-vif-plugged-e6391bae-e60b-4d29-95da-60d4643e6928 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:49:32 user nova-compute[75341]: WARNING nova.compute.manager [req-3db5beb1-6208-46ee-87c7-d78bd3813257 req-ca27b392-85eb-4485-8530-a050d75cc99a service nova] [instance: 680f66a5-e813-4c49-ad05-def95be9d0b7] Received unexpected event network-vif-plugged-e6391bae-e60b-4d29-95da-60d4643e6928 for instance with vm_state active and task_state deleting.
Nov 14 23:49:32 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 680f66a5-e813-4c49-ad05-def95be9d0b7] Instance destroyed successfully.
Nov 14 23:49:32 user nova-compute[75341]: DEBUG nova.objects.instance [None req-51dc82d4-6cff-43fc-96b5-4270c18db5d5 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Lazy-loading 'resources' on Instance uuid 680f66a5-e813-4c49-ad05-def95be9d0b7 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:49:32 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-51dc82d4-6cff-43fc-96b5-4270c18db5d5 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:47:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-354716180',display_name='tempest-VolumesActionsTest-instance-354716180',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-354716180',id=27,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:47:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='24aa6f705262457e95f2f3f47c0ee709',ramdisk_id='',reservation_id='r-fefa02ks',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1514431738',owner_user_name='tempest-VolumesActionsTest-1514431738-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:47:49Z,user_data=None,user_id='aff47f00e24e461787b1224fa6e697fa',uuid=680f66a5-e813-4c49-ad05-def95be9d0b7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e6391bae-e60b-4d29-95da-60d4643e6928", "address": "fa:16:3e:d5:75:b6", "network": {"id": "b87c269d-b129-4bd0-b995-e9a9657dbd1a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1162722602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24aa6f705262457e95f2f3f47c0ee709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6391bae-e6", "ovs_interfaceid": "e6391bae-e60b-4d29-95da-60d4643e6928", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 23:49:32 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-51dc82d4-6cff-43fc-96b5-4270c18db5d5 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Converting VIF {"id": "e6391bae-e60b-4d29-95da-60d4643e6928", "address": "fa:16:3e:d5:75:b6", "network": {"id": "b87c269d-b129-4bd0-b995-e9a9657dbd1a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1162722602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24aa6f705262457e95f2f3f47c0ee709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6391bae-e6", "ovs_interfaceid": "e6391bae-e60b-4d29-95da-60d4643e6928", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:49:32 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-51dc82d4-6cff-43fc-96b5-4270c18db5d5 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:75:b6,bridge_name='br-int',has_traffic_filtering=True,id=e6391bae-e60b-4d29-95da-60d4643e6928,network=Network(b87c269d-b129-4bd0-b995-e9a9657dbd1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6391bae-e6') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:49:32 user nova-compute[75341]: DEBUG os_vif [None req-51dc82d4-6cff-43fc-96b5-4270c18db5d5 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:75:b6,bridge_name='br-int',has_traffic_filtering=True,id=e6391bae-e60b-4d29-95da-60d4643e6928,network=Network(b87c269d-b129-4bd0-b995-e9a9657dbd1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6391bae-e6') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 23:49:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape6391bae-e6, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:49:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:49:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4e64bf18-3a88-4fb7-bc35-5b86b6d511ff) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:49:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:32 user nova-compute[75341]: INFO os_vif [None req-51dc82d4-6cff-43fc-96b5-4270c18db5d5 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:75:b6,bridge_name='br-int',has_traffic_filtering=True,id=e6391bae-e60b-4d29-95da-60d4643e6928,network=Network(b87c269d-b129-4bd0-b995-e9a9657dbd1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6391bae-e6')
Nov 14 23:49:32 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-51dc82d4-6cff-43fc-96b5-4270c18db5d5 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 680f66a5-e813-4c49-ad05-def95be9d0b7] Deleting instance files /opt/stack/data/nova/instances/680f66a5-e813-4c49-ad05-def95be9d0b7_del
Nov 14 23:49:32 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-51dc82d4-6cff-43fc-96b5-4270c18db5d5 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 680f66a5-e813-4c49-ad05-def95be9d0b7] Deletion of /opt/stack/data/nova/instances/680f66a5-e813-4c49-ad05-def95be9d0b7_del complete
Nov 14 23:49:32 user nova-compute[75341]: INFO nova.compute.manager [None req-51dc82d4-6cff-43fc-96b5-4270c18db5d5 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] [instance: 680f66a5-e813-4c49-ad05-def95be9d0b7] Took 1.01 seconds to destroy the instance on the hypervisor.
Nov 14 23:49:32 user nova-compute[75341]: DEBUG oslo.service.loopingcall [None req-51dc82d4-6cff-43fc-96b5-4270c18db5d5 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75341) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 23:49:32 user nova-compute[75341]: DEBUG nova.compute.manager [-] [instance: 680f66a5-e813-4c49-ad05-def95be9d0b7] Deallocating network for instance {{(pid=75341) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 23:49:32 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: 680f66a5-e813-4c49-ad05-def95be9d0b7] deallocate_for_instance() {{(pid=75341) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 23:49:33 user nova-compute[75341]: DEBUG nova.compute.manager [req-c2c1e169-ea5f-4b10-9510-66aff91fd629 req-c5c78bc0-5e86-45c5-946c-a77d0931f837 service nova] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Received event network-vif-plugged-71caa935-899c-4716-9953-ae35733e691e {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:49:33 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-c2c1e169-ea5f-4b10-9510-66aff91fd629 req-c5c78bc0-5e86-45c5-946c-a77d0931f837 service nova] Acquiring lock "2316aa9e-d4c9-43d0-9918-86265583aed1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:49:33 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-c2c1e169-ea5f-4b10-9510-66aff91fd629 req-c5c78bc0-5e86-45c5-946c-a77d0931f837 service nova] Lock "2316aa9e-d4c9-43d0-9918-86265583aed1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:49:33 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-c2c1e169-ea5f-4b10-9510-66aff91fd629 req-c5c78bc0-5e86-45c5-946c-a77d0931f837 service nova] Lock "2316aa9e-d4c9-43d0-9918-86265583aed1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:49:33 user nova-compute[75341]: DEBUG nova.compute.manager [req-c2c1e169-ea5f-4b10-9510-66aff91fd629 req-c5c78bc0-5e86-45c5-946c-a77d0931f837 service nova] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] No waiting events found dispatching network-vif-plugged-71caa935-899c-4716-9953-ae35733e691e {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:49:33 user nova-compute[75341]: WARNING nova.compute.manager [req-c2c1e169-ea5f-4b10-9510-66aff91fd629 req-c5c78bc0-5e86-45c5-946c-a77d0931f837 service nova] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Received unexpected event network-vif-plugged-71caa935-899c-4716-9953-ae35733e691e for instance with vm_state building and task_state spawning.
Nov 14 23:49:33 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:33 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:33 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:33 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: 680f66a5-e813-4c49-ad05-def95be9d0b7] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:49:33 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:33 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:33 user nova-compute[75341]: INFO nova.compute.manager [-] [instance: 680f66a5-e813-4c49-ad05-def95be9d0b7] Took 0.55 seconds to deallocate network for instance.
Nov 14 23:49:33 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-51dc82d4-6cff-43fc-96b5-4270c18db5d5 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:49:33 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-51dc82d4-6cff-43fc-96b5-4270c18db5d5 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:49:33 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-51dc82d4-6cff-43fc-96b5-4270c18db5d5 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:49:33 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-51dc82d4-6cff-43fc-96b5-4270c18db5d5 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:49:33 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-51dc82d4-6cff-43fc-96b5-4270c18db5d5 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.324s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:49:34 user nova-compute[75341]: INFO nova.scheduler.client.report [None req-51dc82d4-6cff-43fc-96b5-4270c18db5d5 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Deleted allocations for instance 680f66a5-e813-4c49-ad05-def95be9d0b7
Nov 14 23:49:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-51dc82d4-6cff-43fc-96b5-4270c18db5d5 tempest-VolumesActionsTest-1514431738 tempest-VolumesActionsTest-1514431738-project-member] Lock "680f66a5-e813-4c49-ad05-def95be9d0b7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.128s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:49:34 user nova-compute[75341]: DEBUG nova.compute.manager [req-aefb7844-1817-4ed3-8ca3-97cc8e6cc28c req-0728db80-4997-43c7-a38d-b5e65c47764c service nova] [instance: 680f66a5-e813-4c49-ad05-def95be9d0b7] Received event network-vif-deleted-e6391bae-e60b-4d29-95da-60d4643e6928 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:49:35 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0e2ec74a-3e04-4d98-a70a-d22a8672a6d9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Acquiring lock "d92ba9df-c739-414d-a701-ddba04563427" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:49:35 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0e2ec74a-3e04-4d98-a70a-d22a8672a6d9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "d92ba9df-c739-414d-a701-ddba04563427" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:49:35 user nova-compute[75341]: DEBUG nova.compute.manager [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Instance event wait completed in 0 seconds for  {{(pid=75341) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 23:49:35 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Guest created on hypervisor {{(pid=75341) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 23:49:35 user nova-compute[75341]: INFO nova.compute.manager [None req-0e2ec74a-3e04-4d98-a70a-d22a8672a6d9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d92ba9df-c739-414d-a701-ddba04563427] Detaching volume 346c1ba7-daae-453a-ae47-97d5556b6774
Nov 14 23:49:35 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Instance spawned successfully.
Nov 14 23:49:35 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 23:49:35 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Found default for hw_cdrom_bus of ide {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:49:35 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Found default for hw_disk_bus of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:49:35 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Found default for hw_input_bus of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:49:35 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Found default for hw_pointer_model of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:49:35 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Found default for hw_video_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:49:35 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Found default for hw_vif_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:49:35 user nova-compute[75341]: INFO nova.virt.block_device [None req-0e2ec74a-3e04-4d98-a70a-d22a8672a6d9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d92ba9df-c739-414d-a701-ddba04563427] Attempting to driver detach volume 346c1ba7-daae-453a-ae47-97d5556b6774 from mountpoint /dev/vdb
Nov 14 23:49:35 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-0e2ec74a-3e04-4d98-a70a-d22a8672a6d9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Attempting to detach device vdb from instance d92ba9df-c739-414d-a701-ddba04563427 from the persistent domain config. {{(pid=75341) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 23:49:35 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-0e2ec74a-3e04-4d98-a70a-d22a8672a6d9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 23:49:35 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:49:35 user nova-compute[75341]:   <source dev="/dev/sdb"/>
Nov 14 23:49:35 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:49:35 user nova-compute[75341]:   <serial>346c1ba7-daae-453a-ae47-97d5556b6774</serial>
Nov 14 23:49:35 user nova-compute[75341]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 23:49:35 user nova-compute[75341]: </disk>
Nov 14 23:49:35 user nova-compute[75341]:  {{(pid=75341) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 23:49:35 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-0e2ec74a-3e04-4d98-a70a-d22a8672a6d9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Successfully detached device vdb from instance d92ba9df-c739-414d-a701-ddba04563427 from the persistent domain config.
Nov 14 23:49:35 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-0e2ec74a-3e04-4d98-a70a-d22a8672a6d9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d92ba9df-c739-414d-a701-ddba04563427 from the live domain config. {{(pid=75341) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 23:49:35 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-0e2ec74a-3e04-4d98-a70a-d22a8672a6d9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 23:49:35 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:49:35 user nova-compute[75341]:   <source dev="/dev/sdb"/>
Nov 14 23:49:35 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:49:35 user nova-compute[75341]:   <serial>346c1ba7-daae-453a-ae47-97d5556b6774</serial>
Nov 14 23:49:35 user nova-compute[75341]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 23:49:35 user nova-compute[75341]: </disk>
Nov 14 23:49:35 user nova-compute[75341]:  {{(pid=75341) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 23:49:35 user nova-compute[75341]: INFO nova.compute.manager [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Took 5.71 seconds to spawn the instance on the hypervisor.
Nov 14 23:49:35 user nova-compute[75341]: DEBUG nova.compute.manager [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 23:49:35 user nova-compute[75341]: DEBUG nova.compute.manager [req-63747685-b91e-45f0-9aaf-f3fea0a5431a req-df6905bf-b72a-4494-9012-5b9d4ad93ae8 service nova] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Received event network-vif-plugged-71caa935-899c-4716-9953-ae35733e691e {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:49:35 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-63747685-b91e-45f0-9aaf-f3fea0a5431a req-df6905bf-b72a-4494-9012-5b9d4ad93ae8 service nova] Acquiring lock "2316aa9e-d4c9-43d0-9918-86265583aed1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:49:35 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-63747685-b91e-45f0-9aaf-f3fea0a5431a req-df6905bf-b72a-4494-9012-5b9d4ad93ae8 service nova] Lock "2316aa9e-d4c9-43d0-9918-86265583aed1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:49:35 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-63747685-b91e-45f0-9aaf-f3fea0a5431a req-df6905bf-b72a-4494-9012-5b9d4ad93ae8 service nova] Lock "2316aa9e-d4c9-43d0-9918-86265583aed1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:49:35 user nova-compute[75341]: DEBUG nova.compute.manager [req-63747685-b91e-45f0-9aaf-f3fea0a5431a req-df6905bf-b72a-4494-9012-5b9d4ad93ae8 service nova] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] No waiting events found dispatching network-vif-plugged-71caa935-899c-4716-9953-ae35733e691e {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:49:35 user nova-compute[75341]: WARNING nova.compute.manager [req-63747685-b91e-45f0-9aaf-f3fea0a5431a req-df6905bf-b72a-4494-9012-5b9d4ad93ae8 service nova] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Received unexpected event network-vif-plugged-71caa935-899c-4716-9953-ae35733e691e for instance with vm_state building and task_state spawning.
Nov 14 23:49:35 user nova-compute[75341]: INFO nova.compute.manager [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Took 6.48 seconds to build instance.
Nov 14 23:49:35 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d595327b-7e71-44c0-9a19-06e9bee2503f tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "2316aa9e-d4c9-43d0-9918-86265583aed1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.576s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:49:35 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-0e2ec74a-3e04-4d98-a70a-d22a8672a6d9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d92ba9df-c739-414d-a701-ddba04563427 {{(pid=75341) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 23:49:36 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:37 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:41 user nova-compute[75341]: DEBUG nova.compute.manager [req-23d735e7-ecd9-47b8-a697-76b011e120e4 req-72ad40fa-d991-4694-9aa6-b5c8c8162f06 service nova] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Received event network-changed-beb17cbc-97e3-43ed-ba83-d364cec9b619 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:49:41 user nova-compute[75341]: DEBUG nova.compute.manager [req-23d735e7-ecd9-47b8-a697-76b011e120e4 req-72ad40fa-d991-4694-9aa6-b5c8c8162f06 service nova] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Refreshing instance network info cache due to event network-changed-beb17cbc-97e3-43ed-ba83-d364cec9b619. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:49:41 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-23d735e7-ecd9-47b8-a697-76b011e120e4 req-72ad40fa-d991-4694-9aa6-b5c8c8162f06 service nova] Acquiring lock "refresh_cache-f8e73e44-9d2e-4b15-836c-738398adc685" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:49:41 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-23d735e7-ecd9-47b8-a697-76b011e120e4 req-72ad40fa-d991-4694-9aa6-b5c8c8162f06 service nova] Acquired lock "refresh_cache-f8e73e44-9d2e-4b15-836c-738398adc685" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:49:41 user nova-compute[75341]: DEBUG nova.network.neutron [req-23d735e7-ecd9-47b8-a697-76b011e120e4 req-72ad40fa-d991-4694-9aa6-b5c8c8162f06 service nova] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Refreshing network info cache for port beb17cbc-97e3-43ed-ba83-d364cec9b619 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:49:41 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-501b0cae-c4a3-44a5-b652-e5157596ad6a tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Acquiring lock "f8e73e44-9d2e-4b15-836c-738398adc685" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:49:41 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-501b0cae-c4a3-44a5-b652-e5157596ad6a tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lock "f8e73e44-9d2e-4b15-836c-738398adc685" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:49:41 user nova-compute[75341]: DEBUG nova.objects.instance [None req-501b0cae-c4a3-44a5-b652-e5157596ad6a tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lazy-loading 'flavor' on Instance uuid f8e73e44-9d2e-4b15-836c-738398adc685 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:49:42 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-501b0cae-c4a3-44a5-b652-e5157596ad6a tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Ignoring supplied device name: /dev/vdb
Nov 14 23:49:42 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-501b0cae-c4a3-44a5-b652-e5157596ad6a tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lock "f8e73e44-9d2e-4b15-836c-738398adc685" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.116s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:49:42 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-501b0cae-c4a3-44a5-b652-e5157596ad6a tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Acquiring lock "f8e73e44-9d2e-4b15-836c-738398adc685" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:49:42 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-501b0cae-c4a3-44a5-b652-e5157596ad6a tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lock "f8e73e44-9d2e-4b15-836c-738398adc685" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:49:42 user nova-compute[75341]: INFO nova.compute.manager [None req-501b0cae-c4a3-44a5-b652-e5157596ad6a tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Attaching volume da0ad9b0-5863-4ebf-b7b5-ca2f5027edf1 to /dev/vdb
Nov 14 23:49:42 user nova-compute[75341]: DEBUG os_brick.utils [None req-501b0cae-c4a3-44a5-b652-e5157596ad6a tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:49:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:49:42 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50d20da-83dc-4f92-aaca-a9d92c5cdbb4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6d1cfca09c9\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:49:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:42 user nova-compute[75341]: DEBUG nova.network.neutron [req-23d735e7-ecd9-47b8-a697-76b011e120e4 req-72ad40fa-d991-4694-9aa6-b5c8c8162f06 service nova] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Updated VIF entry in instance network info cache for port beb17cbc-97e3-43ed-ba83-d364cec9b619. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:49:42 user nova-compute[75341]: DEBUG nova.network.neutron [req-23d735e7-ecd9-47b8-a697-76b011e120e4 req-72ad40fa-d991-4694-9aa6-b5c8c8162f06 service nova] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Updating instance_info_cache with network_info: [{"id": "beb17cbc-97e3-43ed-ba83-d364cec9b619", "address": "fa:16:3e:56:69:7a", "network": {"id": "a1cc71d9-4161-4044-ad08-02aa4a7aef1c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-73156846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f694dc021a9442a49bbde9f367fbefc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeb17cbc-97", "ovs_interfaceid": "beb17cbc-97e3-43ed-ba83-d364cec9b619", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:49:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:49:42 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[252a5ed2-9e4b-4dd6-b5d1-b3ce6774e8aa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:49:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:42 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-23d735e7-ecd9-47b8-a697-76b011e120e4 req-72ad40fa-d991-4694-9aa6-b5c8c8162f06 service nova] Releasing lock "refresh_cache-f8e73e44-9d2e-4b15-836c-738398adc685" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:49:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:49:42 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec63924-3cae-4b42-a1a9-db9f93ddd7a9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:49:42 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c486458-d19f-452a-9d51-315127dc9967]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:49:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-501b0cae-c4a3-44a5-b652-e5157596ad6a tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Running cmd (subprocess): nvme version {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-501b0cae-c4a3-44a5-b652-e5157596ad6a tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] 'nvme version' failed. Not Retrying. {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:49:42 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.nvmeof [None req-501b0cae-c4a3-44a5-b652-e5157596ad6a tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] nvme not present on system {{(pid=75341) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 23:49:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:49:42 user nova-compute[75341]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 23:49:42 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eda076e-534d-4f1f-84cb-69a17aa29168]: (4, '') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:49:42 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-501b0cae-c4a3-44a5-b652-e5157596ad6a tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75341) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 23:49:42 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-501b0cae-c4a3-44a5-b652-e5157596ad6a tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 23:49:42 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-501b0cae-c4a3-44a5-b652-e5157596ad6a tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] LIGHTOS: no hostnqn found. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 23:49:42 user nova-compute[75341]: DEBUG os_brick.utils [None req-501b0cae-c4a3-44a5-b652-e5157596ad6a tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6d1cfca09c9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:49:42 user nova-compute[75341]: DEBUG nova.virt.block_device [None req-501b0cae-c4a3-44a5-b652-e5157596ad6a tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Updating existing volume attachment record: 791e5007-2b75-43da-af35-0de3420436b0 {{(pid=75341) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 23:49:42 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:46 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:46 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-501b0cae-c4a3-44a5-b652-e5157596ad6a tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Calling os-brick to attach iSCSI Volume {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 23:49:46 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-501b0cae-c4a3-44a5-b652-e5157596ad6a tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:da0ad9b0-5863-4ebf-b7b5-ca2f5027edf1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vVhqXeRl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:49:46 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-501b0cae-c4a3-44a5-b652-e5157596ad6a tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:49:46 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-501b0cae-c4a3-44a5-b652-e5157596ad6a tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:49:46 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-501b0cae-c4a3-44a5-b652-e5157596ad6a tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:49:46 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-501b0cae-c4a3-44a5-b652-e5157596ad6a tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:49:46 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-501b0cae-c4a3-44a5-b652-e5157596ad6a tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da0ad9b0-5863-4ebf-b7b5-ca2f5027edf1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:49:46 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-501b0cae-c4a3-44a5-b652-e5157596ad6a tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da0ad9b0-5863-4ebf-b7b5-ca2f5027edf1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:49:46 user nova-compute[75341]: INFO os_brick.initiator.connectors.iscsi [None req-501b0cae-c4a3-44a5-b652-e5157596ad6a tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 23:49:46 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da0ad9b0-5863-4ebf-b7b5-ca2f5027edf1 -p 172.16.0.220:3260 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:46 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da0ad9b0-5863-4ebf-b7b5-ca2f5027edf1 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:49:46 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8cbcfd1-6fca-45c8-9e09-44c06f2dde7a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:49:46 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-501b0cae-c4a3-44a5-b652-e5157596ad6a tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 23:49:46 user nova-compute[75341]:  {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:49:46 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da0ad9b0-5863-4ebf-b7b5-ca2f5027edf1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:46 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da0ad9b0-5863-4ebf-b7b5-ca2f5027edf1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:49:46 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb08c57-5a18-4cf5-9a09-ad6f4b6eb22b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da0ad9b0-5863-4ebf-b7b5-ca2f5027edf1] added\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:49:46 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-501b0cae-c4a3-44a5-b652-e5157596ad6a tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da0ad9b0-5863-4ebf-b7b5-ca2f5027edf1] added
Nov 14 23:49:46 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:49:46 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da0ad9b0-5863-4ebf-b7b5-ca2f5027edf1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:46 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da0ad9b0-5863-4ebf-b7b5-ca2f5027edf1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:49:46 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87b7f3f-31a2-47b8-aa66-6d88ddfe37c1]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:49:46 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-501b0cae-c4a3-44a5-b652-e5157596ad6a tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:49:46 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da0ad9b0-5863-4ebf-b7b5-ca2f5027edf1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:46 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da0ad9b0-5863-4ebf-b7b5-ca2f5027edf1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:49:46 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[57787513-9f7d-4d18-937a-f63f50613e05]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:49:46 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-501b0cae-c4a3-44a5-b652-e5157596ad6a tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:49:46 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da0ad9b0-5863-4ebf-b7b5-ca2f5027edf1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vVhqXeRl {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:46 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da0ad9b0-5863-4ebf-b7b5-ca2f5027edf1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vVhqXeRl" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:49:46 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b17ef40-fa9f-4930-9e96-4001bf821778]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:49:46 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-501b0cae-c4a3-44a5-b652-e5157596ad6a tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vVhqXeRl'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:49:46 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da0ad9b0-5863-4ebf-b7b5-ca2f5027edf1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:46 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da0ad9b0-5863-4ebf-b7b5-ca2f5027edf1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:49:46 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[937b8ecc-e9b4-490f-9220-336e536a1cec]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:49:46 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-501b0cae-c4a3-44a5-b652-e5157596ad6a tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:49:46 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:46 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:49:46 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[a833965c-6cc8-41bd-8117-e9f9d3c04a7e]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:49:46 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-501b0cae-c4a3-44a5-b652-e5157596ad6a tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774 (non-flash)
Nov 14 23:49:46 user nova-compute[75341]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)
Nov 14 23:49:46 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:49:46 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-501b0cae-c4a3-44a5-b652-e5157596ad6a tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774 (non-flash)
Nov 14 23:49:46 user nova-compute[75341]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)
Nov 14 23:49:46 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:49:46 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da0ad9b0-5863-4ebf-b7b5-ca2f5027edf1 -p 172.16.0.220:3260 --login {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da0ad9b0-5863-4ebf-b7b5-ca2f5027edf1 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:49:47 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c50b0b-1f1e-4f1a-aa15-db2beb2458ab]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:da0ad9b0-5863-4ebf-b7b5-ca2f5027edf1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:da0ad9b0-5863-4ebf-b7b5-ca2f5027edf1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:49:47 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-501b0cae-c4a3-44a5-b652-e5157596ad6a tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:da0ad9b0-5863-4ebf-b7b5-ca2f5027edf1, portal: 172.16.0.220,3260]
Nov 14 23:49:47 user nova-compute[75341]: Login to [iface: default, target: iqn.2010-10.org.openstack:da0ad9b0-5863-4ebf-b7b5-ca2f5027edf1, portal: 172.16.0.220,3260] successful.
Nov 14 23:49:47 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:49:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da0ad9b0-5863-4ebf-b7b5-ca2f5027edf1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da0ad9b0-5863-4ebf-b7b5-ca2f5027edf1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:49:47 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[b167f414-159c-4714-b3a2-b66e344b783b]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:49:47 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-501b0cae-c4a3-44a5-b652-e5157596ad6a tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:49:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:49:47 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec8f97e-280e-41ff-a763-874283db5d63]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da0ad9b0-5863-4ebf-b7b5-ca2f5027edf1 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:49:47 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-501b0cae-c4a3-44a5-b652-e5157596ad6a tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774 (non-flash)
Nov 14 23:49:47 user nova-compute[75341]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)
Nov 14 23:49:47 user nova-compute[75341]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da0ad9b0-5863-4ebf-b7b5-ca2f5027edf1 (non-flash)
Nov 14 23:49:47 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:49:47 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-501b0cae-c4a3-44a5-b652-e5157596ad6a tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774 (non-flash)
Nov 14 23:49:47 user nova-compute[75341]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)
Nov 14 23:49:47 user nova-compute[75341]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da0ad9b0-5863-4ebf-b7b5-ca2f5027edf1 (non-flash)
Nov 14 23:49:47 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:49:47 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-501b0cae-c4a3-44a5-b652-e5157596ad6a tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da0ad9b0-5863-4ebf-b7b5-ca2f5027edf1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:49:47 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-501b0cae-c4a3-44a5-b652-e5157596ad6a tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Connected to 172.16.0.220:3260 {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 23:49:47 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-501b0cae-c4a3-44a5-b652-e5157596ad6a tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] HCTL ('34', '-', '-', 0) found on session 32 with lun 0 {{(pid=75341) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 23:49:47 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-501b0cae-c4a3-44a5-b652-e5157596ad6a tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75341) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 23:49:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:49:47 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfab4d8c-ca4b-4965-b22d-45068d25435d]: (4, ('- - 0', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:49:47 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-501b0cae-c4a3-44a5-b652-e5157596ad6a tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Searching for a device in session 32 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 23:49:47 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-501b0cae-c4a3-44a5-b652-e5157596ad6a tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:da0ad9b0-5863-4ebf-b7b5-ca2f5027edf1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vVhqXeRl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 23:49:47 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:48 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-501b0cae-c4a3-44a5-b652-e5157596ad6a tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:49:48 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-501b0cae-c4a3-44a5-b652-e5157596ad6a tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23337356438623132', 'path': '/dev/sdc'} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:49:48 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-501b0cae-c4a3-44a5-b652-e5157596ad6a tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337356438623132', 'path': '/dev/sdc'} {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 23:49:48 user nova-compute[75341]: DEBUG nova.objects.instance [None req-501b0cae-c4a3-44a5-b652-e5157596ad6a tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lazy-loading 'flavor' on Instance uuid f8e73e44-9d2e-4b15-836c-738398adc685 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:49:48 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-501b0cae-c4a3-44a5-b652-e5157596ad6a tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 23:49:48 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:49:48 user nova-compute[75341]:   <source dev="/dev/sdc"/>
Nov 14 23:49:48 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:49:48 user nova-compute[75341]:   <serial>da0ad9b0-5863-4ebf-b7b5-ca2f5027edf1</serial>
Nov 14 23:49:48 user nova-compute[75341]: </disk>
Nov 14 23:49:48 user nova-compute[75341]:  {{(pid=75341) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 23:49:48 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-501b0cae-c4a3-44a5-b652-e5157596ad6a tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:49:48 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-501b0cae-c4a3-44a5-b652-e5157596ad6a tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:49:48 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-501b0cae-c4a3-44a5-b652-e5157596ad6a tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] No VIF found with MAC fa:16:3e:56:69:7a, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:49:48 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:49:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-501b0cae-c4a3-44a5-b652-e5157596ad6a tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lock "f8e73e44-9d2e-4b15-836c-738398adc685" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.770s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:49:50 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:49:50 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:49:50 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75341) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 23:49:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:51 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:49:51 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:49:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:52 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:49:52 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Starting heal instance info cache {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 23:49:52 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Didn't find any instances for network info cache update. {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 23:49:52 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:49:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:49:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:49:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:49:52 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75341) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 23:49:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8e73e44-9d2e-4b15-836c-738398adc685/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8e73e44-9d2e-4b15-836c-738398adc685/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:49:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8e73e44-9d2e-4b15-836c-738398adc685/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8e73e44-9d2e-4b15-836c-738398adc685/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:49:53 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 23:49:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/223825d6-841d-4169-9c9b-f0ddf50b4d94/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/223825d6-841d-4169-9c9b-f0ddf50b4d94/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:49:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/223825d6-841d-4169-9c9b-f0ddf50b4d94/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/223825d6-841d-4169-9c9b-f0ddf50b4d94/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:49:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5070fb03-8f40-426c-8c3e-192f6517f7c3/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5070fb03-8f40-426c-8c3e-192f6517f7c3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:49:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5070fb03-8f40-426c-8c3e-192f6517f7c3/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5070fb03-8f40-426c-8c3e-192f6517f7c3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:49:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a141d7ee-3f77-4fdc-85ec-2cbd5af17646/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a141d7ee-3f77-4fdc-85ec-2cbd5af17646/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:49:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a141d7ee-3f77-4fdc-85ec-2cbd5af17646/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a141d7ee-3f77-4fdc-85ec-2cbd5af17646/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:49:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d92ba9df-c739-414d-a701-ddba04563427/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d92ba9df-c739-414d-a701-ddba04563427/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:49:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d92ba9df-c739-414d-a701-ddba04563427/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d92ba9df-c739-414d-a701-ddba04563427/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:49:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk.rescue --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:49:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk.rescue --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:49:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:55 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-0e2ec74a-3e04-4d98-a70a-d22a8672a6d9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d92ba9df-c739-414d-a701-ddba04563427 is timed out.
Nov 14 23:49:55 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-0e2ec74a-3e04-4d98-a70a-d22a8672a6d9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Successfully detached device vdb from instance d92ba9df-c739-414d-a701-ddba04563427 from the live domain config.
Nov 14 23:49:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e2ec74a-3e04-4d98-a70a-d22a8672a6d9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d92ba9df-c739-414d-a701-ddba04563427] calling os-brick to detach iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 23:49:55 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2ec74a-3e04-4d98-a70a-d22a8672a6d9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, {'target_iqn': 'iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SMizbvOp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:49:55 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-0e2ec74a-3e04-4d98-a70a-d22a8672a6d9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:49:55 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-0e2ec74a-3e04-4d98-a70a-d22a8672a6d9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:49:55 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-0e2ec74a-3e04-4d98-a70a-d22a8672a6d9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:49:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:49:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:49:55 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe01503-10e4-455e-875f-53db58a60667]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:da0ad9b0-5863-4ebf-b7b5-ca2f5027edf1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:49:55 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2ec74a-3e04-4d98-a70a-d22a8672a6d9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 23:49:55 user nova-compute[75341]: No targets found.
Nov 14 23:49:55 user nova-compute[75341]: iSNS:
Nov 14 23:49:55 user nova-compute[75341]: No targets found.
Nov 14 23:49:55 user nova-compute[75341]: STATIC:
Nov 14 23:49:55 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9
Nov 14 23:49:55 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:49:55 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:49:55 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:da0ad9b0-5863-4ebf-b7b5-ca2f5027edf1
Nov 14 23:49:55 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:49:55 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:49:55 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774
Nov 14 23:49:55 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:49:55 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:49:55 user nova-compute[75341]: FIRMWARE:
Nov 14 23:49:55 user nova-compute[75341]: No targets found.
Nov 14 23:49:55 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:49:55 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2ec74a-3e04-4d98-a70a-d22a8672a6d9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 23:49:55 user nova-compute[75341]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 23:49:55 user nova-compute[75341]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75341) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 23:49:55 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2ec74a-3e04-4d98-a70a-d22a8672a6d9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774', 0)] {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 23:49:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:49:55 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[950d9e60-2e60-4d4d-b2ad-7c50cc14bb07]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da0ad9b0-5863-4ebf-b7b5-ca2f5027edf1\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:49:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:49:55 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c7dcf0-31e2-4899-9711-4b96bc177c46]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da0ad9b0-5863-4ebf-b7b5-ca2f5027edf1 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:49:55 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2ec74a-3e04-4d98-a70a-d22a8672a6d9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774 (non-flash)
Nov 14 23:49:55 user nova-compute[75341]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)
Nov 14 23:49:55 user nova-compute[75341]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da0ad9b0-5863-4ebf-b7b5-ca2f5027edf1 (non-flash)
Nov 14 23:49:55 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:49:55 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2ec74a-3e04-4d98-a70a-d22a8672a6d9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774 (non-flash)
Nov 14 23:49:55 user nova-compute[75341]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)
Nov 14 23:49:55 user nova-compute[75341]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da0ad9b0-5863-4ebf-b7b5-ca2f5027edf1 (non-flash)
Nov 14 23:49:55 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:49:55 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2ec74a-3e04-4d98-a70a-d22a8672a6d9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18903f8700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774'): ({'sdb'}, set())}) {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 23:49:55 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-0e2ec74a-3e04-4d98-a70a-d22a8672a6d9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Removing single pathed devices sdb {{(pid=75341) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 23:49:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:49:55 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[07fd07f7-2de4-4317-af9a-c263306b3046]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:49:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:49:55 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba587832-be34-4043-9a71-514ac2755d79]: (4, ('ok\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:49:55 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-0e2ec74a-3e04-4d98-a70a-d22a8672a6d9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Flushing IO for device /dev/sdb {{(pid=75341) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 23:49:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:49:55 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[29fc686a-9457-4d98-92b6-1d8758a37b56]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:49:55 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-0e2ec74a-3e04-4d98-a70a-d22a8672a6d9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75341) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 23:49:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:49:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk.rescue --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:49:55 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[e359ed8d-a662-4892-b289-92e52e4331a1]: (4, ('1', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:49:55 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-0e2ec74a-3e04-4d98-a70a-d22a8672a6d9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 23:49:55 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-0e2ec74a-3e04-4d98-a70a-d22a8672a6d9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] SCSI volumes sdb have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 23:49:55 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2ec74a-3e04-4d98-a70a-d22a8672a6d9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774')] {{(pid=75341) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 23:49:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:49:55 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[5017b646-4ce9-495c-b907-607a3951471d]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:49:55 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2ec74a-3e04-4d98-a70a-d22a8672a6d9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:49:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774 -p 172.16.0.220:3260 --logout {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:49:55 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f2e197-5ffc-4be2-866b-475a3eac7495]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:49:55 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2ec74a-3e04-4d98-a70a-d22a8672a6d9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774, portal: 172.16.0.220,3260]
Nov 14 23:49:55 user nova-compute[75341]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774, portal: 172.16.0.220,3260] successful.
Nov 14 23:49:55 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:49:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774 -p 172.16.0.220:3260 --op delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:346c1ba7-daae-453a-ae47-97d5556b6774 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:49:55 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf64a53f-c3da-4e6d-9a07-0e4757b6c431]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:49:55 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2ec74a-3e04-4d98-a70a-d22a8672a6d9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:49:55 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-0e2ec74a-3e04-4d98-a70a-d22a8672a6d9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:49:55 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2ec74a-3e04-4d98-a70a-d22a8672a6d9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] <== disconnect_volume: return (353ms) None {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:49:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e2ec74a-3e04-4d98-a70a-d22a8672a6d9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d92ba9df-c739-414d-a701-ddba04563427] Disconnected iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 23:49:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:49:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk.rescue --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:49:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:49:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:49:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:49:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:56 user nova-compute[75341]: DEBUG nova.objects.instance [None req-0e2ec74a-3e04-4d98-a70a-d22a8672a6d9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lazy-loading 'flavor' on Instance uuid d92ba9df-c739-414d-a701-ddba04563427 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:49:56 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0e2ec74a-3e04-4d98-a70a-d22a8672a6d9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "d92ba9df-c739-414d-a701-ddba04563427" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.876s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:49:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:49:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:49:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:49:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01b30e67-ac52-4cf6-9a31-30096f8b3344/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01b30e67-ac52-4cf6-9a31-30096f8b3344/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:49:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01b30e67-ac52-4cf6-9a31-30096f8b3344/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:49:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01b30e67-ac52-4cf6-9a31-30096f8b3344/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:49:57 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 23:49:58 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:49:58 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:49:58 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:49:58 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Hypervisor/Node resource view: name=user free_ram=7091MB free_disk=25.30176544189453GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75341) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 23:49:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:49:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:49:58 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance a141d7ee-3f77-4fdc-85ec-2cbd5af17646 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:49:58 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 51045050-c7c6-49c5-acd4-2a76be0f466f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:49:58 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 6382e432-838f-4d89-a743-cbaa37f50ab5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:49:58 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance d92ba9df-c739-414d-a701-ddba04563427 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:49:58 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 5070fb03-8f40-426c-8c3e-192f6517f7c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:49:58 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance defae731-4191-4526-99cc-a301cf5b3355 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:49:58 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance f8e73e44-9d2e-4b15-836c-738398adc685 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:49:58 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 9996fc26-f3ad-40e2-91a5-51178c0194ef actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:49:58 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 223825d6-841d-4169-9c9b-f0ddf50b4d94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:49:58 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 01b30e67-ac52-4cf6-9a31-30096f8b3344 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:49:58 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 2316aa9e-d4c9-43d0-9918-86265583aed1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:49:58 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 23:49:58 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 23:49:58 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:49:58 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:49:58 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Compute_service record updated for user:user {{(pid=75341) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 23:49:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.488s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:50:00 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:50:00 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:50:00 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:50:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:03 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-18f4deb4-bbdb-4535-845b-91aca3d4cf82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Acquiring lock "f8e73e44-9d2e-4b15-836c-738398adc685" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:50:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-18f4deb4-bbdb-4535-845b-91aca3d4cf82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lock "f8e73e44-9d2e-4b15-836c-738398adc685" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:50:03 user nova-compute[75341]: INFO nova.compute.manager [None req-18f4deb4-bbdb-4535-845b-91aca3d4cf82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Detaching volume da0ad9b0-5863-4ebf-b7b5-ca2f5027edf1
Nov 14 23:50:03 user nova-compute[75341]: INFO nova.virt.block_device [None req-18f4deb4-bbdb-4535-845b-91aca3d4cf82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Attempting to driver detach volume da0ad9b0-5863-4ebf-b7b5-ca2f5027edf1 from mountpoint /dev/vdb
Nov 14 23:50:03 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-18f4deb4-bbdb-4535-845b-91aca3d4cf82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Attempting to detach device vdb from instance f8e73e44-9d2e-4b15-836c-738398adc685 from the persistent domain config. {{(pid=75341) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 23:50:03 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-18f4deb4-bbdb-4535-845b-91aca3d4cf82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 23:50:03 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:50:03 user nova-compute[75341]:   <source dev="/dev/sdc"/>
Nov 14 23:50:03 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:50:03 user nova-compute[75341]:   <serial>da0ad9b0-5863-4ebf-b7b5-ca2f5027edf1</serial>
Nov 14 23:50:03 user nova-compute[75341]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 23:50:03 user nova-compute[75341]: </disk>
Nov 14 23:50:03 user nova-compute[75341]:  {{(pid=75341) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 23:50:03 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-18f4deb4-bbdb-4535-845b-91aca3d4cf82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Successfully detached device vdb from instance f8e73e44-9d2e-4b15-836c-738398adc685 from the persistent domain config.
Nov 14 23:50:03 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-18f4deb4-bbdb-4535-845b-91aca3d4cf82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f8e73e44-9d2e-4b15-836c-738398adc685 from the live domain config. {{(pid=75341) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 23:50:03 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-18f4deb4-bbdb-4535-845b-91aca3d4cf82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 23:50:03 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:50:03 user nova-compute[75341]:   <source dev="/dev/sdc"/>
Nov 14 23:50:03 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:50:03 user nova-compute[75341]:   <serial>da0ad9b0-5863-4ebf-b7b5-ca2f5027edf1</serial>
Nov 14 23:50:03 user nova-compute[75341]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 23:50:03 user nova-compute[75341]: </disk>
Nov 14 23:50:03 user nova-compute[75341]:  {{(pid=75341) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 23:50:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0453633c-48a3-45cf-83e5-0fdc4378a19c tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Acquiring lock "f8e73e44-9d2e-4b15-836c-738398adc685" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:50:03 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-18f4deb4-bbdb-4535-845b-91aca3d4cf82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f8e73e44-9d2e-4b15-836c-738398adc685 {{(pid=75341) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 23:50:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:08 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:50:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 23:50:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 23:50:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 23:50:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:15 user nova-compute[75341]: DEBUG nova.compute.manager [req-747bf2ae-cdc9-4ede-99a8-73e08c2ef068 req-bf277814-9c49-4664-b0d8-6643f17345e2 service nova] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] Received event network-changed-1bb06e1a-0451-48ae-b964-93c0cce50a0a {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:50:15 user nova-compute[75341]: DEBUG nova.compute.manager [req-747bf2ae-cdc9-4ede-99a8-73e08c2ef068 req-bf277814-9c49-4664-b0d8-6643f17345e2 service nova] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] Refreshing instance network info cache due to event network-changed-1bb06e1a-0451-48ae-b964-93c0cce50a0a. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:50:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-747bf2ae-cdc9-4ede-99a8-73e08c2ef068 req-bf277814-9c49-4664-b0d8-6643f17345e2 service nova] Acquiring lock "refresh_cache-9996fc26-f3ad-40e2-91a5-51178c0194ef" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:50:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-747bf2ae-cdc9-4ede-99a8-73e08c2ef068 req-bf277814-9c49-4664-b0d8-6643f17345e2 service nova] Acquired lock "refresh_cache-9996fc26-f3ad-40e2-91a5-51178c0194ef" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:50:15 user nova-compute[75341]: DEBUG nova.network.neutron [req-747bf2ae-cdc9-4ede-99a8-73e08c2ef068 req-bf277814-9c49-4664-b0d8-6643f17345e2 service nova] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] Refreshing network info cache for port 1bb06e1a-0451-48ae-b964-93c0cce50a0a {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:50:15 user nova-compute[75341]: DEBUG nova.network.neutron [req-747bf2ae-cdc9-4ede-99a8-73e08c2ef068 req-bf277814-9c49-4664-b0d8-6643f17345e2 service nova] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] Updated VIF entry in instance network info cache for port 1bb06e1a-0451-48ae-b964-93c0cce50a0a. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:50:15 user nova-compute[75341]: DEBUG nova.network.neutron [req-747bf2ae-cdc9-4ede-99a8-73e08c2ef068 req-bf277814-9c49-4664-b0d8-6643f17345e2 service nova] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] Updating instance_info_cache with network_info: [{"id": "1bb06e1a-0451-48ae-b964-93c0cce50a0a", "address": "fa:16:3e:15:5d:17", "network": {"id": "227eb779-a064-477d-8447-45862017ae7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-3827253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96674073965642f1af11221b4add8a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb06e1a-04", "ovs_interfaceid": "1bb06e1a-0451-48ae-b964-93c0cce50a0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:50:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-747bf2ae-cdc9-4ede-99a8-73e08c2ef068 req-bf277814-9c49-4664-b0d8-6643f17345e2 service nova] Releasing lock "refresh_cache-9996fc26-f3ad-40e2-91a5-51178c0194ef" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:50:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1e0bee2e-b282-4cda-b92b-5001486f6623 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] Acquiring lock "223825d6-841d-4169-9c9b-f0ddf50b4d94" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:50:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1e0bee2e-b282-4cda-b92b-5001486f6623 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] Lock "223825d6-841d-4169-9c9b-f0ddf50b4d94" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:50:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1e0bee2e-b282-4cda-b92b-5001486f6623 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] Acquiring lock "223825d6-841d-4169-9c9b-f0ddf50b4d94-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:50:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1e0bee2e-b282-4cda-b92b-5001486f6623 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] Lock "223825d6-841d-4169-9c9b-f0ddf50b4d94-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:50:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1e0bee2e-b282-4cda-b92b-5001486f6623 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] Lock "223825d6-841d-4169-9c9b-f0ddf50b4d94-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:50:16 user nova-compute[75341]: INFO nova.compute.manager [None req-1e0bee2e-b282-4cda-b92b-5001486f6623 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] [instance: 223825d6-841d-4169-9c9b-f0ddf50b4d94] Terminating instance
Nov 14 23:50:16 user nova-compute[75341]: DEBUG nova.compute.manager [None req-1e0bee2e-b282-4cda-b92b-5001486f6623 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] [instance: 223825d6-841d-4169-9c9b-f0ddf50b4d94] Start destroying the instance on the hypervisor. {{(pid=75341) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 23:50:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:16 user nova-compute[75341]: DEBUG nova.compute.manager [req-e08d1616-7c50-42c7-9316-f2bdcd00afeb req-41e944fa-4da2-4115-acda-abcd0c3d529a service nova] [instance: 223825d6-841d-4169-9c9b-f0ddf50b4d94] Received event network-vif-unplugged-cd795c93-66a7-4861-8ce6-e7b4f5c17ae5 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:50:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-e08d1616-7c50-42c7-9316-f2bdcd00afeb req-41e944fa-4da2-4115-acda-abcd0c3d529a service nova] Acquiring lock "223825d6-841d-4169-9c9b-f0ddf50b4d94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:50:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-e08d1616-7c50-42c7-9316-f2bdcd00afeb req-41e944fa-4da2-4115-acda-abcd0c3d529a service nova] Lock "223825d6-841d-4169-9c9b-f0ddf50b4d94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:50:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-e08d1616-7c50-42c7-9316-f2bdcd00afeb req-41e944fa-4da2-4115-acda-abcd0c3d529a service nova] Lock "223825d6-841d-4169-9c9b-f0ddf50b4d94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:50:16 user nova-compute[75341]: DEBUG nova.compute.manager [req-e08d1616-7c50-42c7-9316-f2bdcd00afeb req-41e944fa-4da2-4115-acda-abcd0c3d529a service nova] [instance: 223825d6-841d-4169-9c9b-f0ddf50b4d94] No waiting events found dispatching network-vif-unplugged-cd795c93-66a7-4861-8ce6-e7b4f5c17ae5 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:50:16 user nova-compute[75341]: DEBUG nova.compute.manager [req-e08d1616-7c50-42c7-9316-f2bdcd00afeb req-41e944fa-4da2-4115-acda-abcd0c3d529a service nova] [instance: 223825d6-841d-4169-9c9b-f0ddf50b4d94] Received event network-vif-unplugged-cd795c93-66a7-4861-8ce6-e7b4f5c17ae5 for instance with task_state deleting. {{(pid=75341) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 23:50:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:16 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 223825d6-841d-4169-9c9b-f0ddf50b4d94] Instance destroyed successfully.
Nov 14 23:50:16 user nova-compute[75341]: DEBUG nova.objects.instance [None req-1e0bee2e-b282-4cda-b92b-5001486f6623 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] Lazy-loading 'resources' on Instance uuid 223825d6-841d-4169-9c9b-f0ddf50b4d94 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:50:17 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-1e0bee2e-b282-4cda-b92b-5001486f6623 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:48:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1286313774',display_name='tempest-VolumesNegativeTest-instance-1286313774',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1286313774',id=30,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:48:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f387630e6a954bb180ebe9b0ea2b42a3',ramdisk_id='',reservation_id='r-dcmns2hh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-806213437',owner_user_name='tempest-VolumesNegativeTest-806213437-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:48:33Z,user_data=None,user_id='9ee88737d6ae4ea5b6e086040b10ef5a',uuid=223825d6-841d-4169-9c9b-f0ddf50b4d94,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cd795c93-66a7-4861-8ce6-e7b4f5c17ae5", "address": "fa:16:3e:8c:e6:55", "network": {"id": "e7850045-e26c-4fff-a226-6118b062a26e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "81b1e55661954a999e9fc78dcda9950b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd795c93-66", "ovs_interfaceid": "cd795c93-66a7-4861-8ce6-e7b4f5c17ae5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 23:50:17 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-1e0bee2e-b282-4cda-b92b-5001486f6623 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] Converting VIF {"id": "cd795c93-66a7-4861-8ce6-e7b4f5c17ae5", "address": "fa:16:3e:8c:e6:55", "network": {"id": "e7850045-e26c-4fff-a226-6118b062a26e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "81b1e55661954a999e9fc78dcda9950b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd795c93-66", "ovs_interfaceid": "cd795c93-66a7-4861-8ce6-e7b4f5c17ae5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:50:17 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-1e0bee2e-b282-4cda-b92b-5001486f6623 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:e6:55,bridge_name='br-int',has_traffic_filtering=True,id=cd795c93-66a7-4861-8ce6-e7b4f5c17ae5,network=Network(e7850045-e26c-4fff-a226-6118b062a26e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd795c93-66') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:50:17 user nova-compute[75341]: DEBUG os_vif [None req-1e0bee2e-b282-4cda-b92b-5001486f6623 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:e6:55,bridge_name='br-int',has_traffic_filtering=True,id=cd795c93-66a7-4861-8ce6-e7b4f5c17ae5,network=Network(e7850045-e26c-4fff-a226-6118b062a26e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd795c93-66') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 23:50:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcd795c93-66, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:50:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dbba15c1-9cc0-4cef-a7c5-e8b7043d487c) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:50:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:17 user nova-compute[75341]: INFO os_vif [None req-1e0bee2e-b282-4cda-b92b-5001486f6623 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:e6:55,bridge_name='br-int',has_traffic_filtering=True,id=cd795c93-66a7-4861-8ce6-e7b4f5c17ae5,network=Network(e7850045-e26c-4fff-a226-6118b062a26e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd795c93-66')
Nov 14 23:50:17 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-1e0bee2e-b282-4cda-b92b-5001486f6623 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] [instance: 223825d6-841d-4169-9c9b-f0ddf50b4d94] Deleting instance files /opt/stack/data/nova/instances/223825d6-841d-4169-9c9b-f0ddf50b4d94_del
Nov 14 23:50:17 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-1e0bee2e-b282-4cda-b92b-5001486f6623 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] [instance: 223825d6-841d-4169-9c9b-f0ddf50b4d94] Deletion of /opt/stack/data/nova/instances/223825d6-841d-4169-9c9b-f0ddf50b4d94_del complete
Nov 14 23:50:17 user nova-compute[75341]: INFO nova.compute.manager [None req-1e0bee2e-b282-4cda-b92b-5001486f6623 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] [instance: 223825d6-841d-4169-9c9b-f0ddf50b4d94] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 14 23:50:17 user nova-compute[75341]: DEBUG oslo.service.loopingcall [None req-1e0bee2e-b282-4cda-b92b-5001486f6623 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75341) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 23:50:17 user nova-compute[75341]: DEBUG nova.compute.manager [-] [instance: 223825d6-841d-4169-9c9b-f0ddf50b4d94] Deallocating network for instance {{(pid=75341) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 23:50:17 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: 223825d6-841d-4169-9c9b-f0ddf50b4d94] deallocate_for_instance() {{(pid=75341) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 23:50:18 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: 223825d6-841d-4169-9c9b-f0ddf50b4d94] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:50:18 user nova-compute[75341]: INFO nova.compute.manager [-] [instance: 223825d6-841d-4169-9c9b-f0ddf50b4d94] Took 0.99 seconds to deallocate network for instance.
Nov 14 23:50:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1e0bee2e-b282-4cda-b92b-5001486f6623 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:50:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1e0bee2e-b282-4cda-b92b-5001486f6623 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:50:18 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-1e0bee2e-b282-4cda-b92b-5001486f6623 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:50:18 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-1e0bee2e-b282-4cda-b92b-5001486f6623 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:50:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1e0bee2e-b282-4cda-b92b-5001486f6623 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.372s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:50:18 user nova-compute[75341]: INFO nova.scheduler.client.report [None req-1e0bee2e-b282-4cda-b92b-5001486f6623 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] Deleted allocations for instance 223825d6-841d-4169-9c9b-f0ddf50b4d94
Nov 14 23:50:18 user nova-compute[75341]: DEBUG nova.compute.manager [req-02eda197-b525-4f27-9de2-8682a6b3babd req-4a4e3474-4e29-4dd2-9bfa-550f2051497b service nova] [instance: 223825d6-841d-4169-9c9b-f0ddf50b4d94] Received event network-vif-plugged-cd795c93-66a7-4861-8ce6-e7b4f5c17ae5 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:50:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-02eda197-b525-4f27-9de2-8682a6b3babd req-4a4e3474-4e29-4dd2-9bfa-550f2051497b service nova] Acquiring lock "223825d6-841d-4169-9c9b-f0ddf50b4d94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:50:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-02eda197-b525-4f27-9de2-8682a6b3babd req-4a4e3474-4e29-4dd2-9bfa-550f2051497b service nova] Lock "223825d6-841d-4169-9c9b-f0ddf50b4d94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:50:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-02eda197-b525-4f27-9de2-8682a6b3babd req-4a4e3474-4e29-4dd2-9bfa-550f2051497b service nova] Lock "223825d6-841d-4169-9c9b-f0ddf50b4d94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:50:18 user nova-compute[75341]: DEBUG nova.compute.manager [req-02eda197-b525-4f27-9de2-8682a6b3babd req-4a4e3474-4e29-4dd2-9bfa-550f2051497b service nova] [instance: 223825d6-841d-4169-9c9b-f0ddf50b4d94] No waiting events found dispatching network-vif-plugged-cd795c93-66a7-4861-8ce6-e7b4f5c17ae5 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:50:18 user nova-compute[75341]: WARNING nova.compute.manager [req-02eda197-b525-4f27-9de2-8682a6b3babd req-4a4e3474-4e29-4dd2-9bfa-550f2051497b service nova] [instance: 223825d6-841d-4169-9c9b-f0ddf50b4d94] Received unexpected event network-vif-plugged-cd795c93-66a7-4861-8ce6-e7b4f5c17ae5 for instance with vm_state deleted and task_state None.
Nov 14 23:50:18 user nova-compute[75341]: DEBUG nova.compute.manager [req-02eda197-b525-4f27-9de2-8682a6b3babd req-4a4e3474-4e29-4dd2-9bfa-550f2051497b service nova] [instance: 223825d6-841d-4169-9c9b-f0ddf50b4d94] Received event network-vif-deleted-cd795c93-66a7-4861-8ce6-e7b4f5c17ae5 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:50:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1e0bee2e-b282-4cda-b92b-5001486f6623 tempest-VolumesNegativeTest-806213437 tempest-VolumesNegativeTest-806213437-project-member] Lock "223825d6-841d-4169-9c9b-f0ddf50b4d94" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.420s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:50:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Acquiring lock "713b9caa-4ca7-4d78-8252-e8419d72ece3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:50:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "713b9caa-4ca7-4d78-8252-e8419d72ece3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:50:21 user nova-compute[75341]: DEBUG nova.compute.manager [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] Starting instance... {{(pid=75341) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 23:50:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:50:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:50:21 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75341) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 23:50:21 user nova-compute[75341]: INFO nova.compute.claims [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] Claim successful on node user
Nov 14 23:50:21 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:21 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:50:21 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:50:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.424s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:50:21 user nova-compute[75341]: DEBUG nova.compute.manager [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] Start building networks asynchronously for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 23:50:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:22 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 23:50:22 user nova-compute[75341]: DEBUG nova.compute.manager [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] Allocating IP information in the background. {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 23:50:22 user nova-compute[75341]: DEBUG nova.network.neutron [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] allocate_for_instance() {{(pid=75341) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 23:50:22 user nova-compute[75341]: DEBUG nova.compute.manager [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] Start building block device mappings for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 23:50:22 user nova-compute[75341]: INFO nova.virt.block_device [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] Booting with volume snapshot 3730727e-5d95-4911-8303-7057e340b259 at /dev/vda
Nov 14 23:50:22 user nova-compute[75341]: DEBUG nova.policy [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b08f7ddf6c2f4fd596e214d6ca56c234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96674073965642f1af11221b4add8a6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75341) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 23:50:22 user nova-compute[75341]: DEBUG nova.network.neutron [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] Successfully created port: b80cf75e-07c5-438f-add6-83636ba0d977 {{(pid=75341) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 23:50:23 user nova-compute[75341]: DEBUG nova.network.neutron [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] Successfully updated port: b80cf75e-07c5-438f-add6-83636ba0d977 {{(pid=75341) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 23:50:23 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Acquiring lock "refresh_cache-713b9caa-4ca7-4d78-8252-e8419d72ece3" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:50:23 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Acquired lock "refresh_cache-713b9caa-4ca7-4d78-8252-e8419d72ece3" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:50:23 user nova-compute[75341]: DEBUG nova.network.neutron [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 23:50:23 user nova-compute[75341]: DEBUG nova.compute.manager [req-ce85e1de-ed28-4c4a-b344-32291399ca48 req-9e534cb9-5ef8-470b-94b8-d9bf2b151b78 service nova] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] Received event network-changed-b80cf75e-07c5-438f-add6-83636ba0d977 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:50:23 user nova-compute[75341]: DEBUG nova.compute.manager [req-ce85e1de-ed28-4c4a-b344-32291399ca48 req-9e534cb9-5ef8-470b-94b8-d9bf2b151b78 service nova] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] Refreshing instance network info cache due to event network-changed-b80cf75e-07c5-438f-add6-83636ba0d977. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:50:23 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ce85e1de-ed28-4c4a-b344-32291399ca48 req-9e534cb9-5ef8-470b-94b8-d9bf2b151b78 service nova] Acquiring lock "refresh_cache-713b9caa-4ca7-4d78-8252-e8419d72ece3" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:50:23 user nova-compute[75341]: DEBUG nova.network.neutron [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] Instance cache missing network info. {{(pid=75341) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 23:50:23 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-18f4deb4-bbdb-4535-845b-91aca3d4cf82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f8e73e44-9d2e-4b15-836c-738398adc685 is timed out.
Nov 14 23:50:23 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-18f4deb4-bbdb-4535-845b-91aca3d4cf82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Successfully detached device vdb from instance f8e73e44-9d2e-4b15-836c-738398adc685 from the live domain config.
Nov 14 23:50:23 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18f4deb4-bbdb-4535-845b-91aca3d4cf82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] calling os-brick to detach iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 23:50:23 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18f4deb4-bbdb-4535-845b-91aca3d4cf82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, {'target_iqn': 'iqn.2010-10.org.openstack:da0ad9b0-5863-4ebf-b7b5-ca2f5027edf1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vVhqXeRl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:50:23 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-18f4deb4-bbdb-4535-845b-91aca3d4cf82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:50:23 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-18f4deb4-bbdb-4535-845b-91aca3d4cf82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:50:23 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-18f4deb4-bbdb-4535-845b-91aca3d4cf82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:50:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:50:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:50:23 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[2838f350-e6da-44c1-a4df-f14fe3c88d61]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:da0ad9b0-5863-4ebf-b7b5-ca2f5027edf1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:50:23 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18f4deb4-bbdb-4535-845b-91aca3d4cf82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 23:50:23 user nova-compute[75341]: No targets found.
Nov 14 23:50:23 user nova-compute[75341]: iSNS:
Nov 14 23:50:23 user nova-compute[75341]: No targets found.
Nov 14 23:50:23 user nova-compute[75341]: STATIC:
Nov 14 23:50:23 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9
Nov 14 23:50:23 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:50:23 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:50:23 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:da0ad9b0-5863-4ebf-b7b5-ca2f5027edf1
Nov 14 23:50:23 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:50:23 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:50:23 user nova-compute[75341]: FIRMWARE:
Nov 14 23:50:23 user nova-compute[75341]: No targets found.
Nov 14 23:50:23 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:50:23 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18f4deb4-bbdb-4535-845b-91aca3d4cf82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 23:50:23 user nova-compute[75341]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 23:50:23 user nova-compute[75341]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75341) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 23:50:23 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18f4deb4-bbdb-4535-845b-91aca3d4cf82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da0ad9b0-5863-4ebf-b7b5-ca2f5027edf1', 0)] {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 23:50:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:50:23 user nova-compute[75341]: DEBUG nova.network.neutron [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] Updating instance_info_cache with network_info: [{"id": "b80cf75e-07c5-438f-add6-83636ba0d977", "address": "fa:16:3e:69:c0:2e", "network": {"id": "227eb779-a064-477d-8447-45862017ae7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-3827253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96674073965642f1af11221b4add8a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb80cf75e-07", "ovs_interfaceid": "b80cf75e-07c5-438f-add6-83636ba0d977", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:50:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:50:23 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[16647ab3-2dfd-4086-9527-aa02ed1253a4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da0ad9b0-5863-4ebf-b7b5-ca2f5027edf1\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:50:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:50:23 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Releasing lock "refresh_cache-713b9caa-4ca7-4d78-8252-e8419d72ece3" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:50:23 user nova-compute[75341]: DEBUG nova.compute.manager [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] Instance network_info: |[{"id": "b80cf75e-07c5-438f-add6-83636ba0d977", "address": "fa:16:3e:69:c0:2e", "network": {"id": "227eb779-a064-477d-8447-45862017ae7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-3827253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96674073965642f1af11221b4add8a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb80cf75e-07", "ovs_interfaceid": "b80cf75e-07c5-438f-add6-83636ba0d977", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 23:50:23 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ce85e1de-ed28-4c4a-b344-32291399ca48 req-9e534cb9-5ef8-470b-94b8-d9bf2b151b78 service nova] Acquired lock "refresh_cache-713b9caa-4ca7-4d78-8252-e8419d72ece3" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:50:23 user nova-compute[75341]: DEBUG nova.network.neutron [req-ce85e1de-ed28-4c4a-b344-32291399ca48 req-9e534cb9-5ef8-470b-94b8-d9bf2b151b78 service nova] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] Refreshing network info cache for port b80cf75e-07c5-438f-add6-83636ba0d977 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:50:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:50:24 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78737aa-8238-4871-8a17-5992d111c1eb]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da0ad9b0-5863-4ebf-b7b5-ca2f5027edf1 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:50:24 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18f4deb4-bbdb-4535-845b-91aca3d4cf82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)
Nov 14 23:50:24 user nova-compute[75341]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da0ad9b0-5863-4ebf-b7b5-ca2f5027edf1 (non-flash)
Nov 14 23:50:24 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:50:24 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18f4deb4-bbdb-4535-845b-91aca3d4cf82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)
Nov 14 23:50:24 user nova-compute[75341]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da0ad9b0-5863-4ebf-b7b5-ca2f5027edf1 (non-flash)
Nov 14 23:50:24 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:50:24 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18f4deb4-bbdb-4535-845b-91aca3d4cf82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18505645e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da0ad9b0-5863-4ebf-b7b5-ca2f5027edf1'): ({'sdc'}, set())}) {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 23:50:24 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-18f4deb4-bbdb-4535-845b-91aca3d4cf82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Removing single pathed devices sdc {{(pid=75341) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 23:50:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:50:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:50:24 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[7483005b-dd08-4004-b87b-06970eb94a65]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:50:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:50:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:50:24 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c195c4b-bda7-43e6-affc-fecef99e4c96]: (4, ('ok\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:50:24 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-18f4deb4-bbdb-4535-845b-91aca3d4cf82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Flushing IO for device /dev/sdc {{(pid=75341) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 23:50:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:50:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:50:24 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5cd626-b721-4394-8bfc-25c38c521305]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:50:24 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-18f4deb4-bbdb-4535-845b-91aca3d4cf82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75341) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 23:50:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:50:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:50:24 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[844326e3-914d-4acb-8ee4-dfe1bffc5c3e]: (4, ('1', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:50:24 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-18f4deb4-bbdb-4535-845b-91aca3d4cf82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 23:50:24 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-18f4deb4-bbdb-4535-845b-91aca3d4cf82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] SCSI volumes sdc have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 23:50:24 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18f4deb4-bbdb-4535-845b-91aca3d4cf82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da0ad9b0-5863-4ebf-b7b5-ca2f5027edf1')] {{(pid=75341) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 23:50:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da0ad9b0-5863-4ebf-b7b5-ca2f5027edf1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:50:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da0ad9b0-5863-4ebf-b7b5-ca2f5027edf1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:50:24 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[9723bb8f-5650-4fe2-b110-b1aa4b3ba12e]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:50:24 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18f4deb4-bbdb-4535-845b-91aca3d4cf82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:50:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da0ad9b0-5863-4ebf-b7b5-ca2f5027edf1 -p 172.16.0.220:3260 --logout {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:50:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da0ad9b0-5863-4ebf-b7b5-ca2f5027edf1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:50:24 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8ec619-858f-4391-a317-6b418cfa0bbe]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:da0ad9b0-5863-4ebf-b7b5-ca2f5027edf1, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:da0ad9b0-5863-4ebf-b7b5-ca2f5027edf1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:50:24 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18f4deb4-bbdb-4535-845b-91aca3d4cf82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:da0ad9b0-5863-4ebf-b7b5-ca2f5027edf1, portal: 172.16.0.220,3260]
Nov 14 23:50:24 user nova-compute[75341]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:da0ad9b0-5863-4ebf-b7b5-ca2f5027edf1, portal: 172.16.0.220,3260] successful.
Nov 14 23:50:24 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:50:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da0ad9b0-5863-4ebf-b7b5-ca2f5027edf1 -p 172.16.0.220:3260 --op delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:50:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da0ad9b0-5863-4ebf-b7b5-ca2f5027edf1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:50:24 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d569756-ac83-419d-8f4b-e4a5136c7d83]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:50:24 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18f4deb4-bbdb-4535-845b-91aca3d4cf82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:50:24 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-18f4deb4-bbdb-4535-845b-91aca3d4cf82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:50:24 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18f4deb4-bbdb-4535-845b-91aca3d4cf82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] <== disconnect_volume: return (289ms) None {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:50:24 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18f4deb4-bbdb-4535-845b-91aca3d4cf82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Disconnected iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 23:50:24 user nova-compute[75341]: DEBUG nova.network.neutron [req-ce85e1de-ed28-4c4a-b344-32291399ca48 req-9e534cb9-5ef8-470b-94b8-d9bf2b151b78 service nova] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] Updated VIF entry in instance network info cache for port b80cf75e-07c5-438f-add6-83636ba0d977. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:50:24 user nova-compute[75341]: DEBUG nova.network.neutron [req-ce85e1de-ed28-4c4a-b344-32291399ca48 req-9e534cb9-5ef8-470b-94b8-d9bf2b151b78 service nova] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] Updating instance_info_cache with network_info: [{"id": "b80cf75e-07c5-438f-add6-83636ba0d977", "address": "fa:16:3e:69:c0:2e", "network": {"id": "227eb779-a064-477d-8447-45862017ae7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-3827253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96674073965642f1af11221b4add8a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb80cf75e-07", "ovs_interfaceid": "b80cf75e-07c5-438f-add6-83636ba0d977", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:50:24 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ce85e1de-ed28-4c4a-b344-32291399ca48 req-9e534cb9-5ef8-470b-94b8-d9bf2b151b78 service nova] Releasing lock "refresh_cache-713b9caa-4ca7-4d78-8252-e8419d72ece3" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:50:24 user nova-compute[75341]: DEBUG nova.objects.instance [None req-18f4deb4-bbdb-4535-845b-91aca3d4cf82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lazy-loading 'flavor' on Instance uuid f8e73e44-9d2e-4b15-836c-738398adc685 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:50:24 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-18f4deb4-bbdb-4535-845b-91aca3d4cf82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lock "f8e73e44-9d2e-4b15-836c-738398adc685" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.564s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:50:24 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0453633c-48a3-45cf-83e5-0fdc4378a19c tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lock "f8e73e44-9d2e-4b15-836c-738398adc685" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.458s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:50:24 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0453633c-48a3-45cf-83e5-0fdc4378a19c tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Acquiring lock "f8e73e44-9d2e-4b15-836c-738398adc685-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:50:24 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0453633c-48a3-45cf-83e5-0fdc4378a19c tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lock "f8e73e44-9d2e-4b15-836c-738398adc685-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:50:24 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0453633c-48a3-45cf-83e5-0fdc4378a19c tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lock "f8e73e44-9d2e-4b15-836c-738398adc685-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:50:24 user nova-compute[75341]: INFO nova.compute.manager [None req-0453633c-48a3-45cf-83e5-0fdc4378a19c tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Terminating instance
Nov 14 23:50:24 user nova-compute[75341]: DEBUG nova.compute.manager [None req-0453633c-48a3-45cf-83e5-0fdc4378a19c tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Start destroying the instance on the hypervisor. {{(pid=75341) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 23:50:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:25 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-de2107eb-ff16-48f9-bba6-9318043f323d tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Acquiring lock "d92ba9df-c739-414d-a701-ddba04563427" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:50:25 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-de2107eb-ff16-48f9-bba6-9318043f323d tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "d92ba9df-c739-414d-a701-ddba04563427" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:50:25 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-de2107eb-ff16-48f9-bba6-9318043f323d tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Acquiring lock "d92ba9df-c739-414d-a701-ddba04563427-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:50:25 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-de2107eb-ff16-48f9-bba6-9318043f323d tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "d92ba9df-c739-414d-a701-ddba04563427-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:50:25 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-de2107eb-ff16-48f9-bba6-9318043f323d tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "d92ba9df-c739-414d-a701-ddba04563427-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:50:25 user nova-compute[75341]: INFO nova.compute.manager [None req-de2107eb-ff16-48f9-bba6-9318043f323d tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d92ba9df-c739-414d-a701-ddba04563427] Terminating instance
Nov 14 23:50:25 user nova-compute[75341]: DEBUG nova.compute.manager [None req-de2107eb-ff16-48f9-bba6-9318043f323d tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d92ba9df-c739-414d-a701-ddba04563427] Start destroying the instance on the hypervisor. {{(pid=75341) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 23:50:25 user nova-compute[75341]: DEBUG nova.compute.manager [req-42f36e59-bcb0-4da7-9529-6112c35a2a85 req-01fc6d6a-8371-4226-9936-833e42d28440 service nova] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Received event network-vif-unplugged-beb17cbc-97e3-43ed-ba83-d364cec9b619 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:50:25 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-42f36e59-bcb0-4da7-9529-6112c35a2a85 req-01fc6d6a-8371-4226-9936-833e42d28440 service nova] Acquiring lock "f8e73e44-9d2e-4b15-836c-738398adc685-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:50:25 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-42f36e59-bcb0-4da7-9529-6112c35a2a85 req-01fc6d6a-8371-4226-9936-833e42d28440 service nova] Lock "f8e73e44-9d2e-4b15-836c-738398adc685-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:50:25 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-42f36e59-bcb0-4da7-9529-6112c35a2a85 req-01fc6d6a-8371-4226-9936-833e42d28440 service nova] Lock "f8e73e44-9d2e-4b15-836c-738398adc685-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:50:25 user nova-compute[75341]: DEBUG nova.compute.manager [req-42f36e59-bcb0-4da7-9529-6112c35a2a85 req-01fc6d6a-8371-4226-9936-833e42d28440 service nova] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] No waiting events found dispatching network-vif-unplugged-beb17cbc-97e3-43ed-ba83-d364cec9b619 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:50:25 user nova-compute[75341]: DEBUG nova.compute.manager [req-42f36e59-bcb0-4da7-9529-6112c35a2a85 req-01fc6d6a-8371-4226-9936-833e42d28440 service nova] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Received event network-vif-unplugged-beb17cbc-97e3-43ed-ba83-d364cec9b619 for instance with task_state deleting. {{(pid=75341) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 23:50:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:26 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:26 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:26 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:26 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Instance destroyed successfully.
Nov 14 23:50:26 user nova-compute[75341]: DEBUG nova.objects.instance [None req-0453633c-48a3-45cf-83e5-0fdc4378a19c tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lazy-loading 'resources' on Instance uuid f8e73e44-9d2e-4b15-836c-738398adc685 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:50:26 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: d92ba9df-c739-414d-a701-ddba04563427] Instance destroyed successfully.
Nov 14 23:50:26 user nova-compute[75341]: DEBUG nova.objects.instance [None req-de2107eb-ff16-48f9-bba6-9318043f323d tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lazy-loading 'resources' on Instance uuid d92ba9df-c739-414d-a701-ddba04563427 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:50:26 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:26 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-0453633c-48a3-45cf-83e5-0fdc4378a19c tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:47:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1377634340',display_name='tempest-VolumesSnapshotTestJSON-instance-1377634340',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1377634340',id=28,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPcoRmBlwrfNIh/bYaD1M0bqkJ7ZLGnc/U6vN0SXIbeIMK5uPuwQ1wlJtEWX6niXVGSbAMQ5E+v6JhU6G7Az5nOwiJp8slWFBKgYtVVIpdItzOBmIDmm0FG62oPIFhlYQ==',key_name='tempest-keypair-2084827374',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:47:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f694dc021a9442a49bbde9f367fbefc6',ramdisk_id='',reservation_id='r-fplvcwvt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1856831414',owner_user_name='tempest-VolumesSnapshotTestJSON-1856831414-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:47:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='526fe3083ac541b79d7dbfb9b5abaf7c',uuid=f8e73e44-9d2e-4b15-836c-738398adc685,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "beb17cbc-97e3-43ed-ba83-d364cec9b619", "address": "fa:16:3e:56:69:7a", "network": {"id": "a1cc71d9-4161-4044-ad08-02aa4a7aef1c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-73156846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f694dc021a9442a49bbde9f367fbefc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeb17cbc-97", "ovs_interfaceid": "beb17cbc-97e3-43ed-ba83-d364cec9b619", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 23:50:26 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-0453633c-48a3-45cf-83e5-0fdc4378a19c tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Converting VIF {"id": "beb17cbc-97e3-43ed-ba83-d364cec9b619", "address": "fa:16:3e:56:69:7a", "network": {"id": "a1cc71d9-4161-4044-ad08-02aa4a7aef1c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-73156846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f694dc021a9442a49bbde9f367fbefc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeb17cbc-97", "ovs_interfaceid": "beb17cbc-97e3-43ed-ba83-d364cec9b619", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:50:26 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-0453633c-48a3-45cf-83e5-0fdc4378a19c tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:56:69:7a,bridge_name='br-int',has_traffic_filtering=True,id=beb17cbc-97e3-43ed-ba83-d364cec9b619,network=Network(a1cc71d9-4161-4044-ad08-02aa4a7aef1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbeb17cbc-97') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:50:26 user nova-compute[75341]: DEBUG os_vif [None req-0453633c-48a3-45cf-83e5-0fdc4378a19c tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:69:7a,bridge_name='br-int',has_traffic_filtering=True,id=beb17cbc-97e3-43ed-ba83-d364cec9b619,network=Network(a1cc71d9-4161-4044-ad08-02aa4a7aef1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbeb17cbc-97') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 23:50:26 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:26 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbeb17cbc-97, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:50:26 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-de2107eb-ff16-48f9-bba6-9318043f323d tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:44:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1097690889',display_name='tempest-AttachVolumeNegativeTest-server-1097690889',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1097690889',id=19,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/+ymLiRQc0q1R+iJDn58zOn+lVhcGJlNDcnS9pKUI011JCvy6OoeB8hXhnmWcRKyNmxbD128fs9Twdc4hXLWgfOZO6Ubnrr3zL0hmUik0rrNEa4ehFeMt2nMglkXME3A==',key_name='tempest-keypair-119997497',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:44:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='542a85b3a6d14c77872f1957120ba655',ramdisk_id='',reservation_id='r-k4peuaea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-802469934',owner_user_name='tempest-AttachVolumeNegativeTest-802469934-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:44:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d0b6eae0d3124f70982781555ccc7ec0',uuid=d92ba9df-c739-414d-a701-ddba04563427,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5d23fcc8-0277-4900-b524-398ad1f6f27a", "address": "fa:16:3e:0d:0a:ad", "network": {"id": "9ad7204e-07f5-4676-b2de-09e036a92e61", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-718201239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542a85b3a6d14c77872f1957120ba655", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d23fcc8-02", "ovs_interfaceid": "5d23fcc8-0277-4900-b524-398ad1f6f27a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 23:50:26 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-de2107eb-ff16-48f9-bba6-9318043f323d tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Converting VIF {"id": "5d23fcc8-0277-4900-b524-398ad1f6f27a", "address": "fa:16:3e:0d:0a:ad", "network": {"id": "9ad7204e-07f5-4676-b2de-09e036a92e61", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-718201239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542a85b3a6d14c77872f1957120ba655", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d23fcc8-02", "ovs_interfaceid": "5d23fcc8-0277-4900-b524-398ad1f6f27a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:50:26 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-de2107eb-ff16-48f9-bba6-9318043f323d tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:0a:ad,bridge_name='br-int',has_traffic_filtering=True,id=5d23fcc8-0277-4900-b524-398ad1f6f27a,network=Network(9ad7204e-07f5-4676-b2de-09e036a92e61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d23fcc8-02') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:50:26 user nova-compute[75341]: DEBUG os_vif [None req-de2107eb-ff16-48f9-bba6-9318043f323d tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:0a:ad,bridge_name='br-int',has_traffic_filtering=True,id=5d23fcc8-0277-4900-b524-398ad1f6f27a,network=Network(9ad7204e-07f5-4676-b2de-09e036a92e61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d23fcc8-02') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 23:50:26 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:26 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:26 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5d23fcc8-02, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:50:26 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:50:26 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:26 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1a9cfe09-8953-441b-b178-a29112127c39) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:50:26 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:50:26 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:26 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cd9be1cf-a0b9-476c-a90f-70fb7c280d8f) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:50:26 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:26 user nova-compute[75341]: INFO os_vif [None req-0453633c-48a3-45cf-83e5-0fdc4378a19c tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:69:7a,bridge_name='br-int',has_traffic_filtering=True,id=beb17cbc-97e3-43ed-ba83-d364cec9b619,network=Network(a1cc71d9-4161-4044-ad08-02aa4a7aef1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbeb17cbc-97')
Nov 14 23:50:26 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:50:26 user nova-compute[75341]: INFO os_vif [None req-de2107eb-ff16-48f9-bba6-9318043f323d tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:0a:ad,bridge_name='br-int',has_traffic_filtering=True,id=5d23fcc8-0277-4900-b524-398ad1f6f27a,network=Network(9ad7204e-07f5-4676-b2de-09e036a92e61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d23fcc8-02')
Nov 14 23:50:26 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-de2107eb-ff16-48f9-bba6-9318043f323d tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d92ba9df-c739-414d-a701-ddba04563427] Deleting instance files /opt/stack/data/nova/instances/d92ba9df-c739-414d-a701-ddba04563427_del
Nov 14 23:50:26 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-de2107eb-ff16-48f9-bba6-9318043f323d tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d92ba9df-c739-414d-a701-ddba04563427] Deletion of /opt/stack/data/nova/instances/d92ba9df-c739-414d-a701-ddba04563427_del complete
Nov 14 23:50:26 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0453633c-48a3-45cf-83e5-0fdc4378a19c tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] calling os-brick to detach iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 23:50:26 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0453633c-48a3-45cf-83e5-0fdc4378a19c tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, {'target_iqn': 'iqn.2010-10.org.openstack:da0ad9b0-5863-4ebf-b7b5-ca2f5027edf1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vVhqXeRl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:50:26 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-0453633c-48a3-45cf-83e5-0fdc4378a19c tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:50:26 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-0453633c-48a3-45cf-83e5-0fdc4378a19c tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:50:26 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-0453633c-48a3-45cf-83e5-0fdc4378a19c tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:50:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:50:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:50:26 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1411196-d80c-4ecc-b355-71341b6cdaac]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:50:26 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0453633c-48a3-45cf-83e5-0fdc4378a19c tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 23:50:26 user nova-compute[75341]: No targets found.
Nov 14 23:50:26 user nova-compute[75341]: iSNS:
Nov 14 23:50:26 user nova-compute[75341]: No targets found.
Nov 14 23:50:26 user nova-compute[75341]: STATIC:
Nov 14 23:50:26 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9
Nov 14 23:50:26 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:50:26 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:50:26 user nova-compute[75341]: FIRMWARE:
Nov 14 23:50:26 user nova-compute[75341]: No targets found.
Nov 14 23:50:26 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:50:26 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0453633c-48a3-45cf-83e5-0fdc4378a19c tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 23:50:26 user nova-compute[75341]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 23:50:26 user nova-compute[75341]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75341) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 23:50:26 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0453633c-48a3-45cf-83e5-0fdc4378a19c tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da0ad9b0-5863-4ebf-b7b5-ca2f5027edf1', 0)] {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 23:50:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:50:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:50:26 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[10099104-87c2-4fa6-a5a1-08a610377747]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:50:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:50:26 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:50:26 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ecd1ad-5437-43ac-bf8e-085d98845315]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:50:26 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0453633c-48a3-45cf-83e5-0fdc4378a19c tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)
Nov 14 23:50:26 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:50:26 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0453633c-48a3-45cf-83e5-0fdc4378a19c tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)
Nov 14 23:50:26 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:50:26 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0453633c-48a3-45cf-83e5-0fdc4378a19c tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1850706440>, {}) {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 23:50:26 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0453633c-48a3-45cf-83e5-0fdc4378a19c tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Disconnecting from: [] {{(pid=75341) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 23:50:26 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-0453633c-48a3-45cf-83e5-0fdc4378a19c tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.107s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:50:26 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0453633c-48a3-45cf-83e5-0fdc4378a19c tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] <== disconnect_volume: return (108ms) None {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:50:26 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0453633c-48a3-45cf-83e5-0fdc4378a19c tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Disconnected iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 23:50:26 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-0453633c-48a3-45cf-83e5-0fdc4378a19c tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Deleting instance files /opt/stack/data/nova/instances/f8e73e44-9d2e-4b15-836c-738398adc685_del
Nov 14 23:50:26 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-0453633c-48a3-45cf-83e5-0fdc4378a19c tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Deletion of /opt/stack/data/nova/instances/f8e73e44-9d2e-4b15-836c-738398adc685_del complete
Nov 14 23:50:26 user nova-compute[75341]: INFO nova.compute.manager [None req-de2107eb-ff16-48f9-bba6-9318043f323d tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d92ba9df-c739-414d-a701-ddba04563427] Took 1.02 seconds to destroy the instance on the hypervisor.
Nov 14 23:50:26 user nova-compute[75341]: DEBUG oslo.service.loopingcall [None req-de2107eb-ff16-48f9-bba6-9318043f323d tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75341) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 23:50:26 user nova-compute[75341]: DEBUG nova.compute.manager [-] [instance: d92ba9df-c739-414d-a701-ddba04563427] Deallocating network for instance {{(pid=75341) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 23:50:26 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: d92ba9df-c739-414d-a701-ddba04563427] deallocate_for_instance() {{(pid=75341) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 23:50:26 user nova-compute[75341]: INFO nova.compute.manager [None req-0453633c-48a3-45cf-83e5-0fdc4378a19c tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Took 1.55 seconds to destroy the instance on the hypervisor.
Nov 14 23:50:26 user nova-compute[75341]: DEBUG oslo.service.loopingcall [None req-0453633c-48a3-45cf-83e5-0fdc4378a19c tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75341) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 23:50:26 user nova-compute[75341]: DEBUG nova.compute.manager [-] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Deallocating network for instance {{(pid=75341) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 23:50:26 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] deallocate_for_instance() {{(pid=75341) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 23:50:26 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:26 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:26 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:26 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:27 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:50:27 user nova-compute[75341]: INFO nova.compute.manager [-] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Took 0.75 seconds to deallocate network for instance.
Nov 14 23:50:27 user nova-compute[75341]: WARNING nova.volume.cinder [None req-0453633c-48a3-45cf-83e5-0fdc4378a19c tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Attachment 791e5007-2b75-43da-af35-0de3420436b0 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 791e5007-2b75-43da-af35-0de3420436b0. (HTTP 404) (Request-ID: req-4be1bc29-901d-445b-b6e4-a8217d83491f)
Nov 14 23:50:27 user nova-compute[75341]: INFO nova.compute.manager [None req-0453633c-48a3-45cf-83e5-0fdc4378a19c tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Took 0.02 seconds to detach 1 volumes for instance.
Nov 14 23:50:27 user nova-compute[75341]: DEBUG nova.compute.manager [req-e49e2ee5-4940-4381-8779-c2f8b3b526fa req-15e25807-3cb2-49d2-87b5-4a3a2b32eee7 service nova] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Received event network-vif-deleted-beb17cbc-97e3-43ed-ba83-d364cec9b619 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:50:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0453633c-48a3-45cf-83e5-0fdc4378a19c tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:50:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0453633c-48a3-45cf-83e5-0fdc4378a19c tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:50:27 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: d92ba9df-c739-414d-a701-ddba04563427] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:50:27 user nova-compute[75341]: INFO nova.compute.manager [-] [instance: d92ba9df-c739-414d-a701-ddba04563427] Took 0.97 seconds to deallocate network for instance.
Nov 14 23:50:27 user nova-compute[75341]: DEBUG nova.compute.manager [req-c4d3fff6-6c00-48c0-8a66-db10c2ddcc52 req-cdf27a45-48a4-4378-8cdf-7f2f7753b178 service nova] [instance: d92ba9df-c739-414d-a701-ddba04563427] Received event network-vif-deleted-5d23fcc8-0277-4900-b524-398ad1f6f27a {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:50:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-de2107eb-ff16-48f9-bba6-9318043f323d tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:50:27 user nova-compute[75341]: DEBUG nova.compute.manager [req-8d4f909e-0b3e-4639-8476-bfbc2d3dd016 req-63f0731a-233e-4001-b356-9fa36eb75d0c service nova] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Received event network-vif-plugged-beb17cbc-97e3-43ed-ba83-d364cec9b619 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:50:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-8d4f909e-0b3e-4639-8476-bfbc2d3dd016 req-63f0731a-233e-4001-b356-9fa36eb75d0c service nova] Acquiring lock "f8e73e44-9d2e-4b15-836c-738398adc685-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:50:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-8d4f909e-0b3e-4639-8476-bfbc2d3dd016 req-63f0731a-233e-4001-b356-9fa36eb75d0c service nova] Lock "f8e73e44-9d2e-4b15-836c-738398adc685-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:50:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-8d4f909e-0b3e-4639-8476-bfbc2d3dd016 req-63f0731a-233e-4001-b356-9fa36eb75d0c service nova] Lock "f8e73e44-9d2e-4b15-836c-738398adc685-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:50:27 user nova-compute[75341]: DEBUG nova.compute.manager [req-8d4f909e-0b3e-4639-8476-bfbc2d3dd016 req-63f0731a-233e-4001-b356-9fa36eb75d0c service nova] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] No waiting events found dispatching network-vif-plugged-beb17cbc-97e3-43ed-ba83-d364cec9b619 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:50:27 user nova-compute[75341]: WARNING nova.compute.manager [req-8d4f909e-0b3e-4639-8476-bfbc2d3dd016 req-63f0731a-233e-4001-b356-9fa36eb75d0c service nova] [instance: f8e73e44-9d2e-4b15-836c-738398adc685] Received unexpected event network-vif-plugged-beb17cbc-97e3-43ed-ba83-d364cec9b619 for instance with vm_state deleted and task_state None.
Nov 14 23:50:27 user nova-compute[75341]: DEBUG nova.compute.manager [req-8d4f909e-0b3e-4639-8476-bfbc2d3dd016 req-63f0731a-233e-4001-b356-9fa36eb75d0c service nova] [instance: d92ba9df-c739-414d-a701-ddba04563427] Received event network-vif-unplugged-5d23fcc8-0277-4900-b524-398ad1f6f27a {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:50:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-8d4f909e-0b3e-4639-8476-bfbc2d3dd016 req-63f0731a-233e-4001-b356-9fa36eb75d0c service nova] Acquiring lock "d92ba9df-c739-414d-a701-ddba04563427-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:50:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-8d4f909e-0b3e-4639-8476-bfbc2d3dd016 req-63f0731a-233e-4001-b356-9fa36eb75d0c service nova] Lock "d92ba9df-c739-414d-a701-ddba04563427-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:50:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-8d4f909e-0b3e-4639-8476-bfbc2d3dd016 req-63f0731a-233e-4001-b356-9fa36eb75d0c service nova] Lock "d92ba9df-c739-414d-a701-ddba04563427-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:50:27 user nova-compute[75341]: DEBUG nova.compute.manager [req-8d4f909e-0b3e-4639-8476-bfbc2d3dd016 req-63f0731a-233e-4001-b356-9fa36eb75d0c service nova] [instance: d92ba9df-c739-414d-a701-ddba04563427] No waiting events found dispatching network-vif-unplugged-5d23fcc8-0277-4900-b524-398ad1f6f27a {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:50:27 user nova-compute[75341]: DEBUG nova.compute.manager [req-8d4f909e-0b3e-4639-8476-bfbc2d3dd016 req-63f0731a-233e-4001-b356-9fa36eb75d0c service nova] [instance: d92ba9df-c739-414d-a701-ddba04563427] Received event network-vif-unplugged-5d23fcc8-0277-4900-b524-398ad1f6f27a for instance with task_state deleting. {{(pid=75341) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 23:50:27 user nova-compute[75341]: DEBUG nova.compute.manager [req-8d4f909e-0b3e-4639-8476-bfbc2d3dd016 req-63f0731a-233e-4001-b356-9fa36eb75d0c service nova] [instance: d92ba9df-c739-414d-a701-ddba04563427] Received event network-vif-plugged-5d23fcc8-0277-4900-b524-398ad1f6f27a {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:50:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-8d4f909e-0b3e-4639-8476-bfbc2d3dd016 req-63f0731a-233e-4001-b356-9fa36eb75d0c service nova] Acquiring lock "d92ba9df-c739-414d-a701-ddba04563427-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:50:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-8d4f909e-0b3e-4639-8476-bfbc2d3dd016 req-63f0731a-233e-4001-b356-9fa36eb75d0c service nova] Lock "d92ba9df-c739-414d-a701-ddba04563427-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:50:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-8d4f909e-0b3e-4639-8476-bfbc2d3dd016 req-63f0731a-233e-4001-b356-9fa36eb75d0c service nova] Lock "d92ba9df-c739-414d-a701-ddba04563427-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:50:27 user nova-compute[75341]: DEBUG nova.compute.manager [req-8d4f909e-0b3e-4639-8476-bfbc2d3dd016 req-63f0731a-233e-4001-b356-9fa36eb75d0c service nova] [instance: d92ba9df-c739-414d-a701-ddba04563427] No waiting events found dispatching network-vif-plugged-5d23fcc8-0277-4900-b524-398ad1f6f27a {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:50:27 user nova-compute[75341]: WARNING nova.compute.manager [req-8d4f909e-0b3e-4639-8476-bfbc2d3dd016 req-63f0731a-233e-4001-b356-9fa36eb75d0c service nova] [instance: d92ba9df-c739-414d-a701-ddba04563427] Received unexpected event network-vif-plugged-5d23fcc8-0277-4900-b524-398ad1f6f27a for instance with vm_state active and task_state deleting.
Nov 14 23:50:27 user nova-compute[75341]: DEBUG nova.compute.manager [req-8d4f909e-0b3e-4639-8476-bfbc2d3dd016 req-63f0731a-233e-4001-b356-9fa36eb75d0c service nova] [instance: d92ba9df-c739-414d-a701-ddba04563427] Received event network-vif-plugged-5d23fcc8-0277-4900-b524-398ad1f6f27a {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:50:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-8d4f909e-0b3e-4639-8476-bfbc2d3dd016 req-63f0731a-233e-4001-b356-9fa36eb75d0c service nova] Acquiring lock "d92ba9df-c739-414d-a701-ddba04563427-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:50:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-8d4f909e-0b3e-4639-8476-bfbc2d3dd016 req-63f0731a-233e-4001-b356-9fa36eb75d0c service nova] Lock "d92ba9df-c739-414d-a701-ddba04563427-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:50:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-8d4f909e-0b3e-4639-8476-bfbc2d3dd016 req-63f0731a-233e-4001-b356-9fa36eb75d0c service nova] Lock "d92ba9df-c739-414d-a701-ddba04563427-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:50:27 user nova-compute[75341]: DEBUG nova.compute.manager [req-8d4f909e-0b3e-4639-8476-bfbc2d3dd016 req-63f0731a-233e-4001-b356-9fa36eb75d0c service nova] [instance: d92ba9df-c739-414d-a701-ddba04563427] No waiting events found dispatching network-vif-plugged-5d23fcc8-0277-4900-b524-398ad1f6f27a {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:50:27 user nova-compute[75341]: WARNING nova.compute.manager [req-8d4f909e-0b3e-4639-8476-bfbc2d3dd016 req-63f0731a-233e-4001-b356-9fa36eb75d0c service nova] [instance: d92ba9df-c739-414d-a701-ddba04563427] Received unexpected event network-vif-plugged-5d23fcc8-0277-4900-b524-398ad1f6f27a for instance with vm_state active and task_state deleting.
Nov 14 23:50:27 user nova-compute[75341]: DEBUG nova.compute.manager [req-8d4f909e-0b3e-4639-8476-bfbc2d3dd016 req-63f0731a-233e-4001-b356-9fa36eb75d0c service nova] [instance: d92ba9df-c739-414d-a701-ddba04563427] Received event network-vif-plugged-5d23fcc8-0277-4900-b524-398ad1f6f27a {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:50:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-8d4f909e-0b3e-4639-8476-bfbc2d3dd016 req-63f0731a-233e-4001-b356-9fa36eb75d0c service nova] Acquiring lock "d92ba9df-c739-414d-a701-ddba04563427-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:50:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-8d4f909e-0b3e-4639-8476-bfbc2d3dd016 req-63f0731a-233e-4001-b356-9fa36eb75d0c service nova] Lock "d92ba9df-c739-414d-a701-ddba04563427-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:50:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-8d4f909e-0b3e-4639-8476-bfbc2d3dd016 req-63f0731a-233e-4001-b356-9fa36eb75d0c service nova] Lock "d92ba9df-c739-414d-a701-ddba04563427-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:50:27 user nova-compute[75341]: DEBUG nova.compute.manager [req-8d4f909e-0b3e-4639-8476-bfbc2d3dd016 req-63f0731a-233e-4001-b356-9fa36eb75d0c service nova] [instance: d92ba9df-c739-414d-a701-ddba04563427] No waiting events found dispatching network-vif-plugged-5d23fcc8-0277-4900-b524-398ad1f6f27a {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:50:27 user nova-compute[75341]: WARNING nova.compute.manager [req-8d4f909e-0b3e-4639-8476-bfbc2d3dd016 req-63f0731a-233e-4001-b356-9fa36eb75d0c service nova] [instance: d92ba9df-c739-414d-a701-ddba04563427] Received unexpected event network-vif-plugged-5d23fcc8-0277-4900-b524-398ad1f6f27a for instance with vm_state active and task_state deleting.
Nov 14 23:50:27 user nova-compute[75341]: DEBUG nova.compute.manager [req-8d4f909e-0b3e-4639-8476-bfbc2d3dd016 req-63f0731a-233e-4001-b356-9fa36eb75d0c service nova] [instance: d92ba9df-c739-414d-a701-ddba04563427] Received event network-vif-unplugged-5d23fcc8-0277-4900-b524-398ad1f6f27a {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:50:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-8d4f909e-0b3e-4639-8476-bfbc2d3dd016 req-63f0731a-233e-4001-b356-9fa36eb75d0c service nova] Acquiring lock "d92ba9df-c739-414d-a701-ddba04563427-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:50:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-8d4f909e-0b3e-4639-8476-bfbc2d3dd016 req-63f0731a-233e-4001-b356-9fa36eb75d0c service nova] Lock "d92ba9df-c739-414d-a701-ddba04563427-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:50:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-8d4f909e-0b3e-4639-8476-bfbc2d3dd016 req-63f0731a-233e-4001-b356-9fa36eb75d0c service nova] Lock "d92ba9df-c739-414d-a701-ddba04563427-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:50:27 user nova-compute[75341]: DEBUG nova.compute.manager [req-8d4f909e-0b3e-4639-8476-bfbc2d3dd016 req-63f0731a-233e-4001-b356-9fa36eb75d0c service nova] [instance: d92ba9df-c739-414d-a701-ddba04563427] No waiting events found dispatching network-vif-unplugged-5d23fcc8-0277-4900-b524-398ad1f6f27a {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:50:27 user nova-compute[75341]: DEBUG nova.compute.manager [req-8d4f909e-0b3e-4639-8476-bfbc2d3dd016 req-63f0731a-233e-4001-b356-9fa36eb75d0c service nova] [instance: d92ba9df-c739-414d-a701-ddba04563427] Received event network-vif-unplugged-5d23fcc8-0277-4900-b524-398ad1f6f27a for instance with task_state deleting. {{(pid=75341) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 23:50:27 user nova-compute[75341]: DEBUG nova.compute.manager [req-8d4f909e-0b3e-4639-8476-bfbc2d3dd016 req-63f0731a-233e-4001-b356-9fa36eb75d0c service nova] [instance: d92ba9df-c739-414d-a701-ddba04563427] Received event network-vif-plugged-5d23fcc8-0277-4900-b524-398ad1f6f27a {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:50:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-8d4f909e-0b3e-4639-8476-bfbc2d3dd016 req-63f0731a-233e-4001-b356-9fa36eb75d0c service nova] Acquiring lock "d92ba9df-c739-414d-a701-ddba04563427-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:50:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-8d4f909e-0b3e-4639-8476-bfbc2d3dd016 req-63f0731a-233e-4001-b356-9fa36eb75d0c service nova] Lock "d92ba9df-c739-414d-a701-ddba04563427-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:50:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-8d4f909e-0b3e-4639-8476-bfbc2d3dd016 req-63f0731a-233e-4001-b356-9fa36eb75d0c service nova] Lock "d92ba9df-c739-414d-a701-ddba04563427-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:50:27 user nova-compute[75341]: DEBUG nova.compute.manager [req-8d4f909e-0b3e-4639-8476-bfbc2d3dd016 req-63f0731a-233e-4001-b356-9fa36eb75d0c service nova] [instance: d92ba9df-c739-414d-a701-ddba04563427] No waiting events found dispatching network-vif-plugged-5d23fcc8-0277-4900-b524-398ad1f6f27a {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:50:27 user nova-compute[75341]: WARNING nova.compute.manager [req-8d4f909e-0b3e-4639-8476-bfbc2d3dd016 req-63f0731a-233e-4001-b356-9fa36eb75d0c service nova] [instance: d92ba9df-c739-414d-a701-ddba04563427] Received unexpected event network-vif-plugged-5d23fcc8-0277-4900-b524-398ad1f6f27a for instance with vm_state active and task_state deleting.
Nov 14 23:50:27 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-0453633c-48a3-45cf-83e5-0fdc4378a19c tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:50:27 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-0453633c-48a3-45cf-83e5-0fdc4378a19c tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:50:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0453633c-48a3-45cf-83e5-0fdc4378a19c tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.356s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:50:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-de2107eb-ff16-48f9-bba6-9318043f323d tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.223s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:50:27 user nova-compute[75341]: INFO nova.scheduler.client.report [None req-0453633c-48a3-45cf-83e5-0fdc4378a19c tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Deleted allocations for instance f8e73e44-9d2e-4b15-836c-738398adc685
Nov 14 23:50:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0453633c-48a3-45cf-83e5-0fdc4378a19c tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lock "f8e73e44-9d2e-4b15-836c-738398adc685" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.870s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:50:27 user nova-compute[75341]: DEBUG os_brick.utils [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:50:27 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:50:27 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:50:27 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b325a79-ec66-4cac-b560-0b3897a9dad7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6d1cfca09c9\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:50:27 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:50:27 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:50:27 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb21b4d7-a700-4ebb-bd15-ca601914c413]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:50:27 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:50:27 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:50:27 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a191ec-9bea-49f0-bf7c-6d37813d25d5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:50:27 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[7104dab4-df76-4f38-8c9b-772414d1ed17]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:50:27 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Running cmd (subprocess): nvme version {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:50:27 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] 'nvme version' failed. Not Retrying. {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:50:27 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] nvme not present on system {{(pid=75341) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 23:50:28 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:50:28 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:50:28 user nova-compute[75341]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 23:50:28 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[820e6a87-9514-4686-b07b-ad74a25dbe54]: (4, '') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:50:28 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75341) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 23:50:28 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 23:50:28 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] LIGHTOS: no hostnqn found. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 23:50:28 user nova-compute[75341]: DEBUG os_brick.utils [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6d1cfca09c9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:50:28 user nova-compute[75341]: DEBUG nova.virt.block_device [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] Updating existing volume attachment record: 90d1f82d-4310-4cdc-b731-939881f6a1b7 {{(pid=75341) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 23:50:28 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-de2107eb-ff16-48f9-bba6-9318043f323d tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:50:28 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-de2107eb-ff16-48f9-bba6-9318043f323d tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:50:28 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-de2107eb-ff16-48f9-bba6-9318043f323d tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.435s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:50:28 user nova-compute[75341]: INFO nova.scheduler.client.report [None req-de2107eb-ff16-48f9-bba6-9318043f323d tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Deleted allocations for instance d92ba9df-c739-414d-a701-ddba04563427
Nov 14 23:50:28 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-de2107eb-ff16-48f9-bba6-9318043f323d tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "d92ba9df-c739-414d-a701-ddba04563427" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.876s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:50:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG nova.compute.manager [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] Start spawning the instance on the hypervisor. {{(pid=75341) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] Creating instance directory {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 23:50:33 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] Creating image(s)
Nov 14 23:50:33 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] Did not create local disks {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] Ensure instance console log exists: /opt/stack/data/nova/instances/713b9caa-4ca7-4d78-8252-e8419d72ece3/console.log {{(pid=75341) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] Start _get_guest_xml network_info=[{"id": "b80cf75e-07c5-438f-add6-83636ba0d977", "address": "fa:16:3e:69:c0:2e", "network": {"id": "227eb779-a064-477d-8447-45862017ae7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-3827253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96674073965642f1af11221b4add8a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb80cf75e-07", "ovs_interfaceid": "b80cf75e-07c5-438f-add6-83636ba0d977", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-14T23:50:17Z,direct_url=<?>,disk_format='qcow2',id=724935f5-a270-4fdc-89bb-fb4c99911ac0,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-514025796',owner='96674073965642f1af11221b4add8a6d',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-14T23:50:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '90d1f82d-4310-4cdc-b731-939881f6a1b7', 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GUVdvySQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '713b9caa-4ca7-4d78-8252-e8419d72ece3', 'attached_at': '', 'detached_at': '', 'volume_id': '54fb0997-ac36-4d49-abf8-4f968cb2f455', 'serial': '54fb0997-ac36-4d49-abf8-4f968cb2f455'}, 'delete_on_termination': True, 'volume_type': None} {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 23:50:33 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:50:33 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:50:33 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-14T23:50:17Z,direct_url=<?>,disk_format='qcow2',id=724935f5-a270-4fdc-89bb-fb4c99911ac0,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-514025796',owner='96674073965642f1af11221b4add8a6d',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-14T23:50:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] Calling os-brick to attach iSCSI Volume {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GUVdvySQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:50:33 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:50:33 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:50:33 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:50:33 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:50:33 user nova-compute[75341]: INFO os_brick.initiator.connectors.iscsi [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 23:50:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455 -p 172.16.0.220:3260 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4efc59d-3a81-415d-8f39-4549196c2fac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 23:50:33 user nova-compute[75341]:  {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455 -p 172.16.0.220:3260 --interface default --op new {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[320e4a8c-e68e-49cf-9c91-3ae1fd69e6f6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455] added\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455] added
Nov 14 23:50:33 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9e52e1-08ad-45fb-a242-68b7df4d52ea]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[346c10bf-1c28-4856-9138-9635ccd0fd1b]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GUVdvySQ {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GUVdvySQ" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[c797291c-63ee-44ba-9438-4007e2315fc9]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GUVdvySQ'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b8bdf3-4e77-4e01-8fa7-cb0353b3185b]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54b625f-c302-45ad-95f4-57697a10f11c]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c243f9d-3946-46db-8854-5d37db002bbe (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)
Nov 14 23:50:33 user nova-compute[75341]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c243f9d-3946-46db-8854-5d37db002bbe (non-flash)
Nov 14 23:50:33 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)
Nov 14 23:50:33 user nova-compute[75341]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c243f9d-3946-46db-8854-5d37db002bbe (non-flash)
Nov 14 23:50:33 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455 -p 172.16.0.220:3260 --login {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ca3911-642e-4593-8e6c-13ba3391790d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455, portal: 172.16.0.220,3260]
Nov 14 23:50:33 user nova-compute[75341]: Login to [iface: default, target: iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455, portal: 172.16.0.220,3260] successful.
Nov 14 23:50:33 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[a325b119-eeab-4359-ad61-2270cf4668a4]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7bd6ed-60cb-4740-a846-ac3aebe65fc5]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c243f9d-3946-46db-8854-5d37db002bbe (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)
Nov 14 23:50:33 user nova-compute[75341]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c243f9d-3946-46db-8854-5d37db002bbe (non-flash)
Nov 14 23:50:33 user nova-compute[75341]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455 (non-flash)
Nov 14 23:50:33 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)
Nov 14 23:50:33 user nova-compute[75341]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c243f9d-3946-46db-8854-5d37db002bbe (non-flash)
Nov 14 23:50:33 user nova-compute[75341]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455 (non-flash)
Nov 14 23:50:33 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Connected to 172.16.0.220:3260 {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] HCTL ('34', '-', '-', 0) found on session 34 with lun 0 {{(pid=75341) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75341) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d31f63-9ee0-4f02-b93b-57e6ae1d0587]: (4, ('- - 0', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Searching for a device in session 34 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 23:50:33 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GUVdvySQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 23:50:34 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:50:34 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '26634386139343938', 'path': '/dev/sdc'} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:50:34 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634386139343938', 'path': '/dev/sdc'} {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 23:50:35 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:50:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1843717353',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1843717353',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1843717353',id=33,image_ref='724935f5-a270-4fdc-89bb-fb4c99911ac0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCvhcUyu2EYFUwkh8tkwl+NXtk6OhaYXxsLRxhI8LgHcD/S7OtjzVcbE3iKCG6NgYMX42+gy0KKv8Ws3CG4I2ODY1sWNbrH7HxyB/Ym+UInKL7lxa7/c8x3R4TFgmu099A==',key_name='tempest-keypair-485924258',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96674073965642f1af11221b4add8a6d',ramdisk_id='',reservation_id='r-ozr4c9fc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-320933673',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-320933673-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-320933673',owner_user_name='tempest-TestVolumeBootPattern-320933673-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:50:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b08f7ddf6c2f4fd596e214d6ca56c234',uuid=713b9caa-4ca7-4d78-8252-e8419d72ece3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b80cf75e-07c5-438f-add6-83636ba0d977", "address": "fa:16:3e:69:c0:2e", "network": {"id": "227eb779-a064-477d-8447-45862017ae7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-3827253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96674073965642f1af11221b4add8a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb80cf75e-07", "ovs_interfaceid": "b80cf75e-07c5-438f-add6-83636ba0d977", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:50:35 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Converting VIF {"id": "b80cf75e-07c5-438f-add6-83636ba0d977", "address": "fa:16:3e:69:c0:2e", "network": {"id": "227eb779-a064-477d-8447-45862017ae7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-3827253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96674073965642f1af11221b4add8a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb80cf75e-07", "ovs_interfaceid": "b80cf75e-07c5-438f-add6-83636ba0d977", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:50:35 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:c0:2e,bridge_name='br-int',has_traffic_filtering=True,id=b80cf75e-07c5-438f-add6-83636ba0d977,network=Network(227eb779-a064-477d-8447-45862017ae7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb80cf75e-07') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:50:35 user nova-compute[75341]: DEBUG nova.objects.instance [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lazy-loading 'pci_devices' on Instance uuid 713b9caa-4ca7-4d78-8252-e8419d72ece3 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:50:35 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] End _get_guest_xml xml=<domain type="kvm">
Nov 14 23:50:35 user nova-compute[75341]:   <uuid>713b9caa-4ca7-4d78-8252-e8419d72ece3</uuid>
Nov 14 23:50:35 user nova-compute[75341]:   <name>instance-00000021</name>
Nov 14 23:50:35 user nova-compute[75341]:   <memory>524288</memory>
Nov 14 23:50:35 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 14 23:50:35 user nova-compute[75341]:   <metadata>
Nov 14 23:50:35 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 23:50:35 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 14 23:50:35 user nova-compute[75341]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1843717353</nova:name>
Nov 14 23:50:35 user nova-compute[75341]:       <nova:creationTime>2023-11-14 23:50:33</nova:creationTime>
Nov 14 23:50:35 user nova-compute[75341]:       <nova:flavor name="m1.tiny">
Nov 14 23:50:35 user nova-compute[75341]:         <nova:memory>512</nova:memory>
Nov 14 23:50:35 user nova-compute[75341]:         <nova:disk>1</nova:disk>
Nov 14 23:50:35 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 14 23:50:35 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 23:50:35 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 14 23:50:35 user nova-compute[75341]:       </nova:flavor>
Nov 14 23:50:35 user nova-compute[75341]:       <nova:owner>
Nov 14 23:50:35 user nova-compute[75341]:         <nova:user uuid="b08f7ddf6c2f4fd596e214d6ca56c234">tempest-TestVolumeBootPattern-320933673-project-member</nova:user>
Nov 14 23:50:35 user nova-compute[75341]:         <nova:project uuid="96674073965642f1af11221b4add8a6d">tempest-TestVolumeBootPattern-320933673</nova:project>
Nov 14 23:50:35 user nova-compute[75341]:       </nova:owner>
Nov 14 23:50:35 user nova-compute[75341]:       <nova:root type="image" uuid="724935f5-a270-4fdc-89bb-fb4c99911ac0"/>
Nov 14 23:50:35 user nova-compute[75341]:       <nova:ports>
Nov 14 23:50:35 user nova-compute[75341]:         <nova:port uuid="b80cf75e-07c5-438f-add6-83636ba0d977">
Nov 14 23:50:35 user nova-compute[75341]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 23:50:35 user nova-compute[75341]:         </nova:port>
Nov 14 23:50:35 user nova-compute[75341]:       </nova:ports>
Nov 14 23:50:35 user nova-compute[75341]:     </nova:instance>
Nov 14 23:50:35 user nova-compute[75341]:   </metadata>
Nov 14 23:50:35 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 14 23:50:35 user nova-compute[75341]:     <system>
Nov 14 23:50:35 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 23:50:35 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 14 23:50:35 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 14 23:50:35 user nova-compute[75341]:       <entry name="serial">713b9caa-4ca7-4d78-8252-e8419d72ece3</entry>
Nov 14 23:50:35 user nova-compute[75341]:       <entry name="uuid">713b9caa-4ca7-4d78-8252-e8419d72ece3</entry>
Nov 14 23:50:35 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 14 23:50:35 user nova-compute[75341]:     </system>
Nov 14 23:50:35 user nova-compute[75341]:   </sysinfo>
Nov 14 23:50:35 user nova-compute[75341]:   <os>
Nov 14 23:50:35 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 23:50:35 user nova-compute[75341]:     <boot dev="hd"/>
Nov 14 23:50:35 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 14 23:50:35 user nova-compute[75341]:   </os>
Nov 14 23:50:35 user nova-compute[75341]:   <features>
Nov 14 23:50:35 user nova-compute[75341]:     <acpi/>
Nov 14 23:50:35 user nova-compute[75341]:     <apic/>
Nov 14 23:50:35 user nova-compute[75341]:     <vmcoreinfo/>
Nov 14 23:50:35 user nova-compute[75341]:   </features>
Nov 14 23:50:35 user nova-compute[75341]:   <clock offset="utc">
Nov 14 23:50:35 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 23:50:35 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 23:50:35 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 14 23:50:35 user nova-compute[75341]:   </clock>
Nov 14 23:50:35 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 14 23:50:35 user nova-compute[75341]:     <model>Nehalem</model>
Nov 14 23:50:35 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 23:50:35 user nova-compute[75341]:   </cpu>
Nov 14 23:50:35 user nova-compute[75341]:   <devices>
Nov 14 23:50:35 user nova-compute[75341]:     <disk type="block" device="disk">
Nov 14 23:50:35 user nova-compute[75341]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:50:35 user nova-compute[75341]:       <source dev="/dev/sdc"/>
Nov 14 23:50:35 user nova-compute[75341]:       <target dev="vda" bus="virtio"/>
Nov 14 23:50:35 user nova-compute[75341]:       <serial>54fb0997-ac36-4d49-abf8-4f968cb2f455</serial>
Nov 14 23:50:35 user nova-compute[75341]:     </disk>
Nov 14 23:50:35 user nova-compute[75341]:     <interface type="ethernet">
Nov 14 23:50:35 user nova-compute[75341]:       <mac address="fa:16:3e:69:c0:2e"/>
Nov 14 23:50:35 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:50:35 user nova-compute[75341]:       <mtu size="1442"/>
Nov 14 23:50:35 user nova-compute[75341]:       <target dev="tapb80cf75e-07"/>
Nov 14 23:50:35 user nova-compute[75341]:     </interface>
Nov 14 23:50:35 user nova-compute[75341]:     <serial type="pty">
Nov 14 23:50:35 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/713b9caa-4ca7-4d78-8252-e8419d72ece3/console.log" append="off"/>
Nov 14 23:50:35 user nova-compute[75341]:     </serial>
Nov 14 23:50:35 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 23:50:35 user nova-compute[75341]:     <video>
Nov 14 23:50:35 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:50:35 user nova-compute[75341]:     </video>
Nov 14 23:50:35 user nova-compute[75341]:     <rng model="virtio">
Nov 14 23:50:35 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 14 23:50:35 user nova-compute[75341]:     </rng>
Nov 14 23:50:35 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 14 23:50:35 user nova-compute[75341]:     <memballoon model="virtio">
Nov 14 23:50:35 user nova-compute[75341]:       <stats period="10"/>
Nov 14 23:50:35 user nova-compute[75341]:     </memballoon>
Nov 14 23:50:35 user nova-compute[75341]:   </devices>
Nov 14 23:50:35 user nova-compute[75341]: </domain>
Nov 14 23:50:35 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 23:50:35 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:50:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1843717353',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1843717353',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1843717353',id=33,image_ref='724935f5-a270-4fdc-89bb-fb4c99911ac0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCvhcUyu2EYFUwkh8tkwl+NXtk6OhaYXxsLRxhI8LgHcD/S7OtjzVcbE3iKCG6NgYMX42+gy0KKv8Ws3CG4I2ODY1sWNbrH7HxyB/Ym+UInKL7lxa7/c8x3R4TFgmu099A==',key_name='tempest-keypair-485924258',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96674073965642f1af11221b4add8a6d',ramdisk_id='',reservation_id='r-ozr4c9fc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-320933673',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-320933673-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-320933673',owner_user_name='tempest-TestVolumeBootPattern-320933673-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:50:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b08f7ddf6c2f4fd596e214d6ca56c234',uuid=713b9caa-4ca7-4d78-8252-e8419d72ece3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b80cf75e-07c5-438f-add6-83636ba0d977", "address": "fa:16:3e:69:c0:2e", "network": {"id": "227eb779-a064-477d-8447-45862017ae7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-3827253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96674073965642f1af11221b4add8a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb80cf75e-07", "ovs_interfaceid": "b80cf75e-07c5-438f-add6-83636ba0d977", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 23:50:35 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Converting VIF {"id": "b80cf75e-07c5-438f-add6-83636ba0d977", "address": "fa:16:3e:69:c0:2e", "network": {"id": "227eb779-a064-477d-8447-45862017ae7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-3827253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96674073965642f1af11221b4add8a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb80cf75e-07", "ovs_interfaceid": "b80cf75e-07c5-438f-add6-83636ba0d977", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:50:35 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:c0:2e,bridge_name='br-int',has_traffic_filtering=True,id=b80cf75e-07c5-438f-add6-83636ba0d977,network=Network(227eb779-a064-477d-8447-45862017ae7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb80cf75e-07') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:50:35 user nova-compute[75341]: DEBUG os_vif [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:c0:2e,bridge_name='br-int',has_traffic_filtering=True,id=b80cf75e-07c5-438f-add6-83636ba0d977,network=Network(227eb779-a064-477d-8447-45862017ae7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb80cf75e-07') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 23:50:35 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:35 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:50:35 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 23:50:35 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:35 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3ce59b9e-e863-5975-8d09-53afdad5f311', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:50:35 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:35 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:50:35 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:35 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb80cf75e-07, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:50:35 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb80cf75e-07, col_values=(('qos', UUID('1ea46866-0065-41c9-a9e9-a2a6b3e0b79a')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:50:35 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb80cf75e-07, col_values=(('external_ids', {'iface-id': 'b80cf75e-07c5-438f-add6-83636ba0d977', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:c0:2e', 'vm-uuid': '713b9caa-4ca7-4d78-8252-e8419d72ece3'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:50:35 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:35 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:50:35 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:35 user nova-compute[75341]: INFO os_vif [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:c0:2e,bridge_name='br-int',has_traffic_filtering=True,id=b80cf75e-07c5-438f-add6-83636ba0d977,network=Network(227eb779-a064-477d-8447-45862017ae7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb80cf75e-07')
Nov 14 23:50:35 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:50:35 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] No VIF found with MAC fa:16:3e:69:c0:2e, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:50:36 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:36 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:36 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:36 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:36 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:36 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:36 user nova-compute[75341]: DEBUG nova.compute.manager [req-4880e8d7-de61-4454-8f6d-15e7f857ba2b req-9e3b9b98-0e65-4d56-b956-dadf1eaeaeb8 service nova] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] Received event network-vif-plugged-b80cf75e-07c5-438f-add6-83636ba0d977 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:50:36 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4880e8d7-de61-4454-8f6d-15e7f857ba2b req-9e3b9b98-0e65-4d56-b956-dadf1eaeaeb8 service nova] Acquiring lock "713b9caa-4ca7-4d78-8252-e8419d72ece3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:50:36 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4880e8d7-de61-4454-8f6d-15e7f857ba2b req-9e3b9b98-0e65-4d56-b956-dadf1eaeaeb8 service nova] Lock "713b9caa-4ca7-4d78-8252-e8419d72ece3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:50:36 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4880e8d7-de61-4454-8f6d-15e7f857ba2b req-9e3b9b98-0e65-4d56-b956-dadf1eaeaeb8 service nova] Lock "713b9caa-4ca7-4d78-8252-e8419d72ece3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:50:36 user nova-compute[75341]: DEBUG nova.compute.manager [req-4880e8d7-de61-4454-8f6d-15e7f857ba2b req-9e3b9b98-0e65-4d56-b956-dadf1eaeaeb8 service nova] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] No waiting events found dispatching network-vif-plugged-b80cf75e-07c5-438f-add6-83636ba0d977 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:50:36 user nova-compute[75341]: WARNING nova.compute.manager [req-4880e8d7-de61-4454-8f6d-15e7f857ba2b req-9e3b9b98-0e65-4d56-b956-dadf1eaeaeb8 service nova] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] Received unexpected event network-vif-plugged-b80cf75e-07c5-438f-add6-83636ba0d977 for instance with vm_state building and task_state spawning.
Nov 14 23:50:38 user nova-compute[75341]: DEBUG nova.compute.manager [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] Instance event wait completed in 0 seconds for  {{(pid=75341) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 23:50:38 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] Guest created on hypervisor {{(pid=75341) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 23:50:38 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] Instance spawned successfully.
Nov 14 23:50:38 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 23:50:38 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] Found default for hw_input_bus of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:50:38 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] Found default for hw_pointer_model of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:50:38 user nova-compute[75341]: INFO nova.compute.manager [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] Took 5.71 seconds to spawn the instance on the hypervisor.
Nov 14 23:50:38 user nova-compute[75341]: DEBUG nova.compute.manager [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 23:50:38 user nova-compute[75341]: INFO nova.compute.manager [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] Took 17.37 seconds to build instance.
Nov 14 23:50:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1eb910a7-7aae-4094-87c1-abb206e2f8fb tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "713b9caa-4ca7-4d78-8252-e8419d72ece3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.475s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:50:38 user nova-compute[75341]: DEBUG nova.compute.manager [req-db874b71-607e-44b0-b0aa-1abd20b36c52 req-bf1056e4-f409-4a25-af57-6afe26d4ffa2 service nova] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] Received event network-vif-plugged-b80cf75e-07c5-438f-add6-83636ba0d977 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:50:39 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-db874b71-607e-44b0-b0aa-1abd20b36c52 req-bf1056e4-f409-4a25-af57-6afe26d4ffa2 service nova] Acquiring lock "713b9caa-4ca7-4d78-8252-e8419d72ece3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:50:39 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-db874b71-607e-44b0-b0aa-1abd20b36c52 req-bf1056e4-f409-4a25-af57-6afe26d4ffa2 service nova] Lock "713b9caa-4ca7-4d78-8252-e8419d72ece3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:50:39 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-db874b71-607e-44b0-b0aa-1abd20b36c52 req-bf1056e4-f409-4a25-af57-6afe26d4ffa2 service nova] Lock "713b9caa-4ca7-4d78-8252-e8419d72ece3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:50:39 user nova-compute[75341]: DEBUG nova.compute.manager [req-db874b71-607e-44b0-b0aa-1abd20b36c52 req-bf1056e4-f409-4a25-af57-6afe26d4ffa2 service nova] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] No waiting events found dispatching network-vif-plugged-b80cf75e-07c5-438f-add6-83636ba0d977 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:50:39 user nova-compute[75341]: WARNING nova.compute.manager [req-db874b71-607e-44b0-b0aa-1abd20b36c52 req-bf1056e4-f409-4a25-af57-6afe26d4ffa2 service nova] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] Received unexpected event network-vif-plugged-b80cf75e-07c5-438f-add6-83636ba0d977 for instance with vm_state active and task_state None.
Nov 14 23:50:40 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:45 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Acquiring lock "12c9a7d6-03a5-4fd2-9082-c68758f1542f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:50:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "12c9a7d6-03a5-4fd2-9082-c68758f1542f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:50:46 user nova-compute[75341]: DEBUG nova.compute.manager [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Starting instance... {{(pid=75341) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 23:50:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:50:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:50:46 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75341) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 23:50:46 user nova-compute[75341]: INFO nova.compute.claims [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Claim successful on node user
Nov 14 23:50:46 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:50:46 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:50:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.403s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:50:46 user nova-compute[75341]: DEBUG nova.compute.manager [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Start building networks asynchronously for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 23:50:46 user nova-compute[75341]: DEBUG nova.compute.manager [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Allocating IP information in the background. {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 23:50:46 user nova-compute[75341]: DEBUG nova.network.neutron [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] allocate_for_instance() {{(pid=75341) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 23:50:46 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 23:50:46 user nova-compute[75341]: DEBUG nova.compute.manager [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Start building block device mappings for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 23:50:46 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:46 user nova-compute[75341]: DEBUG nova.policy [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '442aae0161f347d0a79b168a1b60286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c69a942b4f4b97a1a3152dea86c7fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75341) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 23:50:46 user nova-compute[75341]: DEBUG nova.compute.manager [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Start spawning the instance on the hypervisor. {{(pid=75341) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 23:50:46 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Creating instance directory {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 23:50:46 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Creating image(s)
Nov 14 23:50:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Acquiring lock "/opt/stack/data/nova/instances/12c9a7d6-03a5-4fd2-9082-c68758f1542f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:50:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "/opt/stack/data/nova/instances/12c9a7d6-03a5-4fd2-9082-c68758f1542f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:50:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "/opt/stack/data/nova/instances/12c9a7d6-03a5-4fd2-9082-c68758f1542f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:50:46 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:50:46 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.182s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:50:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Acquiring lock "4754efee9a6d73d3647f2add2cfe86c291949740" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:50:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:50:46 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:50:46 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:50:46 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Cleaning up deleted instances {{(pid=75341) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 23:50:46 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] There are 0 instances to clean {{(pid=75341) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 23:50:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.183s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:50:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/12c9a7d6-03a5-4fd2-9082-c68758f1542f/disk 1073741824 {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:50:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/12c9a7d6-03a5-4fd2-9082-c68758f1542f/disk 1073741824" returned: 0 in 0.050s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:50:47 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:50:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:50:47 user nova-compute[75341]: DEBUG nova.network.neutron [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Successfully created port: 1def089a-31ed-4ac4-be68-4050fa9c9fe6 {{(pid=75341) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 23:50:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.194s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:50:47 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Checking if we can resize image /opt/stack/data/nova/instances/12c9a7d6-03a5-4fd2-9082-c68758f1542f/disk. size=1073741824 {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 23:50:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c9a7d6-03a5-4fd2-9082-c68758f1542f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:50:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c9a7d6-03a5-4fd2-9082-c68758f1542f/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:50:47 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Cannot resize image /opt/stack/data/nova/instances/12c9a7d6-03a5-4fd2-9082-c68758f1542f/disk to a smaller size. {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 23:50:47 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Created local disks {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 23:50:47 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Ensure instance console log exists: /opt/stack/data/nova/instances/12c9a7d6-03a5-4fd2-9082-c68758f1542f/console.log {{(pid=75341) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 23:50:47 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:50:47 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:50:47 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:50:48 user nova-compute[75341]: DEBUG nova.network.neutron [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Successfully updated port: 1def089a-31ed-4ac4-be68-4050fa9c9fe6 {{(pid=75341) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 23:50:48 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Acquiring lock "refresh_cache-12c9a7d6-03a5-4fd2-9082-c68758f1542f" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:50:48 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Acquired lock "refresh_cache-12c9a7d6-03a5-4fd2-9082-c68758f1542f" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:50:48 user nova-compute[75341]: DEBUG nova.network.neutron [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 23:50:48 user nova-compute[75341]: DEBUG nova.compute.manager [req-10084ca4-a41a-4fc0-89f4-ef2ad49468d2 req-8907aec0-43be-483f-a814-3ba863337694 service nova] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Received event network-changed-1def089a-31ed-4ac4-be68-4050fa9c9fe6 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:50:48 user nova-compute[75341]: DEBUG nova.compute.manager [req-10084ca4-a41a-4fc0-89f4-ef2ad49468d2 req-8907aec0-43be-483f-a814-3ba863337694 service nova] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Refreshing instance network info cache due to event network-changed-1def089a-31ed-4ac4-be68-4050fa9c9fe6. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:50:48 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-10084ca4-a41a-4fc0-89f4-ef2ad49468d2 req-8907aec0-43be-483f-a814-3ba863337694 service nova] Acquiring lock "refresh_cache-12c9a7d6-03a5-4fd2-9082-c68758f1542f" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:50:48 user nova-compute[75341]: DEBUG nova.network.neutron [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Instance cache missing network info. {{(pid=75341) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 23:50:48 user nova-compute[75341]: DEBUG nova.network.neutron [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Updating instance_info_cache with network_info: [{"id": "1def089a-31ed-4ac4-be68-4050fa9c9fe6", "address": "fa:16:3e:3c:51:b6", "network": {"id": "d86a8e7f-6658-4994-9a13-eb3163bd3865", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-635863702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c69a942b4f4b97a1a3152dea86c7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1def089a-31", "ovs_interfaceid": "1def089a-31ed-4ac4-be68-4050fa9c9fe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:50:48 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Releasing lock "refresh_cache-12c9a7d6-03a5-4fd2-9082-c68758f1542f" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:50:48 user nova-compute[75341]: DEBUG nova.compute.manager [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Instance network_info: |[{"id": "1def089a-31ed-4ac4-be68-4050fa9c9fe6", "address": "fa:16:3e:3c:51:b6", "network": {"id": "d86a8e7f-6658-4994-9a13-eb3163bd3865", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-635863702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c69a942b4f4b97a1a3152dea86c7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1def089a-31", "ovs_interfaceid": "1def089a-31ed-4ac4-be68-4050fa9c9fe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 23:50:48 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-10084ca4-a41a-4fc0-89f4-ef2ad49468d2 req-8907aec0-43be-483f-a814-3ba863337694 service nova] Acquired lock "refresh_cache-12c9a7d6-03a5-4fd2-9082-c68758f1542f" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:50:48 user nova-compute[75341]: DEBUG nova.network.neutron [req-10084ca4-a41a-4fc0-89f4-ef2ad49468d2 req-8907aec0-43be-483f-a814-3ba863337694 service nova] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Refreshing network info cache for port 1def089a-31ed-4ac4-be68-4050fa9c9fe6 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:50:48 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Start _get_guest_xml network_info=[{"id": "1def089a-31ed-4ac4-be68-4050fa9c9fe6", "address": "fa:16:3e:3c:51:b6", "network": {"id": "d86a8e7f-6658-4994-9a13-eb3163bd3865", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-635863702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c69a942b4f4b97a1a3152dea86c7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1def089a-31", "ovs_interfaceid": "1def089a-31ed-4ac4-be68-4050fa9c9fe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encrypted': False, 'image_id': 'e46abb82-b810-490e-a8a1-ccdc5fa1a796'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 23:50:48 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:50:48 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:50:48 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 23:50:48 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 23:50:48 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 23:50:48 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 23:50:48 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 23:50:48 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 23:50:48 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 23:50:48 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 23:50:48 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 23:50:48 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 23:50:48 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 23:50:48 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 23:50:48 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 23:50:48 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 23:50:48 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 23:50:48 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 23:50:48 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:50:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-354068924',display_name='tempest-tempest.common.compute-instance-354068924',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-354068924',id=34,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5He922s8rk+PmMGVsYQr5cOK2M7RyE6pRHPukFN7KTwHIYhqpey5pP25XxRxS64/nnTZtZU0s7MKkpDVnG7pj8Bq4MwPLqGCEvlosZZWTgxDQbmYxiYN/iVtJlhcHp1A==',key_name='tempest-keypair-1680109364',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4c69a942b4f4b97a1a3152dea86c7fb',ramdisk_id='',reservation_id='r-hde50h2m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1796396043',owner_user_name='tempest-ServerActionsTestOtherA-1796396043-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:50:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='442aae0161f347d0a79b168a1b60286a',uuid=12c9a7d6-03a5-4fd2-9082-c68758f1542f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1def089a-31ed-4ac4-be68-4050fa9c9fe6", "address": "fa:16:3e:3c:51:b6", "network": {"id": "d86a8e7f-6658-4994-9a13-eb3163bd3865", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-635863702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c69a942b4f4b97a1a3152dea86c7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1def089a-31", "ovs_interfaceid": "1def089a-31ed-4ac4-be68-4050fa9c9fe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:50:48 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Converting VIF {"id": "1def089a-31ed-4ac4-be68-4050fa9c9fe6", "address": "fa:16:3e:3c:51:b6", "network": {"id": "d86a8e7f-6658-4994-9a13-eb3163bd3865", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-635863702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c69a942b4f4b97a1a3152dea86c7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1def089a-31", "ovs_interfaceid": "1def089a-31ed-4ac4-be68-4050fa9c9fe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:50:48 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:51:b6,bridge_name='br-int',has_traffic_filtering=True,id=1def089a-31ed-4ac4-be68-4050fa9c9fe6,network=Network(d86a8e7f-6658-4994-9a13-eb3163bd3865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1def089a-31') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:50:48 user nova-compute[75341]: DEBUG nova.objects.instance [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lazy-loading 'pci_devices' on Instance uuid 12c9a7d6-03a5-4fd2-9082-c68758f1542f {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:50:48 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] End _get_guest_xml xml=<domain type="kvm">
Nov 14 23:50:48 user nova-compute[75341]:   <uuid>12c9a7d6-03a5-4fd2-9082-c68758f1542f</uuid>
Nov 14 23:50:48 user nova-compute[75341]:   <name>instance-00000022</name>
Nov 14 23:50:48 user nova-compute[75341]:   <memory>524288</memory>
Nov 14 23:50:48 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 14 23:50:48 user nova-compute[75341]:   <metadata>
Nov 14 23:50:48 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 23:50:48 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 14 23:50:48 user nova-compute[75341]:       <nova:name>tempest-tempest.common.compute-instance-354068924</nova:name>
Nov 14 23:50:48 user nova-compute[75341]:       <nova:creationTime>2023-11-14 23:50:48</nova:creationTime>
Nov 14 23:50:48 user nova-compute[75341]:       <nova:flavor name="m1.tiny">
Nov 14 23:50:48 user nova-compute[75341]:         <nova:memory>512</nova:memory>
Nov 14 23:50:48 user nova-compute[75341]:         <nova:disk>1</nova:disk>
Nov 14 23:50:48 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 14 23:50:48 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 23:50:48 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 14 23:50:48 user nova-compute[75341]:       </nova:flavor>
Nov 14 23:50:48 user nova-compute[75341]:       <nova:owner>
Nov 14 23:50:48 user nova-compute[75341]:         <nova:user uuid="442aae0161f347d0a79b168a1b60286a">tempest-ServerActionsTestOtherA-1796396043-project-member</nova:user>
Nov 14 23:50:48 user nova-compute[75341]:         <nova:project uuid="f4c69a942b4f4b97a1a3152dea86c7fb">tempest-ServerActionsTestOtherA-1796396043</nova:project>
Nov 14 23:50:48 user nova-compute[75341]:       </nova:owner>
Nov 14 23:50:48 user nova-compute[75341]:       <nova:root type="image" uuid="e46abb82-b810-490e-a8a1-ccdc5fa1a796"/>
Nov 14 23:50:48 user nova-compute[75341]:       <nova:ports>
Nov 14 23:50:48 user nova-compute[75341]:         <nova:port uuid="1def089a-31ed-4ac4-be68-4050fa9c9fe6">
Nov 14 23:50:48 user nova-compute[75341]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 23:50:48 user nova-compute[75341]:         </nova:port>
Nov 14 23:50:48 user nova-compute[75341]:       </nova:ports>
Nov 14 23:50:48 user nova-compute[75341]:     </nova:instance>
Nov 14 23:50:48 user nova-compute[75341]:   </metadata>
Nov 14 23:50:48 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 14 23:50:48 user nova-compute[75341]:     <system>
Nov 14 23:50:48 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 23:50:48 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 14 23:50:48 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 14 23:50:48 user nova-compute[75341]:       <entry name="serial">12c9a7d6-03a5-4fd2-9082-c68758f1542f</entry>
Nov 14 23:50:48 user nova-compute[75341]:       <entry name="uuid">12c9a7d6-03a5-4fd2-9082-c68758f1542f</entry>
Nov 14 23:50:48 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 14 23:50:48 user nova-compute[75341]:     </system>
Nov 14 23:50:48 user nova-compute[75341]:   </sysinfo>
Nov 14 23:50:48 user nova-compute[75341]:   <os>
Nov 14 23:50:48 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 23:50:48 user nova-compute[75341]:     <boot dev="hd"/>
Nov 14 23:50:48 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 14 23:50:48 user nova-compute[75341]:   </os>
Nov 14 23:50:48 user nova-compute[75341]:   <features>
Nov 14 23:50:48 user nova-compute[75341]:     <acpi/>
Nov 14 23:50:48 user nova-compute[75341]:     <apic/>
Nov 14 23:50:48 user nova-compute[75341]:     <vmcoreinfo/>
Nov 14 23:50:48 user nova-compute[75341]:   </features>
Nov 14 23:50:48 user nova-compute[75341]:   <clock offset="utc">
Nov 14 23:50:48 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 23:50:48 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 23:50:48 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 14 23:50:48 user nova-compute[75341]:   </clock>
Nov 14 23:50:48 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 14 23:50:48 user nova-compute[75341]:     <model>Nehalem</model>
Nov 14 23:50:48 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 23:50:48 user nova-compute[75341]:   </cpu>
Nov 14 23:50:48 user nova-compute[75341]:   <devices>
Nov 14 23:50:48 user nova-compute[75341]:     <disk type="file" device="disk">
Nov 14 23:50:48 user nova-compute[75341]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 23:50:48 user nova-compute[75341]:       <source file="/opt/stack/data/nova/instances/12c9a7d6-03a5-4fd2-9082-c68758f1542f/disk"/>
Nov 14 23:50:48 user nova-compute[75341]:       <target dev="vda" bus="virtio"/>
Nov 14 23:50:48 user nova-compute[75341]:     </disk>
Nov 14 23:50:48 user nova-compute[75341]:     <interface type="ethernet">
Nov 14 23:50:48 user nova-compute[75341]:       <mac address="fa:16:3e:3c:51:b6"/>
Nov 14 23:50:48 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:50:48 user nova-compute[75341]:       <mtu size="1442"/>
Nov 14 23:50:48 user nova-compute[75341]:       <target dev="tap1def089a-31"/>
Nov 14 23:50:48 user nova-compute[75341]:     </interface>
Nov 14 23:50:48 user nova-compute[75341]:     <serial type="pty">
Nov 14 23:50:48 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/12c9a7d6-03a5-4fd2-9082-c68758f1542f/console.log" append="off"/>
Nov 14 23:50:48 user nova-compute[75341]:     </serial>
Nov 14 23:50:48 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 23:50:48 user nova-compute[75341]:     <video>
Nov 14 23:50:48 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:50:48 user nova-compute[75341]:     </video>
Nov 14 23:50:48 user nova-compute[75341]:     <rng model="virtio">
Nov 14 23:50:48 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 14 23:50:48 user nova-compute[75341]:     </rng>
Nov 14 23:50:48 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 14 23:50:48 user nova-compute[75341]:     <memballoon model="virtio">
Nov 14 23:50:48 user nova-compute[75341]:       <stats period="10"/>
Nov 14 23:50:48 user nova-compute[75341]:     </memballoon>
Nov 14 23:50:48 user nova-compute[75341]:   </devices>
Nov 14 23:50:48 user nova-compute[75341]: </domain>
Nov 14 23:50:48 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 23:50:48 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:50:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-354068924',display_name='tempest-tempest.common.compute-instance-354068924',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-354068924',id=34,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5He922s8rk+PmMGVsYQr5cOK2M7RyE6pRHPukFN7KTwHIYhqpey5pP25XxRxS64/nnTZtZU0s7MKkpDVnG7pj8Bq4MwPLqGCEvlosZZWTgxDQbmYxiYN/iVtJlhcHp1A==',key_name='tempest-keypair-1680109364',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4c69a942b4f4b97a1a3152dea86c7fb',ramdisk_id='',reservation_id='r-hde50h2m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1796396043',owner_user_name='tempest-ServerActionsTestOtherA-1796396043-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:50:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='442aae0161f347d0a79b168a1b60286a',uuid=12c9a7d6-03a5-4fd2-9082-c68758f1542f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1def089a-31ed-4ac4-be68-4050fa9c9fe6", "address": "fa:16:3e:3c:51:b6", "network": {"id": "d86a8e7f-6658-4994-9a13-eb3163bd3865", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-635863702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c69a942b4f4b97a1a3152dea86c7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1def089a-31", "ovs_interfaceid": "1def089a-31ed-4ac4-be68-4050fa9c9fe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 23:50:48 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Converting VIF {"id": "1def089a-31ed-4ac4-be68-4050fa9c9fe6", "address": "fa:16:3e:3c:51:b6", "network": {"id": "d86a8e7f-6658-4994-9a13-eb3163bd3865", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-635863702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c69a942b4f4b97a1a3152dea86c7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1def089a-31", "ovs_interfaceid": "1def089a-31ed-4ac4-be68-4050fa9c9fe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:50:48 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:51:b6,bridge_name='br-int',has_traffic_filtering=True,id=1def089a-31ed-4ac4-be68-4050fa9c9fe6,network=Network(d86a8e7f-6658-4994-9a13-eb3163bd3865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1def089a-31') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:50:48 user nova-compute[75341]: DEBUG os_vif [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:51:b6,bridge_name='br-int',has_traffic_filtering=True,id=1def089a-31ed-4ac4-be68-4050fa9c9fe6,network=Network(d86a8e7f-6658-4994-9a13-eb3163bd3865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1def089a-31') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 23:50:48 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:48 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:50:48 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 23:50:48 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:48 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9606f2fe-d5b3-52bc-9133-fe1bec2b32b7', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:50:48 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:48 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:48 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:48 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1def089a-31, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:50:48 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1def089a-31, col_values=(('qos', UUID('af9ce109-dd50-4f61-8f52-1f31d6d604c5')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:50:48 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1def089a-31, col_values=(('external_ids', {'iface-id': '1def089a-31ed-4ac4-be68-4050fa9c9fe6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:51:b6', 'vm-uuid': '12c9a7d6-03a5-4fd2-9082-c68758f1542f'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:50:48 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:48 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:50:48 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:48 user nova-compute[75341]: INFO os_vif [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:51:b6,bridge_name='br-int',has_traffic_filtering=True,id=1def089a-31ed-4ac4-be68-4050fa9c9fe6,network=Network(d86a8e7f-6658-4994-9a13-eb3163bd3865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1def089a-31')
Nov 14 23:50:48 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:50:48 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] No VIF found with MAC fa:16:3e:3c:51:b6, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:50:48 user nova-compute[75341]: DEBUG nova.network.neutron [req-10084ca4-a41a-4fc0-89f4-ef2ad49468d2 req-8907aec0-43be-483f-a814-3ba863337694 service nova] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Updated VIF entry in instance network info cache for port 1def089a-31ed-4ac4-be68-4050fa9c9fe6. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:50:48 user nova-compute[75341]: DEBUG nova.network.neutron [req-10084ca4-a41a-4fc0-89f4-ef2ad49468d2 req-8907aec0-43be-483f-a814-3ba863337694 service nova] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Updating instance_info_cache with network_info: [{"id": "1def089a-31ed-4ac4-be68-4050fa9c9fe6", "address": "fa:16:3e:3c:51:b6", "network": {"id": "d86a8e7f-6658-4994-9a13-eb3163bd3865", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-635863702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c69a942b4f4b97a1a3152dea86c7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1def089a-31", "ovs_interfaceid": "1def089a-31ed-4ac4-be68-4050fa9c9fe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:50:48 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-10084ca4-a41a-4fc0-89f4-ef2ad49468d2 req-8907aec0-43be-483f-a814-3ba863337694 service nova] Releasing lock "refresh_cache-12c9a7d6-03a5-4fd2-9082-c68758f1542f" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:50:49 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:50:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:50 user nova-compute[75341]: DEBUG nova.compute.manager [req-167c0e34-5ec5-4c2f-931b-6976651f3461 req-e7860c10-0290-4fcf-aedd-eda001a019a3 service nova] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Received event network-vif-plugged-1def089a-31ed-4ac4-be68-4050fa9c9fe6 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:50:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-167c0e34-5ec5-4c2f-931b-6976651f3461 req-e7860c10-0290-4fcf-aedd-eda001a019a3 service nova] Acquiring lock "12c9a7d6-03a5-4fd2-9082-c68758f1542f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:50:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-167c0e34-5ec5-4c2f-931b-6976651f3461 req-e7860c10-0290-4fcf-aedd-eda001a019a3 service nova] Lock "12c9a7d6-03a5-4fd2-9082-c68758f1542f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:50:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-167c0e34-5ec5-4c2f-931b-6976651f3461 req-e7860c10-0290-4fcf-aedd-eda001a019a3 service nova] Lock "12c9a7d6-03a5-4fd2-9082-c68758f1542f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:50:50 user nova-compute[75341]: DEBUG nova.compute.manager [req-167c0e34-5ec5-4c2f-931b-6976651f3461 req-e7860c10-0290-4fcf-aedd-eda001a019a3 service nova] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] No waiting events found dispatching network-vif-plugged-1def089a-31ed-4ac4-be68-4050fa9c9fe6 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:50:50 user nova-compute[75341]: WARNING nova.compute.manager [req-167c0e34-5ec5-4c2f-931b-6976651f3461 req-e7860c10-0290-4fcf-aedd-eda001a019a3 service nova] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Received unexpected event network-vif-plugged-1def089a-31ed-4ac4-be68-4050fa9c9fe6 for instance with vm_state building and task_state spawning.
Nov 14 23:50:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:50 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:50:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:51 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:50:51 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:50:51 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75341) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 23:50:52 user nova-compute[75341]: DEBUG nova.compute.manager [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Instance event wait completed in 0 seconds for  {{(pid=75341) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 23:50:52 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Guest created on hypervisor {{(pid=75341) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 23:50:52 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Instance spawned successfully.
Nov 14 23:50:52 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 23:50:52 user nova-compute[75341]: DEBUG nova.compute.manager [req-339cf315-6b8f-4e35-8a9b-184f4c8a8590 req-519c2d2c-3499-4ad5-a9cf-061c516beb72 service nova] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Received event network-vif-plugged-1def089a-31ed-4ac4-be68-4050fa9c9fe6 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:50:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-339cf315-6b8f-4e35-8a9b-184f4c8a8590 req-519c2d2c-3499-4ad5-a9cf-061c516beb72 service nova] Acquiring lock "12c9a7d6-03a5-4fd2-9082-c68758f1542f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:50:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-339cf315-6b8f-4e35-8a9b-184f4c8a8590 req-519c2d2c-3499-4ad5-a9cf-061c516beb72 service nova] Lock "12c9a7d6-03a5-4fd2-9082-c68758f1542f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:50:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-339cf315-6b8f-4e35-8a9b-184f4c8a8590 req-519c2d2c-3499-4ad5-a9cf-061c516beb72 service nova] Lock "12c9a7d6-03a5-4fd2-9082-c68758f1542f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:50:52 user nova-compute[75341]: DEBUG nova.compute.manager [req-339cf315-6b8f-4e35-8a9b-184f4c8a8590 req-519c2d2c-3499-4ad5-a9cf-061c516beb72 service nova] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] No waiting events found dispatching network-vif-plugged-1def089a-31ed-4ac4-be68-4050fa9c9fe6 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:50:52 user nova-compute[75341]: WARNING nova.compute.manager [req-339cf315-6b8f-4e35-8a9b-184f4c8a8590 req-519c2d2c-3499-4ad5-a9cf-061c516beb72 service nova] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Received unexpected event network-vif-plugged-1def089a-31ed-4ac4-be68-4050fa9c9fe6 for instance with vm_state building and task_state spawning.
Nov 14 23:50:52 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Found default for hw_cdrom_bus of ide {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:50:52 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Found default for hw_disk_bus of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:50:52 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Found default for hw_input_bus of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:50:52 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Found default for hw_pointer_model of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:50:52 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Found default for hw_video_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:50:52 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Found default for hw_vif_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:50:52 user nova-compute[75341]: INFO nova.compute.manager [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Took 5.71 seconds to spawn the instance on the hypervisor.
Nov 14 23:50:52 user nova-compute[75341]: DEBUG nova.compute.manager [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 23:50:52 user nova-compute[75341]: INFO nova.compute.manager [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Took 6.43 seconds to build instance.
Nov 14 23:50:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0a944b86-de15-427b-80d7-03e776b84e18 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "12c9a7d6-03a5-4fd2-9082-c68758f1542f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.524s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:50:52 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:50:53 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:53 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:53 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:50:53 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Starting heal instance info cache {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 23:50:53 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Rebuilding the list of instances to heal {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 23:50:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "refresh_cache-a141d7ee-3f77-4fdc-85ec-2cbd5af17646" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:50:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquired lock "refresh_cache-a141d7ee-3f77-4fdc-85ec-2cbd5af17646" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:50:54 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: a141d7ee-3f77-4fdc-85ec-2cbd5af17646] Forcefully refreshing network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 23:50:54 user nova-compute[75341]: DEBUG nova.objects.instance [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lazy-loading 'info_cache' on Instance uuid a141d7ee-3f77-4fdc-85ec-2cbd5af17646 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:50:54 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: a141d7ee-3f77-4fdc-85ec-2cbd5af17646] Updating instance_info_cache with network_info: [{"id": "a64b87d5-7175-42f5-b6d0-09f45ac29e96", "address": "fa:16:3e:4c:4c:c2", "network": {"id": "7673016a-86f3-4643-a21f-148adc2a96dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-89785556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d86dc7dc1b6b41bf874f1a25d7bca91d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa64b87d5-71", "ovs_interfaceid": "a64b87d5-7175-42f5-b6d0-09f45ac29e96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:50:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Releasing lock "refresh_cache-a141d7ee-3f77-4fdc-85ec-2cbd5af17646" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:50:54 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: a141d7ee-3f77-4fdc-85ec-2cbd5af17646] Updated the network info_cache for instance {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 23:50:54 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:50:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:50:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:50:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:50:54 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75341) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 23:50:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5070fb03-8f40-426c-8c3e-192f6517f7c3/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:50:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5070fb03-8f40-426c-8c3e-192f6517f7c3/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:50:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5070fb03-8f40-426c-8c3e-192f6517f7c3/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:50:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5070fb03-8f40-426c-8c3e-192f6517f7c3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:50:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 23:50:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a141d7ee-3f77-4fdc-85ec-2cbd5af17646/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:50:55 user nova-compute[75341]: INFO nova.compute.manager [None req-b517d195-3b73-47bb-b5bb-c80273ba98f5 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Unrescuing
Nov 14 23:50:55 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b517d195-3b73-47bb-b5bb-c80273ba98f5 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Acquiring lock "refresh_cache-51045050-c7c6-49c5-acd4-2a76be0f466f" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:50:55 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b517d195-3b73-47bb-b5bb-c80273ba98f5 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Acquired lock "refresh_cache-51045050-c7c6-49c5-acd4-2a76be0f466f" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:50:55 user nova-compute[75341]: DEBUG nova.network.neutron [None req-b517d195-3b73-47bb-b5bb-c80273ba98f5 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 23:50:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a141d7ee-3f77-4fdc-85ec-2cbd5af17646/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:50:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a141d7ee-3f77-4fdc-85ec-2cbd5af17646/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:50:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a141d7ee-3f77-4fdc-85ec-2cbd5af17646/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:50:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c9a7d6-03a5-4fd2-9082-c68758f1542f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:50:56 user nova-compute[75341]: DEBUG nova.network.neutron [None req-b517d195-3b73-47bb-b5bb-c80273ba98f5 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Updating instance_info_cache with network_info: [{"id": "64ebe5e6-0c81-41fd-b49e-75bed11e40df", "address": "fa:16:3e:44:63:f2", "network": {"id": "fcd22da6-016e-4872-a84c-4d82601c48d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-550677181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44bb8b1415c14bb59c4c35cc2b830875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ebe5e6-0c", "ovs_interfaceid": "64ebe5e6-0c81-41fd-b49e-75bed11e40df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:50:56 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b517d195-3b73-47bb-b5bb-c80273ba98f5 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Releasing lock "refresh_cache-51045050-c7c6-49c5-acd4-2a76be0f466f" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:50:56 user nova-compute[75341]: DEBUG nova.objects.instance [None req-b517d195-3b73-47bb-b5bb-c80273ba98f5 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lazy-loading 'flavor' on Instance uuid 51045050-c7c6-49c5-acd4-2a76be0f466f {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:50:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c9a7d6-03a5-4fd2-9082-c68758f1542f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:50:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c9a7d6-03a5-4fd2-9082-c68758f1542f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:50:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c9a7d6-03a5-4fd2-9082-c68758f1542f/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:50:56 user nova-compute[75341]: DEBUG nova.compute.manager [req-df83911d-b49b-4da8-ac18-5063f20b89c5 req-d5b5b769-7fc4-4fda-b7eb-497e17a3d3e7 service nova] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Received event network-vif-unplugged-64ebe5e6-0c81-41fd-b49e-75bed11e40df {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:50:56 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-df83911d-b49b-4da8-ac18-5063f20b89c5 req-d5b5b769-7fc4-4fda-b7eb-497e17a3d3e7 service nova] Acquiring lock "51045050-c7c6-49c5-acd4-2a76be0f466f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:50:56 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-df83911d-b49b-4da8-ac18-5063f20b89c5 req-d5b5b769-7fc4-4fda-b7eb-497e17a3d3e7 service nova] Lock "51045050-c7c6-49c5-acd4-2a76be0f466f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:50:56 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-df83911d-b49b-4da8-ac18-5063f20b89c5 req-d5b5b769-7fc4-4fda-b7eb-497e17a3d3e7 service nova] Lock "51045050-c7c6-49c5-acd4-2a76be0f466f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:50:56 user nova-compute[75341]: DEBUG nova.compute.manager [req-df83911d-b49b-4da8-ac18-5063f20b89c5 req-d5b5b769-7fc4-4fda-b7eb-497e17a3d3e7 service nova] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] No waiting events found dispatching network-vif-unplugged-64ebe5e6-0c81-41fd-b49e-75bed11e40df {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:50:56 user nova-compute[75341]: WARNING nova.compute.manager [req-df83911d-b49b-4da8-ac18-5063f20b89c5 req-d5b5b769-7fc4-4fda-b7eb-497e17a3d3e7 service nova] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Received unexpected event network-vif-unplugged-64ebe5e6-0c81-41fd-b49e-75bed11e40df for instance with vm_state rescued and task_state unrescuing.
Nov 14 23:50:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk.rescue --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:50:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk.rescue --force-share --output=json" returned: 0 in 0.224s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:50:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk.rescue --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:50:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:50:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:50:57 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Instance destroyed successfully.
Nov 14 23:50:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:50:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:50:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:50:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk.rescue --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:50:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:50:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk.rescue --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:50:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:50:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:50:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:50:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:50:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:50:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:50:58 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:50:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:50:58 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:58 user nova-compute[75341]: DEBUG nova.compute.manager [req-5020a20d-d576-4b62-b8d9-3af8c8e7644f req-6e4f836d-f97a-434a-aa52-f9ce8245601c service nova] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Received event network-vif-plugged-64ebe5e6-0c81-41fd-b49e-75bed11e40df {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:50:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-5020a20d-d576-4b62-b8d9-3af8c8e7644f req-6e4f836d-f97a-434a-aa52-f9ce8245601c service nova] Acquiring lock "51045050-c7c6-49c5-acd4-2a76be0f466f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:50:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-5020a20d-d576-4b62-b8d9-3af8c8e7644f req-6e4f836d-f97a-434a-aa52-f9ce8245601c service nova] Lock "51045050-c7c6-49c5-acd4-2a76be0f466f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:50:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-5020a20d-d576-4b62-b8d9-3af8c8e7644f req-6e4f836d-f97a-434a-aa52-f9ce8245601c service nova] Lock "51045050-c7c6-49c5-acd4-2a76be0f466f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:50:58 user nova-compute[75341]: DEBUG nova.compute.manager [req-5020a20d-d576-4b62-b8d9-3af8c8e7644f req-6e4f836d-f97a-434a-aa52-f9ce8245601c service nova] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] No waiting events found dispatching network-vif-plugged-64ebe5e6-0c81-41fd-b49e-75bed11e40df {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:50:58 user nova-compute[75341]: WARNING nova.compute.manager [req-5020a20d-d576-4b62-b8d9-3af8c8e7644f req-6e4f836d-f97a-434a-aa52-f9ce8245601c service nova] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Received unexpected event network-vif-plugged-64ebe5e6-0c81-41fd-b49e-75bed11e40df for instance with vm_state rescued and task_state unrescuing.
Nov 14 23:50:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:50:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:50:58 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:58 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:50:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:50:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:50:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:50:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01b30e67-ac52-4cf6-9a31-30096f8b3344/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:50:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01b30e67-ac52-4cf6-9a31-30096f8b3344/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:50:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01b30e67-ac52-4cf6-9a31-30096f8b3344/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:50:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01b30e67-ac52-4cf6-9a31-30096f8b3344/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:50:59 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 23:51:00 user nova-compute[75341]: DEBUG nova.compute.manager [req-e5744569-6d0e-4abf-b633-4472cb8d2aea req-05ea22b0-d5fa-44a4-bda6-e0363f630c94 service nova] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Received event network-vif-plugged-64ebe5e6-0c81-41fd-b49e-75bed11e40df {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:51:00 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-e5744569-6d0e-4abf-b633-4472cb8d2aea req-05ea22b0-d5fa-44a4-bda6-e0363f630c94 service nova] Acquiring lock "51045050-c7c6-49c5-acd4-2a76be0f466f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:51:00 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-e5744569-6d0e-4abf-b633-4472cb8d2aea req-05ea22b0-d5fa-44a4-bda6-e0363f630c94 service nova] Lock "51045050-c7c6-49c5-acd4-2a76be0f466f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:51:00 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-e5744569-6d0e-4abf-b633-4472cb8d2aea req-05ea22b0-d5fa-44a4-bda6-e0363f630c94 service nova] Lock "51045050-c7c6-49c5-acd4-2a76be0f466f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:51:00 user nova-compute[75341]: DEBUG nova.compute.manager [req-e5744569-6d0e-4abf-b633-4472cb8d2aea req-05ea22b0-d5fa-44a4-bda6-e0363f630c94 service nova] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] No waiting events found dispatching network-vif-plugged-64ebe5e6-0c81-41fd-b49e-75bed11e40df {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:51:00 user nova-compute[75341]: WARNING nova.compute.manager [req-e5744569-6d0e-4abf-b633-4472cb8d2aea req-05ea22b0-d5fa-44a4-bda6-e0363f630c94 service nova] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Received unexpected event network-vif-plugged-64ebe5e6-0c81-41fd-b49e-75bed11e40df for instance with vm_state rescued and task_state unrescuing.
Nov 14 23:51:00 user nova-compute[75341]: DEBUG nova.compute.manager [req-e5744569-6d0e-4abf-b633-4472cb8d2aea req-05ea22b0-d5fa-44a4-bda6-e0363f630c94 service nova] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Received event network-vif-plugged-64ebe5e6-0c81-41fd-b49e-75bed11e40df {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:51:00 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-e5744569-6d0e-4abf-b633-4472cb8d2aea req-05ea22b0-d5fa-44a4-bda6-e0363f630c94 service nova] Acquiring lock "51045050-c7c6-49c5-acd4-2a76be0f466f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:51:00 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-e5744569-6d0e-4abf-b633-4472cb8d2aea req-05ea22b0-d5fa-44a4-bda6-e0363f630c94 service nova] Lock "51045050-c7c6-49c5-acd4-2a76be0f466f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:51:00 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-e5744569-6d0e-4abf-b633-4472cb8d2aea req-05ea22b0-d5fa-44a4-bda6-e0363f630c94 service nova] Lock "51045050-c7c6-49c5-acd4-2a76be0f466f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:51:00 user nova-compute[75341]: DEBUG nova.compute.manager [req-e5744569-6d0e-4abf-b633-4472cb8d2aea req-05ea22b0-d5fa-44a4-bda6-e0363f630c94 service nova] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] No waiting events found dispatching network-vif-plugged-64ebe5e6-0c81-41fd-b49e-75bed11e40df {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:51:00 user nova-compute[75341]: WARNING nova.compute.manager [req-e5744569-6d0e-4abf-b633-4472cb8d2aea req-05ea22b0-d5fa-44a4-bda6-e0363f630c94 service nova] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Received unexpected event network-vif-plugged-64ebe5e6-0c81-41fd-b49e-75bed11e40df for instance with vm_state rescued and task_state unrescuing.
Nov 14 23:51:00 user nova-compute[75341]: DEBUG nova.compute.manager [None req-b517d195-3b73-47bb-b5bb-c80273ba98f5 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 23:51:00 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:51:00 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:51:00 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Hypervisor/Node resource view: name=user free_ram=7511MB free_disk=25.378551483154297GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75341) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 23:51:00 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:51:00 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:51:00 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Acquiring lock "5950ba70-e7c0-4b5f-839c-569e0a27b625" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:51:00 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "5950ba70-e7c0-4b5f-839c-569e0a27b625" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:51:00 user nova-compute[75341]: INFO nova.compute.manager [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Unshelving
Nov 14 23:51:01 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:51:01 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance a141d7ee-3f77-4fdc-85ec-2cbd5af17646 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:51:01 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 51045050-c7c6-49c5-acd4-2a76be0f466f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:51:01 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 6382e432-838f-4d89-a743-cbaa37f50ab5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:51:01 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 5070fb03-8f40-426c-8c3e-192f6517f7c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:51:01 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance defae731-4191-4526-99cc-a301cf5b3355 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:51:01 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 9996fc26-f3ad-40e2-91a5-51178c0194ef actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:51:01 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 01b30e67-ac52-4cf6-9a31-30096f8b3344 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:51:01 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 2316aa9e-d4c9-43d0-9918-86265583aed1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:51:01 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 713b9caa-4ca7-4d78-8252-e8419d72ece3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:51:01 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 12c9a7d6-03a5-4fd2-9082-c68758f1542f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:51:01 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 5950ba70-e7c0-4b5f-839c-569e0a27b625 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 14 23:51:01 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 23:51:01 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 23:51:01 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Refreshing inventories for resource provider 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 23:51:01 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Updating ProviderTree inventory for provider 8fa114cc-b541-418f-865c-16c44294e72d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 23:51:01 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Updating inventory in ProviderTree for provider 8fa114cc-b541-418f-865c-16c44294e72d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 23:51:01 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Refreshing aggregate associations for resource provider 8fa114cc-b541-418f-865c-16c44294e72d, aggregates: None {{(pid=75341) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 23:51:01 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Refreshing trait associations for resource provider 8fa114cc-b541-418f-865c-16c44294e72d, traits: COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_MMX,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000E {{(pid=75341) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 23:51:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:01 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:51:01 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:51:01 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Compute_service record updated for user:user {{(pid=75341) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 23:51:01 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.931s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:51:01 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.666s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:51:01 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:51:01 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75341) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 23:51:01 user nova-compute[75341]: DEBUG nova.objects.instance [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lazy-loading 'pci_requests' on Instance uuid 5950ba70-e7c0-4b5f-839c-569e0a27b625 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:51:01 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:51:01 user nova-compute[75341]: DEBUG nova.objects.instance [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lazy-loading 'numa_topology' on Instance uuid 5950ba70-e7c0-4b5f-839c-569e0a27b625 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:51:01 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75341) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 23:51:01 user nova-compute[75341]: INFO nova.compute.claims [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Claim successful on node user
Nov 14 23:51:02 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:51:02 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:51:02 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.532s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:51:02 user nova-compute[75341]: INFO nova.network.neutron [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Updating port 6df0f48f-1a94-42ec-b540-0aee55dc6b70 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 14 23:51:02 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:51:02 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:51:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Acquiring lock "refresh_cache-5950ba70-e7c0-4b5f-839c-569e0a27b625" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:51:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Acquired lock "refresh_cache-5950ba70-e7c0-4b5f-839c-569e0a27b625" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:51:03 user nova-compute[75341]: DEBUG nova.network.neutron [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 23:51:03 user nova-compute[75341]: DEBUG nova.compute.manager [req-fac64dba-f714-48d7-9e38-5ec0f6739f2e req-1aadf405-09ac-4706-86cf-73c28dce8d1f service nova] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Received event network-changed-6df0f48f-1a94-42ec-b540-0aee55dc6b70 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:51:03 user nova-compute[75341]: DEBUG nova.compute.manager [req-fac64dba-f714-48d7-9e38-5ec0f6739f2e req-1aadf405-09ac-4706-86cf-73c28dce8d1f service nova] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Refreshing instance network info cache due to event network-changed-6df0f48f-1a94-42ec-b540-0aee55dc6b70. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:51:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-fac64dba-f714-48d7-9e38-5ec0f6739f2e req-1aadf405-09ac-4706-86cf-73c28dce8d1f service nova] Acquiring lock "refresh_cache-5950ba70-e7c0-4b5f-839c-569e0a27b625" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:51:03 user nova-compute[75341]: DEBUG nova.network.neutron [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Updating instance_info_cache with network_info: [{"id": "6df0f48f-1a94-42ec-b540-0aee55dc6b70", "address": "fa:16:3e:67:d4:76", "network": {"id": "e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-64240219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f27e41f4cc1451291b8aca34544867b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df0f48f-1a", "ovs_interfaceid": "6df0f48f-1a94-42ec-b540-0aee55dc6b70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:51:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Releasing lock "refresh_cache-5950ba70-e7c0-4b5f-839c-569e0a27b625" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:51:03 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Creating instance directory {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 23:51:03 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Creating image(s)
Nov 14 23:51:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Acquiring lock "/opt/stack/data/nova/instances/5950ba70-e7c0-4b5f-839c-569e0a27b625/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:51:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "/opt/stack/data/nova/instances/5950ba70-e7c0-4b5f-839c-569e0a27b625/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:51:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "/opt/stack/data/nova/instances/5950ba70-e7c0-4b5f-839c-569e0a27b625/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:51:03 user nova-compute[75341]: DEBUG nova.objects.instance [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5950ba70-e7c0-4b5f-839c-569e0a27b625 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:51:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-fac64dba-f714-48d7-9e38-5ec0f6739f2e req-1aadf405-09ac-4706-86cf-73c28dce8d1f service nova] Acquired lock "refresh_cache-5950ba70-e7c0-4b5f-839c-569e0a27b625" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:51:03 user nova-compute[75341]: DEBUG nova.network.neutron [req-fac64dba-f714-48d7-9e38-5ec0f6739f2e req-1aadf405-09ac-4706-86cf-73c28dce8d1f service nova] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Refreshing network info cache for port 6df0f48f-1a94-42ec-b540-0aee55dc6b70 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:51:03 user nova-compute[75341]: DEBUG nova.objects.base [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Object Instance<5950ba70-e7c0-4b5f-839c-569e0a27b625> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75341) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 23:51:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Acquiring lock "a226ef0bac4e3c80b432f10ecbdca15260668496" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:51:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "a226ef0bac4e3c80b432f10ecbdca15260668496" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:51:03 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a226ef0bac4e3c80b432f10ecbdca15260668496.part --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:05 user nova-compute[75341]: DEBUG nova.network.neutron [req-fac64dba-f714-48d7-9e38-5ec0f6739f2e req-1aadf405-09ac-4706-86cf-73c28dce8d1f service nova] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Updated VIF entry in instance network info cache for port 6df0f48f-1a94-42ec-b540-0aee55dc6b70. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:51:05 user nova-compute[75341]: DEBUG nova.network.neutron [req-fac64dba-f714-48d7-9e38-5ec0f6739f2e req-1aadf405-09ac-4706-86cf-73c28dce8d1f service nova] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Updating instance_info_cache with network_info: [{"id": "6df0f48f-1a94-42ec-b540-0aee55dc6b70", "address": "fa:16:3e:67:d4:76", "network": {"id": "e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-64240219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f27e41f4cc1451291b8aca34544867b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df0f48f-1a", "ovs_interfaceid": "6df0f48f-1a94-42ec-b540-0aee55dc6b70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:51:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a226ef0bac4e3c80b432f10ecbdca15260668496.part --force-share --output=json" returned: 0 in 0.260s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:05 user nova-compute[75341]: DEBUG nova.virt.images [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] 0dac51f9-c959-4cbf-949a-c63a3fbc3ace was qcow2, converting to raw {{(pid=75341) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 23:51:05 user nova-compute[75341]: DEBUG nova.privsep.utils [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75341) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 23:51:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a226ef0bac4e3c80b432f10ecbdca15260668496.part /opt/stack/data/nova/instances/_base/a226ef0bac4e3c80b432f10ecbdca15260668496.converted {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:05 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-fac64dba-f714-48d7-9e38-5ec0f6739f2e req-1aadf405-09ac-4706-86cf-73c28dce8d1f service nova] Releasing lock "refresh_cache-5950ba70-e7c0-4b5f-839c-569e0a27b625" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:51:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a226ef0bac4e3c80b432f10ecbdca15260668496.part /opt/stack/data/nova/instances/_base/a226ef0bac4e3c80b432f10ecbdca15260668496.converted" returned: 0 in 0.226s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a226ef0bac4e3c80b432f10ecbdca15260668496.converted --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a226ef0bac4e3c80b432f10ecbdca15260668496.converted --force-share --output=json" returned: 0 in 0.202s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:05 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "a226ef0bac4e3c80b432f10ecbdca15260668496" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.827s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:51:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a226ef0bac4e3c80b432f10ecbdca15260668496 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a226ef0bac4e3c80b432f10ecbdca15260668496 --force-share --output=json" returned: 0 in 0.218s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:05 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Acquiring lock "a226ef0bac4e3c80b432f10ecbdca15260668496" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:51:05 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "a226ef0bac4e3c80b432f10ecbdca15260668496" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:51:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a226ef0bac4e3c80b432f10ecbdca15260668496 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a226ef0bac4e3c80b432f10ecbdca15260668496 --force-share --output=json" returned: 0 in 0.213s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a226ef0bac4e3c80b432f10ecbdca15260668496,backing_fmt=raw /opt/stack/data/nova/instances/5950ba70-e7c0-4b5f-839c-569e0a27b625/disk 1073741824 {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a226ef0bac4e3c80b432f10ecbdca15260668496,backing_fmt=raw /opt/stack/data/nova/instances/5950ba70-e7c0-4b5f-839c-569e0a27b625/disk 1073741824" returned: 0 in 0.060s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:05 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "a226ef0bac4e3c80b432f10ecbdca15260668496" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:51:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a226ef0bac4e3c80b432f10ecbdca15260668496 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a226ef0bac4e3c80b432f10ecbdca15260668496 --force-share --output=json" returned: 0 in 0.259s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:06 user nova-compute[75341]: DEBUG nova.objects.instance [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lazy-loading 'migration_context' on Instance uuid 5950ba70-e7c0-4b5f-839c-569e0a27b625 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:51:06 user nova-compute[75341]: DEBUG nova.objects.base [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Object Instance<5950ba70-e7c0-4b5f-839c-569e0a27b625> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75341) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 23:51:06 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Rebasing disk image.
Nov 14 23:51:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.248s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 -F raw /opt/stack/data/nova/instances/5950ba70-e7c0-4b5f-839c-569e0a27b625/disk {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:06 user nova-compute[75341]: DEBUG nova.compute.manager [req-eea1ba27-c153-434d-96b1-11df29ac54c2 req-af5f0fc3-80e1-4027-a925-2e364059947b service nova] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Received event network-changed-4eb44d3f-ff8b-4b03-aa6f-d257d1de66e4 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:51:06 user nova-compute[75341]: DEBUG nova.compute.manager [req-eea1ba27-c153-434d-96b1-11df29ac54c2 req-af5f0fc3-80e1-4027-a925-2e364059947b service nova] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Refreshing instance network info cache due to event network-changed-4eb44d3f-ff8b-4b03-aa6f-d257d1de66e4. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:51:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-eea1ba27-c153-434d-96b1-11df29ac54c2 req-af5f0fc3-80e1-4027-a925-2e364059947b service nova] Acquiring lock "refresh_cache-01b30e67-ac52-4cf6-9a31-30096f8b3344" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:51:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-eea1ba27-c153-434d-96b1-11df29ac54c2 req-af5f0fc3-80e1-4027-a925-2e364059947b service nova] Acquired lock "refresh_cache-01b30e67-ac52-4cf6-9a31-30096f8b3344" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:51:06 user nova-compute[75341]: DEBUG nova.network.neutron [req-eea1ba27-c153-434d-96b1-11df29ac54c2 req-af5f0fc3-80e1-4027-a925-2e364059947b service nova] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Refreshing network info cache for port 4eb44d3f-ff8b-4b03-aa6f-d257d1de66e4 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:51:07 user nova-compute[75341]: DEBUG nova.network.neutron [req-eea1ba27-c153-434d-96b1-11df29ac54c2 req-af5f0fc3-80e1-4027-a925-2e364059947b service nova] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Updated VIF entry in instance network info cache for port 4eb44d3f-ff8b-4b03-aa6f-d257d1de66e4. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:51:07 user nova-compute[75341]: DEBUG nova.network.neutron [req-eea1ba27-c153-434d-96b1-11df29ac54c2 req-af5f0fc3-80e1-4027-a925-2e364059947b service nova] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Updating instance_info_cache with network_info: [{"id": "4eb44d3f-ff8b-4b03-aa6f-d257d1de66e4", "address": "fa:16:3e:f4:cc:cd", "network": {"id": "e9abba2c-7994-4781-a3ca-07e8e4be7825", "bridge": "br-int", "label": "tempest-TestStampPattern-1410971761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af462be688d4127a8368ee3dcb2a340", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eb44d3f-ff", "ovs_interfaceid": "4eb44d3f-ff8b-4b03-aa6f-d257d1de66e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:51:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-eea1ba27-c153-434d-96b1-11df29ac54c2 req-af5f0fc3-80e1-4027-a925-2e364059947b service nova] Releasing lock "refresh_cache-01b30e67-ac52-4cf6-9a31-30096f8b3344" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:51:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0f37e883-952c-4039-bd20-c7fe32dab93a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Acquiring lock "01b30e67-ac52-4cf6-9a31-30096f8b3344" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:51:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0f37e883-952c-4039-bd20-c7fe32dab93a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Lock "01b30e67-ac52-4cf6-9a31-30096f8b3344" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:51:07 user nova-compute[75341]: DEBUG nova.objects.instance [None req-0f37e883-952c-4039-bd20-c7fe32dab93a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Lazy-loading 'flavor' on Instance uuid 01b30e67-ac52-4cf6-9a31-30096f8b3344 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:51:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0f37e883-952c-4039-bd20-c7fe32dab93a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Lock "01b30e67-ac52-4cf6-9a31-30096f8b3344" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:51:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0f37e883-952c-4039-bd20-c7fe32dab93a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Acquiring lock "01b30e67-ac52-4cf6-9a31-30096f8b3344" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:51:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0f37e883-952c-4039-bd20-c7fe32dab93a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Lock "01b30e67-ac52-4cf6-9a31-30096f8b3344" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:51:08 user nova-compute[75341]: INFO nova.compute.manager [None req-0f37e883-952c-4039-bd20-c7fe32dab93a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Attaching volume c41d6927-f54d-4872-be46-03a519486d61 to /dev/vdb
Nov 14 23:51:08 user nova-compute[75341]: DEBUG os_brick.utils [None req-0f37e883-952c-4039-bd20-c7fe32dab93a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:51:08 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:08 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:08 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f75dfc-1037-474c-b1c0-18332cc05317]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6d1cfca09c9\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:51:08 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:08 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:08 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[af3efc01-4319-4104-b3d5-76053d6c82b7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:51:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Acquiring lock "9ae467da-9fb5-4f4f-a3f8-fce2ac368dda" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:51:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lock "9ae467da-9fb5-4f4f-a3f8-fce2ac368dda" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:51:08 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:08 user nova-compute[75341]: DEBUG nova.compute.manager [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Starting instance... {{(pid=75341) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 23:51:08 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:08 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba659e09-5e0f-4e82-82d8-bbeddfbb6ea6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:51:08 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f47a11-cd17-4ae2-8ca1-bce2e959288e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:51:08 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-0f37e883-952c-4039-bd20-c7fe32dab93a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Running cmd (subprocess): nvme version {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:08 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-0f37e883-952c-4039-bd20-c7fe32dab93a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] 'nvme version' failed. Not Retrying. {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:51:08 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0f37e883-952c-4039-bd20-c7fe32dab93a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] nvme not present on system {{(pid=75341) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 23:51:08 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:08 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:51:08 user nova-compute[75341]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 23:51:08 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d99215f-a2a3-45bd-a665-4684b4acc5b3]: (4, '') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:51:08 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-0f37e883-952c-4039-bd20-c7fe32dab93a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75341) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 23:51:08 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-0f37e883-952c-4039-bd20-c7fe32dab93a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 23:51:08 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-0f37e883-952c-4039-bd20-c7fe32dab93a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] LIGHTOS: no hostnqn found. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 23:51:08 user nova-compute[75341]: DEBUG os_brick.utils [None req-0f37e883-952c-4039-bd20-c7fe32dab93a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] <== get_connector_properties: return (170ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6d1cfca09c9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:51:08 user nova-compute[75341]: DEBUG nova.virt.block_device [None req-0f37e883-952c-4039-bd20-c7fe32dab93a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Updating existing volume attachment record: 7b0a7bde-ac4e-47a6-be76-b5c3f0ce22f7 {{(pid=75341) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 23:51:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:51:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:51:08 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:08 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75341) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 23:51:08 user nova-compute[75341]: INFO nova.compute.claims [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Claim successful on node user
Nov 14 23:51:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 -F raw /opt/stack/data/nova/instances/5950ba70-e7c0-4b5f-839c-569e0a27b625/disk" returned: 0 in 2.531s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:09 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Created local disks {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 23:51:09 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Ensure instance console log exists: /opt/stack/data/nova/instances/5950ba70-e7c0-4b5f-839c-569e0a27b625/console.log {{(pid=75341) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 23:51:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:51:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:51:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:51:09 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Start _get_guest_xml network_info=[{"id": "6df0f48f-1a94-42ec-b540-0aee55dc6b70", "address": "fa:16:3e:67:d4:76", "network": {"id": "e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-64240219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f27e41f4cc1451291b8aca34544867b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df0f48f-1a", "ovs_interfaceid": "6df0f48f-1a94-42ec-b540-0aee55dc6b70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='9bae5b29919eecb3ac65f9f093043b39',container_format='bare',created_at=2023-11-14T23:49:07Z,direct_url=<?>,disk_format='qcow2',id=0dac51f9-c959-4cbf-949a-c63a3fbc3ace,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1777010379-shelved',owner='5f27e41f4cc1451291b8aca34544867b',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-14T23:49:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encrypted': False, 'image_id': 'e46abb82-b810-490e-a8a1-ccdc5fa1a796'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 23:51:09 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:51:09 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:51:09 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 23:51:09 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 23:51:09 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 23:51:09 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 23:51:09 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 23:51:09 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='9bae5b29919eecb3ac65f9f093043b39',container_format='bare',created_at=2023-11-14T23:49:07Z,direct_url=<?>,disk_format='qcow2',id=0dac51f9-c959-4cbf-949a-c63a3fbc3ace,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1777010379-shelved',owner='5f27e41f4cc1451291b8aca34544867b',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-14T23:49:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 23:51:09 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 23:51:09 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 23:51:09 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 23:51:09 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 23:51:09 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 23:51:09 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 23:51:09 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 23:51:09 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 23:51:09 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 23:51:09 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 23:51:09 user nova-compute[75341]: DEBUG nova.objects.instance [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5950ba70-e7c0-4b5f-839c-569e0a27b625 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:51:09 user nova-compute[75341]: DEBUG nova.objects.base [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Object Instance<5950ba70-e7c0-4b5f-839c-569e0a27b625> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75341) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 23:51:09 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T23:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1777010379',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1777010379',id=26,image_ref='0dac51f9-c959-4cbf-949a-c63a3fbc3ace',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1640023904',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:47:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5f27e41f4cc1451291b8aca34544867b',ramdisk_id='',reservation_id='r-5jpqwdpl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-946394493',owner_user_name='tempest-AttachVolumeShelveTestJSON-946394493-project-member',shelved_at='2023-11-14T23:49:11.542787',shelved_host='user',shelved_image_id='0dac51f9-c959-4cbf-949a-c63a3fbc3ace'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:51:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38acd33ad6754965a53017185f473f8a',uuid=5950ba70-e7c0-4b5f-839c-569e0a27b625,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "6df0f48f-1a94-42ec-b540-0aee55dc6b70", "address": "fa:16:3e:67:d4:76", "network": {"id": "e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-64240219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f27e41f4cc1451291b8aca34544867b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df0f48f-1a", "ovs_interfaceid": "6df0f48f-1a94-42ec-b540-0aee55dc6b70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:51:09 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Converting VIF {"id": "6df0f48f-1a94-42ec-b540-0aee55dc6b70", "address": "fa:16:3e:67:d4:76", "network": {"id": "e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-64240219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f27e41f4cc1451291b8aca34544867b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df0f48f-1a", "ovs_interfaceid": "6df0f48f-1a94-42ec-b540-0aee55dc6b70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:51:09 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:d4:76,bridge_name='br-int',has_traffic_filtering=True,id=6df0f48f-1a94-42ec-b540-0aee55dc6b70,network=Network(e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6df0f48f-1a') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:51:09 user nova-compute[75341]: DEBUG nova.objects.instance [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lazy-loading 'pci_devices' on Instance uuid 5950ba70-e7c0-4b5f-839c-569e0a27b625 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:51:09 user nova-compute[75341]: DEBUG nova.objects.base [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Object Instance<5950ba70-e7c0-4b5f-839c-569e0a27b625> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75341) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 23:51:09 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] End _get_guest_xml xml=<domain type="kvm">
Nov 14 23:51:09 user nova-compute[75341]:   <uuid>5950ba70-e7c0-4b5f-839c-569e0a27b625</uuid>
Nov 14 23:51:09 user nova-compute[75341]:   <name>instance-0000001a</name>
Nov 14 23:51:09 user nova-compute[75341]:   <memory>524288</memory>
Nov 14 23:51:09 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 14 23:51:09 user nova-compute[75341]:   <metadata>
Nov 14 23:51:09 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 23:51:09 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 14 23:51:09 user nova-compute[75341]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1777010379</nova:name>
Nov 14 23:51:09 user nova-compute[75341]:       <nova:creationTime>2023-11-14 23:51:09</nova:creationTime>
Nov 14 23:51:09 user nova-compute[75341]:       <nova:flavor name="m1.tiny">
Nov 14 23:51:09 user nova-compute[75341]:         <nova:memory>512</nova:memory>
Nov 14 23:51:09 user nova-compute[75341]:         <nova:disk>1</nova:disk>
Nov 14 23:51:09 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 14 23:51:09 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 23:51:09 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 14 23:51:09 user nova-compute[75341]:       </nova:flavor>
Nov 14 23:51:09 user nova-compute[75341]:       <nova:owner>
Nov 14 23:51:09 user nova-compute[75341]:         <nova:user uuid="38acd33ad6754965a53017185f473f8a">tempest-AttachVolumeShelveTestJSON-946394493-project-member</nova:user>
Nov 14 23:51:09 user nova-compute[75341]:         <nova:project uuid="5f27e41f4cc1451291b8aca34544867b">tempest-AttachVolumeShelveTestJSON-946394493</nova:project>
Nov 14 23:51:09 user nova-compute[75341]:       </nova:owner>
Nov 14 23:51:09 user nova-compute[75341]:       <nova:root type="image" uuid="0dac51f9-c959-4cbf-949a-c63a3fbc3ace"/>
Nov 14 23:51:09 user nova-compute[75341]:       <nova:ports>
Nov 14 23:51:09 user nova-compute[75341]:         <nova:port uuid="6df0f48f-1a94-42ec-b540-0aee55dc6b70">
Nov 14 23:51:09 user nova-compute[75341]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 23:51:09 user nova-compute[75341]:         </nova:port>
Nov 14 23:51:09 user nova-compute[75341]:       </nova:ports>
Nov 14 23:51:09 user nova-compute[75341]:     </nova:instance>
Nov 14 23:51:09 user nova-compute[75341]:   </metadata>
Nov 14 23:51:09 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 14 23:51:09 user nova-compute[75341]:     <system>
Nov 14 23:51:09 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 23:51:09 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 14 23:51:09 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 14 23:51:09 user nova-compute[75341]:       <entry name="serial">5950ba70-e7c0-4b5f-839c-569e0a27b625</entry>
Nov 14 23:51:09 user nova-compute[75341]:       <entry name="uuid">5950ba70-e7c0-4b5f-839c-569e0a27b625</entry>
Nov 14 23:51:09 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 14 23:51:09 user nova-compute[75341]:     </system>
Nov 14 23:51:09 user nova-compute[75341]:   </sysinfo>
Nov 14 23:51:09 user nova-compute[75341]:   <os>
Nov 14 23:51:09 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 23:51:09 user nova-compute[75341]:     <boot dev="hd"/>
Nov 14 23:51:09 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 14 23:51:09 user nova-compute[75341]:   </os>
Nov 14 23:51:09 user nova-compute[75341]:   <features>
Nov 14 23:51:09 user nova-compute[75341]:     <acpi/>
Nov 14 23:51:09 user nova-compute[75341]:     <apic/>
Nov 14 23:51:09 user nova-compute[75341]:     <vmcoreinfo/>
Nov 14 23:51:09 user nova-compute[75341]:   </features>
Nov 14 23:51:09 user nova-compute[75341]:   <clock offset="utc">
Nov 14 23:51:09 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 23:51:09 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 23:51:09 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 14 23:51:09 user nova-compute[75341]:   </clock>
Nov 14 23:51:09 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 14 23:51:09 user nova-compute[75341]:     <model>Nehalem</model>
Nov 14 23:51:09 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 23:51:09 user nova-compute[75341]:   </cpu>
Nov 14 23:51:09 user nova-compute[75341]:   <devices>
Nov 14 23:51:09 user nova-compute[75341]:     <disk type="file" device="disk">
Nov 14 23:51:09 user nova-compute[75341]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 23:51:09 user nova-compute[75341]:       <source file="/opt/stack/data/nova/instances/5950ba70-e7c0-4b5f-839c-569e0a27b625/disk"/>
Nov 14 23:51:09 user nova-compute[75341]:       <target dev="vda" bus="virtio"/>
Nov 14 23:51:09 user nova-compute[75341]:     </disk>
Nov 14 23:51:09 user nova-compute[75341]:     <interface type="ethernet">
Nov 14 23:51:09 user nova-compute[75341]:       <mac address="fa:16:3e:67:d4:76"/>
Nov 14 23:51:09 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:51:09 user nova-compute[75341]:       <mtu size="1442"/>
Nov 14 23:51:09 user nova-compute[75341]:       <target dev="tap6df0f48f-1a"/>
Nov 14 23:51:09 user nova-compute[75341]:     </interface>
Nov 14 23:51:09 user nova-compute[75341]:     <serial type="pty">
Nov 14 23:51:09 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/5950ba70-e7c0-4b5f-839c-569e0a27b625/console.log" append="off"/>
Nov 14 23:51:09 user nova-compute[75341]:     </serial>
Nov 14 23:51:09 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 23:51:09 user nova-compute[75341]:     <video>
Nov 14 23:51:09 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:51:09 user nova-compute[75341]:     </video>
Nov 14 23:51:09 user nova-compute[75341]:     <rng model="virtio">
Nov 14 23:51:09 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 14 23:51:09 user nova-compute[75341]:     </rng>
Nov 14 23:51:09 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 14 23:51:09 user nova-compute[75341]:     <memballoon model="virtio">
Nov 14 23:51:09 user nova-compute[75341]:       <stats period="10"/>
Nov 14 23:51:09 user nova-compute[75341]:     </memballoon>
Nov 14 23:51:09 user nova-compute[75341]:   </devices>
Nov 14 23:51:09 user nova-compute[75341]: </domain>
Nov 14 23:51:09 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 23:51:09 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T23:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1777010379',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1777010379',id=26,image_ref='0dac51f9-c959-4cbf-949a-c63a3fbc3ace',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1640023904',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:47:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5f27e41f4cc1451291b8aca34544867b',ramdisk_id='',reservation_id='r-5jpqwdpl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-946394493',owner_user_name='tempest-AttachVolumeShelveTestJSON-946394493-project-member',shelved_at='2023-11-14T23:49:11.542787',shelved_host='user',shelved_image_id='0dac51f9-c959-4cbf-949a-c63a3fbc3ace'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:51:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38acd33ad6754965a53017185f473f8a',uuid=5950ba70-e7c0-4b5f-839c-569e0a27b625,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "6df0f48f-1a94-42ec-b540-0aee55dc6b70", "address": "fa:16:3e:67:d4:76", "network": {"id": "e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-64240219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f27e41f4cc1451291b8aca34544867b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df0f48f-1a", "ovs_interfaceid": "6df0f48f-1a94-42ec-b540-0aee55dc6b70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 23:51:09 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Converting VIF {"id": "6df0f48f-1a94-42ec-b540-0aee55dc6b70", "address": "fa:16:3e:67:d4:76", "network": {"id": "e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-64240219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f27e41f4cc1451291b8aca34544867b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df0f48f-1a", "ovs_interfaceid": "6df0f48f-1a94-42ec-b540-0aee55dc6b70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:51:09 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:d4:76,bridge_name='br-int',has_traffic_filtering=True,id=6df0f48f-1a94-42ec-b540-0aee55dc6b70,network=Network(e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6df0f48f-1a') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:51:09 user nova-compute[75341]: DEBUG os_vif [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:d4:76,bridge_name='br-int',has_traffic_filtering=True,id=6df0f48f-1a94-42ec-b540-0aee55dc6b70,network=Network(e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6df0f48f-1a') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 23:51:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:51:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 23:51:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3a618fe9-580e-5c2a-8f1b-d91898c8fd72', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:51:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:51:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6df0f48f-1a, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:51:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6df0f48f-1a, col_values=(('qos', UUID('ed732197-89c6-4176-ba54-c213e7ebfa1d')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:51:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6df0f48f-1a, col_values=(('external_ids', {'iface-id': '6df0f48f-1a94-42ec-b540-0aee55dc6b70', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:d4:76', 'vm-uuid': '5950ba70-e7c0-4b5f-839c-569e0a27b625'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:51:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:51:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:09 user nova-compute[75341]: INFO os_vif [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:d4:76,bridge_name='br-int',has_traffic_filtering=True,id=6df0f48f-1a94-42ec-b540-0aee55dc6b70,network=Network(e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6df0f48f-1a')
Nov 14 23:51:09 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:51:09 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:51:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.700s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:51:09 user nova-compute[75341]: DEBUG nova.compute.manager [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Start building networks asynchronously for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 23:51:09 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:51:09 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] No VIF found with MAC fa:16:3e:67:d4:76, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:51:09 user nova-compute[75341]: DEBUG nova.compute.manager [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Allocating IP information in the background. {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 23:51:09 user nova-compute[75341]: DEBUG nova.network.neutron [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] allocate_for_instance() {{(pid=75341) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 23:51:09 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 23:51:09 user nova-compute[75341]: DEBUG nova.compute.manager [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Start building block device mappings for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 23:51:09 user nova-compute[75341]: DEBUG nova.policy [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '526fe3083ac541b79d7dbfb9b5abaf7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f694dc021a9442a49bbde9f367fbefc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75341) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 23:51:09 user nova-compute[75341]: DEBUG nova.compute.manager [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Start spawning the instance on the hypervisor. {{(pid=75341) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 23:51:09 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Creating instance directory {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 23:51:09 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Creating image(s)
Nov 14 23:51:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Acquiring lock "/opt/stack/data/nova/instances/9ae467da-9fb5-4f4f-a3f8-fce2ac368dda/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:51:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lock "/opt/stack/data/nova/instances/9ae467da-9fb5-4f4f-a3f8-fce2ac368dda/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:51:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lock "/opt/stack/data/nova/instances/9ae467da-9fb5-4f4f-a3f8-fce2ac368dda/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:51:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.192s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Acquiring lock "4754efee9a6d73d3647f2add2cfe86c291949740" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:51:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:51:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:10 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.202s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:10 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/9ae467da-9fb5-4f4f-a3f8-fce2ac368dda/disk 1073741824 {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:10 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/9ae467da-9fb5-4f4f-a3f8-fce2ac368dda/disk 1073741824" returned: 0 in 0.079s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:10 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.293s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:51:10 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:10 user nova-compute[75341]: DEBUG nova.network.neutron [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Successfully created port: 0ac8d528-5147-460f-abf8-4e33ac66c4f4 {{(pid=75341) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 23:51:10 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.203s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:10 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9ae467da-9fb5-4f4f-a3f8-fce2ac368dda/disk. size=1073741824 {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 23:51:10 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae467da-9fb5-4f4f-a3f8-fce2ac368dda/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:10 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae467da-9fb5-4f4f-a3f8-fce2ac368dda/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:10 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Cannot resize image /opt/stack/data/nova/instances/9ae467da-9fb5-4f4f-a3f8-fce2ac368dda/disk to a smaller size. {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 23:51:10 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Created local disks {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 23:51:10 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Ensure instance console log exists: /opt/stack/data/nova/instances/9ae467da-9fb5-4f4f-a3f8-fce2ac368dda/console.log {{(pid=75341) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 23:51:10 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:51:10 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:51:10 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:51:10 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:10 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:10 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:11 user nova-compute[75341]: DEBUG nova.network.neutron [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Successfully updated port: 0ac8d528-5147-460f-abf8-4e33ac66c4f4 {{(pid=75341) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 23:51:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Acquiring lock "refresh_cache-9ae467da-9fb5-4f4f-a3f8-fce2ac368dda" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:51:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Acquired lock "refresh_cache-9ae467da-9fb5-4f4f-a3f8-fce2ac368dda" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:51:11 user nova-compute[75341]: DEBUG nova.network.neutron [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 23:51:11 user nova-compute[75341]: DEBUG nova.compute.manager [req-825b338f-2e4e-448a-8243-c97f1cfa0dbc req-4c4b7944-c794-43b3-8b52-0f830fc28fd0 service nova] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Received event network-changed-0ac8d528-5147-460f-abf8-4e33ac66c4f4 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:51:11 user nova-compute[75341]: DEBUG nova.compute.manager [req-825b338f-2e4e-448a-8243-c97f1cfa0dbc req-4c4b7944-c794-43b3-8b52-0f830fc28fd0 service nova] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Refreshing instance network info cache due to event network-changed-0ac8d528-5147-460f-abf8-4e33ac66c4f4. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:51:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-825b338f-2e4e-448a-8243-c97f1cfa0dbc req-4c4b7944-c794-43b3-8b52-0f830fc28fd0 service nova] Acquiring lock "refresh_cache-9ae467da-9fb5-4f4f-a3f8-fce2ac368dda" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:51:11 user nova-compute[75341]: DEBUG nova.network.neutron [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Instance cache missing network info. {{(pid=75341) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 23:51:11 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:11 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:11 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:11 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:11 user nova-compute[75341]: DEBUG nova.network.neutron [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Updating instance_info_cache with network_info: [{"id": "0ac8d528-5147-460f-abf8-4e33ac66c4f4", "address": "fa:16:3e:72:4d:66", "network": {"id": "a1cc71d9-4161-4044-ad08-02aa4a7aef1c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-73156846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f694dc021a9442a49bbde9f367fbefc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac8d528-51", "ovs_interfaceid": "0ac8d528-5147-460f-abf8-4e33ac66c4f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:51:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Releasing lock "refresh_cache-9ae467da-9fb5-4f4f-a3f8-fce2ac368dda" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:51:11 user nova-compute[75341]: DEBUG nova.compute.manager [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Instance network_info: |[{"id": "0ac8d528-5147-460f-abf8-4e33ac66c4f4", "address": "fa:16:3e:72:4d:66", "network": {"id": "a1cc71d9-4161-4044-ad08-02aa4a7aef1c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-73156846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f694dc021a9442a49bbde9f367fbefc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac8d528-51", "ovs_interfaceid": "0ac8d528-5147-460f-abf8-4e33ac66c4f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 23:51:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-825b338f-2e4e-448a-8243-c97f1cfa0dbc req-4c4b7944-c794-43b3-8b52-0f830fc28fd0 service nova] Acquired lock "refresh_cache-9ae467da-9fb5-4f4f-a3f8-fce2ac368dda" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:51:11 user nova-compute[75341]: DEBUG nova.network.neutron [req-825b338f-2e4e-448a-8243-c97f1cfa0dbc req-4c4b7944-c794-43b3-8b52-0f830fc28fd0 service nova] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Refreshing network info cache for port 0ac8d528-5147-460f-abf8-4e33ac66c4f4 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:51:11 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Start _get_guest_xml network_info=[{"id": "0ac8d528-5147-460f-abf8-4e33ac66c4f4", "address": "fa:16:3e:72:4d:66", "network": {"id": "a1cc71d9-4161-4044-ad08-02aa4a7aef1c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-73156846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f694dc021a9442a49bbde9f367fbefc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac8d528-51", "ovs_interfaceid": "0ac8d528-5147-460f-abf8-4e33ac66c4f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encrypted': False, 'image_id': 'e46abb82-b810-490e-a8a1-ccdc5fa1a796'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 23:51:11 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:51:11 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:51:11 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 23:51:11 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 23:51:11 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 23:51:11 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 23:51:11 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 23:51:11 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 23:51:11 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 23:51:11 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 23:51:11 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 23:51:11 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 23:51:11 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 23:51:11 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 23:51:11 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 23:51:11 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 23:51:11 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 23:51:11 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 23:51:11 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:51:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-858091869',display_name='tempest-VolumesSnapshotTestJSON-instance-858091869',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-858091869',id=35,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOtU4Pktbdyp+rAxebRS1Lf5w3oyVZ6otPK/Z7aaavIiS0Whae/I/ID/IsuZkN2wQYssXsm12CkdoL6OZOUZBcpV3M8qDitWaYSgGM0YRUh7iRuhtRm4QndkquGbkH7qeQ==',key_name='tempest-keypair-1785368385',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f694dc021a9442a49bbde9f367fbefc6',ramdisk_id='',reservation_id='r-lkvbm8k2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1856831414',owner_user_name='tempest-VolumesSnapshotTestJSON-1856831414-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:51:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='526fe3083ac541b79d7dbfb9b5abaf7c',uuid=9ae467da-9fb5-4f4f-a3f8-fce2ac368dda,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ac8d528-5147-460f-abf8-4e33ac66c4f4", "address": "fa:16:3e:72:4d:66", "network": {"id": "a1cc71d9-4161-4044-ad08-02aa4a7aef1c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-73156846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f694dc021a9442a49bbde9f367fbefc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac8d528-51", "ovs_interfaceid": "0ac8d528-5147-460f-abf8-4e33ac66c4f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:51:11 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Converting VIF {"id": "0ac8d528-5147-460f-abf8-4e33ac66c4f4", "address": "fa:16:3e:72:4d:66", "network": {"id": "a1cc71d9-4161-4044-ad08-02aa4a7aef1c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-73156846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f694dc021a9442a49bbde9f367fbefc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac8d528-51", "ovs_interfaceid": "0ac8d528-5147-460f-abf8-4e33ac66c4f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:51:11 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:4d:66,bridge_name='br-int',has_traffic_filtering=True,id=0ac8d528-5147-460f-abf8-4e33ac66c4f4,network=Network(a1cc71d9-4161-4044-ad08-02aa4a7aef1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ac8d528-51') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:51:11 user nova-compute[75341]: DEBUG nova.objects.instance [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:51:11 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] End _get_guest_xml xml=<domain type="kvm">
Nov 14 23:51:11 user nova-compute[75341]:   <uuid>9ae467da-9fb5-4f4f-a3f8-fce2ac368dda</uuid>
Nov 14 23:51:11 user nova-compute[75341]:   <name>instance-00000023</name>
Nov 14 23:51:11 user nova-compute[75341]:   <memory>524288</memory>
Nov 14 23:51:11 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 14 23:51:11 user nova-compute[75341]:   <metadata>
Nov 14 23:51:11 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 23:51:11 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 14 23:51:11 user nova-compute[75341]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-858091869</nova:name>
Nov 14 23:51:11 user nova-compute[75341]:       <nova:creationTime>2023-11-14 23:51:11</nova:creationTime>
Nov 14 23:51:11 user nova-compute[75341]:       <nova:flavor name="m1.tiny">
Nov 14 23:51:11 user nova-compute[75341]:         <nova:memory>512</nova:memory>
Nov 14 23:51:11 user nova-compute[75341]:         <nova:disk>1</nova:disk>
Nov 14 23:51:11 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 14 23:51:11 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 23:51:11 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 14 23:51:11 user nova-compute[75341]:       </nova:flavor>
Nov 14 23:51:11 user nova-compute[75341]:       <nova:owner>
Nov 14 23:51:11 user nova-compute[75341]:         <nova:user uuid="526fe3083ac541b79d7dbfb9b5abaf7c">tempest-VolumesSnapshotTestJSON-1856831414-project-member</nova:user>
Nov 14 23:51:11 user nova-compute[75341]:         <nova:project uuid="f694dc021a9442a49bbde9f367fbefc6">tempest-VolumesSnapshotTestJSON-1856831414</nova:project>
Nov 14 23:51:11 user nova-compute[75341]:       </nova:owner>
Nov 14 23:51:11 user nova-compute[75341]:       <nova:root type="image" uuid="e46abb82-b810-490e-a8a1-ccdc5fa1a796"/>
Nov 14 23:51:11 user nova-compute[75341]:       <nova:ports>
Nov 14 23:51:11 user nova-compute[75341]:         <nova:port uuid="0ac8d528-5147-460f-abf8-4e33ac66c4f4">
Nov 14 23:51:11 user nova-compute[75341]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 23:51:11 user nova-compute[75341]:         </nova:port>
Nov 14 23:51:11 user nova-compute[75341]:       </nova:ports>
Nov 14 23:51:11 user nova-compute[75341]:     </nova:instance>
Nov 14 23:51:11 user nova-compute[75341]:   </metadata>
Nov 14 23:51:11 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 14 23:51:11 user nova-compute[75341]:     <system>
Nov 14 23:51:11 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 23:51:11 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 14 23:51:11 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 14 23:51:11 user nova-compute[75341]:       <entry name="serial">9ae467da-9fb5-4f4f-a3f8-fce2ac368dda</entry>
Nov 14 23:51:11 user nova-compute[75341]:       <entry name="uuid">9ae467da-9fb5-4f4f-a3f8-fce2ac368dda</entry>
Nov 14 23:51:11 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 14 23:51:11 user nova-compute[75341]:     </system>
Nov 14 23:51:11 user nova-compute[75341]:   </sysinfo>
Nov 14 23:51:11 user nova-compute[75341]:   <os>
Nov 14 23:51:11 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 23:51:11 user nova-compute[75341]:     <boot dev="hd"/>
Nov 14 23:51:11 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 14 23:51:11 user nova-compute[75341]:   </os>
Nov 14 23:51:11 user nova-compute[75341]:   <features>
Nov 14 23:51:11 user nova-compute[75341]:     <acpi/>
Nov 14 23:51:11 user nova-compute[75341]:     <apic/>
Nov 14 23:51:11 user nova-compute[75341]:     <vmcoreinfo/>
Nov 14 23:51:11 user nova-compute[75341]:   </features>
Nov 14 23:51:11 user nova-compute[75341]:   <clock offset="utc">
Nov 14 23:51:11 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 23:51:11 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 23:51:11 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 14 23:51:11 user nova-compute[75341]:   </clock>
Nov 14 23:51:11 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 14 23:51:11 user nova-compute[75341]:     <model>Nehalem</model>
Nov 14 23:51:11 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 23:51:11 user nova-compute[75341]:   </cpu>
Nov 14 23:51:11 user nova-compute[75341]:   <devices>
Nov 14 23:51:11 user nova-compute[75341]:     <disk type="file" device="disk">
Nov 14 23:51:11 user nova-compute[75341]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 23:51:11 user nova-compute[75341]:       <source file="/opt/stack/data/nova/instances/9ae467da-9fb5-4f4f-a3f8-fce2ac368dda/disk"/>
Nov 14 23:51:11 user nova-compute[75341]:       <target dev="vda" bus="virtio"/>
Nov 14 23:51:11 user nova-compute[75341]:     </disk>
Nov 14 23:51:11 user nova-compute[75341]:     <interface type="ethernet">
Nov 14 23:51:11 user nova-compute[75341]:       <mac address="fa:16:3e:72:4d:66"/>
Nov 14 23:51:11 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:51:11 user nova-compute[75341]:       <mtu size="1442"/>
Nov 14 23:51:11 user nova-compute[75341]:       <target dev="tap0ac8d528-51"/>
Nov 14 23:51:11 user nova-compute[75341]:     </interface>
Nov 14 23:51:11 user nova-compute[75341]:     <serial type="pty">
Nov 14 23:51:11 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/9ae467da-9fb5-4f4f-a3f8-fce2ac368dda/console.log" append="off"/>
Nov 14 23:51:11 user nova-compute[75341]:     </serial>
Nov 14 23:51:11 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 23:51:11 user nova-compute[75341]:     <video>
Nov 14 23:51:11 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:51:11 user nova-compute[75341]:     </video>
Nov 14 23:51:11 user nova-compute[75341]:     <rng model="virtio">
Nov 14 23:51:11 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 14 23:51:11 user nova-compute[75341]:     </rng>
Nov 14 23:51:11 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 14 23:51:11 user nova-compute[75341]:     <memballoon model="virtio">
Nov 14 23:51:11 user nova-compute[75341]:       <stats period="10"/>
Nov 14 23:51:11 user nova-compute[75341]:     </memballoon>
Nov 14 23:51:11 user nova-compute[75341]:   </devices>
Nov 14 23:51:11 user nova-compute[75341]: </domain>
Nov 14 23:51:11 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 23:51:11 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:51:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-858091869',display_name='tempest-VolumesSnapshotTestJSON-instance-858091869',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-858091869',id=35,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOtU4Pktbdyp+rAxebRS1Lf5w3oyVZ6otPK/Z7aaavIiS0Whae/I/ID/IsuZkN2wQYssXsm12CkdoL6OZOUZBcpV3M8qDitWaYSgGM0YRUh7iRuhtRm4QndkquGbkH7qeQ==',key_name='tempest-keypair-1785368385',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f694dc021a9442a49bbde9f367fbefc6',ramdisk_id='',reservation_id='r-lkvbm8k2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1856831414',owner_user_name='tempest-VolumesSnapshotTestJSON-1856831414-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:51:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='526fe3083ac541b79d7dbfb9b5abaf7c',uuid=9ae467da-9fb5-4f4f-a3f8-fce2ac368dda,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ac8d528-5147-460f-abf8-4e33ac66c4f4", "address": "fa:16:3e:72:4d:66", "network": {"id": "a1cc71d9-4161-4044-ad08-02aa4a7aef1c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-73156846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f694dc021a9442a49bbde9f367fbefc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac8d528-51", "ovs_interfaceid": "0ac8d528-5147-460f-abf8-4e33ac66c4f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 23:51:11 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Converting VIF {"id": "0ac8d528-5147-460f-abf8-4e33ac66c4f4", "address": "fa:16:3e:72:4d:66", "network": {"id": "a1cc71d9-4161-4044-ad08-02aa4a7aef1c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-73156846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f694dc021a9442a49bbde9f367fbefc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac8d528-51", "ovs_interfaceid": "0ac8d528-5147-460f-abf8-4e33ac66c4f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:51:11 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:4d:66,bridge_name='br-int',has_traffic_filtering=True,id=0ac8d528-5147-460f-abf8-4e33ac66c4f4,network=Network(a1cc71d9-4161-4044-ad08-02aa4a7aef1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ac8d528-51') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:51:11 user nova-compute[75341]: DEBUG os_vif [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:4d:66,bridge_name='br-int',has_traffic_filtering=True,id=0ac8d528-5147-460f-abf8-4e33ac66c4f4,network=Network(a1cc71d9-4161-4044-ad08-02aa4a7aef1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ac8d528-51') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 23:51:11 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:11 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:51:11 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 23:51:11 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:11 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:11 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '437f4af2-5f70-5636-9f0b-16f4d7eb1d29', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:51:11 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:11 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:11 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:11 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ac8d528-51, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:51:11 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0ac8d528-51, col_values=(('qos', UUID('d659d4c6-b182-4f37-bcc7-0a9f01ef3a87')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:51:11 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0ac8d528-51, col_values=(('external_ids', {'iface-id': '0ac8d528-5147-460f-abf8-4e33ac66c4f4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:4d:66', 'vm-uuid': '9ae467da-9fb5-4f4f-a3f8-fce2ac368dda'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:51:11 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:11 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:51:11 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:11 user nova-compute[75341]: INFO os_vif [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:4d:66,bridge_name='br-int',has_traffic_filtering=True,id=0ac8d528-5147-460f-abf8-4e33ac66c4f4,network=Network(a1cc71d9-4161-4044-ad08-02aa4a7aef1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ac8d528-51')
Nov 14 23:51:11 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:51:11 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] No VIF found with MAC fa:16:3e:72:4d:66, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:51:12 user nova-compute[75341]: DEBUG nova.network.neutron [req-825b338f-2e4e-448a-8243-c97f1cfa0dbc req-4c4b7944-c794-43b3-8b52-0f830fc28fd0 service nova] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Updated VIF entry in instance network info cache for port 0ac8d528-5147-460f-abf8-4e33ac66c4f4. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:51:12 user nova-compute[75341]: DEBUG nova.network.neutron [req-825b338f-2e4e-448a-8243-c97f1cfa0dbc req-4c4b7944-c794-43b3-8b52-0f830fc28fd0 service nova] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Updating instance_info_cache with network_info: [{"id": "0ac8d528-5147-460f-abf8-4e33ac66c4f4", "address": "fa:16:3e:72:4d:66", "network": {"id": "a1cc71d9-4161-4044-ad08-02aa4a7aef1c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-73156846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f694dc021a9442a49bbde9f367fbefc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac8d528-51", "ovs_interfaceid": "0ac8d528-5147-460f-abf8-4e33ac66c4f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:51:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-825b338f-2e4e-448a-8243-c97f1cfa0dbc req-4c4b7944-c794-43b3-8b52-0f830fc28fd0 service nova] Releasing lock "refresh_cache-9ae467da-9fb5-4f4f-a3f8-fce2ac368dda" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:51:13 user nova-compute[75341]: DEBUG nova.compute.manager [req-6cde4c5d-7861-4692-ba51-b0aa97995aeb req-e5956c48-0a69-40fc-8fac-4dd82094bd1b service nova] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Received event network-vif-plugged-6df0f48f-1a94-42ec-b540-0aee55dc6b70 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:51:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6cde4c5d-7861-4692-ba51-b0aa97995aeb req-e5956c48-0a69-40fc-8fac-4dd82094bd1b service nova] Acquiring lock "5950ba70-e7c0-4b5f-839c-569e0a27b625-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:51:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6cde4c5d-7861-4692-ba51-b0aa97995aeb req-e5956c48-0a69-40fc-8fac-4dd82094bd1b service nova] Lock "5950ba70-e7c0-4b5f-839c-569e0a27b625-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:51:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6cde4c5d-7861-4692-ba51-b0aa97995aeb req-e5956c48-0a69-40fc-8fac-4dd82094bd1b service nova] Lock "5950ba70-e7c0-4b5f-839c-569e0a27b625-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:51:13 user nova-compute[75341]: DEBUG nova.compute.manager [req-6cde4c5d-7861-4692-ba51-b0aa97995aeb req-e5956c48-0a69-40fc-8fac-4dd82094bd1b service nova] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] No waiting events found dispatching network-vif-plugged-6df0f48f-1a94-42ec-b540-0aee55dc6b70 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:51:13 user nova-compute[75341]: WARNING nova.compute.manager [req-6cde4c5d-7861-4692-ba51-b0aa97995aeb req-e5956c48-0a69-40fc-8fac-4dd82094bd1b service nova] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Received unexpected event network-vif-plugged-6df0f48f-1a94-42ec-b540-0aee55dc6b70 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 23:51:13 user nova-compute[75341]: DEBUG nova.compute.manager [req-6cde4c5d-7861-4692-ba51-b0aa97995aeb req-e5956c48-0a69-40fc-8fac-4dd82094bd1b service nova] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Received event network-vif-plugged-6df0f48f-1a94-42ec-b540-0aee55dc6b70 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:51:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6cde4c5d-7861-4692-ba51-b0aa97995aeb req-e5956c48-0a69-40fc-8fac-4dd82094bd1b service nova] Acquiring lock "5950ba70-e7c0-4b5f-839c-569e0a27b625-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:51:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6cde4c5d-7861-4692-ba51-b0aa97995aeb req-e5956c48-0a69-40fc-8fac-4dd82094bd1b service nova] Lock "5950ba70-e7c0-4b5f-839c-569e0a27b625-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:51:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6cde4c5d-7861-4692-ba51-b0aa97995aeb req-e5956c48-0a69-40fc-8fac-4dd82094bd1b service nova] Lock "5950ba70-e7c0-4b5f-839c-569e0a27b625-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:51:13 user nova-compute[75341]: DEBUG nova.compute.manager [req-6cde4c5d-7861-4692-ba51-b0aa97995aeb req-e5956c48-0a69-40fc-8fac-4dd82094bd1b service nova] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] No waiting events found dispatching network-vif-plugged-6df0f48f-1a94-42ec-b540-0aee55dc6b70 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:51:13 user nova-compute[75341]: WARNING nova.compute.manager [req-6cde4c5d-7861-4692-ba51-b0aa97995aeb req-e5956c48-0a69-40fc-8fac-4dd82094bd1b service nova] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Received unexpected event network-vif-plugged-6df0f48f-1a94-42ec-b540-0aee55dc6b70 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 23:51:13 user nova-compute[75341]: DEBUG nova.compute.manager [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Instance event wait completed in 0 seconds for  {{(pid=75341) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 23:51:13 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Guest created on hypervisor {{(pid=75341) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 23:51:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:13 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Instance spawned successfully.
Nov 14 23:51:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:13 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f37e883-952c-4039-bd20-c7fe32dab93a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Calling os-brick to attach iSCSI Volume {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 23:51:13 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f37e883-952c-4039-bd20-c7fe32dab93a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c41d6927-f54d-4872-be46-03a519486d61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DTXfVPLe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:51:13 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-0f37e883-952c-4039-bd20-c7fe32dab93a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:51:13 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-0f37e883-952c-4039-bd20-c7fe32dab93a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:51:13 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-0f37e883-952c-4039-bd20-c7fe32dab93a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:51:13 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-0f37e883-952c-4039-bd20-c7fe32dab93a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:51:13 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-0f37e883-952c-4039-bd20-c7fe32dab93a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c41d6927-f54d-4872-be46-03a519486d61" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:51:13 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-0f37e883-952c-4039-bd20-c7fe32dab93a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c41d6927-f54d-4872-be46-03a519486d61" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:51:13 user nova-compute[75341]: INFO os_brick.initiator.connectors.iscsi [None req-0f37e883-952c-4039-bd20-c7fe32dab93a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 23:51:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c41d6927-f54d-4872-be46-03a519486d61 -p 172.16.0.220:3260 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:13 user nova-compute[75341]: DEBUG nova.compute.manager [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 23:51:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c41d6927-f54d-4872-be46-03a519486d61 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:13 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[1866388d-5f33-4c61-88c4-2c8cd247b83f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:51:13 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f37e883-952c-4039-bd20-c7fe32dab93a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 23:51:13 user nova-compute[75341]:  {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:51:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c41d6927-f54d-4872-be46-03a519486d61 -p 172.16.0.220:3260 --interface default --op new {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c41d6927-f54d-4872-be46-03a519486d61 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.041s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:13 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[5175d76d-909e-43e0-8a01-2cbe95503fae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c41d6927-f54d-4872-be46-03a519486d61] added\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:51:13 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f37e883-952c-4039-bd20-c7fe32dab93a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c41d6927-f54d-4872-be46-03a519486d61] added
Nov 14 23:51:13 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:51:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c41d6927-f54d-4872-be46-03a519486d61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c41d6927-f54d-4872-be46-03a519486d61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:13 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33b81e0-f5ac-4ad4-aa13-66c5713f93da]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:51:13 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f37e883-952c-4039-bd20-c7fe32dab93a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:51:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c41d6927-f54d-4872-be46-03a519486d61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c41d6927-f54d-4872-be46-03a519486d61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:13 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[497d4e07-9690-41e5-b23f-62de011bf80b]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:51:13 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f37e883-952c-4039-bd20-c7fe32dab93a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:51:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c41d6927-f54d-4872-be46-03a519486d61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DTXfVPLe {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:14 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c41d6927-f54d-4872-be46-03a519486d61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DTXfVPLe" returned: 0 in 0.030s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:14 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[966b9006-8fed-4e6a-9039-df7d0cf14b70]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:51:14 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f37e883-952c-4039-bd20-c7fe32dab93a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DTXfVPLe'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:51:14 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c41d6927-f54d-4872-be46-03a519486d61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:14 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c41d6927-f54d-4872-be46-03a519486d61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:14 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[986bf030-fdbc-4639-bb70-176f95132138]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:51:14 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f37e883-952c-4039-bd20-c7fe32dab93a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:51:14 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ad1af0d8-35c0-4af2-b46a-234880f6a221 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "5950ba70-e7c0-4b5f-839c-569e0a27b625" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 13.073s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:51:14 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:14 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:14 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c0b690-e3c1-4c0c-be60-92ee34d77c4f]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:51:14 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f37e883-952c-4039-bd20-c7fe32dab93a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)
Nov 14 23:51:14 user nova-compute[75341]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455 (non-flash)
Nov 14 23:51:14 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:51:14 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f37e883-952c-4039-bd20-c7fe32dab93a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)
Nov 14 23:51:14 user nova-compute[75341]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455 (non-flash)
Nov 14 23:51:14 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:51:14 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c41d6927-f54d-4872-be46-03a519486d61 -p 172.16.0.220:3260 --login {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:14 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c41d6927-f54d-4872-be46-03a519486d61 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:14 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8acb82-4ba3-4489-b88e-b3102082831a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c41d6927-f54d-4872-be46-03a519486d61, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c41d6927-f54d-4872-be46-03a519486d61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:51:14 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f37e883-952c-4039-bd20-c7fe32dab93a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c41d6927-f54d-4872-be46-03a519486d61, portal: 172.16.0.220,3260]
Nov 14 23:51:14 user nova-compute[75341]: Login to [iface: default, target: iqn.2010-10.org.openstack:c41d6927-f54d-4872-be46-03a519486d61, portal: 172.16.0.220,3260] successful.
Nov 14 23:51:14 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:51:14 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c41d6927-f54d-4872-be46-03a519486d61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:14 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c41d6927-f54d-4872-be46-03a519486d61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:14 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[db770b1a-499b-4cb8-8791-52f94213115f]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:51:14 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f37e883-952c-4039-bd20-c7fe32dab93a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:51:14 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:14 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:14 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f32790-a3b0-4e35-a51b-186a4dbdbdec]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41d6927-f54d-4872-be46-03a519486d61 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:51:14 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f37e883-952c-4039-bd20-c7fe32dab93a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)
Nov 14 23:51:14 user nova-compute[75341]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455 (non-flash)
Nov 14 23:51:14 user nova-compute[75341]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41d6927-f54d-4872-be46-03a519486d61 (non-flash)
Nov 14 23:51:14 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:51:14 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f37e883-952c-4039-bd20-c7fe32dab93a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)
Nov 14 23:51:14 user nova-compute[75341]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455 (non-flash)
Nov 14 23:51:14 user nova-compute[75341]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41d6927-f54d-4872-be46-03a519486d61 (non-flash)
Nov 14 23:51:14 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:51:14 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-0f37e883-952c-4039-bd20-c7fe32dab93a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c41d6927-f54d-4872-be46-03a519486d61" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.393s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:51:14 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f37e883-952c-4039-bd20-c7fe32dab93a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Connected to 172.16.0.220:3260 {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 23:51:14 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-0f37e883-952c-4039-bd20-c7fe32dab93a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] HCTL ('33', '-', '-', 0) found on session 35 with lun 0 {{(pid=75341) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 23:51:14 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-0f37e883-952c-4039-bd20-c7fe32dab93a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75341) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 23:51:14 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:14 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:14 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf24346f-6d16-44b8-aff1-f1185a58e239]: (4, ('- - 0', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:51:14 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-0f37e883-952c-4039-bd20-c7fe32dab93a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 23:51:14 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f37e883-952c-4039-bd20-c7fe32dab93a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c41d6927-f54d-4872-be46-03a519486d61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DTXfVPLe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 23:51:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:15 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-0f37e883-952c-4039-bd20-c7fe32dab93a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.437s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:51:15 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f37e883-952c-4039-bd20-c7fe32dab93a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] <== connect_volume: return (1439ms) {'type': 'block', 'scsi_wwn': '23463366135376235', 'path': '/dev/sdb'} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:51:15 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f37e883-952c-4039-bd20-c7fe32dab93a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23463366135376235', 'path': '/dev/sdb'} {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 23:51:15 user nova-compute[75341]: DEBUG nova.objects.instance [None req-0f37e883-952c-4039-bd20-c7fe32dab93a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Lazy-loading 'flavor' on Instance uuid 01b30e67-ac52-4cf6-9a31-30096f8b3344 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:51:15 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-0f37e883-952c-4039-bd20-c7fe32dab93a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 23:51:15 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:51:15 user nova-compute[75341]:   <source dev="/dev/sdb"/>
Nov 14 23:51:15 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:51:15 user nova-compute[75341]:   <serial>c41d6927-f54d-4872-be46-03a519486d61</serial>
Nov 14 23:51:15 user nova-compute[75341]: </disk>
Nov 14 23:51:15 user nova-compute[75341]:  {{(pid=75341) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 23:51:15 user nova-compute[75341]: DEBUG nova.compute.manager [req-5e196372-a6b9-43f1-83de-a6066d8d242d req-4ba671a5-c1ab-4d1a-a80d-85cde653269f service nova] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Received event network-vif-plugged-0ac8d528-5147-460f-abf8-4e33ac66c4f4 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:51:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-5e196372-a6b9-43f1-83de-a6066d8d242d req-4ba671a5-c1ab-4d1a-a80d-85cde653269f service nova] Acquiring lock "9ae467da-9fb5-4f4f-a3f8-fce2ac368dda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:51:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-5e196372-a6b9-43f1-83de-a6066d8d242d req-4ba671a5-c1ab-4d1a-a80d-85cde653269f service nova] Lock "9ae467da-9fb5-4f4f-a3f8-fce2ac368dda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:51:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-5e196372-a6b9-43f1-83de-a6066d8d242d req-4ba671a5-c1ab-4d1a-a80d-85cde653269f service nova] Lock "9ae467da-9fb5-4f4f-a3f8-fce2ac368dda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:51:15 user nova-compute[75341]: DEBUG nova.compute.manager [req-5e196372-a6b9-43f1-83de-a6066d8d242d req-4ba671a5-c1ab-4d1a-a80d-85cde653269f service nova] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] No waiting events found dispatching network-vif-plugged-0ac8d528-5147-460f-abf8-4e33ac66c4f4 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:51:15 user nova-compute[75341]: WARNING nova.compute.manager [req-5e196372-a6b9-43f1-83de-a6066d8d242d req-4ba671a5-c1ab-4d1a-a80d-85cde653269f service nova] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Received unexpected event network-vif-plugged-0ac8d528-5147-460f-abf8-4e33ac66c4f4 for instance with vm_state building and task_state spawning.
Nov 14 23:51:15 user nova-compute[75341]: DEBUG nova.compute.manager [req-5e196372-a6b9-43f1-83de-a6066d8d242d req-4ba671a5-c1ab-4d1a-a80d-85cde653269f service nova] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Received event network-vif-plugged-0ac8d528-5147-460f-abf8-4e33ac66c4f4 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:51:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-5e196372-a6b9-43f1-83de-a6066d8d242d req-4ba671a5-c1ab-4d1a-a80d-85cde653269f service nova] Acquiring lock "9ae467da-9fb5-4f4f-a3f8-fce2ac368dda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:51:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-5e196372-a6b9-43f1-83de-a6066d8d242d req-4ba671a5-c1ab-4d1a-a80d-85cde653269f service nova] Lock "9ae467da-9fb5-4f4f-a3f8-fce2ac368dda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:51:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-5e196372-a6b9-43f1-83de-a6066d8d242d req-4ba671a5-c1ab-4d1a-a80d-85cde653269f service nova] Lock "9ae467da-9fb5-4f4f-a3f8-fce2ac368dda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:51:15 user nova-compute[75341]: DEBUG nova.compute.manager [req-5e196372-a6b9-43f1-83de-a6066d8d242d req-4ba671a5-c1ab-4d1a-a80d-85cde653269f service nova] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] No waiting events found dispatching network-vif-plugged-0ac8d528-5147-460f-abf8-4e33ac66c4f4 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:51:15 user nova-compute[75341]: WARNING nova.compute.manager [req-5e196372-a6b9-43f1-83de-a6066d8d242d req-4ba671a5-c1ab-4d1a-a80d-85cde653269f service nova] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Received unexpected event network-vif-plugged-0ac8d528-5147-460f-abf8-4e33ac66c4f4 for instance with vm_state building and task_state spawning.
Nov 14 23:51:15 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-0f37e883-952c-4039-bd20-c7fe32dab93a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:51:15 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-0f37e883-952c-4039-bd20-c7fe32dab93a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:51:15 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-0f37e883-952c-4039-bd20-c7fe32dab93a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] No VIF found with MAC fa:16:3e:f4:cc:cd, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:51:16 user nova-compute[75341]: DEBUG nova.compute.manager [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Instance event wait completed in 0 seconds for  {{(pid=75341) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 23:51:16 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Guest created on hypervisor {{(pid=75341) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 23:51:16 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Instance spawned successfully.
Nov 14 23:51:16 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 23:51:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0f37e883-952c-4039-bd20-c7fe32dab93a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Lock "01b30e67-ac52-4cf6-9a31-30096f8b3344" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.994s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:51:16 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Found default for hw_cdrom_bus of ide {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:51:16 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Found default for hw_disk_bus of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:51:16 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Found default for hw_input_bus of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:51:16 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Found default for hw_pointer_model of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:51:16 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Found default for hw_video_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:51:16 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Found default for hw_vif_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:51:16 user nova-compute[75341]: INFO nova.compute.manager [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Took 6.42 seconds to spawn the instance on the hypervisor.
Nov 14 23:51:16 user nova-compute[75341]: DEBUG nova.compute.manager [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 23:51:16 user nova-compute[75341]: INFO nova.compute.manager [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Took 7.75 seconds to build instance.
Nov 14 23:51:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cd0cfe2e-e687-4abd-95b5-3d50cc094878 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lock "9ae467da-9fb5-4f4f-a3f8-fce2ac368dda" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.108s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:51:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-234be512-3242-4964-b0fe-96a4d017585a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Acquiring lock "01b30e67-ac52-4cf6-9a31-30096f8b3344" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:51:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-234be512-3242-4964-b0fe-96a4d017585a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Lock "01b30e67-ac52-4cf6-9a31-30096f8b3344" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:51:18 user nova-compute[75341]: INFO nova.compute.manager [None req-234be512-3242-4964-b0fe-96a4d017585a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Detaching volume c41d6927-f54d-4872-be46-03a519486d61
Nov 14 23:51:18 user nova-compute[75341]: INFO nova.virt.block_device [None req-234be512-3242-4964-b0fe-96a4d017585a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Attempting to driver detach volume c41d6927-f54d-4872-be46-03a519486d61 from mountpoint /dev/vdb
Nov 14 23:51:18 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-234be512-3242-4964-b0fe-96a4d017585a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Attempting to detach device vdb from instance 01b30e67-ac52-4cf6-9a31-30096f8b3344 from the persistent domain config. {{(pid=75341) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 23:51:18 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-234be512-3242-4964-b0fe-96a4d017585a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 23:51:18 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:51:18 user nova-compute[75341]:   <source dev="/dev/sdb"/>
Nov 14 23:51:18 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:51:18 user nova-compute[75341]:   <serial>c41d6927-f54d-4872-be46-03a519486d61</serial>
Nov 14 23:51:18 user nova-compute[75341]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 23:51:18 user nova-compute[75341]: </disk>
Nov 14 23:51:18 user nova-compute[75341]:  {{(pid=75341) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 23:51:18 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-234be512-3242-4964-b0fe-96a4d017585a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Successfully detached device vdb from instance 01b30e67-ac52-4cf6-9a31-30096f8b3344 from the persistent domain config.
Nov 14 23:51:18 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-234be512-3242-4964-b0fe-96a4d017585a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 01b30e67-ac52-4cf6-9a31-30096f8b3344 from the live domain config. {{(pid=75341) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 23:51:18 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-234be512-3242-4964-b0fe-96a4d017585a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 23:51:18 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:51:18 user nova-compute[75341]:   <source dev="/dev/sdb"/>
Nov 14 23:51:18 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:51:18 user nova-compute[75341]:   <serial>c41d6927-f54d-4872-be46-03a519486d61</serial>
Nov 14 23:51:18 user nova-compute[75341]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 23:51:18 user nova-compute[75341]: </disk>
Nov 14 23:51:18 user nova-compute[75341]:  {{(pid=75341) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 23:51:18 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-234be512-3242-4964-b0fe-96a4d017585a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 01b30e67-ac52-4cf6-9a31-30096f8b3344 {{(pid=75341) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 23:51:19 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Acquiring lock "d93909b3-0373-492a-8ede-7c2cd76bcb88" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:51:19 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "d93909b3-0373-492a-8ede-7c2cd76bcb88" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:51:19 user nova-compute[75341]: DEBUG nova.compute.manager [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Starting instance... {{(pid=75341) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 23:51:19 user nova-compute[75341]: DEBUG nova.compute.manager [req-f6556d30-4a16-421b-b4b7-9606e76c718a req-025a0def-c14b-49d0-9422-4a39fbaf02d4 service nova] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Received event network-changed-71caa935-899c-4716-9953-ae35733e691e {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:51:19 user nova-compute[75341]: DEBUG nova.compute.manager [req-f6556d30-4a16-421b-b4b7-9606e76c718a req-025a0def-c14b-49d0-9422-4a39fbaf02d4 service nova] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Refreshing instance network info cache due to event network-changed-71caa935-899c-4716-9953-ae35733e691e. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:51:19 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-f6556d30-4a16-421b-b4b7-9606e76c718a req-025a0def-c14b-49d0-9422-4a39fbaf02d4 service nova] Acquiring lock "refresh_cache-2316aa9e-d4c9-43d0-9918-86265583aed1" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:51:19 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-f6556d30-4a16-421b-b4b7-9606e76c718a req-025a0def-c14b-49d0-9422-4a39fbaf02d4 service nova] Acquired lock "refresh_cache-2316aa9e-d4c9-43d0-9918-86265583aed1" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:51:19 user nova-compute[75341]: DEBUG nova.network.neutron [req-f6556d30-4a16-421b-b4b7-9606e76c718a req-025a0def-c14b-49d0-9422-4a39fbaf02d4 service nova] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Refreshing network info cache for port 71caa935-899c-4716-9953-ae35733e691e {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:51:20 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:51:20 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:51:20 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75341) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 23:51:20 user nova-compute[75341]: INFO nova.compute.claims [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Claim successful on node user
Nov 14 23:51:20 user nova-compute[75341]: DEBUG nova.network.neutron [req-f6556d30-4a16-421b-b4b7-9606e76c718a req-025a0def-c14b-49d0-9422-4a39fbaf02d4 service nova] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Updated VIF entry in instance network info cache for port 71caa935-899c-4716-9953-ae35733e691e. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:51:20 user nova-compute[75341]: DEBUG nova.network.neutron [req-f6556d30-4a16-421b-b4b7-9606e76c718a req-025a0def-c14b-49d0-9422-4a39fbaf02d4 service nova] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Updating instance_info_cache with network_info: [{"id": "71caa935-899c-4716-9953-ae35733e691e", "address": "fa:16:3e:3d:1f:4a", "network": {"id": "167936c8-5f28-439e-9a1f-d9356b3a1ec9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374167607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e601d11e75d4ec4b7c05e615c67fe20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71caa935-89", "ovs_interfaceid": "71caa935-899c-4716-9953-ae35733e691e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:51:20 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-f6556d30-4a16-421b-b4b7-9606e76c718a req-025a0def-c14b-49d0-9422-4a39fbaf02d4 service nova] Releasing lock "refresh_cache-2316aa9e-d4c9-43d0-9918-86265583aed1" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:51:20 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:51:20 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:51:20 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.593s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:51:20 user nova-compute[75341]: DEBUG nova.compute.manager [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Start building networks asynchronously for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 23:51:20 user nova-compute[75341]: DEBUG nova.compute.manager [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Allocating IP information in the background. {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 23:51:20 user nova-compute[75341]: DEBUG nova.network.neutron [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] allocate_for_instance() {{(pid=75341) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 23:51:20 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 23:51:20 user nova-compute[75341]: DEBUG nova.compute.manager [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Start building block device mappings for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 23:51:20 user nova-compute[75341]: DEBUG nova.policy [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd0b6eae0d3124f70982781555ccc7ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542a85b3a6d14c77872f1957120ba655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75341) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 23:51:20 user nova-compute[75341]: DEBUG nova.compute.manager [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Start spawning the instance on the hypervisor. {{(pid=75341) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 23:51:20 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Creating instance directory {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 23:51:20 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Creating image(s)
Nov 14 23:51:20 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Acquiring lock "/opt/stack/data/nova/instances/d93909b3-0373-492a-8ede-7c2cd76bcb88/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:51:20 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "/opt/stack/data/nova/instances/d93909b3-0373-492a-8ede-7c2cd76bcb88/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:51:20 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "/opt/stack/data/nova/instances/d93909b3-0373-492a-8ede-7c2cd76bcb88/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:51:20 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:21 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.198s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Acquiring lock "4754efee9a6d73d3647f2add2cfe86c291949740" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:51:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:51:21 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:21 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.217s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:21 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/d93909b3-0373-492a-8ede-7c2cd76bcb88/disk 1073741824 {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:21 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/d93909b3-0373-492a-8ede-7c2cd76bcb88/disk 1073741824" returned: 0 in 0.053s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:51:21 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:21 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:21 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.209s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:21 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d93909b3-0373-492a-8ede-7c2cd76bcb88/disk. size=1073741824 {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 23:51:21 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d93909b3-0373-492a-8ede-7c2cd76bcb88/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:21 user nova-compute[75341]: DEBUG nova.network.neutron [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Successfully created port: 712f4b2d-016e-43ab-a3f2-8439868a5055 {{(pid=75341) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 23:51:21 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:21 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:21 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d93909b3-0373-492a-8ede-7c2cd76bcb88/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:21 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Cannot resize image /opt/stack/data/nova/instances/d93909b3-0373-492a-8ede-7c2cd76bcb88/disk to a smaller size. {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 23:51:21 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Created local disks {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 23:51:21 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Ensure instance console log exists: /opt/stack/data/nova/instances/d93909b3-0373-492a-8ede-7c2cd76bcb88/console.log {{(pid=75341) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 23:51:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:51:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:51:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:51:22 user nova-compute[75341]: DEBUG nova.network.neutron [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Successfully updated port: 712f4b2d-016e-43ab-a3f2-8439868a5055 {{(pid=75341) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 23:51:22 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Acquiring lock "refresh_cache-d93909b3-0373-492a-8ede-7c2cd76bcb88" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:51:22 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Acquired lock "refresh_cache-d93909b3-0373-492a-8ede-7c2cd76bcb88" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:51:22 user nova-compute[75341]: DEBUG nova.network.neutron [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 23:51:22 user nova-compute[75341]: DEBUG nova.compute.manager [req-754a85e3-461f-4394-874f-909749f04ac7 req-bc6e0400-95f4-4e96-900c-5b4081663123 service nova] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Received event network-changed-712f4b2d-016e-43ab-a3f2-8439868a5055 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:51:22 user nova-compute[75341]: DEBUG nova.compute.manager [req-754a85e3-461f-4394-874f-909749f04ac7 req-bc6e0400-95f4-4e96-900c-5b4081663123 service nova] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Refreshing instance network info cache due to event network-changed-712f4b2d-016e-43ab-a3f2-8439868a5055. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:51:22 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-754a85e3-461f-4394-874f-909749f04ac7 req-bc6e0400-95f4-4e96-900c-5b4081663123 service nova] Acquiring lock "refresh_cache-d93909b3-0373-492a-8ede-7c2cd76bcb88" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:51:22 user nova-compute[75341]: DEBUG nova.network.neutron [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Instance cache missing network info. {{(pid=75341) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 23:51:22 user nova-compute[75341]: DEBUG nova.network.neutron [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Updating instance_info_cache with network_info: [{"id": "712f4b2d-016e-43ab-a3f2-8439868a5055", "address": "fa:16:3e:b8:ce:f2", "network": {"id": "9ad7204e-07f5-4676-b2de-09e036a92e61", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-718201239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542a85b3a6d14c77872f1957120ba655", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap712f4b2d-01", "ovs_interfaceid": "712f4b2d-016e-43ab-a3f2-8439868a5055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:51:22 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Releasing lock "refresh_cache-d93909b3-0373-492a-8ede-7c2cd76bcb88" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:51:22 user nova-compute[75341]: DEBUG nova.compute.manager [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Instance network_info: |[{"id": "712f4b2d-016e-43ab-a3f2-8439868a5055", "address": "fa:16:3e:b8:ce:f2", "network": {"id": "9ad7204e-07f5-4676-b2de-09e036a92e61", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-718201239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542a85b3a6d14c77872f1957120ba655", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap712f4b2d-01", "ovs_interfaceid": "712f4b2d-016e-43ab-a3f2-8439868a5055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 23:51:22 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-754a85e3-461f-4394-874f-909749f04ac7 req-bc6e0400-95f4-4e96-900c-5b4081663123 service nova] Acquired lock "refresh_cache-d93909b3-0373-492a-8ede-7c2cd76bcb88" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:51:22 user nova-compute[75341]: DEBUG nova.network.neutron [req-754a85e3-461f-4394-874f-909749f04ac7 req-bc6e0400-95f4-4e96-900c-5b4081663123 service nova] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Refreshing network info cache for port 712f4b2d-016e-43ab-a3f2-8439868a5055 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:51:22 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Start _get_guest_xml network_info=[{"id": "712f4b2d-016e-43ab-a3f2-8439868a5055", "address": "fa:16:3e:b8:ce:f2", "network": {"id": "9ad7204e-07f5-4676-b2de-09e036a92e61", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-718201239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542a85b3a6d14c77872f1957120ba655", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap712f4b2d-01", "ovs_interfaceid": "712f4b2d-016e-43ab-a3f2-8439868a5055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encrypted': False, 'image_id': 'e46abb82-b810-490e-a8a1-ccdc5fa1a796'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 23:51:22 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:51:22 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:51:22 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 23:51:22 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 23:51:22 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 23:51:22 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 23:51:22 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 23:51:22 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 23:51:22 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 23:51:22 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 23:51:22 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 23:51:22 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 23:51:22 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 23:51:22 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 23:51:22 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 23:51:22 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 23:51:22 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 23:51:22 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 23:51:22 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:51:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-816790972',display_name='tempest-AttachVolumeNegativeTest-server-816790972',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-816790972',id=36,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNLoMHYiXP+lnUfFr9VBMtRBENQvr4tntDvm0V4M76GOF/XPqEfCrcy6vvrkcVqVY+sG28wrpEuJ8f8B5tl5C58TmswRFkgI+t/pYWvSxr0BQI1JFPuNhEcMdz7EBh2qkg==',key_name='tempest-keypair-568184015',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='542a85b3a6d14c77872f1957120ba655',ramdisk_id='',reservation_id='r-a51qm104',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-802469934',owner_user_name='tempest-AttachVolumeNegativeTest-802469934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:51:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d0b6eae0d3124f70982781555ccc7ec0',uuid=d93909b3-0373-492a-8ede-7c2cd76bcb88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "712f4b2d-016e-43ab-a3f2-8439868a5055", "address": "fa:16:3e:b8:ce:f2", "network": {"id": "9ad7204e-07f5-4676-b2de-09e036a92e61", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-718201239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542a85b3a6d14c77872f1957120ba655", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap712f4b2d-01", "ovs_interfaceid": "712f4b2d-016e-43ab-a3f2-8439868a5055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:51:22 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Converting VIF {"id": "712f4b2d-016e-43ab-a3f2-8439868a5055", "address": "fa:16:3e:b8:ce:f2", "network": {"id": "9ad7204e-07f5-4676-b2de-09e036a92e61", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-718201239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542a85b3a6d14c77872f1957120ba655", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap712f4b2d-01", "ovs_interfaceid": "712f4b2d-016e-43ab-a3f2-8439868a5055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:51:22 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:ce:f2,bridge_name='br-int',has_traffic_filtering=True,id=712f4b2d-016e-43ab-a3f2-8439868a5055,network=Network(9ad7204e-07f5-4676-b2de-09e036a92e61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap712f4b2d-01') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:51:22 user nova-compute[75341]: DEBUG nova.objects.instance [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lazy-loading 'pci_devices' on Instance uuid d93909b3-0373-492a-8ede-7c2cd76bcb88 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:51:22 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] End _get_guest_xml xml=<domain type="kvm">
Nov 14 23:51:22 user nova-compute[75341]:   <uuid>d93909b3-0373-492a-8ede-7c2cd76bcb88</uuid>
Nov 14 23:51:22 user nova-compute[75341]:   <name>instance-00000024</name>
Nov 14 23:51:22 user nova-compute[75341]:   <memory>524288</memory>
Nov 14 23:51:22 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 14 23:51:22 user nova-compute[75341]:   <metadata>
Nov 14 23:51:22 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 23:51:22 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 14 23:51:22 user nova-compute[75341]:       <nova:name>tempest-AttachVolumeNegativeTest-server-816790972</nova:name>
Nov 14 23:51:22 user nova-compute[75341]:       <nova:creationTime>2023-11-14 23:51:22</nova:creationTime>
Nov 14 23:51:22 user nova-compute[75341]:       <nova:flavor name="m1.tiny">
Nov 14 23:51:22 user nova-compute[75341]:         <nova:memory>512</nova:memory>
Nov 14 23:51:22 user nova-compute[75341]:         <nova:disk>1</nova:disk>
Nov 14 23:51:22 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 14 23:51:22 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 23:51:22 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 14 23:51:22 user nova-compute[75341]:       </nova:flavor>
Nov 14 23:51:22 user nova-compute[75341]:       <nova:owner>
Nov 14 23:51:22 user nova-compute[75341]:         <nova:user uuid="d0b6eae0d3124f70982781555ccc7ec0">tempest-AttachVolumeNegativeTest-802469934-project-member</nova:user>
Nov 14 23:51:22 user nova-compute[75341]:         <nova:project uuid="542a85b3a6d14c77872f1957120ba655">tempest-AttachVolumeNegativeTest-802469934</nova:project>
Nov 14 23:51:22 user nova-compute[75341]:       </nova:owner>
Nov 14 23:51:22 user nova-compute[75341]:       <nova:root type="image" uuid="e46abb82-b810-490e-a8a1-ccdc5fa1a796"/>
Nov 14 23:51:22 user nova-compute[75341]:       <nova:ports>
Nov 14 23:51:22 user nova-compute[75341]:         <nova:port uuid="712f4b2d-016e-43ab-a3f2-8439868a5055">
Nov 14 23:51:22 user nova-compute[75341]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 23:51:22 user nova-compute[75341]:         </nova:port>
Nov 14 23:51:22 user nova-compute[75341]:       </nova:ports>
Nov 14 23:51:22 user nova-compute[75341]:     </nova:instance>
Nov 14 23:51:22 user nova-compute[75341]:   </metadata>
Nov 14 23:51:22 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 14 23:51:22 user nova-compute[75341]:     <system>
Nov 14 23:51:22 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 23:51:22 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 14 23:51:22 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 14 23:51:22 user nova-compute[75341]:       <entry name="serial">d93909b3-0373-492a-8ede-7c2cd76bcb88</entry>
Nov 14 23:51:22 user nova-compute[75341]:       <entry name="uuid">d93909b3-0373-492a-8ede-7c2cd76bcb88</entry>
Nov 14 23:51:22 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 14 23:51:22 user nova-compute[75341]:     </system>
Nov 14 23:51:22 user nova-compute[75341]:   </sysinfo>
Nov 14 23:51:22 user nova-compute[75341]:   <os>
Nov 14 23:51:22 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 23:51:22 user nova-compute[75341]:     <boot dev="hd"/>
Nov 14 23:51:22 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 14 23:51:22 user nova-compute[75341]:   </os>
Nov 14 23:51:22 user nova-compute[75341]:   <features>
Nov 14 23:51:22 user nova-compute[75341]:     <acpi/>
Nov 14 23:51:22 user nova-compute[75341]:     <apic/>
Nov 14 23:51:22 user nova-compute[75341]:     <vmcoreinfo/>
Nov 14 23:51:22 user nova-compute[75341]:   </features>
Nov 14 23:51:22 user nova-compute[75341]:   <clock offset="utc">
Nov 14 23:51:22 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 23:51:22 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 23:51:22 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 14 23:51:22 user nova-compute[75341]:   </clock>
Nov 14 23:51:22 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 14 23:51:22 user nova-compute[75341]:     <model>Nehalem</model>
Nov 14 23:51:22 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 23:51:22 user nova-compute[75341]:   </cpu>
Nov 14 23:51:22 user nova-compute[75341]:   <devices>
Nov 14 23:51:22 user nova-compute[75341]:     <disk type="file" device="disk">
Nov 14 23:51:22 user nova-compute[75341]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 23:51:22 user nova-compute[75341]:       <source file="/opt/stack/data/nova/instances/d93909b3-0373-492a-8ede-7c2cd76bcb88/disk"/>
Nov 14 23:51:22 user nova-compute[75341]:       <target dev="vda" bus="virtio"/>
Nov 14 23:51:22 user nova-compute[75341]:     </disk>
Nov 14 23:51:22 user nova-compute[75341]:     <interface type="ethernet">
Nov 14 23:51:22 user nova-compute[75341]:       <mac address="fa:16:3e:b8:ce:f2"/>
Nov 14 23:51:22 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:51:22 user nova-compute[75341]:       <mtu size="1442"/>
Nov 14 23:51:22 user nova-compute[75341]:       <target dev="tap712f4b2d-01"/>
Nov 14 23:51:22 user nova-compute[75341]:     </interface>
Nov 14 23:51:22 user nova-compute[75341]:     <serial type="pty">
Nov 14 23:51:22 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/d93909b3-0373-492a-8ede-7c2cd76bcb88/console.log" append="off"/>
Nov 14 23:51:22 user nova-compute[75341]:     </serial>
Nov 14 23:51:22 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 23:51:22 user nova-compute[75341]:     <video>
Nov 14 23:51:22 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:51:22 user nova-compute[75341]:     </video>
Nov 14 23:51:22 user nova-compute[75341]:     <rng model="virtio">
Nov 14 23:51:22 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 14 23:51:22 user nova-compute[75341]:     </rng>
Nov 14 23:51:22 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 14 23:51:22 user nova-compute[75341]:     <memballoon model="virtio">
Nov 14 23:51:22 user nova-compute[75341]:       <stats period="10"/>
Nov 14 23:51:22 user nova-compute[75341]:     </memballoon>
Nov 14 23:51:22 user nova-compute[75341]:   </devices>
Nov 14 23:51:22 user nova-compute[75341]: </domain>
Nov 14 23:51:22 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 23:51:22 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:51:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-816790972',display_name='tempest-AttachVolumeNegativeTest-server-816790972',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-816790972',id=36,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNLoMHYiXP+lnUfFr9VBMtRBENQvr4tntDvm0V4M76GOF/XPqEfCrcy6vvrkcVqVY+sG28wrpEuJ8f8B5tl5C58TmswRFkgI+t/pYWvSxr0BQI1JFPuNhEcMdz7EBh2qkg==',key_name='tempest-keypair-568184015',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='542a85b3a6d14c77872f1957120ba655',ramdisk_id='',reservation_id='r-a51qm104',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-802469934',owner_user_name='tempest-AttachVolumeNegativeTest-802469934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:51:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d0b6eae0d3124f70982781555ccc7ec0',uuid=d93909b3-0373-492a-8ede-7c2cd76bcb88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "712f4b2d-016e-43ab-a3f2-8439868a5055", "address": "fa:16:3e:b8:ce:f2", "network": {"id": "9ad7204e-07f5-4676-b2de-09e036a92e61", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-718201239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542a85b3a6d14c77872f1957120ba655", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap712f4b2d-01", "ovs_interfaceid": "712f4b2d-016e-43ab-a3f2-8439868a5055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 23:51:22 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Converting VIF {"id": "712f4b2d-016e-43ab-a3f2-8439868a5055", "address": "fa:16:3e:b8:ce:f2", "network": {"id": "9ad7204e-07f5-4676-b2de-09e036a92e61", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-718201239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542a85b3a6d14c77872f1957120ba655", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap712f4b2d-01", "ovs_interfaceid": "712f4b2d-016e-43ab-a3f2-8439868a5055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:51:22 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:ce:f2,bridge_name='br-int',has_traffic_filtering=True,id=712f4b2d-016e-43ab-a3f2-8439868a5055,network=Network(9ad7204e-07f5-4676-b2de-09e036a92e61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap712f4b2d-01') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:51:22 user nova-compute[75341]: DEBUG os_vif [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:ce:f2,bridge_name='br-int',has_traffic_filtering=True,id=712f4b2d-016e-43ab-a3f2-8439868a5055,network=Network(9ad7204e-07f5-4676-b2de-09e036a92e61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap712f4b2d-01') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 23:51:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:51:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 23:51:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7a7f6296-6cbe-5ae9-80ec-882969c8bb58', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:51:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap712f4b2d-01, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:51:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap712f4b2d-01, col_values=(('qos', UUID('c1baf467-79c0-4a6b-a1da-e44fc3548a2e')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:51:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap712f4b2d-01, col_values=(('external_ids', {'iface-id': '712f4b2d-016e-43ab-a3f2-8439868a5055', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:ce:f2', 'vm-uuid': 'd93909b3-0373-492a-8ede-7c2cd76bcb88'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:51:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:51:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:22 user nova-compute[75341]: INFO os_vif [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:ce:f2,bridge_name='br-int',has_traffic_filtering=True,id=712f4b2d-016e-43ab-a3f2-8439868a5055,network=Network(9ad7204e-07f5-4676-b2de-09e036a92e61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap712f4b2d-01')
Nov 14 23:51:22 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:51:22 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] No VIF found with MAC fa:16:3e:b8:ce:f2, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:51:23 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b09a4230-a8c8-4ce1-a7c4-baf8694ea2b0 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Acquiring lock "2316aa9e-d4c9-43d0-9918-86265583aed1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:51:23 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b09a4230-a8c8-4ce1-a7c4-baf8694ea2b0 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "2316aa9e-d4c9-43d0-9918-86265583aed1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:51:23 user nova-compute[75341]: DEBUG nova.objects.instance [None req-b09a4230-a8c8-4ce1-a7c4-baf8694ea2b0 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lazy-loading 'flavor' on Instance uuid 2316aa9e-d4c9-43d0-9918-86265583aed1 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:51:23 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b09a4230-a8c8-4ce1-a7c4-baf8694ea2b0 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "2316aa9e-d4c9-43d0-9918-86265583aed1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:51:23 user nova-compute[75341]: DEBUG nova.network.neutron [req-754a85e3-461f-4394-874f-909749f04ac7 req-bc6e0400-95f4-4e96-900c-5b4081663123 service nova] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Updated VIF entry in instance network info cache for port 712f4b2d-016e-43ab-a3f2-8439868a5055. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:51:23 user nova-compute[75341]: DEBUG nova.network.neutron [req-754a85e3-461f-4394-874f-909749f04ac7 req-bc6e0400-95f4-4e96-900c-5b4081663123 service nova] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Updating instance_info_cache with network_info: [{"id": "712f4b2d-016e-43ab-a3f2-8439868a5055", "address": "fa:16:3e:b8:ce:f2", "network": {"id": "9ad7204e-07f5-4676-b2de-09e036a92e61", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-718201239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542a85b3a6d14c77872f1957120ba655", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap712f4b2d-01", "ovs_interfaceid": "712f4b2d-016e-43ab-a3f2-8439868a5055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:51:23 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-754a85e3-461f-4394-874f-909749f04ac7 req-bc6e0400-95f4-4e96-900c-5b4081663123 service nova] Releasing lock "refresh_cache-d93909b3-0373-492a-8ede-7c2cd76bcb88" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:51:23 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b09a4230-a8c8-4ce1-a7c4-baf8694ea2b0 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Acquiring lock "2316aa9e-d4c9-43d0-9918-86265583aed1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:51:23 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b09a4230-a8c8-4ce1-a7c4-baf8694ea2b0 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "2316aa9e-d4c9-43d0-9918-86265583aed1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:51:23 user nova-compute[75341]: INFO nova.compute.manager [None req-b09a4230-a8c8-4ce1-a7c4-baf8694ea2b0 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Attaching volume 7cdb17e6-f80d-473e-9b68-71710b6ce418 to /dev/vdb
Nov 14 23:51:23 user nova-compute[75341]: DEBUG os_brick.utils [None req-b09a4230-a8c8-4ce1-a7c4-baf8694ea2b0 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:51:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:23 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[eedb8f67-fe88-44c9-b1b8-58bfb7a1350d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6d1cfca09c9\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:51:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:23 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e519a0-eff9-4015-af92-d1f7676eb79d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:51:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:23 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4cf87b5-4dc0-42fe-9e9e-830f56f48f83]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:51:23 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[3949e5b1-c4ca-46c6-8c1d-1a224a226f52]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:51:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-b09a4230-a8c8-4ce1-a7c4-baf8694ea2b0 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Running cmd (subprocess): nvme version {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-b09a4230-a8c8-4ce1-a7c4-baf8694ea2b0 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] 'nvme version' failed. Not Retrying. {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:51:23 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b09a4230-a8c8-4ce1-a7c4-baf8694ea2b0 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] nvme not present on system {{(pid=75341) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 23:51:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:51:23 user nova-compute[75341]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 23:51:23 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d5703b-32de-4102-8e13-df3c790d557c]: (4, '') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:51:23 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-b09a4230-a8c8-4ce1-a7c4-baf8694ea2b0 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75341) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 23:51:23 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-b09a4230-a8c8-4ce1-a7c4-baf8694ea2b0 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 23:51:23 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-b09a4230-a8c8-4ce1-a7c4-baf8694ea2b0 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] LIGHTOS: no hostnqn found. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 23:51:23 user nova-compute[75341]: DEBUG os_brick.utils [None req-b09a4230-a8c8-4ce1-a7c4-baf8694ea2b0 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6d1cfca09c9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:51:23 user nova-compute[75341]: DEBUG nova.virt.block_device [None req-b09a4230-a8c8-4ce1-a7c4-baf8694ea2b0 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Updating existing volume attachment record: d66f8e3c-1505-430a-835e-7de2c680a97e {{(pid=75341) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 23:51:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:24 user nova-compute[75341]: DEBUG nova.compute.manager [req-566796dd-397b-46e9-9258-fb330a1d2e19 req-5585ced0-dc2c-4b53-9888-e734995113c5 service nova] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Received event network-vif-plugged-712f4b2d-016e-43ab-a3f2-8439868a5055 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:51:24 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-566796dd-397b-46e9-9258-fb330a1d2e19 req-5585ced0-dc2c-4b53-9888-e734995113c5 service nova] Acquiring lock "d93909b3-0373-492a-8ede-7c2cd76bcb88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:51:24 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-566796dd-397b-46e9-9258-fb330a1d2e19 req-5585ced0-dc2c-4b53-9888-e734995113c5 service nova] Lock "d93909b3-0373-492a-8ede-7c2cd76bcb88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:51:24 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-566796dd-397b-46e9-9258-fb330a1d2e19 req-5585ced0-dc2c-4b53-9888-e734995113c5 service nova] Lock "d93909b3-0373-492a-8ede-7c2cd76bcb88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:51:24 user nova-compute[75341]: DEBUG nova.compute.manager [req-566796dd-397b-46e9-9258-fb330a1d2e19 req-5585ced0-dc2c-4b53-9888-e734995113c5 service nova] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] No waiting events found dispatching network-vif-plugged-712f4b2d-016e-43ab-a3f2-8439868a5055 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:51:24 user nova-compute[75341]: WARNING nova.compute.manager [req-566796dd-397b-46e9-9258-fb330a1d2e19 req-5585ced0-dc2c-4b53-9888-e734995113c5 service nova] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Received unexpected event network-vif-plugged-712f4b2d-016e-43ab-a3f2-8439868a5055 for instance with vm_state building and task_state spawning.
Nov 14 23:51:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:26 user nova-compute[75341]: DEBUG nova.compute.manager [req-5f530eca-b6d1-4a3e-9b23-195245a3b1f9 req-85b516f2-2dfc-4420-8d87-d03bca59aea8 service nova] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Received event network-vif-plugged-712f4b2d-016e-43ab-a3f2-8439868a5055 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:51:26 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-5f530eca-b6d1-4a3e-9b23-195245a3b1f9 req-85b516f2-2dfc-4420-8d87-d03bca59aea8 service nova] Acquiring lock "d93909b3-0373-492a-8ede-7c2cd76bcb88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:51:26 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-5f530eca-b6d1-4a3e-9b23-195245a3b1f9 req-85b516f2-2dfc-4420-8d87-d03bca59aea8 service nova] Lock "d93909b3-0373-492a-8ede-7c2cd76bcb88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:51:26 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-5f530eca-b6d1-4a3e-9b23-195245a3b1f9 req-85b516f2-2dfc-4420-8d87-d03bca59aea8 service nova] Lock "d93909b3-0373-492a-8ede-7c2cd76bcb88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:51:26 user nova-compute[75341]: DEBUG nova.compute.manager [req-5f530eca-b6d1-4a3e-9b23-195245a3b1f9 req-85b516f2-2dfc-4420-8d87-d03bca59aea8 service nova] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] No waiting events found dispatching network-vif-plugged-712f4b2d-016e-43ab-a3f2-8439868a5055 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:51:26 user nova-compute[75341]: WARNING nova.compute.manager [req-5f530eca-b6d1-4a3e-9b23-195245a3b1f9 req-85b516f2-2dfc-4420-8d87-d03bca59aea8 service nova] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Received unexpected event network-vif-plugged-712f4b2d-016e-43ab-a3f2-8439868a5055 for instance with vm_state building and task_state spawning.
Nov 14 23:51:26 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:27 user nova-compute[75341]: DEBUG nova.compute.manager [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Instance event wait completed in 0 seconds for  {{(pid=75341) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 23:51:27 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Guest created on hypervisor {{(pid=75341) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 23:51:27 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Instance spawned successfully.
Nov 14 23:51:27 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 23:51:27 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Found default for hw_cdrom_bus of ide {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:51:27 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Found default for hw_disk_bus of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:51:27 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Found default for hw_input_bus of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:51:27 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Found default for hw_pointer_model of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:51:27 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Found default for hw_video_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:51:27 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Found default for hw_vif_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:51:27 user nova-compute[75341]: INFO nova.compute.manager [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Took 6.42 seconds to spawn the instance on the hypervisor.
Nov 14 23:51:27 user nova-compute[75341]: DEBUG nova.compute.manager [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 23:51:27 user nova-compute[75341]: INFO nova.compute.manager [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Took 7.44 seconds to build instance.
Nov 14 23:51:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c93a831c-16d4-4501-b542-124d9e040868 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "d93909b3-0373-492a-8ede-7c2cd76bcb88" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.582s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:51:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:28 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b09a4230-a8c8-4ce1-a7c4-baf8694ea2b0 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Calling os-brick to attach iSCSI Volume {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 23:51:28 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09a4230-a8c8-4ce1-a7c4-baf8694ea2b0 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GWOJaprl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:51:28 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-b09a4230-a8c8-4ce1-a7c4-baf8694ea2b0 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:51:28 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-b09a4230-a8c8-4ce1-a7c4-baf8694ea2b0 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:51:28 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-b09a4230-a8c8-4ce1-a7c4-baf8694ea2b0 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:51:28 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-b09a4230-a8c8-4ce1-a7c4-baf8694ea2b0 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:51:28 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-b09a4230-a8c8-4ce1-a7c4-baf8694ea2b0 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:51:28 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-b09a4230-a8c8-4ce1-a7c4-baf8694ea2b0 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:51:28 user nova-compute[75341]: INFO os_brick.initiator.connectors.iscsi [None req-b09a4230-a8c8-4ce1-a7c4-baf8694ea2b0 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 23:51:28 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 -p 172.16.0.220:3260 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:28 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:28 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[cffc6dc0-2062-4442-8836-ec65fd0d3c90]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:51:28 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09a4230-a8c8-4ce1-a7c4-baf8694ea2b0 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 23:51:28 user nova-compute[75341]:  {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:51:28 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 -p 172.16.0.220:3260 --interface default --op new {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:28 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:28 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[38738da8-7fc3-474a-b747-3b09d1952a14]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418] added\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:51:28 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09a4230-a8c8-4ce1-a7c4-baf8694ea2b0 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418] added
Nov 14 23:51:28 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:51:28 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:28 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:28 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe308356-e03c-448b-9c58-9900272aaaf6]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:51:28 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09a4230-a8c8-4ce1-a7c4-baf8694ea2b0 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:51:28 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:28 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:28 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[57226eab-ab0c-4cff-918d-825bd318fb6b]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:51:28 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09a4230-a8c8-4ce1-a7c4-baf8694ea2b0 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:51:28 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GWOJaprl {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:28 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GWOJaprl" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:28 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ccf20f-c9a1-4252-8e2c-aa5d998d012f]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:51:28 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09a4230-a8c8-4ce1-a7c4-baf8694ea2b0 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GWOJaprl'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:51:28 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:29 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[1214b834-8b3a-4a9e-bcd3-06dc7eefd135]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:51:29 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09a4230-a8c8-4ce1-a7c4-baf8694ea2b0 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:51:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:29 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2145eb-c4f8-4438-9fdd-21f34a1b95fc]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41d6927-f54d-4872-be46-03a519486d61 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:51:29 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09a4230-a8c8-4ce1-a7c4-baf8694ea2b0 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)
Nov 14 23:51:29 user nova-compute[75341]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455 (non-flash)
Nov 14 23:51:29 user nova-compute[75341]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41d6927-f54d-4872-be46-03a519486d61 (non-flash)
Nov 14 23:51:29 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:51:29 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09a4230-a8c8-4ce1-a7c4-baf8694ea2b0 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)
Nov 14 23:51:29 user nova-compute[75341]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455 (non-flash)
Nov 14 23:51:29 user nova-compute[75341]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41d6927-f54d-4872-be46-03a519486d61 (non-flash)
Nov 14 23:51:29 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:51:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 -p 172.16.0.220:3260 --login {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:29 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79c29fb-10e1-4cc9-b81c-58335672ce8e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:51:29 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09a4230-a8c8-4ce1-a7c4-baf8694ea2b0 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418, portal: 172.16.0.220,3260]
Nov 14 23:51:29 user nova-compute[75341]: Login to [iface: default, target: iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418, portal: 172.16.0.220,3260] successful.
Nov 14 23:51:29 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:51:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:29 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee8258f-3f30-48f6-828b-79da63a0349b]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:51:29 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09a4230-a8c8-4ce1-a7c4-baf8694ea2b0 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:51:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:29 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[14235ea2-409f-4b1d-826d-7ff7e33344e5]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41d6927-f54d-4872-be46-03a519486d61 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:51:29 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09a4230-a8c8-4ce1-a7c4-baf8694ea2b0 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)
Nov 14 23:51:29 user nova-compute[75341]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455 (non-flash)
Nov 14 23:51:29 user nova-compute[75341]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41d6927-f54d-4872-be46-03a519486d61 (non-flash)
Nov 14 23:51:29 user nova-compute[75341]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)
Nov 14 23:51:29 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:51:29 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09a4230-a8c8-4ce1-a7c4-baf8694ea2b0 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)
Nov 14 23:51:29 user nova-compute[75341]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455 (non-flash)
Nov 14 23:51:29 user nova-compute[75341]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41d6927-f54d-4872-be46-03a519486d61 (non-flash)
Nov 14 23:51:29 user nova-compute[75341]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)
Nov 14 23:51:29 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:51:29 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-b09a4230-a8c8-4ce1-a7c4-baf8694ea2b0 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:51:29 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09a4230-a8c8-4ce1-a7c4-baf8694ea2b0 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Connected to 172.16.0.220:3260 {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 23:51:29 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-b09a4230-a8c8-4ce1-a7c4-baf8694ea2b0 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] HCTL ('36', '-', '-', 0) found on session 36 with lun 0 {{(pid=75341) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 23:51:29 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-b09a4230-a8c8-4ce1-a7c4-baf8694ea2b0 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75341) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 23:51:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:29 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aba0574-1353-4140-9cbf-aec79ad82707]: (4, ('- - 0', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:51:29 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-b09a4230-a8c8-4ce1-a7c4-baf8694ea2b0 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Searching for a device in session 36 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 23:51:29 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09a4230-a8c8-4ce1-a7c4-baf8694ea2b0 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GWOJaprl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 23:51:30 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-b09a4230-a8c8-4ce1-a7c4-baf8694ea2b0 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:51:30 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09a4230-a8c8-4ce1-a7c4-baf8694ea2b0 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] <== connect_volume: return (1360ms) {'type': 'block', 'scsi_wwn': '26230623739373336', 'path': '/dev/sde'} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:51:30 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b09a4230-a8c8-4ce1-a7c4-baf8694ea2b0 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26230623739373336', 'path': '/dev/sde'} {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 23:51:30 user nova-compute[75341]: DEBUG nova.objects.instance [None req-b09a4230-a8c8-4ce1-a7c4-baf8694ea2b0 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lazy-loading 'flavor' on Instance uuid 2316aa9e-d4c9-43d0-9918-86265583aed1 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:51:30 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-b09a4230-a8c8-4ce1-a7c4-baf8694ea2b0 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 23:51:30 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:51:30 user nova-compute[75341]:   <source dev="/dev/sde"/>
Nov 14 23:51:30 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:51:30 user nova-compute[75341]:   <serial>7cdb17e6-f80d-473e-9b68-71710b6ce418</serial>
Nov 14 23:51:30 user nova-compute[75341]: </disk>
Nov 14 23:51:30 user nova-compute[75341]:  {{(pid=75341) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 23:51:30 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b09a4230-a8c8-4ce1-a7c4-baf8694ea2b0 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:51:30 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b09a4230-a8c8-4ce1-a7c4-baf8694ea2b0 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:51:30 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b09a4230-a8c8-4ce1-a7c4-baf8694ea2b0 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] No VIF found with MAC fa:16:3e:3d:1f:4a, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:51:30 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b09a4230-a8c8-4ce1-a7c4-baf8694ea2b0 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "2316aa9e-d4c9-43d0-9918-86265583aed1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.570s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:51:31 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-95255393-09e6-4524-ab01-56814ce5ce68 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Acquiring lock "2316aa9e-d4c9-43d0-9918-86265583aed1" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:51:31 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-95255393-09e6-4524-ab01-56814ce5ce68 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "2316aa9e-d4c9-43d0-9918-86265583aed1" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:51:31 user nova-compute[75341]: DEBUG nova.compute.manager [None req-95255393-09e6-4524-ab01-56814ce5ce68 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 23:51:31 user nova-compute[75341]: DEBUG nova.compute.manager [None req-95255393-09e6-4524-ab01-56814ce5ce68 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75341) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 14 23:51:31 user nova-compute[75341]: DEBUG nova.objects.instance [None req-95255393-09e6-4524-ab01-56814ce5ce68 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lazy-loading 'flavor' on Instance uuid 2316aa9e-d4c9-43d0-9918-86265583aed1 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:51:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:31 user nova-compute[75341]: DEBUG nova.compute.manager [req-6d33e09e-5912-4f27-a1c2-7e11fdffe455 req-3a1071af-577a-42f2-89b6-d0077fcc0191 service nova] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Received event network-vif-unplugged-71caa935-899c-4716-9953-ae35733e691e {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:51:31 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6d33e09e-5912-4f27-a1c2-7e11fdffe455 req-3a1071af-577a-42f2-89b6-d0077fcc0191 service nova] Acquiring lock "2316aa9e-d4c9-43d0-9918-86265583aed1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:51:31 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6d33e09e-5912-4f27-a1c2-7e11fdffe455 req-3a1071af-577a-42f2-89b6-d0077fcc0191 service nova] Lock "2316aa9e-d4c9-43d0-9918-86265583aed1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:51:31 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6d33e09e-5912-4f27-a1c2-7e11fdffe455 req-3a1071af-577a-42f2-89b6-d0077fcc0191 service nova] Lock "2316aa9e-d4c9-43d0-9918-86265583aed1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:51:31 user nova-compute[75341]: DEBUG nova.compute.manager [req-6d33e09e-5912-4f27-a1c2-7e11fdffe455 req-3a1071af-577a-42f2-89b6-d0077fcc0191 service nova] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] No waiting events found dispatching network-vif-unplugged-71caa935-899c-4716-9953-ae35733e691e {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:51:31 user nova-compute[75341]: WARNING nova.compute.manager [req-6d33e09e-5912-4f27-a1c2-7e11fdffe455 req-3a1071af-577a-42f2-89b6-d0077fcc0191 service nova] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Received unexpected event network-vif-unplugged-71caa935-899c-4716-9953-ae35733e691e for instance with vm_state active and task_state powering-off.
Nov 14 23:51:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:32 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Instance destroyed successfully.
Nov 14 23:51:32 user nova-compute[75341]: DEBUG nova.compute.manager [None req-95255393-09e6-4524-ab01-56814ce5ce68 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 23:51:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-95255393-09e6-4524-ab01-56814ce5ce68 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "2316aa9e-d4c9-43d0-9918-86265583aed1" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.958s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:51:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:33 user nova-compute[75341]: DEBUG nova.compute.manager [req-7ba7b8ea-17f0-480a-888b-81b566a0db3f req-0579aeb4-f89a-456f-93e4-517d88f37177 service nova] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Received event network-vif-plugged-71caa935-899c-4716-9953-ae35733e691e {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:51:33 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-7ba7b8ea-17f0-480a-888b-81b566a0db3f req-0579aeb4-f89a-456f-93e4-517d88f37177 service nova] Acquiring lock "2316aa9e-d4c9-43d0-9918-86265583aed1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:51:33 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-7ba7b8ea-17f0-480a-888b-81b566a0db3f req-0579aeb4-f89a-456f-93e4-517d88f37177 service nova] Lock "2316aa9e-d4c9-43d0-9918-86265583aed1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:51:33 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-7ba7b8ea-17f0-480a-888b-81b566a0db3f req-0579aeb4-f89a-456f-93e4-517d88f37177 service nova] Lock "2316aa9e-d4c9-43d0-9918-86265583aed1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:51:33 user nova-compute[75341]: DEBUG nova.compute.manager [req-7ba7b8ea-17f0-480a-888b-81b566a0db3f req-0579aeb4-f89a-456f-93e4-517d88f37177 service nova] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] No waiting events found dispatching network-vif-plugged-71caa935-899c-4716-9953-ae35733e691e {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:51:33 user nova-compute[75341]: WARNING nova.compute.manager [req-7ba7b8ea-17f0-480a-888b-81b566a0db3f req-0579aeb4-f89a-456f-93e4-517d88f37177 service nova] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Received unexpected event network-vif-plugged-71caa935-899c-4716-9953-ae35733e691e for instance with vm_state stopped and task_state None.
Nov 14 23:51:36 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:37 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:37 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:38 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-234be512-3242-4964-b0fe-96a4d017585a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 01b30e67-ac52-4cf6-9a31-30096f8b3344 is timed out.
Nov 14 23:51:38 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-234be512-3242-4964-b0fe-96a4d017585a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Successfully detached device vdb from instance 01b30e67-ac52-4cf6-9a31-30096f8b3344 from the live domain config.
Nov 14 23:51:38 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-234be512-3242-4964-b0fe-96a4d017585a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] calling os-brick to detach iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 23:51:38 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-234be512-3242-4964-b0fe-96a4d017585a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, {'target_iqn': 'iqn.2010-10.org.openstack:c41d6927-f54d-4872-be46-03a519486d61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DTXfVPLe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:51:38 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-234be512-3242-4964-b0fe-96a4d017585a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:51:38 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-234be512-3242-4964-b0fe-96a4d017585a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:51:38 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-234be512-3242-4964-b0fe-96a4d017585a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:51:38 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:38 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:38 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1dfc00d-3653-46d9-96ab-925e8aa9a19c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c41d6927-f54d-4872-be46-03a519486d61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:51:38 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-234be512-3242-4964-b0fe-96a4d017585a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 23:51:38 user nova-compute[75341]: No targets found.
Nov 14 23:51:38 user nova-compute[75341]: iSNS:
Nov 14 23:51:38 user nova-compute[75341]: No targets found.
Nov 14 23:51:38 user nova-compute[75341]: STATIC:
Nov 14 23:51:38 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9
Nov 14 23:51:38 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:51:38 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:51:38 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418
Nov 14 23:51:38 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:51:38 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:51:38 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:c41d6927-f54d-4872-be46-03a519486d61
Nov 14 23:51:38 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:51:38 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:51:38 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455
Nov 14 23:51:38 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:51:38 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:51:38 user nova-compute[75341]: FIRMWARE:
Nov 14 23:51:38 user nova-compute[75341]: No targets found.
Nov 14 23:51:38 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:51:38 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-234be512-3242-4964-b0fe-96a4d017585a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 23:51:38 user nova-compute[75341]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 23:51:38 user nova-compute[75341]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75341) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 23:51:38 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-234be512-3242-4964-b0fe-96a4d017585a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c41d6927-f54d-4872-be46-03a519486d61', 0)] {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 23:51:38 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:38 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:38 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da54ade-7b19-4b45-baee-6deee9d88fd6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c41d6927-f54d-4872-be46-03a519486d61\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:51:38 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:38 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:38 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[408f2108-e3b1-438b-94da-d75b9a4580dc]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41d6927-f54d-4872-be46-03a519486d61 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:51:38 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-234be512-3242-4964-b0fe-96a4d017585a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)
Nov 14 23:51:38 user nova-compute[75341]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455 (non-flash)
Nov 14 23:51:38 user nova-compute[75341]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41d6927-f54d-4872-be46-03a519486d61 (non-flash)
Nov 14 23:51:38 user nova-compute[75341]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)
Nov 14 23:51:38 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:51:38 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-234be512-3242-4964-b0fe-96a4d017585a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)
Nov 14 23:51:38 user nova-compute[75341]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455 (non-flash)
Nov 14 23:51:38 user nova-compute[75341]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41d6927-f54d-4872-be46-03a519486d61 (non-flash)
Nov 14 23:51:38 user nova-compute[75341]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)
Nov 14 23:51:38 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:51:38 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-234be512-3242-4964-b0fe-96a4d017585a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18701ef010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c41d6927-f54d-4872-be46-03a519486d61'): ({'sdb'}, set())}) {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 23:51:38 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-234be512-3242-4964-b0fe-96a4d017585a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Removing single pathed devices sdb {{(pid=75341) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 23:51:38 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:38 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:38 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[a395c956-bbbc-4326-aaf5-3c29827f00be]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:51:38 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:38 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:38 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[6927c0fd-6737-4e36-805b-04cbd21fe771]: (4, ('ok\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:51:38 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-234be512-3242-4964-b0fe-96a4d017585a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Flushing IO for device /dev/sdb {{(pid=75341) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 23:51:38 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:38 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:38 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c4e9f7-4998-457a-a714-5f78bc569c53]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:51:38 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-234be512-3242-4964-b0fe-96a4d017585a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75341) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 23:51:38 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:38 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:38 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[20785b99-4d50-40f4-9d54-ec573122c000]: (4, ('1', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:51:38 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-234be512-3242-4964-b0fe-96a4d017585a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 23:51:38 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-234be512-3242-4964-b0fe-96a4d017585a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] SCSI volumes sdb have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 23:51:38 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-234be512-3242-4964-b0fe-96a4d017585a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c41d6927-f54d-4872-be46-03a519486d61')] {{(pid=75341) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 23:51:38 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c41d6927-f54d-4872-be46-03a519486d61 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:38 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c41d6927-f54d-4872-be46-03a519486d61 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:38 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[9275d5d1-6933-4c42-990d-739c1157fc3d]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:51:38 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-234be512-3242-4964-b0fe-96a4d017585a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:51:38 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c41d6927-f54d-4872-be46-03a519486d61 -p 172.16.0.220:3260 --logout {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:38 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c41d6927-f54d-4872-be46-03a519486d61 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:38 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ce83b0-101c-422a-98fc-a84a8a8d3a61]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:c41d6927-f54d-4872-be46-03a519486d61, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:c41d6927-f54d-4872-be46-03a519486d61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:51:38 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-234be512-3242-4964-b0fe-96a4d017585a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:c41d6927-f54d-4872-be46-03a519486d61, portal: 172.16.0.220,3260]
Nov 14 23:51:38 user nova-compute[75341]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:c41d6927-f54d-4872-be46-03a519486d61, portal: 172.16.0.220,3260] successful.
Nov 14 23:51:38 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:51:38 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c41d6927-f54d-4872-be46-03a519486d61 -p 172.16.0.220:3260 --op delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:38 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c41d6927-f54d-4872-be46-03a519486d61 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:38 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[870bbba6-2cec-47ca-aebd-e3b23495905a]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:51:38 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-234be512-3242-4964-b0fe-96a4d017585a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:51:38 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-234be512-3242-4964-b0fe-96a4d017585a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:51:38 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-234be512-3242-4964-b0fe-96a4d017585a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] <== disconnect_volume: return (340ms) None {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:51:38 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-234be512-3242-4964-b0fe-96a4d017585a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Disconnected iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 23:51:39 user nova-compute[75341]: DEBUG nova.objects.instance [None req-234be512-3242-4964-b0fe-96a4d017585a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Lazy-loading 'flavor' on Instance uuid 01b30e67-ac52-4cf6-9a31-30096f8b3344 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:51:39 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-234be512-3242-4964-b0fe-96a4d017585a tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Lock "01b30e67-ac52-4cf6-9a31-30096f8b3344" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.812s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:51:40 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:42 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:43 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:45 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:46 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:47 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Acquiring lock "53d7a6fe-3914-459a-9494-c75549af7b9f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:51:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lock "53d7a6fe-3914-459a-9494-c75549af7b9f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:51:49 user nova-compute[75341]: DEBUG nova.compute.manager [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Starting instance... {{(pid=75341) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 23:51:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:51:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:51:49 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75341) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 23:51:49 user nova-compute[75341]: INFO nova.compute.claims [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Claim successful on node user
Nov 14 23:51:50 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:51:50 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:51:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.454s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:51:50 user nova-compute[75341]: DEBUG nova.compute.manager [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Start building networks asynchronously for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 23:51:50 user nova-compute[75341]: DEBUG nova.compute.manager [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Allocating IP information in the background. {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 23:51:50 user nova-compute[75341]: DEBUG nova.network.neutron [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] allocate_for_instance() {{(pid=75341) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 23:51:50 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 23:51:50 user nova-compute[75341]: DEBUG nova.compute.manager [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Start building block device mappings for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 23:51:50 user nova-compute[75341]: DEBUG nova.policy [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd9a816d73a424b448157264f42acfaf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '080d7a9c1501453d94616cf03ea12473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75341) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 23:51:50 user nova-compute[75341]: DEBUG nova.compute.manager [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Start spawning the instance on the hypervisor. {{(pid=75341) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 23:51:50 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Creating instance directory {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 23:51:50 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Creating image(s)
Nov 14 23:51:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Acquiring lock "/opt/stack/data/nova/instances/53d7a6fe-3914-459a-9494-c75549af7b9f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:51:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lock "/opt/stack/data/nova/instances/53d7a6fe-3914-459a-9494-c75549af7b9f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:51:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lock "/opt/stack/data/nova/instances/53d7a6fe-3914-459a-9494-c75549af7b9f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:51:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.203s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Acquiring lock "4754efee9a6d73d3647f2add2cfe86c291949740" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:51:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:51:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.190s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/53d7a6fe-3914-459a-9494-c75549af7b9f/disk 1073741824 {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:50 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:51:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/53d7a6fe-3914-459a-9494-c75549af7b9f/disk 1073741824" returned: 0 in 0.052s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:51:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:51 user nova-compute[75341]: DEBUG nova.network.neutron [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Successfully created port: d5f6d779-3733-459c-8144-771980cd9ec2 {{(pid=75341) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 23:51:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.194s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:51 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Checking if we can resize image /opt/stack/data/nova/instances/53d7a6fe-3914-459a-9494-c75549af7b9f/disk. size=1073741824 {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 23:51:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53d7a6fe-3914-459a-9494-c75549af7b9f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53d7a6fe-3914-459a-9494-c75549af7b9f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:51 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Cannot resize image /opt/stack/data/nova/instances/53d7a6fe-3914-459a-9494-c75549af7b9f/disk to a smaller size. {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 23:51:51 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Created local disks {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 23:51:51 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Ensure instance console log exists: /opt/stack/data/nova/instances/53d7a6fe-3914-459a-9494-c75549af7b9f/console.log {{(pid=75341) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 23:51:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:51:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:51:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:51:51 user nova-compute[75341]: DEBUG nova.network.neutron [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Successfully updated port: d5f6d779-3733-459c-8144-771980cd9ec2 {{(pid=75341) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 23:51:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Acquiring lock "refresh_cache-53d7a6fe-3914-459a-9494-c75549af7b9f" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:51:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Acquired lock "refresh_cache-53d7a6fe-3914-459a-9494-c75549af7b9f" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:51:51 user nova-compute[75341]: DEBUG nova.network.neutron [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 23:51:51 user nova-compute[75341]: DEBUG nova.compute.manager [req-a90243f8-5c3d-4b82-bb44-1318502d7302 req-cb191e78-c735-443c-88ba-4ba1eb1ceaa5 service nova] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Received event network-changed-d5f6d779-3733-459c-8144-771980cd9ec2 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:51:51 user nova-compute[75341]: DEBUG nova.compute.manager [req-a90243f8-5c3d-4b82-bb44-1318502d7302 req-cb191e78-c735-443c-88ba-4ba1eb1ceaa5 service nova] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Refreshing instance network info cache due to event network-changed-d5f6d779-3733-459c-8144-771980cd9ec2. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:51:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a90243f8-5c3d-4b82-bb44-1318502d7302 req-cb191e78-c735-443c-88ba-4ba1eb1ceaa5 service nova] Acquiring lock "refresh_cache-53d7a6fe-3914-459a-9494-c75549af7b9f" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:51:51 user nova-compute[75341]: DEBUG nova.network.neutron [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Instance cache missing network info. {{(pid=75341) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 23:51:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:51 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:51:51 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:51:51 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75341) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 23:51:52 user nova-compute[75341]: DEBUG nova.network.neutron [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Updating instance_info_cache with network_info: [{"id": "d5f6d779-3733-459c-8144-771980cd9ec2", "address": "fa:16:3e:14:63:0c", "network": {"id": "e4c01dfd-427e-4d61-92e0-170e541b1fb9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2053751717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "080d7a9c1501453d94616cf03ea12473", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f6d779-37", "ovs_interfaceid": "d5f6d779-3733-459c-8144-771980cd9ec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:51:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Releasing lock "refresh_cache-53d7a6fe-3914-459a-9494-c75549af7b9f" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:51:52 user nova-compute[75341]: DEBUG nova.compute.manager [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Instance network_info: |[{"id": "d5f6d779-3733-459c-8144-771980cd9ec2", "address": "fa:16:3e:14:63:0c", "network": {"id": "e4c01dfd-427e-4d61-92e0-170e541b1fb9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2053751717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "080d7a9c1501453d94616cf03ea12473", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f6d779-37", "ovs_interfaceid": "d5f6d779-3733-459c-8144-771980cd9ec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 23:51:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a90243f8-5c3d-4b82-bb44-1318502d7302 req-cb191e78-c735-443c-88ba-4ba1eb1ceaa5 service nova] Acquired lock "refresh_cache-53d7a6fe-3914-459a-9494-c75549af7b9f" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:51:52 user nova-compute[75341]: DEBUG nova.network.neutron [req-a90243f8-5c3d-4b82-bb44-1318502d7302 req-cb191e78-c735-443c-88ba-4ba1eb1ceaa5 service nova] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Refreshing network info cache for port d5f6d779-3733-459c-8144-771980cd9ec2 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:51:52 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Start _get_guest_xml network_info=[{"id": "d5f6d779-3733-459c-8144-771980cd9ec2", "address": "fa:16:3e:14:63:0c", "network": {"id": "e4c01dfd-427e-4d61-92e0-170e541b1fb9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2053751717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "080d7a9c1501453d94616cf03ea12473", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f6d779-37", "ovs_interfaceid": "d5f6d779-3733-459c-8144-771980cd9ec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encrypted': False, 'image_id': 'e46abb82-b810-490e-a8a1-ccdc5fa1a796'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 23:51:52 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:51:52 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:51:52 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 23:51:52 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 23:51:52 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 23:51:52 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 23:51:52 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 23:51:52 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 23:51:52 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 23:51:52 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 23:51:52 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 23:51:52 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 23:51:52 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 23:51:52 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 23:51:52 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 23:51:52 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 23:51:52 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 23:51:52 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 23:51:52 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:51:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-681502116',display_name='tempest-SnapshotDataIntegrityTests-server-681502116',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-681502116',id=37,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLQpn856CRdRcHXF04ZBaDcpmMr8f9QJqKbZvn67yvJ2et4428e2uD9evkuO8HpedKAkRPE5N41GsL4QOss0ZuQ2znxLa9tHwdKPsAK19iNK8UK439eMi+ccRS1bivR2ww==',key_name='tempest-keypair-1848879181',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='080d7a9c1501453d94616cf03ea12473',ramdisk_id='',reservation_id='r-ijvbsome',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1937652206',owner_user_name='tempest-SnapshotDataIntegrityTests-1937652206-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:51:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9a816d73a424b448157264f42acfaf4',uuid=53d7a6fe-3914-459a-9494-c75549af7b9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5f6d779-3733-459c-8144-771980cd9ec2", "address": "fa:16:3e:14:63:0c", "network": {"id": "e4c01dfd-427e-4d61-92e0-170e541b1fb9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2053751717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "080d7a9c1501453d94616cf03ea12473", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f6d779-37", "ovs_interfaceid": "d5f6d779-3733-459c-8144-771980cd9ec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:51:52 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Converting VIF {"id": "d5f6d779-3733-459c-8144-771980cd9ec2", "address": "fa:16:3e:14:63:0c", "network": {"id": "e4c01dfd-427e-4d61-92e0-170e541b1fb9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2053751717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "080d7a9c1501453d94616cf03ea12473", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f6d779-37", "ovs_interfaceid": "d5f6d779-3733-459c-8144-771980cd9ec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:51:52 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:63:0c,bridge_name='br-int',has_traffic_filtering=True,id=d5f6d779-3733-459c-8144-771980cd9ec2,network=Network(e4c01dfd-427e-4d61-92e0-170e541b1fb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5f6d779-37') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:51:52 user nova-compute[75341]: DEBUG nova.objects.instance [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lazy-loading 'pci_devices' on Instance uuid 53d7a6fe-3914-459a-9494-c75549af7b9f {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:51:52 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] End _get_guest_xml xml=<domain type="kvm">
Nov 14 23:51:52 user nova-compute[75341]:   <uuid>53d7a6fe-3914-459a-9494-c75549af7b9f</uuid>
Nov 14 23:51:52 user nova-compute[75341]:   <name>instance-00000025</name>
Nov 14 23:51:52 user nova-compute[75341]:   <memory>524288</memory>
Nov 14 23:51:52 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 14 23:51:52 user nova-compute[75341]:   <metadata>
Nov 14 23:51:52 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 23:51:52 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 14 23:51:52 user nova-compute[75341]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-681502116</nova:name>
Nov 14 23:51:52 user nova-compute[75341]:       <nova:creationTime>2023-11-14 23:51:52</nova:creationTime>
Nov 14 23:51:52 user nova-compute[75341]:       <nova:flavor name="m1.tiny">
Nov 14 23:51:52 user nova-compute[75341]:         <nova:memory>512</nova:memory>
Nov 14 23:51:52 user nova-compute[75341]:         <nova:disk>1</nova:disk>
Nov 14 23:51:52 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 14 23:51:52 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 23:51:52 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 14 23:51:52 user nova-compute[75341]:       </nova:flavor>
Nov 14 23:51:52 user nova-compute[75341]:       <nova:owner>
Nov 14 23:51:52 user nova-compute[75341]:         <nova:user uuid="d9a816d73a424b448157264f42acfaf4">tempest-SnapshotDataIntegrityTests-1937652206-project-member</nova:user>
Nov 14 23:51:52 user nova-compute[75341]:         <nova:project uuid="080d7a9c1501453d94616cf03ea12473">tempest-SnapshotDataIntegrityTests-1937652206</nova:project>
Nov 14 23:51:52 user nova-compute[75341]:       </nova:owner>
Nov 14 23:51:52 user nova-compute[75341]:       <nova:root type="image" uuid="e46abb82-b810-490e-a8a1-ccdc5fa1a796"/>
Nov 14 23:51:52 user nova-compute[75341]:       <nova:ports>
Nov 14 23:51:52 user nova-compute[75341]:         <nova:port uuid="d5f6d779-3733-459c-8144-771980cd9ec2">
Nov 14 23:51:52 user nova-compute[75341]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 23:51:52 user nova-compute[75341]:         </nova:port>
Nov 14 23:51:52 user nova-compute[75341]:       </nova:ports>
Nov 14 23:51:52 user nova-compute[75341]:     </nova:instance>
Nov 14 23:51:52 user nova-compute[75341]:   </metadata>
Nov 14 23:51:52 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 14 23:51:52 user nova-compute[75341]:     <system>
Nov 14 23:51:52 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 23:51:52 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 14 23:51:52 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 14 23:51:52 user nova-compute[75341]:       <entry name="serial">53d7a6fe-3914-459a-9494-c75549af7b9f</entry>
Nov 14 23:51:52 user nova-compute[75341]:       <entry name="uuid">53d7a6fe-3914-459a-9494-c75549af7b9f</entry>
Nov 14 23:51:52 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 14 23:51:52 user nova-compute[75341]:     </system>
Nov 14 23:51:52 user nova-compute[75341]:   </sysinfo>
Nov 14 23:51:52 user nova-compute[75341]:   <os>
Nov 14 23:51:52 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 23:51:52 user nova-compute[75341]:     <boot dev="hd"/>
Nov 14 23:51:52 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 14 23:51:52 user nova-compute[75341]:   </os>
Nov 14 23:51:52 user nova-compute[75341]:   <features>
Nov 14 23:51:52 user nova-compute[75341]:     <acpi/>
Nov 14 23:51:52 user nova-compute[75341]:     <apic/>
Nov 14 23:51:52 user nova-compute[75341]:     <vmcoreinfo/>
Nov 14 23:51:52 user nova-compute[75341]:   </features>
Nov 14 23:51:52 user nova-compute[75341]:   <clock offset="utc">
Nov 14 23:51:52 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 23:51:52 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 23:51:52 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 14 23:51:52 user nova-compute[75341]:   </clock>
Nov 14 23:51:52 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 14 23:51:52 user nova-compute[75341]:     <model>Nehalem</model>
Nov 14 23:51:52 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 23:51:52 user nova-compute[75341]:   </cpu>
Nov 14 23:51:52 user nova-compute[75341]:   <devices>
Nov 14 23:51:52 user nova-compute[75341]:     <disk type="file" device="disk">
Nov 14 23:51:52 user nova-compute[75341]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 23:51:52 user nova-compute[75341]:       <source file="/opt/stack/data/nova/instances/53d7a6fe-3914-459a-9494-c75549af7b9f/disk"/>
Nov 14 23:51:52 user nova-compute[75341]:       <target dev="vda" bus="virtio"/>
Nov 14 23:51:52 user nova-compute[75341]:     </disk>
Nov 14 23:51:52 user nova-compute[75341]:     <interface type="ethernet">
Nov 14 23:51:52 user nova-compute[75341]:       <mac address="fa:16:3e:14:63:0c"/>
Nov 14 23:51:52 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:51:52 user nova-compute[75341]:       <mtu size="1442"/>
Nov 14 23:51:52 user nova-compute[75341]:       <target dev="tapd5f6d779-37"/>
Nov 14 23:51:52 user nova-compute[75341]:     </interface>
Nov 14 23:51:52 user nova-compute[75341]:     <serial type="pty">
Nov 14 23:51:52 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/53d7a6fe-3914-459a-9494-c75549af7b9f/console.log" append="off"/>
Nov 14 23:51:52 user nova-compute[75341]:     </serial>
Nov 14 23:51:52 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 23:51:52 user nova-compute[75341]:     <video>
Nov 14 23:51:52 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:51:52 user nova-compute[75341]:     </video>
Nov 14 23:51:52 user nova-compute[75341]:     <rng model="virtio">
Nov 14 23:51:52 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 14 23:51:52 user nova-compute[75341]:     </rng>
Nov 14 23:51:52 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 14 23:51:52 user nova-compute[75341]:     <memballoon model="virtio">
Nov 14 23:51:52 user nova-compute[75341]:       <stats period="10"/>
Nov 14 23:51:52 user nova-compute[75341]:     </memballoon>
Nov 14 23:51:52 user nova-compute[75341]:   </devices>
Nov 14 23:51:52 user nova-compute[75341]: </domain>
Nov 14 23:51:52 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 23:51:52 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:51:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-681502116',display_name='tempest-SnapshotDataIntegrityTests-server-681502116',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-681502116',id=37,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLQpn856CRdRcHXF04ZBaDcpmMr8f9QJqKbZvn67yvJ2et4428e2uD9evkuO8HpedKAkRPE5N41GsL4QOss0ZuQ2znxLa9tHwdKPsAK19iNK8UK439eMi+ccRS1bivR2ww==',key_name='tempest-keypair-1848879181',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='080d7a9c1501453d94616cf03ea12473',ramdisk_id='',reservation_id='r-ijvbsome',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1937652206',owner_user_name='tempest-SnapshotDataIntegrityTests-1937652206-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:51:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9a816d73a424b448157264f42acfaf4',uuid=53d7a6fe-3914-459a-9494-c75549af7b9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5f6d779-3733-459c-8144-771980cd9ec2", "address": "fa:16:3e:14:63:0c", "network": {"id": "e4c01dfd-427e-4d61-92e0-170e541b1fb9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2053751717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "080d7a9c1501453d94616cf03ea12473", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f6d779-37", "ovs_interfaceid": "d5f6d779-3733-459c-8144-771980cd9ec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 23:51:52 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Converting VIF {"id": "d5f6d779-3733-459c-8144-771980cd9ec2", "address": "fa:16:3e:14:63:0c", "network": {"id": "e4c01dfd-427e-4d61-92e0-170e541b1fb9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2053751717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "080d7a9c1501453d94616cf03ea12473", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f6d779-37", "ovs_interfaceid": "d5f6d779-3733-459c-8144-771980cd9ec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:51:52 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:63:0c,bridge_name='br-int',has_traffic_filtering=True,id=d5f6d779-3733-459c-8144-771980cd9ec2,network=Network(e4c01dfd-427e-4d61-92e0-170e541b1fb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5f6d779-37') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:51:52 user nova-compute[75341]: DEBUG os_vif [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:63:0c,bridge_name='br-int',has_traffic_filtering=True,id=d5f6d779-3733-459c-8144-771980cd9ec2,network=Network(e4c01dfd-427e-4d61-92e0-170e541b1fb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5f6d779-37') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 23:51:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:51:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 23:51:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a0f77aeb-60bb-500a-a6e5-c617b1cf5c71', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:51:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:51:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd5f6d779-37, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:51:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd5f6d779-37, col_values=(('qos', UUID('cd32a4cd-e85c-4d56-b3e7-a7245075f8a2')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:51:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd5f6d779-37, col_values=(('external_ids', {'iface-id': 'd5f6d779-3733-459c-8144-771980cd9ec2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:63:0c', 'vm-uuid': '53d7a6fe-3914-459a-9494-c75549af7b9f'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:51:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:51:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:52 user nova-compute[75341]: INFO os_vif [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:63:0c,bridge_name='br-int',has_traffic_filtering=True,id=d5f6d779-3733-459c-8144-771980cd9ec2,network=Network(e4c01dfd-427e-4d61-92e0-170e541b1fb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5f6d779-37')
Nov 14 23:51:52 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:51:52 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] No VIF found with MAC fa:16:3e:14:63:0c, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:51:52 user nova-compute[75341]: DEBUG nova.network.neutron [req-a90243f8-5c3d-4b82-bb44-1318502d7302 req-cb191e78-c735-443c-88ba-4ba1eb1ceaa5 service nova] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Updated VIF entry in instance network info cache for port d5f6d779-3733-459c-8144-771980cd9ec2. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:51:52 user nova-compute[75341]: DEBUG nova.network.neutron [req-a90243f8-5c3d-4b82-bb44-1318502d7302 req-cb191e78-c735-443c-88ba-4ba1eb1ceaa5 service nova] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Updating instance_info_cache with network_info: [{"id": "d5f6d779-3733-459c-8144-771980cd9ec2", "address": "fa:16:3e:14:63:0c", "network": {"id": "e4c01dfd-427e-4d61-92e0-170e541b1fb9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2053751717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "080d7a9c1501453d94616cf03ea12473", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f6d779-37", "ovs_interfaceid": "d5f6d779-3733-459c-8144-771980cd9ec2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:51:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a90243f8-5c3d-4b82-bb44-1318502d7302 req-cb191e78-c735-443c-88ba-4ba1eb1ceaa5 service nova] Releasing lock "refresh_cache-53d7a6fe-3914-459a-9494-c75549af7b9f" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:51:52 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:51:53 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:53 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:53 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:53 user nova-compute[75341]: DEBUG nova.compute.manager [req-13292b67-e072-4a6c-b456-0477354be969 req-ac2c7eae-2561-497b-b48c-98b5f301cab1 service nova] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Received event network-vif-plugged-d5f6d779-3733-459c-8144-771980cd9ec2 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:51:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-13292b67-e072-4a6c-b456-0477354be969 req-ac2c7eae-2561-497b-b48c-98b5f301cab1 service nova] Acquiring lock "53d7a6fe-3914-459a-9494-c75549af7b9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:51:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-13292b67-e072-4a6c-b456-0477354be969 req-ac2c7eae-2561-497b-b48c-98b5f301cab1 service nova] Lock "53d7a6fe-3914-459a-9494-c75549af7b9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:51:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-13292b67-e072-4a6c-b456-0477354be969 req-ac2c7eae-2561-497b-b48c-98b5f301cab1 service nova] Lock "53d7a6fe-3914-459a-9494-c75549af7b9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:51:53 user nova-compute[75341]: DEBUG nova.compute.manager [req-13292b67-e072-4a6c-b456-0477354be969 req-ac2c7eae-2561-497b-b48c-98b5f301cab1 service nova] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] No waiting events found dispatching network-vif-plugged-d5f6d779-3733-459c-8144-771980cd9ec2 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:51:53 user nova-compute[75341]: WARNING nova.compute.manager [req-13292b67-e072-4a6c-b456-0477354be969 req-ac2c7eae-2561-497b-b48c-98b5f301cab1 service nova] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Received unexpected event network-vif-plugged-d5f6d779-3733-459c-8144-771980cd9ec2 for instance with vm_state building and task_state spawning.
Nov 14 23:51:53 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:51:53 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Starting heal instance info cache {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 23:51:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "refresh_cache-51045050-c7c6-49c5-acd4-2a76be0f466f" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:51:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquired lock "refresh_cache-51045050-c7c6-49c5-acd4-2a76be0f466f" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:51:54 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Forcefully refreshing network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 23:51:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:54 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Updating instance_info_cache with network_info: [{"id": "64ebe5e6-0c81-41fd-b49e-75bed11e40df", "address": "fa:16:3e:44:63:f2", "network": {"id": "fcd22da6-016e-4872-a84c-4d82601c48d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-550677181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44bb8b1415c14bb59c4c35cc2b830875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ebe5e6-0c", "ovs_interfaceid": "64ebe5e6-0c81-41fd-b49e-75bed11e40df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:51:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Releasing lock "refresh_cache-51045050-c7c6-49c5-acd4-2a76be0f466f" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:51:54 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Updated the network info_cache for instance {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 23:51:54 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:51:54 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:51:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:51:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:51:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:51:54 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75341) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 23:51:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01b30e67-ac52-4cf6-9a31-30096f8b3344/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01b30e67-ac52-4cf6-9a31-30096f8b3344/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01b30e67-ac52-4cf6-9a31-30096f8b3344/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01b30e67-ac52-4cf6-9a31-30096f8b3344/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:55 user nova-compute[75341]: DEBUG nova.compute.manager [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Instance event wait completed in 0 seconds for  {{(pid=75341) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 23:51:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Guest created on hypervisor {{(pid=75341) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 23:51:55 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Instance spawned successfully.
Nov 14 23:51:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 23:51:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Found default for hw_cdrom_bus of ide {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:51:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Found default for hw_disk_bus of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:51:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Found default for hw_input_bus of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:51:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Found default for hw_pointer_model of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:51:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Found default for hw_video_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:51:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Found default for hw_vif_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:51:55 user nova-compute[75341]: INFO nova.compute.manager [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Took 5.20 seconds to spawn the instance on the hypervisor.
Nov 14 23:51:55 user nova-compute[75341]: DEBUG nova.compute.manager [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 23:51:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:55 user nova-compute[75341]: INFO nova.compute.manager [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Took 5.99 seconds to build instance.
Nov 14 23:51:55 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-9fbc0d4f-8c9d-44e4-9635-3be605d8ada2 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lock "53d7a6fe-3914-459a-9494-c75549af7b9f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.094s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:51:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 23:51:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 23:51:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5950ba70-e7c0-4b5f-839c-569e0a27b625/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:55 user nova-compute[75341]: DEBUG nova.compute.manager [req-1331815c-c605-4db4-9c95-c56e6bd96b0f req-6066c316-30e9-4d03-b8de-62b7b189daae service nova] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Received event network-vif-plugged-d5f6d779-3733-459c-8144-771980cd9ec2 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:51:55 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-1331815c-c605-4db4-9c95-c56e6bd96b0f req-6066c316-30e9-4d03-b8de-62b7b189daae service nova] Acquiring lock "53d7a6fe-3914-459a-9494-c75549af7b9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:51:55 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-1331815c-c605-4db4-9c95-c56e6bd96b0f req-6066c316-30e9-4d03-b8de-62b7b189daae service nova] Lock "53d7a6fe-3914-459a-9494-c75549af7b9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:51:55 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-1331815c-c605-4db4-9c95-c56e6bd96b0f req-6066c316-30e9-4d03-b8de-62b7b189daae service nova] Lock "53d7a6fe-3914-459a-9494-c75549af7b9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:51:55 user nova-compute[75341]: DEBUG nova.compute.manager [req-1331815c-c605-4db4-9c95-c56e6bd96b0f req-6066c316-30e9-4d03-b8de-62b7b189daae service nova] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] No waiting events found dispatching network-vif-plugged-d5f6d779-3733-459c-8144-771980cd9ec2 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:51:55 user nova-compute[75341]: WARNING nova.compute.manager [req-1331815c-c605-4db4-9c95-c56e6bd96b0f req-6066c316-30e9-4d03-b8de-62b7b189daae service nova] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Received unexpected event network-vif-plugged-d5f6d779-3733-459c-8144-771980cd9ec2 for instance with vm_state active and task_state None.
Nov 14 23:51:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5950ba70-e7c0-4b5f-839c-569e0a27b625/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5950ba70-e7c0-4b5f-839c-569e0a27b625/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5950ba70-e7c0-4b5f-839c-569e0a27b625/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk.rescue --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk.rescue --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a141d7ee-3f77-4fdc-85ec-2cbd5af17646/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a141d7ee-3f77-4fdc-85ec-2cbd5af17646/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a141d7ee-3f77-4fdc-85ec-2cbd5af17646/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:51:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a141d7ee-3f77-4fdc-85ec-2cbd5af17646/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5070fb03-8f40-426c-8c3e-192f6517f7c3/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5070fb03-8f40-426c-8c3e-192f6517f7c3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5070fb03-8f40-426c-8c3e-192f6517f7c3/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5070fb03-8f40-426c-8c3e-192f6517f7c3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53d7a6fe-3914-459a-9494-c75549af7b9f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53d7a6fe-3914-459a-9494-c75549af7b9f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53d7a6fe-3914-459a-9494-c75549af7b9f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53d7a6fe-3914-459a-9494-c75549af7b9f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae467da-9fb5-4f4f-a3f8-fce2ac368dda/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae467da-9fb5-4f4f-a3f8-fce2ac368dda/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae467da-9fb5-4f4f-a3f8-fce2ac368dda/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae467da-9fb5-4f4f-a3f8-fce2ac368dda/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c9a7d6-03a5-4fd2-9082-c68758f1542f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c9a7d6-03a5-4fd2-9082-c68758f1542f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c9a7d6-03a5-4fd2-9082-c68758f1542f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c9a7d6-03a5-4fd2-9082-c68758f1542f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d93909b3-0373-492a-8ede-7c2cd76bcb88/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d93909b3-0373-492a-8ede-7c2cd76bcb88/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d93909b3-0373-492a-8ede-7c2cd76bcb88/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:51:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d93909b3-0373-492a-8ede-7c2cd76bcb88/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:51:59 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 23:52:00 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:52:00 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:52:00 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Hypervisor/Node resource view: name=user free_ram=6978MB free_disk=25.24514389038086GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75341) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 23:52:00 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:52:00 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:52:00 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance a141d7ee-3f77-4fdc-85ec-2cbd5af17646 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:52:00 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 51045050-c7c6-49c5-acd4-2a76be0f466f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:52:00 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 6382e432-838f-4d89-a743-cbaa37f50ab5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:52:00 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 5070fb03-8f40-426c-8c3e-192f6517f7c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:52:00 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance defae731-4191-4526-99cc-a301cf5b3355 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:52:00 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 9996fc26-f3ad-40e2-91a5-51178c0194ef actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:52:00 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 01b30e67-ac52-4cf6-9a31-30096f8b3344 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:52:00 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 2316aa9e-d4c9-43d0-9918-86265583aed1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:52:00 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 713b9caa-4ca7-4d78-8252-e8419d72ece3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:52:00 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 12c9a7d6-03a5-4fd2-9082-c68758f1542f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:52:00 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 5950ba70-e7c0-4b5f-839c-569e0a27b625 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:52:00 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:52:00 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance d93909b3-0373-492a-8ede-7c2cd76bcb88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:52:00 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 53d7a6fe-3914-459a-9494-c75549af7b9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:52:00 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 23:52:00 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 23:52:00 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:52:00 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:52:01 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Compute_service record updated for user:user {{(pid=75341) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 23:52:01 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.604s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:52:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:03 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:52:03 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:52:03 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:52:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:52:08 user nova-compute[75341]: DEBUG nova.compute.manager [req-7d958e15-43e7-4b00-b554-4bc6f4a62d55 req-1b85e259-5ed9-4ed6-a563-21d7ee35a59e service nova] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Received event network-changed-4eb44d3f-ff8b-4b03-aa6f-d257d1de66e4 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:52:08 user nova-compute[75341]: DEBUG nova.compute.manager [req-7d958e15-43e7-4b00-b554-4bc6f4a62d55 req-1b85e259-5ed9-4ed6-a563-21d7ee35a59e service nova] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Refreshing instance network info cache due to event network-changed-4eb44d3f-ff8b-4b03-aa6f-d257d1de66e4. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:52:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-7d958e15-43e7-4b00-b554-4bc6f4a62d55 req-1b85e259-5ed9-4ed6-a563-21d7ee35a59e service nova] Acquiring lock "refresh_cache-01b30e67-ac52-4cf6-9a31-30096f8b3344" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:52:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-7d958e15-43e7-4b00-b554-4bc6f4a62d55 req-1b85e259-5ed9-4ed6-a563-21d7ee35a59e service nova] Acquired lock "refresh_cache-01b30e67-ac52-4cf6-9a31-30096f8b3344" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:52:08 user nova-compute[75341]: DEBUG nova.network.neutron [req-7d958e15-43e7-4b00-b554-4bc6f4a62d55 req-1b85e259-5ed9-4ed6-a563-21d7ee35a59e service nova] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Refreshing network info cache for port 4eb44d3f-ff8b-4b03-aa6f-d257d1de66e4 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:52:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cc41c93a-5237-447a-908f-74e115669584 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Acquiring lock "01b30e67-ac52-4cf6-9a31-30096f8b3344" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:52:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cc41c93a-5237-447a-908f-74e115669584 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Lock "01b30e67-ac52-4cf6-9a31-30096f8b3344" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:52:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cc41c93a-5237-447a-908f-74e115669584 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Acquiring lock "01b30e67-ac52-4cf6-9a31-30096f8b3344-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:52:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cc41c93a-5237-447a-908f-74e115669584 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Lock "01b30e67-ac52-4cf6-9a31-30096f8b3344-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:52:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cc41c93a-5237-447a-908f-74e115669584 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Lock "01b30e67-ac52-4cf6-9a31-30096f8b3344-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:52:08 user nova-compute[75341]: INFO nova.compute.manager [None req-cc41c93a-5237-447a-908f-74e115669584 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Terminating instance
Nov 14 23:52:08 user nova-compute[75341]: DEBUG nova.compute.manager [None req-cc41c93a-5237-447a-908f-74e115669584 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Start destroying the instance on the hypervisor. {{(pid=75341) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 23:52:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:09 user nova-compute[75341]: DEBUG nova.network.neutron [req-7d958e15-43e7-4b00-b554-4bc6f4a62d55 req-1b85e259-5ed9-4ed6-a563-21d7ee35a59e service nova] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Updated VIF entry in instance network info cache for port 4eb44d3f-ff8b-4b03-aa6f-d257d1de66e4. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:52:09 user nova-compute[75341]: DEBUG nova.network.neutron [req-7d958e15-43e7-4b00-b554-4bc6f4a62d55 req-1b85e259-5ed9-4ed6-a563-21d7ee35a59e service nova] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Updating instance_info_cache with network_info: [{"id": "4eb44d3f-ff8b-4b03-aa6f-d257d1de66e4", "address": "fa:16:3e:f4:cc:cd", "network": {"id": "e9abba2c-7994-4781-a3ca-07e8e4be7825", "bridge": "br-int", "label": "tempest-TestStampPattern-1410971761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af462be688d4127a8368ee3dcb2a340", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eb44d3f-ff", "ovs_interfaceid": "4eb44d3f-ff8b-4b03-aa6f-d257d1de66e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:52:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-7d958e15-43e7-4b00-b554-4bc6f4a62d55 req-1b85e259-5ed9-4ed6-a563-21d7ee35a59e service nova] Releasing lock "refresh_cache-01b30e67-ac52-4cf6-9a31-30096f8b3344" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:52:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:09 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Instance destroyed successfully.
Nov 14 23:52:09 user nova-compute[75341]: DEBUG nova.objects.instance [None req-cc41c93a-5237-447a-908f-74e115669584 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Lazy-loading 'resources' on Instance uuid 01b30e67-ac52-4cf6-9a31-30096f8b3344 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:52:09 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-cc41c93a-5237-447a-908f-74e115669584 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:49:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1086505449',display_name='tempest-TestStampPattern-server-1086505449',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1086505449',id=31,image_ref='f3499e18-1771-42ea-a76c-5e8cb7353617',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3k4a6947+jIKLvmTnCELFNO1dnVN6DgXq9Xj0CmQaSvYB0hJlJ042GniTnSgjACK17rkv4NlkLk+t1g4KrW1PNXrKxIcV24jCAaqde0p0EUk9jn7Pe6DP8ihh+nNZNxg==',key_name='tempest-TestStampPattern-1455376223',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:49:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0af462be688d4127a8368ee3dcb2a340',ramdisk_id='',reservation_id='r-5z5sfjpq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='5070fb03-8f40-426c-8c3e-192f6517f7c3',image_min_disk='1',image_min_ram='0',image_owner_id='0af462be688d4127a8368ee3dcb2a340',image_owner_project_name='tempest-TestStampPattern-1579449792',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1579449792-project-member',image_user_id='1bea063034a84067bd8645aecfe3560d',owner_project_name='tempest-TestStampPattern-1579449792',owner_user_name='tempest-TestStampPattern-1579449792-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:49:22Z,user_data=None,user_id='1bea063034a84067bd8645aecfe3560d',uuid=01b30e67-ac52-4cf6-9a31-30096f8b3344,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4eb44d3f-ff8b-4b03-aa6f-d257d1de66e4", "address": "fa:16:3e:f4:cc:cd", "network": {"id": "e9abba2c-7994-4781-a3ca-07e8e4be7825", "bridge": "br-int", "label": "tempest-TestStampPattern-1410971761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af462be688d4127a8368ee3dcb2a340", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eb44d3f-ff", "ovs_interfaceid": "4eb44d3f-ff8b-4b03-aa6f-d257d1de66e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 23:52:09 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-cc41c93a-5237-447a-908f-74e115669584 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Converting VIF {"id": "4eb44d3f-ff8b-4b03-aa6f-d257d1de66e4", "address": "fa:16:3e:f4:cc:cd", "network": {"id": "e9abba2c-7994-4781-a3ca-07e8e4be7825", "bridge": "br-int", "label": "tempest-TestStampPattern-1410971761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af462be688d4127a8368ee3dcb2a340", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eb44d3f-ff", "ovs_interfaceid": "4eb44d3f-ff8b-4b03-aa6f-d257d1de66e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:52:09 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-cc41c93a-5237-447a-908f-74e115669584 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:cc:cd,bridge_name='br-int',has_traffic_filtering=True,id=4eb44d3f-ff8b-4b03-aa6f-d257d1de66e4,network=Network(e9abba2c-7994-4781-a3ca-07e8e4be7825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4eb44d3f-ff') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:52:09 user nova-compute[75341]: DEBUG os_vif [None req-cc41c93a-5237-447a-908f-74e115669584 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:cc:cd,bridge_name='br-int',has_traffic_filtering=True,id=4eb44d3f-ff8b-4b03-aa6f-d257d1de66e4,network=Network(e9abba2c-7994-4781-a3ca-07e8e4be7825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4eb44d3f-ff') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 23:52:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4eb44d3f-ff, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:52:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:52:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e72236c6-c149-48ae-93f4-b0c89be583a8) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:52:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:52:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:09 user nova-compute[75341]: INFO os_vif [None req-cc41c93a-5237-447a-908f-74e115669584 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:cc:cd,bridge_name='br-int',has_traffic_filtering=True,id=4eb44d3f-ff8b-4b03-aa6f-d257d1de66e4,network=Network(e9abba2c-7994-4781-a3ca-07e8e4be7825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4eb44d3f-ff')
Nov 14 23:52:09 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-cc41c93a-5237-447a-908f-74e115669584 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Deleting instance files /opt/stack/data/nova/instances/01b30e67-ac52-4cf6-9a31-30096f8b3344_del
Nov 14 23:52:09 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-cc41c93a-5237-447a-908f-74e115669584 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Deletion of /opt/stack/data/nova/instances/01b30e67-ac52-4cf6-9a31-30096f8b3344_del complete
Nov 14 23:52:09 user nova-compute[75341]: INFO nova.compute.manager [None req-cc41c93a-5237-447a-908f-74e115669584 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 14 23:52:09 user nova-compute[75341]: DEBUG oslo.service.loopingcall [None req-cc41c93a-5237-447a-908f-74e115669584 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75341) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 23:52:09 user nova-compute[75341]: DEBUG nova.compute.manager [-] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Deallocating network for instance {{(pid=75341) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 23:52:09 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] deallocate_for_instance() {{(pid=75341) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 23:52:10 user nova-compute[75341]: DEBUG nova.compute.manager [req-7587f4c9-df81-4ab1-be52-324b0b406f6d req-6ad85aad-4618-40cd-b319-b18bea07a76d service nova] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Received event network-vif-deleted-4eb44d3f-ff8b-4b03-aa6f-d257d1de66e4 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:52:10 user nova-compute[75341]: INFO nova.compute.manager [req-7587f4c9-df81-4ab1-be52-324b0b406f6d req-6ad85aad-4618-40cd-b319-b18bea07a76d service nova] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Neutron deleted interface 4eb44d3f-ff8b-4b03-aa6f-d257d1de66e4; detaching it from the instance and deleting it from the info cache
Nov 14 23:52:10 user nova-compute[75341]: DEBUG nova.network.neutron [req-7587f4c9-df81-4ab1-be52-324b0b406f6d req-6ad85aad-4618-40cd-b319-b18bea07a76d service nova] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:52:10 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:52:10 user nova-compute[75341]: INFO nova.compute.manager [-] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Took 0.45 seconds to deallocate network for instance.
Nov 14 23:52:10 user nova-compute[75341]: DEBUG nova.compute.manager [req-7587f4c9-df81-4ab1-be52-324b0b406f6d req-6ad85aad-4618-40cd-b319-b18bea07a76d service nova] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Detach interface failed, port_id=4eb44d3f-ff8b-4b03-aa6f-d257d1de66e4, reason: Instance 01b30e67-ac52-4cf6-9a31-30096f8b3344 could not be found. {{(pid=75341) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 23:52:10 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cc41c93a-5237-447a-908f-74e115669584 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:52:10 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cc41c93a-5237-447a-908f-74e115669584 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:52:10 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-cc41c93a-5237-447a-908f-74e115669584 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:52:10 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-cc41c93a-5237-447a-908f-74e115669584 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:52:10 user nova-compute[75341]: DEBUG nova.compute.manager [req-f77f9a7c-0e8d-466f-bdb4-c3148c79ff55 req-20c417b2-a5c9-42b5-b658-04c4fa5c7cf6 service nova] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Received event network-vif-unplugged-4eb44d3f-ff8b-4b03-aa6f-d257d1de66e4 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:52:10 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-f77f9a7c-0e8d-466f-bdb4-c3148c79ff55 req-20c417b2-a5c9-42b5-b658-04c4fa5c7cf6 service nova] Acquiring lock "01b30e67-ac52-4cf6-9a31-30096f8b3344-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:52:10 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-f77f9a7c-0e8d-466f-bdb4-c3148c79ff55 req-20c417b2-a5c9-42b5-b658-04c4fa5c7cf6 service nova] Lock "01b30e67-ac52-4cf6-9a31-30096f8b3344-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:52:10 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-f77f9a7c-0e8d-466f-bdb4-c3148c79ff55 req-20c417b2-a5c9-42b5-b658-04c4fa5c7cf6 service nova] Lock "01b30e67-ac52-4cf6-9a31-30096f8b3344-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:52:10 user nova-compute[75341]: DEBUG nova.compute.manager [req-f77f9a7c-0e8d-466f-bdb4-c3148c79ff55 req-20c417b2-a5c9-42b5-b658-04c4fa5c7cf6 service nova] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] No waiting events found dispatching network-vif-unplugged-4eb44d3f-ff8b-4b03-aa6f-d257d1de66e4 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:52:10 user nova-compute[75341]: WARNING nova.compute.manager [req-f77f9a7c-0e8d-466f-bdb4-c3148c79ff55 req-20c417b2-a5c9-42b5-b658-04c4fa5c7cf6 service nova] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Received unexpected event network-vif-unplugged-4eb44d3f-ff8b-4b03-aa6f-d257d1de66e4 for instance with vm_state deleted and task_state None.
Nov 14 23:52:10 user nova-compute[75341]: DEBUG nova.compute.manager [req-f77f9a7c-0e8d-466f-bdb4-c3148c79ff55 req-20c417b2-a5c9-42b5-b658-04c4fa5c7cf6 service nova] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Received event network-vif-plugged-4eb44d3f-ff8b-4b03-aa6f-d257d1de66e4 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:52:10 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-f77f9a7c-0e8d-466f-bdb4-c3148c79ff55 req-20c417b2-a5c9-42b5-b658-04c4fa5c7cf6 service nova] Acquiring lock "01b30e67-ac52-4cf6-9a31-30096f8b3344-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:52:10 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-f77f9a7c-0e8d-466f-bdb4-c3148c79ff55 req-20c417b2-a5c9-42b5-b658-04c4fa5c7cf6 service nova] Lock "01b30e67-ac52-4cf6-9a31-30096f8b3344-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:52:10 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-f77f9a7c-0e8d-466f-bdb4-c3148c79ff55 req-20c417b2-a5c9-42b5-b658-04c4fa5c7cf6 service nova] Lock "01b30e67-ac52-4cf6-9a31-30096f8b3344-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:52:10 user nova-compute[75341]: DEBUG nova.compute.manager [req-f77f9a7c-0e8d-466f-bdb4-c3148c79ff55 req-20c417b2-a5c9-42b5-b658-04c4fa5c7cf6 service nova] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] No waiting events found dispatching network-vif-plugged-4eb44d3f-ff8b-4b03-aa6f-d257d1de66e4 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:52:10 user nova-compute[75341]: WARNING nova.compute.manager [req-f77f9a7c-0e8d-466f-bdb4-c3148c79ff55 req-20c417b2-a5c9-42b5-b658-04c4fa5c7cf6 service nova] [instance: 01b30e67-ac52-4cf6-9a31-30096f8b3344] Received unexpected event network-vif-plugged-4eb44d3f-ff8b-4b03-aa6f-d257d1de66e4 for instance with vm_state deleted and task_state None.
Nov 14 23:52:10 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cc41c93a-5237-447a-908f-74e115669584 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.563s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:52:10 user nova-compute[75341]: INFO nova.scheduler.client.report [None req-cc41c93a-5237-447a-908f-74e115669584 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Deleted allocations for instance 01b30e67-ac52-4cf6-9a31-30096f8b3344
Nov 14 23:52:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-cc41c93a-5237-447a-908f-74e115669584 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Lock "01b30e67-ac52-4cf6-9a31-30096f8b3344" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.089s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:52:11 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-9cb92f32-bc62-4701-bd5f-606abf93d2a9 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Acquiring lock "713b9caa-4ca7-4d78-8252-e8419d72ece3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:52:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-9cb92f32-bc62-4701-bd5f-606abf93d2a9 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "713b9caa-4ca7-4d78-8252-e8419d72ece3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:52:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-9cb92f32-bc62-4701-bd5f-606abf93d2a9 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Acquiring lock "713b9caa-4ca7-4d78-8252-e8419d72ece3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:52:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-9cb92f32-bc62-4701-bd5f-606abf93d2a9 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "713b9caa-4ca7-4d78-8252-e8419d72ece3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:52:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-9cb92f32-bc62-4701-bd5f-606abf93d2a9 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "713b9caa-4ca7-4d78-8252-e8419d72ece3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:52:12 user nova-compute[75341]: INFO nova.compute.manager [None req-9cb92f32-bc62-4701-bd5f-606abf93d2a9 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] Terminating instance
Nov 14 23:52:12 user nova-compute[75341]: DEBUG nova.compute.manager [None req-9cb92f32-bc62-4701-bd5f-606abf93d2a9 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] Start destroying the instance on the hypervisor. {{(pid=75341) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 23:52:12 user nova-compute[75341]: DEBUG nova.compute.manager [req-a29704c5-a1b4-4f1d-a430-debfb3f1c7ff req-2884b57d-fb5b-434d-8e01-9e5d3f4aa369 service nova] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] Received event network-changed-b80cf75e-07c5-438f-add6-83636ba0d977 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:52:12 user nova-compute[75341]: DEBUG nova.compute.manager [req-a29704c5-a1b4-4f1d-a430-debfb3f1c7ff req-2884b57d-fb5b-434d-8e01-9e5d3f4aa369 service nova] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] Refreshing instance network info cache due to event network-changed-b80cf75e-07c5-438f-add6-83636ba0d977. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:52:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a29704c5-a1b4-4f1d-a430-debfb3f1c7ff req-2884b57d-fb5b-434d-8e01-9e5d3f4aa369 service nova] Acquiring lock "refresh_cache-713b9caa-4ca7-4d78-8252-e8419d72ece3" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:52:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a29704c5-a1b4-4f1d-a430-debfb3f1c7ff req-2884b57d-fb5b-434d-8e01-9e5d3f4aa369 service nova] Acquired lock "refresh_cache-713b9caa-4ca7-4d78-8252-e8419d72ece3" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:52:12 user nova-compute[75341]: DEBUG nova.network.neutron [req-a29704c5-a1b4-4f1d-a430-debfb3f1c7ff req-2884b57d-fb5b-434d-8e01-9e5d3f4aa369 service nova] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] Refreshing network info cache for port b80cf75e-07c5-438f-add6-83636ba0d977 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:52:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG nova.compute.manager [req-02387429-400f-4e81-88cd-c69278e27de5 req-c408ec1f-042e-4efb-87f4-a3dc58e26a76 service nova] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] Received event network-vif-unplugged-b80cf75e-07c5-438f-add6-83636ba0d977 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-02387429-400f-4e81-88cd-c69278e27de5 req-c408ec1f-042e-4efb-87f4-a3dc58e26a76 service nova] Acquiring lock "713b9caa-4ca7-4d78-8252-e8419d72ece3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-02387429-400f-4e81-88cd-c69278e27de5 req-c408ec1f-042e-4efb-87f4-a3dc58e26a76 service nova] Lock "713b9caa-4ca7-4d78-8252-e8419d72ece3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-02387429-400f-4e81-88cd-c69278e27de5 req-c408ec1f-042e-4efb-87f4-a3dc58e26a76 service nova] Lock "713b9caa-4ca7-4d78-8252-e8419d72ece3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG nova.compute.manager [req-02387429-400f-4e81-88cd-c69278e27de5 req-c408ec1f-042e-4efb-87f4-a3dc58e26a76 service nova] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] No waiting events found dispatching network-vif-unplugged-b80cf75e-07c5-438f-add6-83636ba0d977 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG nova.compute.manager [req-02387429-400f-4e81-88cd-c69278e27de5 req-c408ec1f-042e-4efb-87f4-a3dc58e26a76 service nova] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] Received event network-vif-unplugged-b80cf75e-07c5-438f-add6-83636ba0d977 for instance with task_state deleting. {{(pid=75341) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG nova.network.neutron [req-a29704c5-a1b4-4f1d-a430-debfb3f1c7ff req-2884b57d-fb5b-434d-8e01-9e5d3f4aa369 service nova] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] Updated VIF entry in instance network info cache for port b80cf75e-07c5-438f-add6-83636ba0d977. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG nova.network.neutron [req-a29704c5-a1b4-4f1d-a430-debfb3f1c7ff req-2884b57d-fb5b-434d-8e01-9e5d3f4aa369 service nova] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] Updating instance_info_cache with network_info: [{"id": "b80cf75e-07c5-438f-add6-83636ba0d977", "address": "fa:16:3e:69:c0:2e", "network": {"id": "227eb779-a064-477d-8447-45862017ae7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-3827253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96674073965642f1af11221b4add8a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb80cf75e-07", "ovs_interfaceid": "b80cf75e-07c5-438f-add6-83636ba0d977", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a29704c5-a1b4-4f1d-a430-debfb3f1c7ff req-2884b57d-fb5b-434d-8e01-9e5d3f4aa369 service nova] Releasing lock "refresh_cache-713b9caa-4ca7-4d78-8252-e8419d72ece3" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:52:13 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] Instance destroyed successfully.
Nov 14 23:52:13 user nova-compute[75341]: DEBUG nova.objects.instance [None req-9cb92f32-bc62-4701-bd5f-606abf93d2a9 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lazy-loading 'resources' on Instance uuid 713b9caa-4ca7-4d78-8252-e8419d72ece3 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-9cb92f32-bc62-4701-bd5f-606abf93d2a9 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:50:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1843717353',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1843717353',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1843717353',id=33,image_ref='724935f5-a270-4fdc-89bb-fb4c99911ac0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCvhcUyu2EYFUwkh8tkwl+NXtk6OhaYXxsLRxhI8LgHcD/S7OtjzVcbE3iKCG6NgYMX42+gy0KKv8Ws3CG4I2ODY1sWNbrH7HxyB/Ym+UInKL7lxa7/c8x3R4TFgmu099A==',key_name='tempest-keypair-485924258',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:50:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='96674073965642f1af11221b4add8a6d',ramdisk_id='',reservation_id='r-ozr4c9fc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-320933673',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-320933673-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-320933673',owner_user_name='tempest-TestVolumeBootPattern-320933673-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:50:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b08f7ddf6c2f4fd596e214d6ca56c234',uuid=713b9caa-4ca7-4d78-8252-e8419d72ece3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b80cf75e-07c5-438f-add6-83636ba0d977", "address": "fa:16:3e:69:c0:2e", "network": {"id": "227eb779-a064-477d-8447-45862017ae7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-3827253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96674073965642f1af11221b4add8a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb80cf75e-07", "ovs_interfaceid": "b80cf75e-07c5-438f-add6-83636ba0d977", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-9cb92f32-bc62-4701-bd5f-606abf93d2a9 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Converting VIF {"id": "b80cf75e-07c5-438f-add6-83636ba0d977", "address": "fa:16:3e:69:c0:2e", "network": {"id": "227eb779-a064-477d-8447-45862017ae7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-3827253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96674073965642f1af11221b4add8a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb80cf75e-07", "ovs_interfaceid": "b80cf75e-07c5-438f-add6-83636ba0d977", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-9cb92f32-bc62-4701-bd5f-606abf93d2a9 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:c0:2e,bridge_name='br-int',has_traffic_filtering=True,id=b80cf75e-07c5-438f-add6-83636ba0d977,network=Network(227eb779-a064-477d-8447-45862017ae7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb80cf75e-07') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG os_vif [None req-9cb92f32-bc62-4701-bd5f-606abf93d2a9 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:c0:2e,bridge_name='br-int',has_traffic_filtering=True,id=b80cf75e-07c5-438f-add6-83636ba0d977,network=Network(227eb779-a064-477d-8447-45862017ae7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb80cf75e-07') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb80cf75e-07, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1ea46866-0065-41c9-a9e9-a2a6b3e0b79a) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:13 user nova-compute[75341]: INFO os_vif [None req-9cb92f32-bc62-4701-bd5f-606abf93d2a9 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:c0:2e,bridge_name='br-int',has_traffic_filtering=True,id=b80cf75e-07c5-438f-add6-83636ba0d977,network=Network(227eb779-a064-477d-8447-45862017ae7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb80cf75e-07')
Nov 14 23:52:13 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cb92f32-bc62-4701-bd5f-606abf93d2a9 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] calling os-brick to detach iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb92f32-bc62-4701-bd5f-606abf93d2a9 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, {'target_iqn': 'iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GUVdvySQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:52:13 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-9cb92f32-bc62-4701-bd5f-606abf93d2a9 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:52:13 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-9cb92f32-bc62-4701-bd5f-606abf93d2a9 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-9cb92f32-bc62-4701-bd5f-606abf93d2a9 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5549306-5f6c-4cba-9e1d-02a71bd52385]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb92f32-bc62-4701-bd5f-606abf93d2a9 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 23:52:13 user nova-compute[75341]: No targets found.
Nov 14 23:52:13 user nova-compute[75341]: iSNS:
Nov 14 23:52:13 user nova-compute[75341]: No targets found.
Nov 14 23:52:13 user nova-compute[75341]: STATIC:
Nov 14 23:52:13 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9
Nov 14 23:52:13 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:52:13 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:52:13 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418
Nov 14 23:52:13 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:52:13 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:52:13 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455
Nov 14 23:52:13 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:52:13 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:52:13 user nova-compute[75341]: FIRMWARE:
Nov 14 23:52:13 user nova-compute[75341]: No targets found.
Nov 14 23:52:13 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb92f32-bc62-4701-bd5f-606abf93d2a9 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 23:52:13 user nova-compute[75341]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 23:52:13 user nova-compute[75341]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75341) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb92f32-bc62-4701-bd5f-606abf93d2a9 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455', 0)] {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[69bb9d99-09ad-42fd-94ff-07b420732aca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[76fa4c26-ceac-48bb-bbfe-6fce0fa394eb]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb92f32-bc62-4701-bd5f-606abf93d2a9 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)
Nov 14 23:52:13 user nova-compute[75341]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455 (non-flash)
Nov 14 23:52:13 user nova-compute[75341]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)
Nov 14 23:52:13 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb92f32-bc62-4701-bd5f-606abf93d2a9 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)
Nov 14 23:52:13 user nova-compute[75341]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455 (non-flash)
Nov 14 23:52:13 user nova-compute[75341]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)
Nov 14 23:52:13 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb92f32-bc62-4701-bd5f-606abf93d2a9 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1870456950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455'): ({'sdc'}, set())}) {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-9cb92f32-bc62-4701-bd5f-606abf93d2a9 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Removing single pathed devices sdc {{(pid=75341) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef78072c-7356-4489-86ca-62b97b47c662]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa904e2-c23f-4486-98a3-49c0eefbf1f3]: (4, ('ok\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-9cb92f32-bc62-4701-bd5f-606abf93d2a9 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Flushing IO for device /dev/sdc {{(pid=75341) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0a79fb-9c98-4c01-a5b3-59f74b0b845f]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-9cb92f32-bc62-4701-bd5f-606abf93d2a9 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75341) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[43dd1df6-b87f-43dd-a4a6-b7d18804e4e2]: (4, ('1', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-9cb92f32-bc62-4701-bd5f-606abf93d2a9 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-9cb92f32-bc62-4701-bd5f-606abf93d2a9 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] SCSI volumes sdc have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO1a8cd6c7-f48a949807713505', '/dev/disk/by-id/scsi-26634386139343938', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_1a8cd6c7') {{(pid=86063) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 23:52:13 user nova-compute[75341]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO1a8cd6c7-f48a949807713505
Nov 14 23:52:13 user nova-compute[75341]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26634386139343938
Nov 14 23:52:13 user nova-compute[75341]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_1a8cd6c7
Nov 14 23:52:13 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bec1ec6-a12b-4074-b710-3fae45831c4c]: (4, None) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb92f32-bc62-4701-bd5f-606abf93d2a9 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455')] {{(pid=75341) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a93db15-fc9c-4c4a-9320-bdd89d3fc57d]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb92f32-bc62-4701-bd5f-606abf93d2a9 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455 -p 172.16.0.220:3260 --logout {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2f47ff-b92b-46ba-abbc-efeb5213e852]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb92f32-bc62-4701-bd5f-606abf93d2a9 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455, portal: 172.16.0.220,3260]
Nov 14 23:52:13 user nova-compute[75341]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455, portal: 172.16.0.220,3260] successful.
Nov 14 23:52:13 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:52:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455 -p 172.16.0.220:3260 --op delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:52:14 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54fb0997-ac36-4d49-abf8-4f968cb2f455 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:52:14 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[db46d9fb-3501-4799-a25d-96b5d62dc171]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:52:14 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb92f32-bc62-4701-bd5f-606abf93d2a9 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:52:14 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-9cb92f32-bc62-4701-bd5f-606abf93d2a9 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:52:14 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb92f32-bc62-4701-bd5f-606abf93d2a9 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] <== disconnect_volume: return (306ms) None {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:52:14 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cb92f32-bc62-4701-bd5f-606abf93d2a9 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] Disconnected iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 23:52:14 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-9cb92f32-bc62-4701-bd5f-606abf93d2a9 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] Deleting instance files /opt/stack/data/nova/instances/713b9caa-4ca7-4d78-8252-e8419d72ece3_del
Nov 14 23:52:14 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-9cb92f32-bc62-4701-bd5f-606abf93d2a9 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] Deletion of /opt/stack/data/nova/instances/713b9caa-4ca7-4d78-8252-e8419d72ece3_del complete
Nov 14 23:52:14 user nova-compute[75341]: INFO nova.compute.manager [None req-9cb92f32-bc62-4701-bd5f-606abf93d2a9 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 14 23:52:14 user nova-compute[75341]: DEBUG oslo.service.loopingcall [None req-9cb92f32-bc62-4701-bd5f-606abf93d2a9 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75341) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 23:52:14 user nova-compute[75341]: DEBUG nova.compute.manager [-] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] Deallocating network for instance {{(pid=75341) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 23:52:14 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] deallocate_for_instance() {{(pid=75341) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 23:52:14 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:52:14 user nova-compute[75341]: INFO nova.compute.manager [-] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] Took 0.64 seconds to deallocate network for instance.
Nov 14 23:52:14 user nova-compute[75341]: DEBUG nova.compute.manager [req-1097d8fb-1288-4622-9911-6d5327b30d4f req-762db45f-c14d-4cdb-84ee-bb07ba9bf94f service nova] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] Received event network-vif-deleted-b80cf75e-07c5-438f-add6-83636ba0d977 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:52:14 user nova-compute[75341]: INFO nova.compute.manager [req-1097d8fb-1288-4622-9911-6d5327b30d4f req-762db45f-c14d-4cdb-84ee-bb07ba9bf94f service nova] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] Neutron deleted interface b80cf75e-07c5-438f-add6-83636ba0d977; detaching it from the instance and deleting it from the info cache
Nov 14 23:52:14 user nova-compute[75341]: DEBUG nova.network.neutron [req-1097d8fb-1288-4622-9911-6d5327b30d4f req-762db45f-c14d-4cdb-84ee-bb07ba9bf94f service nova] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:52:14 user nova-compute[75341]: DEBUG nova.compute.manager [req-1097d8fb-1288-4622-9911-6d5327b30d4f req-762db45f-c14d-4cdb-84ee-bb07ba9bf94f service nova] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] Detach interface failed, port_id=b80cf75e-07c5-438f-add6-83636ba0d977, reason: Instance 713b9caa-4ca7-4d78-8252-e8419d72ece3 could not be found. {{(pid=75341) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 23:52:15 user nova-compute[75341]: DEBUG nova.compute.manager [req-54e8dfdf-b188-46f2-825a-6b733113f39b req-56922357-915b-43e7-9f4e-d7e6817d9c93 service nova] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] Received event network-vif-plugged-b80cf75e-07c5-438f-add6-83636ba0d977 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:52:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-54e8dfdf-b188-46f2-825a-6b733113f39b req-56922357-915b-43e7-9f4e-d7e6817d9c93 service nova] Acquiring lock "713b9caa-4ca7-4d78-8252-e8419d72ece3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:52:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-54e8dfdf-b188-46f2-825a-6b733113f39b req-56922357-915b-43e7-9f4e-d7e6817d9c93 service nova] Lock "713b9caa-4ca7-4d78-8252-e8419d72ece3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:52:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-54e8dfdf-b188-46f2-825a-6b733113f39b req-56922357-915b-43e7-9f4e-d7e6817d9c93 service nova] Lock "713b9caa-4ca7-4d78-8252-e8419d72ece3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:52:15 user nova-compute[75341]: DEBUG nova.compute.manager [req-54e8dfdf-b188-46f2-825a-6b733113f39b req-56922357-915b-43e7-9f4e-d7e6817d9c93 service nova] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] No waiting events found dispatching network-vif-plugged-b80cf75e-07c5-438f-add6-83636ba0d977 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:52:15 user nova-compute[75341]: WARNING nova.compute.manager [req-54e8dfdf-b188-46f2-825a-6b733113f39b req-56922357-915b-43e7-9f4e-d7e6817d9c93 service nova] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] Received unexpected event network-vif-plugged-b80cf75e-07c5-438f-add6-83636ba0d977 for instance with vm_state active and task_state deleting.
Nov 14 23:52:15 user nova-compute[75341]: INFO nova.compute.manager [None req-9cb92f32-bc62-4701-bd5f-606abf93d2a9 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] Took 0.73 seconds to detach 1 volumes for instance.
Nov 14 23:52:15 user nova-compute[75341]: DEBUG nova.compute.manager [None req-9cb92f32-bc62-4701-bd5f-606abf93d2a9 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 713b9caa-4ca7-4d78-8252-e8419d72ece3] Deleting volume: 54fb0997-ac36-4d49-abf8-4f968cb2f455 {{(pid=75341) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 23:52:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-9cb92f32-bc62-4701-bd5f-606abf93d2a9 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:52:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-9cb92f32-bc62-4701-bd5f-606abf93d2a9 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:52:15 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-9cb92f32-bc62-4701-bd5f-606abf93d2a9 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:52:15 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-9cb92f32-bc62-4701-bd5f-606abf93d2a9 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:52:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-9cb92f32-bc62-4701-bd5f-606abf93d2a9 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.383s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:52:16 user nova-compute[75341]: INFO nova.scheduler.client.report [None req-9cb92f32-bc62-4701-bd5f-606abf93d2a9 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Deleted allocations for instance 713b9caa-4ca7-4d78-8252-e8419d72ece3
Nov 14 23:52:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-9cb92f32-bc62-4701-bd5f-606abf93d2a9 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "713b9caa-4ca7-4d78-8252-e8419d72ece3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.373s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:52:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:21 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:23 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:26 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-16aa9f0d-9545-47d7-a28c-a945335c575f tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Acquiring lock "a141d7ee-3f77-4fdc-85ec-2cbd5af17646" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:52:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-16aa9f0d-9545-47d7-a28c-a945335c575f tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Lock "a141d7ee-3f77-4fdc-85ec-2cbd5af17646" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:52:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-16aa9f0d-9545-47d7-a28c-a945335c575f tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Acquiring lock "a141d7ee-3f77-4fdc-85ec-2cbd5af17646-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:52:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-16aa9f0d-9545-47d7-a28c-a945335c575f tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Lock "a141d7ee-3f77-4fdc-85ec-2cbd5af17646-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:52:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-16aa9f0d-9545-47d7-a28c-a945335c575f tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Lock "a141d7ee-3f77-4fdc-85ec-2cbd5af17646-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:52:27 user nova-compute[75341]: INFO nova.compute.manager [None req-16aa9f0d-9545-47d7-a28c-a945335c575f tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: a141d7ee-3f77-4fdc-85ec-2cbd5af17646] Terminating instance
Nov 14 23:52:27 user nova-compute[75341]: DEBUG nova.compute.manager [None req-16aa9f0d-9545-47d7-a28c-a945335c575f tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: a141d7ee-3f77-4fdc-85ec-2cbd5af17646] Start destroying the instance on the hypervisor. {{(pid=75341) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 23:52:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:28 user nova-compute[75341]: DEBUG nova.compute.manager [req-c08e8288-6f06-4848-bad7-b75a776c8401 req-fae62425-7b23-4971-a3d1-a58057a21a33 service nova] [instance: a141d7ee-3f77-4fdc-85ec-2cbd5af17646] Received event network-vif-unplugged-a64b87d5-7175-42f5-b6d0-09f45ac29e96 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:52:28 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-c08e8288-6f06-4848-bad7-b75a776c8401 req-fae62425-7b23-4971-a3d1-a58057a21a33 service nova] Acquiring lock "a141d7ee-3f77-4fdc-85ec-2cbd5af17646-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:52:28 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-c08e8288-6f06-4848-bad7-b75a776c8401 req-fae62425-7b23-4971-a3d1-a58057a21a33 service nova] Lock "a141d7ee-3f77-4fdc-85ec-2cbd5af17646-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:52:28 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-c08e8288-6f06-4848-bad7-b75a776c8401 req-fae62425-7b23-4971-a3d1-a58057a21a33 service nova] Lock "a141d7ee-3f77-4fdc-85ec-2cbd5af17646-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:52:28 user nova-compute[75341]: DEBUG nova.compute.manager [req-c08e8288-6f06-4848-bad7-b75a776c8401 req-fae62425-7b23-4971-a3d1-a58057a21a33 service nova] [instance: a141d7ee-3f77-4fdc-85ec-2cbd5af17646] No waiting events found dispatching network-vif-unplugged-a64b87d5-7175-42f5-b6d0-09f45ac29e96 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:52:28 user nova-compute[75341]: DEBUG nova.compute.manager [req-c08e8288-6f06-4848-bad7-b75a776c8401 req-fae62425-7b23-4971-a3d1-a58057a21a33 service nova] [instance: a141d7ee-3f77-4fdc-85ec-2cbd5af17646] Received event network-vif-unplugged-a64b87d5-7175-42f5-b6d0-09f45ac29e96 for instance with task_state deleting. {{(pid=75341) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 23:52:28 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: a141d7ee-3f77-4fdc-85ec-2cbd5af17646] Instance destroyed successfully.
Nov 14 23:52:28 user nova-compute[75341]: DEBUG nova.objects.instance [None req-16aa9f0d-9545-47d7-a28c-a945335c575f tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Lazy-loading 'resources' on Instance uuid a141d7ee-3f77-4fdc-85ec-2cbd5af17646 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:52:28 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-16aa9f0d-9545-47d7-a28c-a945335c575f tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:43:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-208275026',display_name='tempest-ServersNegativeTestJSON-server-208275026',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-208275026',id=15,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:43:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d86dc7dc1b6b41bf874f1a25d7bca91d',ramdisk_id='',reservation_id='r-oih0upz4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-2018102579',owner_user_name='tempest-ServersNegativeTestJSON-2018102579-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:43:56Z,user_data=None,user_id='c449c68aafa04accb8f06dbf87371f2d',uuid=a141d7ee-3f77-4fdc-85ec-2cbd5af17646,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a64b87d5-7175-42f5-b6d0-09f45ac29e96", "address": "fa:16:3e:4c:4c:c2", "network": {"id": "7673016a-86f3-4643-a21f-148adc2a96dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-89785556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d86dc7dc1b6b41bf874f1a25d7bca91d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa64b87d5-71", "ovs_interfaceid": "a64b87d5-7175-42f5-b6d0-09f45ac29e96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 23:52:28 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-16aa9f0d-9545-47d7-a28c-a945335c575f tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Converting VIF {"id": "a64b87d5-7175-42f5-b6d0-09f45ac29e96", "address": "fa:16:3e:4c:4c:c2", "network": {"id": "7673016a-86f3-4643-a21f-148adc2a96dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-89785556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d86dc7dc1b6b41bf874f1a25d7bca91d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa64b87d5-71", "ovs_interfaceid": "a64b87d5-7175-42f5-b6d0-09f45ac29e96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:52:28 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-16aa9f0d-9545-47d7-a28c-a945335c575f tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4c:4c:c2,bridge_name='br-int',has_traffic_filtering=True,id=a64b87d5-7175-42f5-b6d0-09f45ac29e96,network=Network(7673016a-86f3-4643-a21f-148adc2a96dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa64b87d5-71') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:52:28 user nova-compute[75341]: DEBUG os_vif [None req-16aa9f0d-9545-47d7-a28c-a945335c575f tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:4c:c2,bridge_name='br-int',has_traffic_filtering=True,id=a64b87d5-7175-42f5-b6d0-09f45ac29e96,network=Network(7673016a-86f3-4643-a21f-148adc2a96dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa64b87d5-71') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 23:52:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa64b87d5-71, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:52:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:52:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b5826ddc-13b6-48f0-b6ab-221a878d3d12) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:52:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:52:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:28 user nova-compute[75341]: INFO os_vif [None req-16aa9f0d-9545-47d7-a28c-a945335c575f tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:4c:c2,bridge_name='br-int',has_traffic_filtering=True,id=a64b87d5-7175-42f5-b6d0-09f45ac29e96,network=Network(7673016a-86f3-4643-a21f-148adc2a96dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa64b87d5-71')
Nov 14 23:52:28 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-16aa9f0d-9545-47d7-a28c-a945335c575f tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: a141d7ee-3f77-4fdc-85ec-2cbd5af17646] Deleting instance files /opt/stack/data/nova/instances/a141d7ee-3f77-4fdc-85ec-2cbd5af17646_del
Nov 14 23:52:28 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-16aa9f0d-9545-47d7-a28c-a945335c575f tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: a141d7ee-3f77-4fdc-85ec-2cbd5af17646] Deletion of /opt/stack/data/nova/instances/a141d7ee-3f77-4fdc-85ec-2cbd5af17646_del complete
Nov 14 23:52:28 user nova-compute[75341]: INFO nova.compute.manager [None req-16aa9f0d-9545-47d7-a28c-a945335c575f tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] [instance: a141d7ee-3f77-4fdc-85ec-2cbd5af17646] Took 0.69 seconds to destroy the instance on the hypervisor.
Nov 14 23:52:28 user nova-compute[75341]: DEBUG oslo.service.loopingcall [None req-16aa9f0d-9545-47d7-a28c-a945335c575f tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75341) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 23:52:28 user nova-compute[75341]: DEBUG nova.compute.manager [-] [instance: a141d7ee-3f77-4fdc-85ec-2cbd5af17646] Deallocating network for instance {{(pid=75341) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 23:52:28 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: a141d7ee-3f77-4fdc-85ec-2cbd5af17646] deallocate_for_instance() {{(pid=75341) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 23:52:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:28 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: a141d7ee-3f77-4fdc-85ec-2cbd5af17646] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:52:28 user nova-compute[75341]: INFO nova.compute.manager [-] [instance: a141d7ee-3f77-4fdc-85ec-2cbd5af17646] Took 0.46 seconds to deallocate network for instance.
Nov 14 23:52:28 user nova-compute[75341]: DEBUG nova.compute.manager [req-2a0dcef3-c6b9-4606-972a-1e3c50b72e59 req-9877befd-499a-4fdd-8271-f18643615ed2 service nova] [instance: a141d7ee-3f77-4fdc-85ec-2cbd5af17646] Received event network-vif-deleted-a64b87d5-7175-42f5-b6d0-09f45ac29e96 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:52:28 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-16aa9f0d-9545-47d7-a28c-a945335c575f tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:52:28 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-16aa9f0d-9545-47d7-a28c-a945335c575f tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:52:29 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-16aa9f0d-9545-47d7-a28c-a945335c575f tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:52:29 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-16aa9f0d-9545-47d7-a28c-a945335c575f tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:52:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-16aa9f0d-9545-47d7-a28c-a945335c575f tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.377s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:52:29 user nova-compute[75341]: INFO nova.scheduler.client.report [None req-16aa9f0d-9545-47d7-a28c-a945335c575f tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Deleted allocations for instance a141d7ee-3f77-4fdc-85ec-2cbd5af17646
Nov 14 23:52:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-16aa9f0d-9545-47d7-a28c-a945335c575f tempest-ServersNegativeTestJSON-2018102579 tempest-ServersNegativeTestJSON-2018102579-project-member] Lock "a141d7ee-3f77-4fdc-85ec-2cbd5af17646" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.698s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:52:30 user nova-compute[75341]: DEBUG nova.compute.manager [req-c5bf7834-db0c-4716-bc53-cf72245cb28c req-f628e896-a9ed-45b5-a93b-f1844ee23c7f service nova] [instance: a141d7ee-3f77-4fdc-85ec-2cbd5af17646] Received event network-vif-plugged-a64b87d5-7175-42f5-b6d0-09f45ac29e96 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:52:30 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-c5bf7834-db0c-4716-bc53-cf72245cb28c req-f628e896-a9ed-45b5-a93b-f1844ee23c7f service nova] Acquiring lock "a141d7ee-3f77-4fdc-85ec-2cbd5af17646-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:52:30 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-c5bf7834-db0c-4716-bc53-cf72245cb28c req-f628e896-a9ed-45b5-a93b-f1844ee23c7f service nova] Lock "a141d7ee-3f77-4fdc-85ec-2cbd5af17646-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:52:30 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-c5bf7834-db0c-4716-bc53-cf72245cb28c req-f628e896-a9ed-45b5-a93b-f1844ee23c7f service nova] Lock "a141d7ee-3f77-4fdc-85ec-2cbd5af17646-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:52:30 user nova-compute[75341]: DEBUG nova.compute.manager [req-c5bf7834-db0c-4716-bc53-cf72245cb28c req-f628e896-a9ed-45b5-a93b-f1844ee23c7f service nova] [instance: a141d7ee-3f77-4fdc-85ec-2cbd5af17646] No waiting events found dispatching network-vif-plugged-a64b87d5-7175-42f5-b6d0-09f45ac29e96 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:52:30 user nova-compute[75341]: WARNING nova.compute.manager [req-c5bf7834-db0c-4716-bc53-cf72245cb28c req-f628e896-a9ed-45b5-a93b-f1844ee23c7f service nova] [instance: a141d7ee-3f77-4fdc-85ec-2cbd5af17646] Received unexpected event network-vif-plugged-a64b87d5-7175-42f5-b6d0-09f45ac29e96 for instance with vm_state deleted and task_state None.
Nov 14 23:52:33 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:37 user nova-compute[75341]: DEBUG nova.compute.manager [req-66ed090f-3527-44f7-9710-e44db4200ee6 req-e51921db-6d77-46dd-8fa7-d8b7133965ef service nova] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Received event network-changed-1def089a-31ed-4ac4-be68-4050fa9c9fe6 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:52:37 user nova-compute[75341]: DEBUG nova.compute.manager [req-66ed090f-3527-44f7-9710-e44db4200ee6 req-e51921db-6d77-46dd-8fa7-d8b7133965ef service nova] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Refreshing instance network info cache due to event network-changed-1def089a-31ed-4ac4-be68-4050fa9c9fe6. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:52:37 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-66ed090f-3527-44f7-9710-e44db4200ee6 req-e51921db-6d77-46dd-8fa7-d8b7133965ef service nova] Acquiring lock "refresh_cache-12c9a7d6-03a5-4fd2-9082-c68758f1542f" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:52:37 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-66ed090f-3527-44f7-9710-e44db4200ee6 req-e51921db-6d77-46dd-8fa7-d8b7133965ef service nova] Acquired lock "refresh_cache-12c9a7d6-03a5-4fd2-9082-c68758f1542f" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:52:37 user nova-compute[75341]: DEBUG nova.network.neutron [req-66ed090f-3527-44f7-9710-e44db4200ee6 req-e51921db-6d77-46dd-8fa7-d8b7133965ef service nova] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Refreshing network info cache for port 1def089a-31ed-4ac4-be68-4050fa9c9fe6 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:52:37 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8ee146b6-ea50-47d1-879e-2184cf7a8780 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Acquiring lock "12c9a7d6-03a5-4fd2-9082-c68758f1542f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:52:37 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8ee146b6-ea50-47d1-879e-2184cf7a8780 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "12c9a7d6-03a5-4fd2-9082-c68758f1542f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:52:37 user nova-compute[75341]: DEBUG nova.network.neutron [req-66ed090f-3527-44f7-9710-e44db4200ee6 req-e51921db-6d77-46dd-8fa7-d8b7133965ef service nova] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Updated VIF entry in instance network info cache for port 1def089a-31ed-4ac4-be68-4050fa9c9fe6. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:52:37 user nova-compute[75341]: DEBUG nova.network.neutron [req-66ed090f-3527-44f7-9710-e44db4200ee6 req-e51921db-6d77-46dd-8fa7-d8b7133965ef service nova] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Updating instance_info_cache with network_info: [{"id": "1def089a-31ed-4ac4-be68-4050fa9c9fe6", "address": "fa:16:3e:3c:51:b6", "network": {"id": "d86a8e7f-6658-4994-9a13-eb3163bd3865", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-635863702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c69a942b4f4b97a1a3152dea86c7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1def089a-31", "ovs_interfaceid": "1def089a-31ed-4ac4-be68-4050fa9c9fe6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:52:37 user nova-compute[75341]: DEBUG nova.objects.instance [None req-8ee146b6-ea50-47d1-879e-2184cf7a8780 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lazy-loading 'flavor' on Instance uuid 12c9a7d6-03a5-4fd2-9082-c68758f1542f {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:52:37 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-66ed090f-3527-44f7-9710-e44db4200ee6 req-e51921db-6d77-46dd-8fa7-d8b7133965ef service nova] Releasing lock "refresh_cache-12c9a7d6-03a5-4fd2-9082-c68758f1542f" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:52:37 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8ee146b6-ea50-47d1-879e-2184cf7a8780 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "12c9a7d6-03a5-4fd2-9082-c68758f1542f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:52:37 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8ee146b6-ea50-47d1-879e-2184cf7a8780 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Acquiring lock "12c9a7d6-03a5-4fd2-9082-c68758f1542f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:52:37 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8ee146b6-ea50-47d1-879e-2184cf7a8780 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "12c9a7d6-03a5-4fd2-9082-c68758f1542f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:52:37 user nova-compute[75341]: INFO nova.compute.manager [None req-8ee146b6-ea50-47d1-879e-2184cf7a8780 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Attaching volume 9efe345e-fc79-46f6-973c-ed817a24dd05 to /dev/vdb
Nov 14 23:52:37 user nova-compute[75341]: DEBUG os_brick.utils [None req-8ee146b6-ea50-47d1-879e-2184cf7a8780 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:52:37 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:52:37 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:52:37 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d7346f-5134-4e58-ac6f-cfa198bc09f1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6d1cfca09c9\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:52:37 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:52:37 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:52:37 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e10c713-c86d-4ca5-8bdb-dc34c014e3ca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:52:37 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:52:37 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:52:37 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df65381-f6c9-4c36-98c6-56d07d827810]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:52:37 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb3ce5d-7eff-42ef-89a7-4973b0717f65]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:52:37 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-8ee146b6-ea50-47d1-879e-2184cf7a8780 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Running cmd (subprocess): nvme version {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:52:37 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-8ee146b6-ea50-47d1-879e-2184cf7a8780 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] 'nvme version' failed. Not Retrying. {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:52:37 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8ee146b6-ea50-47d1-879e-2184cf7a8780 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] nvme not present on system {{(pid=75341) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 23:52:37 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:52:37 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:52:37 user nova-compute[75341]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 23:52:37 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fccd419-97a7-458a-96e9-af80474ce655]: (4, '') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:52:37 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-8ee146b6-ea50-47d1-879e-2184cf7a8780 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75341) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 23:52:37 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-8ee146b6-ea50-47d1-879e-2184cf7a8780 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 23:52:37 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-8ee146b6-ea50-47d1-879e-2184cf7a8780 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] LIGHTOS: no hostnqn found. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 23:52:37 user nova-compute[75341]: DEBUG os_brick.utils [None req-8ee146b6-ea50-47d1-879e-2184cf7a8780 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6d1cfca09c9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:52:37 user nova-compute[75341]: DEBUG nova.virt.block_device [None req-8ee146b6-ea50-47d1-879e-2184cf7a8780 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Updating existing volume attachment record: 7b6e6538-ad06-4b7a-bcb6-53005890ce74 {{(pid=75341) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 23:52:38 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:52:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:42 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ee146b6-ea50-47d1-879e-2184cf7a8780 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Calling os-brick to attach iSCSI Volume {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 23:52:42 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee146b6-ea50-47d1-879e-2184cf7a8780 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WYmGxpur', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:52:42 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-8ee146b6-ea50-47d1-879e-2184cf7a8780 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:52:42 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-8ee146b6-ea50-47d1-879e-2184cf7a8780 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:52:42 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-8ee146b6-ea50-47d1-879e-2184cf7a8780 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:52:42 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-8ee146b6-ea50-47d1-879e-2184cf7a8780 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:52:42 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-8ee146b6-ea50-47d1-879e-2184cf7a8780 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:52:42 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-8ee146b6-ea50-47d1-879e-2184cf7a8780 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:52:42 user nova-compute[75341]: INFO os_brick.initiator.connectors.iscsi [None req-8ee146b6-ea50-47d1-879e-2184cf7a8780 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 23:52:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 -p 172.16.0.220:3260 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:52:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:52:42 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e06fa96-2943-4af0-beea-e5483a6233ed]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:52:42 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee146b6-ea50-47d1-879e-2184cf7a8780 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 23:52:42 user nova-compute[75341]:  {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:52:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 -p 172.16.0.220:3260 --interface default --op new {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:52:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:52:42 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c1f65e-bad7-4cee-865e-18f9ed620d4a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05] added\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:52:42 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee146b6-ea50-47d1-879e-2184cf7a8780 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05] added
Nov 14 23:52:42 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:52:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:52:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:52:42 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4b7d21-a7e8-4ad5-99a9-252ebec739e4]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:52:42 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee146b6-ea50-47d1-879e-2184cf7a8780 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:52:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:52:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:52:42 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[2629ec60-db60-4d3a-a0d9-cd2a5e94c69c]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:52:42 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee146b6-ea50-47d1-879e-2184cf7a8780 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:52:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WYmGxpur {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:52:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WYmGxpur" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:52:42 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[92bfb68e-52d5-4b39-8089-dbb21b6ab650]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:52:42 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee146b6-ea50-47d1-879e-2184cf7a8780 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WYmGxpur'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:52:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:52:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:52:42 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[afef1f0b-25f5-4c4d-b299-88f0301f7337]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:52:42 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee146b6-ea50-47d1-879e-2184cf7a8780 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:52:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:52:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:52:42 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[84aac6fb-e8b2-45b7-b15d-e601172fec5d]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:52:42 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee146b6-ea50-47d1-879e-2184cf7a8780 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)
Nov 14 23:52:42 user nova-compute[75341]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)
Nov 14 23:52:42 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:52:42 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee146b6-ea50-47d1-879e-2184cf7a8780 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)
Nov 14 23:52:42 user nova-compute[75341]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)
Nov 14 23:52:42 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:52:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 -p 172.16.0.220:3260 --login {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:52:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:52:42 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c44137e-52b8-4c1c-9260-502c13175fd5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:52:42 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee146b6-ea50-47d1-879e-2184cf7a8780 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05, portal: 172.16.0.220,3260]
Nov 14 23:52:42 user nova-compute[75341]: Login to [iface: default, target: iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05, portal: 172.16.0.220,3260] successful.
Nov 14 23:52:42 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:52:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:52:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:52:42 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a22c4c-1344-4436-9b35-55bdd0777c58]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:52:42 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee146b6-ea50-47d1-879e-2184cf7a8780 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:52:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:52:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:52:42 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[475fd3a9-3129-4ec5-b23c-504c274914e2]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:52:42 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee146b6-ea50-47d1-879e-2184cf7a8780 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)
Nov 14 23:52:42 user nova-compute[75341]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)
Nov 14 23:52:42 user nova-compute[75341]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)
Nov 14 23:52:42 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:52:42 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee146b6-ea50-47d1-879e-2184cf7a8780 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)
Nov 14 23:52:42 user nova-compute[75341]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)
Nov 14 23:52:42 user nova-compute[75341]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)
Nov 14 23:52:42 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:52:42 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-8ee146b6-ea50-47d1-879e-2184cf7a8780 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:52:42 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee146b6-ea50-47d1-879e-2184cf7a8780 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Connected to 172.16.0.220:3260 {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 23:52:42 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-8ee146b6-ea50-47d1-879e-2184cf7a8780 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] HCTL ('33', '-', '-', 0) found on session 37 with lun 0 {{(pid=75341) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 23:52:42 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-8ee146b6-ea50-47d1-879e-2184cf7a8780 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75341) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 23:52:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:52:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:52:42 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[975aaf3d-a536-4ded-b2c6-7d3d46cf1287]: (4, ('- - 0', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:52:42 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-8ee146b6-ea50-47d1-879e-2184cf7a8780 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: None {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 23:52:43 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:43 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-8ee146b6-ea50-47d1-879e-2184cf7a8780 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 23:52:43 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee146b6-ea50-47d1-879e-2184cf7a8780 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WYmGxpur', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 23:52:43 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-8ee146b6-ea50-47d1-879e-2184cf7a8780 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:52:43 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ee146b6-ea50-47d1-879e-2184cf7a8780 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23165613736633131', 'path': '/dev/sdb'} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:52:43 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ee146b6-ea50-47d1-879e-2184cf7a8780 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165613736633131', 'path': '/dev/sdb'} {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 23:52:43 user nova-compute[75341]: DEBUG nova.objects.instance [None req-8ee146b6-ea50-47d1-879e-2184cf7a8780 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lazy-loading 'flavor' on Instance uuid 12c9a7d6-03a5-4fd2-9082-c68758f1542f {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:52:43 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-8ee146b6-ea50-47d1-879e-2184cf7a8780 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 23:52:43 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:52:43 user nova-compute[75341]:   <source dev="/dev/sdb"/>
Nov 14 23:52:43 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:52:43 user nova-compute[75341]:   <serial>9efe345e-fc79-46f6-973c-ed817a24dd05</serial>
Nov 14 23:52:43 user nova-compute[75341]: </disk>
Nov 14 23:52:43 user nova-compute[75341]:  {{(pid=75341) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 23:52:44 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-8ee146b6-ea50-47d1-879e-2184cf7a8780 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:52:44 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-8ee146b6-ea50-47d1-879e-2184cf7a8780 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:52:44 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-8ee146b6-ea50-47d1-879e-2184cf7a8780 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] No VIF found with MAC fa:16:3e:3c:51:b6, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:52:44 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8ee146b6-ea50-47d1-879e-2184cf7a8780 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "12c9a7d6-03a5-4fd2-9082-c68758f1542f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.408s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:52:45 user nova-compute[75341]: INFO nova.compute.manager [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Rebuilding instance
Nov 14 23:52:46 user nova-compute[75341]: DEBUG nova.compute.manager [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 23:52:46 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:46 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:46 user nova-compute[75341]: DEBUG nova.compute.manager [req-0f314c70-83fe-4446-aeb1-d83611f09110 req-6882f7c0-1b9f-42bc-823d-76f9d99e785a service nova] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Received event network-vif-unplugged-1def089a-31ed-4ac4-be68-4050fa9c9fe6 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:52:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-0f314c70-83fe-4446-aeb1-d83611f09110 req-6882f7c0-1b9f-42bc-823d-76f9d99e785a service nova] Acquiring lock "12c9a7d6-03a5-4fd2-9082-c68758f1542f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:52:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-0f314c70-83fe-4446-aeb1-d83611f09110 req-6882f7c0-1b9f-42bc-823d-76f9d99e785a service nova] Lock "12c9a7d6-03a5-4fd2-9082-c68758f1542f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:52:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-0f314c70-83fe-4446-aeb1-d83611f09110 req-6882f7c0-1b9f-42bc-823d-76f9d99e785a service nova] Lock "12c9a7d6-03a5-4fd2-9082-c68758f1542f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:52:46 user nova-compute[75341]: DEBUG nova.compute.manager [req-0f314c70-83fe-4446-aeb1-d83611f09110 req-6882f7c0-1b9f-42bc-823d-76f9d99e785a service nova] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] No waiting events found dispatching network-vif-unplugged-1def089a-31ed-4ac4-be68-4050fa9c9fe6 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:52:46 user nova-compute[75341]: WARNING nova.compute.manager [req-0f314c70-83fe-4446-aeb1-d83611f09110 req-6882f7c0-1b9f-42bc-823d-76f9d99e785a service nova] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Received unexpected event network-vif-unplugged-1def089a-31ed-4ac4-be68-4050fa9c9fe6 for instance with vm_state active and task_state rebuilding.
Nov 14 23:52:46 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:46 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:46 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:46 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Instance destroyed successfully.
Nov 14 23:52:46 user nova-compute[75341]: INFO nova.compute.manager [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Detaching volume 9efe345e-fc79-46f6-973c-ed817a24dd05
Nov 14 23:52:47 user nova-compute[75341]: INFO nova.virt.block_device [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Attempting to driver detach volume 9efe345e-fc79-46f6-973c-ed817a24dd05 from mountpoint /dev/vdb
Nov 14 23:52:47 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Attempting to detach device vdb from instance 12c9a7d6-03a5-4fd2-9082-c68758f1542f from the persistent domain config. {{(pid=75341) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 23:52:47 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 23:52:47 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:52:47 user nova-compute[75341]:   <source dev="/dev/sdb"/>
Nov 14 23:52:47 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:52:47 user nova-compute[75341]:   <serial>9efe345e-fc79-46f6-973c-ed817a24dd05</serial>
Nov 14 23:52:47 user nova-compute[75341]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 23:52:47 user nova-compute[75341]: </disk>
Nov 14 23:52:47 user nova-compute[75341]:  {{(pid=75341) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 23:52:47 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Successfully detached device vdb from instance 12c9a7d6-03a5-4fd2-9082-c68758f1542f from the persistent domain config.
Nov 14 23:52:47 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] calling os-brick to detach iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 23:52:47 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, {'target_iqn': 'iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WYmGxpur', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:52:47 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 23:52:47 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:52:47 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:52:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:52:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:52:47 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1296467-cdd3-49a1-b872-07f42f01b814]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:52:47 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 23:52:47 user nova-compute[75341]: No targets found.
Nov 14 23:52:47 user nova-compute[75341]: iSNS:
Nov 14 23:52:47 user nova-compute[75341]: No targets found.
Nov 14 23:52:47 user nova-compute[75341]: STATIC:
Nov 14 23:52:47 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9
Nov 14 23:52:47 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:52:47 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:52:47 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05
Nov 14 23:52:47 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:52:47 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:52:47 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418
Nov 14 23:52:47 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:52:47 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:52:47 user nova-compute[75341]: FIRMWARE:
Nov 14 23:52:47 user nova-compute[75341]: No targets found.
Nov 14 23:52:47 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:52:47 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 23:52:47 user nova-compute[75341]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 23:52:47 user nova-compute[75341]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75341) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 23:52:47 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05', 0)] {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 23:52:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:52:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:52:47 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[91fd9e21-a377-4b3b-9839-792a71066c06]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:52:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:52:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:52:47 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96980bc-4e1f-4840-bd43-3b8d7aa16959]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:52:47 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)
Nov 14 23:52:47 user nova-compute[75341]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)
Nov 14 23:52:47 user nova-compute[75341]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)
Nov 14 23:52:47 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:52:47 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)
Nov 14 23:52:47 user nova-compute[75341]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)
Nov 14 23:52:47 user nova-compute[75341]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)
Nov 14 23:52:47 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:52:47 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1870456950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05'): ({'sdb'}, set())}) {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 23:52:47 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Removing single pathed devices sdb {{(pid=75341) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 23:52:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:52:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:52:47 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea631a5-8053-44f6-8515-15c26a64bde9]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:52:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:52:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:52:47 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04e2bc3-c522-4b9e-af10-7a971762a610]: (4, ('ok\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:52:47 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Flushing IO for device /dev/sdb {{(pid=75341) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 23:52:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:52:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:52:47 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[623fb14d-5acf-417e-86c8-796926a9de82]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:52:47 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75341) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 23:52:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:52:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:52:47 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad4132c-8199-449a-8df5-6d3d6e1f7bdc]: (4, ('1', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:52:47 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 23:52:47 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] SCSI volumes sdb have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 23:52:47 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05')] {{(pid=75341) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 23:52:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:52:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:52:47 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[968ab543-9803-47c1-a252-94cc23fdf70c]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:52:47 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:52:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 -p 172.16.0.220:3260 --logout {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:52:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:52:47 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42ae366-de39-457a-9920-0b0dcf59ac71]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:52:47 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05, portal: 172.16.0.220,3260]
Nov 14 23:52:47 user nova-compute[75341]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05, portal: 172.16.0.220,3260] successful.
Nov 14 23:52:47 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:52:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 -p 172.16.0.220:3260 --op delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:52:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:52:47 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ea85f7-ad2e-4dbc-b665-928ae5f544ec]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:52:47 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:52:47 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:52:47 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] <== disconnect_volume: return (297ms) None {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:52:47 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Disconnected iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 23:52:48 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Instance destroyed successfully.
Nov 14 23:52:48 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:50:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-354068924',display_name='tempest-ServerActionsTestOtherA-server-270852724',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-354068924',id=34,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5He922s8rk+PmMGVsYQr5cOK2M7RyE6pRHPukFN7KTwHIYhqpey5pP25XxRxS64/nnTZtZU0s7MKkpDVnG7pj8Bq4MwPLqGCEvlosZZWTgxDQbmYxiYN/iVtJlhcHp1A==',key_name='tempest-keypair-1680109364',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:50:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f4c69a942b4f4b97a1a3152dea86c7fb',ramdisk_id='',reservation_id='r-hde50h2m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1796396043',owner_user_name='tempest-ServerActionsTestOtherA-1796396043-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:52:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='442aae0161f347d0a79b168a1b60286a',uuid=12c9a7d6-03a5-4fd2-9082-c68758f1542f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1def089a-31ed-4ac4-be68-4050fa9c9fe6", "address": "fa:16:3e:3c:51:b6", "network": {"id": "d86a8e7f-6658-4994-9a13-eb3163bd3865", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-635863702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c69a942b4f4b97a1a3152dea86c7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1def089a-31", "ovs_interfaceid": "1def089a-31ed-4ac4-be68-4050fa9c9fe6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 23:52:48 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Converting VIF {"id": "1def089a-31ed-4ac4-be68-4050fa9c9fe6", "address": "fa:16:3e:3c:51:b6", "network": {"id": "d86a8e7f-6658-4994-9a13-eb3163bd3865", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-635863702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c69a942b4f4b97a1a3152dea86c7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1def089a-31", "ovs_interfaceid": "1def089a-31ed-4ac4-be68-4050fa9c9fe6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:52:48 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3c:51:b6,bridge_name='br-int',has_traffic_filtering=True,id=1def089a-31ed-4ac4-be68-4050fa9c9fe6,network=Network(d86a8e7f-6658-4994-9a13-eb3163bd3865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1def089a-31') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:52:48 user nova-compute[75341]: DEBUG os_vif [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:51:b6,bridge_name='br-int',has_traffic_filtering=True,id=1def089a-31ed-4ac4-be68-4050fa9c9fe6,network=Network(d86a8e7f-6658-4994-9a13-eb3163bd3865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1def089a-31') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 23:52:48 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:48 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1def089a-31, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:52:48 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:52:48 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:52:48 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:48 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:48 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=af9ce109-dd50-4f61-8f52-1f31d6d604c5) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:52:48 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:52:48 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:48 user nova-compute[75341]: INFO os_vif [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:51:b6,bridge_name='br-int',has_traffic_filtering=True,id=1def089a-31ed-4ac4-be68-4050fa9c9fe6,network=Network(d86a8e7f-6658-4994-9a13-eb3163bd3865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1def089a-31')
Nov 14 23:52:48 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] calling os-brick to detach iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 23:52:48 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, {'target_iqn': 'iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WYmGxpur', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:52:48 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 23:52:48 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:52:48 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:52:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:52:48 user nova-compute[75341]: DEBUG nova.compute.manager [req-59faa47f-0566-4309-b178-d6fcde9feb95 req-a0fb3024-2d52-415e-ba22-b32224b8ae57 service nova] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Received event network-vif-plugged-1def089a-31ed-4ac4-be68-4050fa9c9fe6 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:52:48 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-59faa47f-0566-4309-b178-d6fcde9feb95 req-a0fb3024-2d52-415e-ba22-b32224b8ae57 service nova] Acquiring lock "12c9a7d6-03a5-4fd2-9082-c68758f1542f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:52:48 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-59faa47f-0566-4309-b178-d6fcde9feb95 req-a0fb3024-2d52-415e-ba22-b32224b8ae57 service nova] Lock "12c9a7d6-03a5-4fd2-9082-c68758f1542f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:52:48 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-59faa47f-0566-4309-b178-d6fcde9feb95 req-a0fb3024-2d52-415e-ba22-b32224b8ae57 service nova] Lock "12c9a7d6-03a5-4fd2-9082-c68758f1542f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:52:48 user nova-compute[75341]: DEBUG nova.compute.manager [req-59faa47f-0566-4309-b178-d6fcde9feb95 req-a0fb3024-2d52-415e-ba22-b32224b8ae57 service nova] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] No waiting events found dispatching network-vif-plugged-1def089a-31ed-4ac4-be68-4050fa9c9fe6 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:52:48 user nova-compute[75341]: WARNING nova.compute.manager [req-59faa47f-0566-4309-b178-d6fcde9feb95 req-a0fb3024-2d52-415e-ba22-b32224b8ae57 service nova] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Received unexpected event network-vif-plugged-1def089a-31ed-4ac4-be68-4050fa9c9fe6 for instance with vm_state active and task_state rebuilding.
Nov 14 23:52:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:52:48 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6809d12-dea2-4d43-a07a-773a4e07c253]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:52:48 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 23:52:48 user nova-compute[75341]: No targets found.
Nov 14 23:52:48 user nova-compute[75341]: iSNS:
Nov 14 23:52:48 user nova-compute[75341]: No targets found.
Nov 14 23:52:48 user nova-compute[75341]: STATIC:
Nov 14 23:52:48 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9
Nov 14 23:52:48 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:52:48 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:52:48 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418
Nov 14 23:52:48 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:52:48 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:52:48 user nova-compute[75341]: FIRMWARE:
Nov 14 23:52:48 user nova-compute[75341]: No targets found.
Nov 14 23:52:48 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:52:48 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 23:52:48 user nova-compute[75341]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 23:52:48 user nova-compute[75341]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75341) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 23:52:48 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05', 0)] {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 23:52:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:52:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:52:48 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6b0500-2103-43b7-b67d-e2a095095887]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:52:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:52:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:52:48 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[741d0d4c-d28e-4f16-92fd-13212adf2d91]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:52:48 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)
Nov 14 23:52:48 user nova-compute[75341]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)
Nov 14 23:52:48 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:52:48 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)
Nov 14 23:52:48 user nova-compute[75341]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)
Nov 14 23:52:48 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:52:48 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18901544c0>, {}) {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 23:52:48 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Disconnecting from: [] {{(pid=75341) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 23:52:48 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.083s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:52:48 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] <== disconnect_volume: return (84ms) None {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:52:48 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Disconnected iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 23:52:48 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Deleting instance files /opt/stack/data/nova/instances/12c9a7d6-03a5-4fd2-9082-c68758f1542f_del
Nov 14 23:52:48 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Deletion of /opt/stack/data/nova/instances/12c9a7d6-03a5-4fd2-9082-c68758f1542f_del complete
Nov 14 23:52:48 user nova-compute[75341]: INFO nova.virt.block_device [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Booting with volume 9efe345e-fc79-46f6-973c-ed817a24dd05 at /dev/vdb
Nov 14 23:52:48 user nova-compute[75341]: DEBUG os_brick.utils [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:52:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:52:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:52:48 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[6453baa3-ba8a-49c7-9bd3-9f634da328f7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6d1cfca09c9\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:52:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:52:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:52:48 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e9d30e-f524-4bf5-b382-c8bfdca62ad6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:52:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:52:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:52:48 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[8baaeb03-4148-4903-82af-08c325dd5fd3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:52:48 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff111ab-247b-4e25-92db-d50f40e9854e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:52:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Running cmd (subprocess): nvme version {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:52:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] 'nvme version' failed. Not Retrying. {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:52:48 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] nvme not present on system {{(pid=75341) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 23:52:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:52:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:52:48 user nova-compute[75341]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 23:52:48 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4615aa-bcaf-458d-913a-1a382c6b9380]: (4, '') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:52:48 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75341) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 23:52:48 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 23:52:48 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] LIGHTOS: no hostnqn found. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 23:52:48 user nova-compute[75341]: DEBUG os_brick.utils [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6d1cfca09c9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:52:48 user nova-compute[75341]: DEBUG nova.virt.block_device [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Updating existing volume attachment record: b7818750-4b6a-4033-b411-4d8e19223fe3 {{(pid=75341) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 23:52:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Acquiring lock "c62455e6-61af-45b1-899f-bad37dc57b22" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:52:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "c62455e6-61af-45b1-899f-bad37dc57b22" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:52:50 user nova-compute[75341]: DEBUG nova.compute.manager [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Starting instance... {{(pid=75341) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 23:52:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8c4c9334-a8ef-4a2c-95ab-b9ec197cc639 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Acquiring lock "5950ba70-e7c0-4b5f-839c-569e0a27b625" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:52:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8c4c9334-a8ef-4a2c-95ab-b9ec197cc639 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "5950ba70-e7c0-4b5f-839c-569e0a27b625" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:52:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8c4c9334-a8ef-4a2c-95ab-b9ec197cc639 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Acquiring lock "5950ba70-e7c0-4b5f-839c-569e0a27b625-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:52:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8c4c9334-a8ef-4a2c-95ab-b9ec197cc639 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "5950ba70-e7c0-4b5f-839c-569e0a27b625-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:52:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8c4c9334-a8ef-4a2c-95ab-b9ec197cc639 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "5950ba70-e7c0-4b5f-839c-569e0a27b625-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:52:50 user nova-compute[75341]: INFO nova.compute.manager [None req-8c4c9334-a8ef-4a2c-95ab-b9ec197cc639 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Terminating instance
Nov 14 23:52:50 user nova-compute[75341]: DEBUG nova.compute.manager [None req-8c4c9334-a8ef-4a2c-95ab-b9ec197cc639 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Start destroying the instance on the hypervisor. {{(pid=75341) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 23:52:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:52:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:52:50 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75341) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 23:52:50 user nova-compute[75341]: INFO nova.compute.claims [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Claim successful on node user
Nov 14 23:52:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:50 user nova-compute[75341]: DEBUG nova.compute.manager [req-b9245cfb-b48a-43e3-92fa-4c1a9f2f88a5 req-aabacb9a-d249-41c0-8281-e34922c4b057 service nova] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Received event network-vif-unplugged-6df0f48f-1a94-42ec-b540-0aee55dc6b70 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:52:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-b9245cfb-b48a-43e3-92fa-4c1a9f2f88a5 req-aabacb9a-d249-41c0-8281-e34922c4b057 service nova] Acquiring lock "5950ba70-e7c0-4b5f-839c-569e0a27b625-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:52:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-b9245cfb-b48a-43e3-92fa-4c1a9f2f88a5 req-aabacb9a-d249-41c0-8281-e34922c4b057 service nova] Lock "5950ba70-e7c0-4b5f-839c-569e0a27b625-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:52:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-b9245cfb-b48a-43e3-92fa-4c1a9f2f88a5 req-aabacb9a-d249-41c0-8281-e34922c4b057 service nova] Lock "5950ba70-e7c0-4b5f-839c-569e0a27b625-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:52:50 user nova-compute[75341]: DEBUG nova.compute.manager [req-b9245cfb-b48a-43e3-92fa-4c1a9f2f88a5 req-aabacb9a-d249-41c0-8281-e34922c4b057 service nova] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] No waiting events found dispatching network-vif-unplugged-6df0f48f-1a94-42ec-b540-0aee55dc6b70 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:52:50 user nova-compute[75341]: DEBUG nova.compute.manager [req-b9245cfb-b48a-43e3-92fa-4c1a9f2f88a5 req-aabacb9a-d249-41c0-8281-e34922c4b057 service nova] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Received event network-vif-unplugged-6df0f48f-1a94-42ec-b540-0aee55dc6b70 for instance with task_state deleting. {{(pid=75341) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 23:52:50 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:52:50 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:52:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.504s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:52:50 user nova-compute[75341]: DEBUG nova.compute.manager [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Start building networks asynchronously for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 23:52:50 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:52:50 user nova-compute[75341]: DEBUG nova.compute.manager [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Allocating IP information in the background. {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 23:52:50 user nova-compute[75341]: DEBUG nova.network.neutron [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] allocate_for_instance() {{(pid=75341) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 23:52:50 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 23:52:50 user nova-compute[75341]: DEBUG nova.compute.manager [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Start building block device mappings for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 23:52:51 user nova-compute[75341]: DEBUG nova.policy [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3c49a358e2f942f3a9777910ee755575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bb8b1415c14bb59c4c35cc2b830875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75341) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 23:52:51 user nova-compute[75341]: DEBUG nova.compute.manager [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Start spawning the instance on the hypervisor. {{(pid=75341) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 23:52:51 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Creating instance directory {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 23:52:51 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Creating image(s)
Nov 14 23:52:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Acquiring lock "/opt/stack/data/nova/instances/c62455e6-61af-45b1-899f-bad37dc57b22/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:52:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "/opt/stack/data/nova/instances/c62455e6-61af-45b1-899f-bad37dc57b22/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:52:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "/opt/stack/data/nova/instances/c62455e6-61af-45b1-899f-bad37dc57b22/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:52:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:52:51 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Instance destroyed successfully.
Nov 14 23:52:51 user nova-compute[75341]: DEBUG nova.objects.instance [None req-8c4c9334-a8ef-4a2c-95ab-b9ec197cc639 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lazy-loading 'resources' on Instance uuid 5950ba70-e7c0-4b5f-839c-569e0a27b625 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:52:51 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-8c4c9334-a8ef-4a2c-95ab-b9ec197cc639 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T23:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1777010379',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1777010379',id=26,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFD/gQIk9sUxqytzFW+oIEoqeanqxhZ0nToGQHLSMfBJMBwXTQoqiqkjX7C2tOIZAKXm6CkDxugybhl1fVd4nRFiiiLCvqiflsVfW4bdFOB/z4735jWpOaIZAnYZPVxHVw==',key_name='tempest-keypair-1640023904',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:51:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5f27e41f4cc1451291b8aca34544867b',ramdisk_id='',reservation_id='r-5jpqwdpl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-946394493',owner_user_name='tempest-AttachVolumeShelveTestJSON-946394493-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:51:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38acd33ad6754965a53017185f473f8a',uuid=5950ba70-e7c0-4b5f-839c-569e0a27b625,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6df0f48f-1a94-42ec-b540-0aee55dc6b70", "address": "fa:16:3e:67:d4:76", "network": {"id": "e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-64240219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f27e41f4cc1451291b8aca34544867b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df0f48f-1a", "ovs_interfaceid": "6df0f48f-1a94-42ec-b540-0aee55dc6b70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 23:52:51 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-8c4c9334-a8ef-4a2c-95ab-b9ec197cc639 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Converting VIF {"id": "6df0f48f-1a94-42ec-b540-0aee55dc6b70", "address": "fa:16:3e:67:d4:76", "network": {"id": "e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-64240219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f27e41f4cc1451291b8aca34544867b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df0f48f-1a", "ovs_interfaceid": "6df0f48f-1a94-42ec-b540-0aee55dc6b70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:52:51 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-8c4c9334-a8ef-4a2c-95ab-b9ec197cc639 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:d4:76,bridge_name='br-int',has_traffic_filtering=True,id=6df0f48f-1a94-42ec-b540-0aee55dc6b70,network=Network(e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6df0f48f-1a') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:52:51 user nova-compute[75341]: DEBUG os_vif [None req-8c4c9334-a8ef-4a2c-95ab-b9ec197cc639 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:d4:76,bridge_name='br-int',has_traffic_filtering=True,id=6df0f48f-1a94-42ec-b540-0aee55dc6b70,network=Network(e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6df0f48f-1a') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 23:52:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6df0f48f-1a, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:52:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:52:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ed732197-89c6-4176-ba54-c213e7ebfa1d) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:52:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:52:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:51 user nova-compute[75341]: INFO os_vif [None req-8c4c9334-a8ef-4a2c-95ab-b9ec197cc639 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:d4:76,bridge_name='br-int',has_traffic_filtering=True,id=6df0f48f-1a94-42ec-b540-0aee55dc6b70,network=Network(e4bd65d5-ea6a-4ac4-b8d6-8176c99a1373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6df0f48f-1a')
Nov 14 23:52:51 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-8c4c9334-a8ef-4a2c-95ab-b9ec197cc639 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Deleting instance files /opt/stack/data/nova/instances/5950ba70-e7c0-4b5f-839c-569e0a27b625_del
Nov 14 23:52:51 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-8c4c9334-a8ef-4a2c-95ab-b9ec197cc639 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Deletion of /opt/stack/data/nova/instances/5950ba70-e7c0-4b5f-839c-569e0a27b625_del complete
Nov 14 23:52:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.191s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:52:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Acquiring lock "4754efee9a6d73d3647f2add2cfe86c291949740" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:52:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:52:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:52:51 user nova-compute[75341]: INFO nova.compute.manager [None req-8c4c9334-a8ef-4a2c-95ab-b9ec197cc639 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 14 23:52:51 user nova-compute[75341]: DEBUG oslo.service.loopingcall [None req-8c4c9334-a8ef-4a2c-95ab-b9ec197cc639 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75341) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 23:52:51 user nova-compute[75341]: DEBUG nova.compute.manager [-] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Deallocating network for instance {{(pid=75341) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 23:52:51 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] deallocate_for_instance() {{(pid=75341) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 23:52:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.174s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:52:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/c62455e6-61af-45b1-899f-bad37dc57b22/disk 1073741824 {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:52:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/c62455e6-61af-45b1-899f-bad37dc57b22/disk 1073741824" returned: 0 in 0.051s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:52:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:52:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:52:51 user nova-compute[75341]: DEBUG nova.network.neutron [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Successfully created port: 8989d87f-615c-4cfe-9d3d-6c012e3fdf48 {{(pid=75341) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 23:52:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.199s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:52:51 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c62455e6-61af-45b1-899f-bad37dc57b22/disk. size=1073741824 {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 23:52:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c62455e6-61af-45b1-899f-bad37dc57b22/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:52:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c62455e6-61af-45b1-899f-bad37dc57b22/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:52:51 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Cannot resize image /opt/stack/data/nova/instances/c62455e6-61af-45b1-899f-bad37dc57b22/disk to a smaller size. {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 23:52:51 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Created local disks {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 23:52:51 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Ensure instance console log exists: /opt/stack/data/nova/instances/c62455e6-61af-45b1-899f-bad37dc57b22/console.log {{(pid=75341) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 23:52:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:52:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:52:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:52:52 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:52:52 user nova-compute[75341]: INFO nova.compute.manager [-] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Took 0.90 seconds to deallocate network for instance.
Nov 14 23:52:52 user nova-compute[75341]: DEBUG nova.compute.manager [req-012bda7a-5f81-4209-8a8a-7151b16a3af6 req-bc5b530c-eb3d-44aa-aaf5-14f409683163 service nova] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Received event network-vif-deleted-6df0f48f-1a94-42ec-b540-0aee55dc6b70 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:52:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8c4c9334-a8ef-4a2c-95ab-b9ec197cc639 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:52:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8c4c9334-a8ef-4a2c-95ab-b9ec197cc639 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:52:52 user nova-compute[75341]: DEBUG nova.network.neutron [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Successfully updated port: 8989d87f-615c-4cfe-9d3d-6c012e3fdf48 {{(pid=75341) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 23:52:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Acquiring lock "refresh_cache-c62455e6-61af-45b1-899f-bad37dc57b22" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:52:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Acquired lock "refresh_cache-c62455e6-61af-45b1-899f-bad37dc57b22" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:52:52 user nova-compute[75341]: DEBUG nova.network.neutron [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 23:52:52 user nova-compute[75341]: DEBUG nova.network.neutron [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Instance cache missing network info. {{(pid=75341) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 23:52:52 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-8c4c9334-a8ef-4a2c-95ab-b9ec197cc639 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:52:52 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-8c4c9334-a8ef-4a2c-95ab-b9ec197cc639 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:52:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8c4c9334-a8ef-4a2c-95ab-b9ec197cc639 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.361s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:52:52 user nova-compute[75341]: INFO nova.scheduler.client.report [None req-8c4c9334-a8ef-4a2c-95ab-b9ec197cc639 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Deleted allocations for instance 5950ba70-e7c0-4b5f-839c-569e0a27b625
Nov 14 23:52:52 user nova-compute[75341]: DEBUG nova.compute.manager [req-725b12fd-3f96-4fd9-8eb4-f44d027b268e req-b641d6ed-6fef-480e-9af2-3d9180ad67e5 service nova] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Received event network-vif-plugged-6df0f48f-1a94-42ec-b540-0aee55dc6b70 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:52:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-725b12fd-3f96-4fd9-8eb4-f44d027b268e req-b641d6ed-6fef-480e-9af2-3d9180ad67e5 service nova] Acquiring lock "5950ba70-e7c0-4b5f-839c-569e0a27b625-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:52:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-725b12fd-3f96-4fd9-8eb4-f44d027b268e req-b641d6ed-6fef-480e-9af2-3d9180ad67e5 service nova] Lock "5950ba70-e7c0-4b5f-839c-569e0a27b625-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:52:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-725b12fd-3f96-4fd9-8eb4-f44d027b268e req-b641d6ed-6fef-480e-9af2-3d9180ad67e5 service nova] Lock "5950ba70-e7c0-4b5f-839c-569e0a27b625-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:52:52 user nova-compute[75341]: DEBUG nova.compute.manager [req-725b12fd-3f96-4fd9-8eb4-f44d027b268e req-b641d6ed-6fef-480e-9af2-3d9180ad67e5 service nova] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] No waiting events found dispatching network-vif-plugged-6df0f48f-1a94-42ec-b540-0aee55dc6b70 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:52:52 user nova-compute[75341]: WARNING nova.compute.manager [req-725b12fd-3f96-4fd9-8eb4-f44d027b268e req-b641d6ed-6fef-480e-9af2-3d9180ad67e5 service nova] [instance: 5950ba70-e7c0-4b5f-839c-569e0a27b625] Received unexpected event network-vif-plugged-6df0f48f-1a94-42ec-b540-0aee55dc6b70 for instance with vm_state deleted and task_state None.
Nov 14 23:52:52 user nova-compute[75341]: DEBUG nova.compute.manager [req-725b12fd-3f96-4fd9-8eb4-f44d027b268e req-b641d6ed-6fef-480e-9af2-3d9180ad67e5 service nova] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Received event network-changed-8989d87f-615c-4cfe-9d3d-6c012e3fdf48 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:52:52 user nova-compute[75341]: DEBUG nova.compute.manager [req-725b12fd-3f96-4fd9-8eb4-f44d027b268e req-b641d6ed-6fef-480e-9af2-3d9180ad67e5 service nova] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Refreshing instance network info cache due to event network-changed-8989d87f-615c-4cfe-9d3d-6c012e3fdf48. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:52:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-725b12fd-3f96-4fd9-8eb4-f44d027b268e req-b641d6ed-6fef-480e-9af2-3d9180ad67e5 service nova] Acquiring lock "refresh_cache-c62455e6-61af-45b1-899f-bad37dc57b22" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:52:52 user nova-compute[75341]: DEBUG nova.network.neutron [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Updating instance_info_cache with network_info: [{"id": "8989d87f-615c-4cfe-9d3d-6c012e3fdf48", "address": "fa:16:3e:2d:04:44", "network": {"id": "fcd22da6-016e-4872-a84c-4d82601c48d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-550677181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44bb8b1415c14bb59c4c35cc2b830875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8989d87f-61", "ovs_interfaceid": "8989d87f-615c-4cfe-9d3d-6c012e3fdf48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:52:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8c4c9334-a8ef-4a2c-95ab-b9ec197cc639 tempest-AttachVolumeShelveTestJSON-946394493 tempest-AttachVolumeShelveTestJSON-946394493-project-member] Lock "5950ba70-e7c0-4b5f-839c-569e0a27b625" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.461s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:52:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Releasing lock "refresh_cache-c62455e6-61af-45b1-899f-bad37dc57b22" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:52:52 user nova-compute[75341]: DEBUG nova.compute.manager [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Instance network_info: |[{"id": "8989d87f-615c-4cfe-9d3d-6c012e3fdf48", "address": "fa:16:3e:2d:04:44", "network": {"id": "fcd22da6-016e-4872-a84c-4d82601c48d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-550677181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44bb8b1415c14bb59c4c35cc2b830875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8989d87f-61", "ovs_interfaceid": "8989d87f-615c-4cfe-9d3d-6c012e3fdf48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 23:52:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-725b12fd-3f96-4fd9-8eb4-f44d027b268e req-b641d6ed-6fef-480e-9af2-3d9180ad67e5 service nova] Acquired lock "refresh_cache-c62455e6-61af-45b1-899f-bad37dc57b22" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:52:52 user nova-compute[75341]: DEBUG nova.network.neutron [req-725b12fd-3f96-4fd9-8eb4-f44d027b268e req-b641d6ed-6fef-480e-9af2-3d9180ad67e5 service nova] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Refreshing network info cache for port 8989d87f-615c-4cfe-9d3d-6c012e3fdf48 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:52:52 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Start _get_guest_xml network_info=[{"id": "8989d87f-615c-4cfe-9d3d-6c012e3fdf48", "address": "fa:16:3e:2d:04:44", "network": {"id": "fcd22da6-016e-4872-a84c-4d82601c48d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-550677181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44bb8b1415c14bb59c4c35cc2b830875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8989d87f-61", "ovs_interfaceid": "8989d87f-615c-4cfe-9d3d-6c012e3fdf48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encrypted': False, 'image_id': 'e46abb82-b810-490e-a8a1-ccdc5fa1a796'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 23:52:52 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:52:52 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:52:52 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 23:52:52 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 23:52:52 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 23:52:52 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 23:52:52 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 23:52:52 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 23:52:52 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 23:52:52 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 23:52:52 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 23:52:52 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 23:52:52 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 23:52:52 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 23:52:52 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 23:52:52 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 23:52:52 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 23:52:52 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 23:52:52 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:52:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1462035552',display_name='tempest-ServerRescueNegativeTestJSON-server-1462035552',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1462035552',id=38,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNs4W2OktPVBOZWeaKzDzmXrUWs93ClVQv27cek+6cQRNCqjAwvdx6Y93/zXFXRb3ClOs1rK9E9IRD2QFgmNu1bmmVuar6AjgojHBaCfi643v9btLecoeDIfapdQ5VGE1g==',key_name='tempest-keypair-1814364720',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44bb8b1415c14bb59c4c35cc2b830875',ramdisk_id='',reservation_id='r-zjkidlzv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1956631656',owner_user_name='tempest-ServerRescueNegativeTestJSON-1956631656-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:52:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c49a358e2f942f3a9777910ee755575',uuid=c62455e6-61af-45b1-899f-bad37dc57b22,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8989d87f-615c-4cfe-9d3d-6c012e3fdf48", "address": "fa:16:3e:2d:04:44", "network": {"id": "fcd22da6-016e-4872-a84c-4d82601c48d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-550677181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44bb8b1415c14bb59c4c35cc2b830875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8989d87f-61", "ovs_interfaceid": "8989d87f-615c-4cfe-9d3d-6c012e3fdf48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:52:52 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Converting VIF {"id": "8989d87f-615c-4cfe-9d3d-6c012e3fdf48", "address": "fa:16:3e:2d:04:44", "network": {"id": "fcd22da6-016e-4872-a84c-4d82601c48d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-550677181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44bb8b1415c14bb59c4c35cc2b830875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8989d87f-61", "ovs_interfaceid": "8989d87f-615c-4cfe-9d3d-6c012e3fdf48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:52:52 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:04:44,bridge_name='br-int',has_traffic_filtering=True,id=8989d87f-615c-4cfe-9d3d-6c012e3fdf48,network=Network(fcd22da6-016e-4872-a84c-4d82601c48d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8989d87f-61') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:52:52 user nova-compute[75341]: DEBUG nova.objects.instance [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lazy-loading 'pci_devices' on Instance uuid c62455e6-61af-45b1-899f-bad37dc57b22 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:52:52 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] End _get_guest_xml xml=<domain type="kvm">
Nov 14 23:52:52 user nova-compute[75341]:   <uuid>c62455e6-61af-45b1-899f-bad37dc57b22</uuid>
Nov 14 23:52:52 user nova-compute[75341]:   <name>instance-00000026</name>
Nov 14 23:52:52 user nova-compute[75341]:   <memory>524288</memory>
Nov 14 23:52:52 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 14 23:52:52 user nova-compute[75341]:   <metadata>
Nov 14 23:52:52 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 23:52:52 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 14 23:52:52 user nova-compute[75341]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1462035552</nova:name>
Nov 14 23:52:52 user nova-compute[75341]:       <nova:creationTime>2023-11-14 23:52:52</nova:creationTime>
Nov 14 23:52:52 user nova-compute[75341]:       <nova:flavor name="m1.tiny">
Nov 14 23:52:52 user nova-compute[75341]:         <nova:memory>512</nova:memory>
Nov 14 23:52:52 user nova-compute[75341]:         <nova:disk>1</nova:disk>
Nov 14 23:52:52 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 14 23:52:52 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 23:52:52 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 14 23:52:52 user nova-compute[75341]:       </nova:flavor>
Nov 14 23:52:52 user nova-compute[75341]:       <nova:owner>
Nov 14 23:52:52 user nova-compute[75341]:         <nova:user uuid="3c49a358e2f942f3a9777910ee755575">tempest-ServerRescueNegativeTestJSON-1956631656-project-member</nova:user>
Nov 14 23:52:52 user nova-compute[75341]:         <nova:project uuid="44bb8b1415c14bb59c4c35cc2b830875">tempest-ServerRescueNegativeTestJSON-1956631656</nova:project>
Nov 14 23:52:52 user nova-compute[75341]:       </nova:owner>
Nov 14 23:52:52 user nova-compute[75341]:       <nova:root type="image" uuid="e46abb82-b810-490e-a8a1-ccdc5fa1a796"/>
Nov 14 23:52:52 user nova-compute[75341]:       <nova:ports>
Nov 14 23:52:52 user nova-compute[75341]:         <nova:port uuid="8989d87f-615c-4cfe-9d3d-6c012e3fdf48">
Nov 14 23:52:52 user nova-compute[75341]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 23:52:52 user nova-compute[75341]:         </nova:port>
Nov 14 23:52:52 user nova-compute[75341]:       </nova:ports>
Nov 14 23:52:52 user nova-compute[75341]:     </nova:instance>
Nov 14 23:52:52 user nova-compute[75341]:   </metadata>
Nov 14 23:52:52 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 14 23:52:52 user nova-compute[75341]:     <system>
Nov 14 23:52:52 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 23:52:52 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 14 23:52:52 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 14 23:52:52 user nova-compute[75341]:       <entry name="serial">c62455e6-61af-45b1-899f-bad37dc57b22</entry>
Nov 14 23:52:52 user nova-compute[75341]:       <entry name="uuid">c62455e6-61af-45b1-899f-bad37dc57b22</entry>
Nov 14 23:52:52 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 14 23:52:52 user nova-compute[75341]:     </system>
Nov 14 23:52:52 user nova-compute[75341]:   </sysinfo>
Nov 14 23:52:52 user nova-compute[75341]:   <os>
Nov 14 23:52:52 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 23:52:52 user nova-compute[75341]:     <boot dev="hd"/>
Nov 14 23:52:52 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 14 23:52:52 user nova-compute[75341]:   </os>
Nov 14 23:52:52 user nova-compute[75341]:   <features>
Nov 14 23:52:52 user nova-compute[75341]:     <acpi/>
Nov 14 23:52:52 user nova-compute[75341]:     <apic/>
Nov 14 23:52:52 user nova-compute[75341]:     <vmcoreinfo/>
Nov 14 23:52:52 user nova-compute[75341]:   </features>
Nov 14 23:52:52 user nova-compute[75341]:   <clock offset="utc">
Nov 14 23:52:52 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 23:52:52 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 23:52:52 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 14 23:52:52 user nova-compute[75341]:   </clock>
Nov 14 23:52:52 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 14 23:52:52 user nova-compute[75341]:     <model>Nehalem</model>
Nov 14 23:52:52 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 23:52:52 user nova-compute[75341]:   </cpu>
Nov 14 23:52:52 user nova-compute[75341]:   <devices>
Nov 14 23:52:52 user nova-compute[75341]:     <disk type="file" device="disk">
Nov 14 23:52:52 user nova-compute[75341]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 23:52:52 user nova-compute[75341]:       <source file="/opt/stack/data/nova/instances/c62455e6-61af-45b1-899f-bad37dc57b22/disk"/>
Nov 14 23:52:52 user nova-compute[75341]:       <target dev="vda" bus="virtio"/>
Nov 14 23:52:52 user nova-compute[75341]:     </disk>
Nov 14 23:52:52 user nova-compute[75341]:     <interface type="ethernet">
Nov 14 23:52:52 user nova-compute[75341]:       <mac address="fa:16:3e:2d:04:44"/>
Nov 14 23:52:52 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:52:52 user nova-compute[75341]:       <mtu size="1442"/>
Nov 14 23:52:52 user nova-compute[75341]:       <target dev="tap8989d87f-61"/>
Nov 14 23:52:52 user nova-compute[75341]:     </interface>
Nov 14 23:52:52 user nova-compute[75341]:     <serial type="pty">
Nov 14 23:52:52 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/c62455e6-61af-45b1-899f-bad37dc57b22/console.log" append="off"/>
Nov 14 23:52:52 user nova-compute[75341]:     </serial>
Nov 14 23:52:52 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 23:52:52 user nova-compute[75341]:     <video>
Nov 14 23:52:52 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:52:52 user nova-compute[75341]:     </video>
Nov 14 23:52:52 user nova-compute[75341]:     <rng model="virtio">
Nov 14 23:52:52 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 14 23:52:52 user nova-compute[75341]:     </rng>
Nov 14 23:52:52 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 14 23:52:52 user nova-compute[75341]:     <memballoon model="virtio">
Nov 14 23:52:52 user nova-compute[75341]:       <stats period="10"/>
Nov 14 23:52:52 user nova-compute[75341]:     </memballoon>
Nov 14 23:52:52 user nova-compute[75341]:   </devices>
Nov 14 23:52:52 user nova-compute[75341]: </domain>
Nov 14 23:52:52 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 23:52:52 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:52:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1462035552',display_name='tempest-ServerRescueNegativeTestJSON-server-1462035552',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1462035552',id=38,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNs4W2OktPVBOZWeaKzDzmXrUWs93ClVQv27cek+6cQRNCqjAwvdx6Y93/zXFXRb3ClOs1rK9E9IRD2QFgmNu1bmmVuar6AjgojHBaCfi643v9btLecoeDIfapdQ5VGE1g==',key_name='tempest-keypair-1814364720',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44bb8b1415c14bb59c4c35cc2b830875',ramdisk_id='',reservation_id='r-zjkidlzv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1956631656',owner_user_name='tempest-ServerRescueNegativeTestJSON-1956631656-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:52:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c49a358e2f942f3a9777910ee755575',uuid=c62455e6-61af-45b1-899f-bad37dc57b22,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8989d87f-615c-4cfe-9d3d-6c012e3fdf48", "address": "fa:16:3e:2d:04:44", "network": {"id": "fcd22da6-016e-4872-a84c-4d82601c48d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-550677181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44bb8b1415c14bb59c4c35cc2b830875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8989d87f-61", "ovs_interfaceid": "8989d87f-615c-4cfe-9d3d-6c012e3fdf48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 23:52:52 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Converting VIF {"id": "8989d87f-615c-4cfe-9d3d-6c012e3fdf48", "address": "fa:16:3e:2d:04:44", "network": {"id": "fcd22da6-016e-4872-a84c-4d82601c48d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-550677181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44bb8b1415c14bb59c4c35cc2b830875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8989d87f-61", "ovs_interfaceid": "8989d87f-615c-4cfe-9d3d-6c012e3fdf48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:52:52 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:04:44,bridge_name='br-int',has_traffic_filtering=True,id=8989d87f-615c-4cfe-9d3d-6c012e3fdf48,network=Network(fcd22da6-016e-4872-a84c-4d82601c48d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8989d87f-61') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:52:52 user nova-compute[75341]: DEBUG os_vif [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:04:44,bridge_name='br-int',has_traffic_filtering=True,id=8989d87f-615c-4cfe-9d3d-6c012e3fdf48,network=Network(fcd22da6-016e-4872-a84c-4d82601c48d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8989d87f-61') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 23:52:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:52:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 23:52:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd55a8172-d0f5-5ea0-9506-e1a096586363', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:52:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:52:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8989d87f-61, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:52:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8989d87f-61, col_values=(('qos', UUID('37bf4bf4-23e4-4a05-9425-768ba4c13030')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:52:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8989d87f-61, col_values=(('external_ids', {'iface-id': '8989d87f-615c-4cfe-9d3d-6c012e3fdf48', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:04:44', 'vm-uuid': 'c62455e6-61af-45b1-899f-bad37dc57b22'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:52:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:52:52 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:52:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:52 user nova-compute[75341]: INFO os_vif [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:04:44,bridge_name='br-int',has_traffic_filtering=True,id=8989d87f-615c-4cfe-9d3d-6c012e3fdf48,network=Network(fcd22da6-016e-4872-a84c-4d82601c48d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8989d87f-61')
Nov 14 23:52:53 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:52:53 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] No VIF found with MAC fa:16:3e:2d:04:44, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:52:53 user nova-compute[75341]: DEBUG nova.network.neutron [req-725b12fd-3f96-4fd9-8eb4-f44d027b268e req-b641d6ed-6fef-480e-9af2-3d9180ad67e5 service nova] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Updated VIF entry in instance network info cache for port 8989d87f-615c-4cfe-9d3d-6c012e3fdf48. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:52:53 user nova-compute[75341]: DEBUG nova.network.neutron [req-725b12fd-3f96-4fd9-8eb4-f44d027b268e req-b641d6ed-6fef-480e-9af2-3d9180ad67e5 service nova] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Updating instance_info_cache with network_info: [{"id": "8989d87f-615c-4cfe-9d3d-6c012e3fdf48", "address": "fa:16:3e:2d:04:44", "network": {"id": "fcd22da6-016e-4872-a84c-4d82601c48d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-550677181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44bb8b1415c14bb59c4c35cc2b830875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8989d87f-61", "ovs_interfaceid": "8989d87f-615c-4cfe-9d3d-6c012e3fdf48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:52:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-725b12fd-3f96-4fd9-8eb4-f44d027b268e req-b641d6ed-6fef-480e-9af2-3d9180ad67e5 service nova] Releasing lock "refresh_cache-c62455e6-61af-45b1-899f-bad37dc57b22" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:52:53 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Creating instance directory {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 23:52:53 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Creating image(s)
Nov 14 23:52:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Acquiring lock "/opt/stack/data/nova/instances/12c9a7d6-03a5-4fd2-9082-c68758f1542f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:52:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "/opt/stack/data/nova/instances/12c9a7d6-03a5-4fd2-9082-c68758f1542f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:52:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "/opt/stack/data/nova/instances/12c9a7d6-03a5-4fd2-9082-c68758f1542f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:52:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:52:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.169s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:52:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Acquiring lock "4754efee9a6d73d3647f2add2cfe86c291949740" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:52:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:52:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:52:53 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:52:53 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:52:53 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75341) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.169s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/12c9a7d6-03a5-4fd2-9082-c68758f1542f/disk 1073741824 {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/12c9a7d6-03a5-4fd2-9082-c68758f1542f/disk 1073741824" returned: 0 in 0.082s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.181s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Checking if we can resize image /opt/stack/data/nova/instances/12c9a7d6-03a5-4fd2-9082-c68758f1542f/disk. size=1073741824 {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c9a7d6-03a5-4fd2-9082-c68758f1542f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c9a7d6-03a5-4fd2-9082-c68758f1542f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Cannot resize image /opt/stack/data/nova/instances/12c9a7d6-03a5-4fd2-9082-c68758f1542f/disk to a smaller size. {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Created local disks {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Ensure instance console log exists: /opt/stack/data/nova/instances/12c9a7d6-03a5-4fd2-9082-c68758f1542f/console.log {{(pid=75341) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Start _get_guest_xml network_info=[{"id": "1def089a-31ed-4ac4-be68-4050fa9c9fe6", "address": "fa:16:3e:3c:51:b6", "network": {"id": "d86a8e7f-6658-4994-9a13-eb3163bd3865", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-635863702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c69a942b4f4b97a1a3152dea86c7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1def089a-31", "ovs_interfaceid": "1def089a-31ed-4ac4-be68-4050fa9c9fe6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encrypted': False, 'image_id': 'e46abb82-b810-490e-a8a1-ccdc5fa1a796'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': None, 'attachment_id': 'b7818750-4b6a-4033-b411-4d8e19223fe3', 'mount_device': '/dev/vdb', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WYmGxpur', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '12c9a7d6-03a5-4fd2-9082-c68758f1542f', 'attached_at': '', 'detached_at': '', 'volume_id': '9efe345e-fc79-46f6-973c-ed817a24dd05', 'serial': '9efe345e-fc79-46f6-973c-ed817a24dd05'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 23:52:54 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 14 23:52:54 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 14 23:52:54 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG nova.objects.instance [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lazy-loading 'vcpu_model' on Instance uuid 12c9a7d6-03a5-4fd2-9082-c68758f1542f {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG nova.compute.manager [req-286fd58b-c8b6-4dbd-82c1-5622ee634370 req-023a917e-7cfd-4d71-bfd9-99f062afd501 service nova] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Received event network-vif-plugged-8989d87f-615c-4cfe-9d3d-6c012e3fdf48 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-286fd58b-c8b6-4dbd-82c1-5622ee634370 req-023a917e-7cfd-4d71-bfd9-99f062afd501 service nova] Acquiring lock "c62455e6-61af-45b1-899f-bad37dc57b22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-286fd58b-c8b6-4dbd-82c1-5622ee634370 req-023a917e-7cfd-4d71-bfd9-99f062afd501 service nova] Lock "c62455e6-61af-45b1-899f-bad37dc57b22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-286fd58b-c8b6-4dbd-82c1-5622ee634370 req-023a917e-7cfd-4d71-bfd9-99f062afd501 service nova] Lock "c62455e6-61af-45b1-899f-bad37dc57b22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG nova.compute.manager [req-286fd58b-c8b6-4dbd-82c1-5622ee634370 req-023a917e-7cfd-4d71-bfd9-99f062afd501 service nova] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] No waiting events found dispatching network-vif-plugged-8989d87f-615c-4cfe-9d3d-6c012e3fdf48 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:52:54 user nova-compute[75341]: WARNING nova.compute.manager [req-286fd58b-c8b6-4dbd-82c1-5622ee634370 req-023a917e-7cfd-4d71-bfd9-99f062afd501 service nova] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Received unexpected event network-vif-plugged-8989d87f-615c-4cfe-9d3d-6c012e3fdf48 for instance with vm_state building and task_state spawning.
Nov 14 23:52:54 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Calling os-brick to attach iSCSI Volume {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WYmGxpur', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:52:54 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 23:52:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:52:54 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 23:52:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:52:54 user nova-compute[75341]: INFO os_brick.initiator.connectors.iscsi [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 23:52:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 -p 172.16.0.220:3260 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c691531-024b-4e2e-b31e-9d730901e49f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 23:52:54 user nova-compute[75341]:  {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 -p 172.16.0.220:3260 --interface default --op new {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[81149479-16fb-4c42-88d8-bfb54af57a85]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05] added\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05] added
Nov 14 23:52:54 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2e85a5-9c3f-4c0c-8cb3-db833737d0f9]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[581bfe71-62a2-4591-980b-d9a61cb109ee]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WYmGxpur {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WYmGxpur" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[e879c50e-2828-4870-8c1e-0dbaf58c0b33]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WYmGxpur'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b7315b-ffcf-488b-b7f0-d9ae80499e74]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[2657a3ec-cba8-4464-b561-5582c29ae7c1]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)
Nov 14 23:52:54 user nova-compute[75341]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)
Nov 14 23:52:54 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)
Nov 14 23:52:54 user nova-compute[75341]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)
Nov 14 23:52:54 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 -p 172.16.0.220:3260 --login {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe6aad6-3d4e-479b-918c-a57edb26e8fd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05, portal: 172.16.0.220,3260]
Nov 14 23:52:54 user nova-compute[75341]: Login to [iface: default, target: iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05, portal: 172.16.0.220,3260] successful.
Nov 14 23:52:54 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e3d8e4-e3bd-48c8-9ea5-0b720a32ca4e]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cecddb7-0283-4f49-953b-0c333c4b7f43]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)
Nov 14 23:52:54 user nova-compute[75341]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)
Nov 14 23:52:54 user nova-compute[75341]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)
Nov 14 23:52:54 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)
Nov 14 23:52:54 user nova-compute[75341]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)
Nov 14 23:52:54 user nova-compute[75341]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)
Nov 14 23:52:54 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Connected to 172.16.0.220:3260 {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] HCTL ('33', '-', '-', 0) found on session 38 with lun 0 {{(pid=75341) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75341) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[37eb1358-b1eb-4ae0-a822-249e56368645]: (4, ('- - 0', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 23:52:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WYmGxpur', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 23:52:55 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:52:55 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Starting heal instance info cache {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 23:52:55 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:52:55 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23165613736633131', 'path': '/dev/sdb'} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:52:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165613736633131', 'path': '/dev/sdb'} {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 23:52:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T23:50:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-354068924',display_name='tempest-ServerActionsTestOtherA-server-270852724',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-354068924',id=34,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5He922s8rk+PmMGVsYQr5cOK2M7RyE6pRHPukFN7KTwHIYhqpey5pP25XxRxS64/nnTZtZU0s7MKkpDVnG7pj8Bq4MwPLqGCEvlosZZWTgxDQbmYxiYN/iVtJlhcHp1A==',key_name='tempest-keypair-1680109364',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:50:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f4c69a942b4f4b97a1a3152dea86c7fb',ramdisk_id='',reservation_id='r-hde50h2m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1796396043',owner_user_name='tempest-ServerActionsTestOtherA-1796396043-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:52:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='442aae0161f347d0a79b168a1b60286a',uuid=12c9a7d6-03a5-4fd2-9082-c68758f1542f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1def089a-31ed-4ac4-be68-4050fa9c9fe6", "address": "fa:16:3e:3c:51:b6", "network": {"id": "d86a8e7f-6658-4994-9a13-eb3163bd3865", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-635863702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c69a942b4f4b97a1a3152dea86c7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1def089a-31", "ovs_interfaceid": "1def089a-31ed-4ac4-be68-4050fa9c9fe6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:52:55 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Converting VIF {"id": "1def089a-31ed-4ac4-be68-4050fa9c9fe6", "address": "fa:16:3e:3c:51:b6", "network": {"id": "d86a8e7f-6658-4994-9a13-eb3163bd3865", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-635863702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c69a942b4f4b97a1a3152dea86c7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1def089a-31", "ovs_interfaceid": "1def089a-31ed-4ac4-be68-4050fa9c9fe6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:52:55 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3c:51:b6,bridge_name='br-int',has_traffic_filtering=True,id=1def089a-31ed-4ac4-be68-4050fa9c9fe6,network=Network(d86a8e7f-6658-4994-9a13-eb3163bd3865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1def089a-31') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:52:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] End _get_guest_xml xml=<domain type="kvm">
Nov 14 23:52:55 user nova-compute[75341]:   <uuid>12c9a7d6-03a5-4fd2-9082-c68758f1542f</uuid>
Nov 14 23:52:55 user nova-compute[75341]:   <name>instance-00000022</name>
Nov 14 23:52:55 user nova-compute[75341]:   <memory>524288</memory>
Nov 14 23:52:55 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 14 23:52:55 user nova-compute[75341]:   <metadata>
Nov 14 23:52:55 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 23:52:55 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 14 23:52:55 user nova-compute[75341]:       <nova:name>tempest-ServerActionsTestOtherA-server-270852724</nova:name>
Nov 14 23:52:55 user nova-compute[75341]:       <nova:creationTime>2023-11-14 23:52:54</nova:creationTime>
Nov 14 23:52:55 user nova-compute[75341]:       <nova:flavor name="m1.tiny">
Nov 14 23:52:55 user nova-compute[75341]:         <nova:memory>512</nova:memory>
Nov 14 23:52:55 user nova-compute[75341]:         <nova:disk>1</nova:disk>
Nov 14 23:52:55 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 14 23:52:55 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 23:52:55 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 14 23:52:55 user nova-compute[75341]:       </nova:flavor>
Nov 14 23:52:55 user nova-compute[75341]:       <nova:owner>
Nov 14 23:52:55 user nova-compute[75341]:         <nova:user uuid="442aae0161f347d0a79b168a1b60286a">tempest-ServerActionsTestOtherA-1796396043-project-member</nova:user>
Nov 14 23:52:55 user nova-compute[75341]:         <nova:project uuid="f4c69a942b4f4b97a1a3152dea86c7fb">tempest-ServerActionsTestOtherA-1796396043</nova:project>
Nov 14 23:52:55 user nova-compute[75341]:       </nova:owner>
Nov 14 23:52:55 user nova-compute[75341]:       <nova:root type="image" uuid="e46abb82-b810-490e-a8a1-ccdc5fa1a796"/>
Nov 14 23:52:55 user nova-compute[75341]:       <nova:ports>
Nov 14 23:52:55 user nova-compute[75341]:         <nova:port uuid="1def089a-31ed-4ac4-be68-4050fa9c9fe6">
Nov 14 23:52:55 user nova-compute[75341]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 23:52:55 user nova-compute[75341]:         </nova:port>
Nov 14 23:52:55 user nova-compute[75341]:       </nova:ports>
Nov 14 23:52:55 user nova-compute[75341]:     </nova:instance>
Nov 14 23:52:55 user nova-compute[75341]:   </metadata>
Nov 14 23:52:55 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 14 23:52:55 user nova-compute[75341]:     <system>
Nov 14 23:52:55 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 23:52:55 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 14 23:52:55 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 14 23:52:55 user nova-compute[75341]:       <entry name="serial">12c9a7d6-03a5-4fd2-9082-c68758f1542f</entry>
Nov 14 23:52:55 user nova-compute[75341]:       <entry name="uuid">12c9a7d6-03a5-4fd2-9082-c68758f1542f</entry>
Nov 14 23:52:55 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 14 23:52:55 user nova-compute[75341]:     </system>
Nov 14 23:52:55 user nova-compute[75341]:   </sysinfo>
Nov 14 23:52:55 user nova-compute[75341]:   <os>
Nov 14 23:52:55 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 23:52:55 user nova-compute[75341]:     <boot dev="hd"/>
Nov 14 23:52:55 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 14 23:52:55 user nova-compute[75341]:   </os>
Nov 14 23:52:55 user nova-compute[75341]:   <features>
Nov 14 23:52:55 user nova-compute[75341]:     <acpi/>
Nov 14 23:52:55 user nova-compute[75341]:     <apic/>
Nov 14 23:52:55 user nova-compute[75341]:     <vmcoreinfo/>
Nov 14 23:52:55 user nova-compute[75341]:   </features>
Nov 14 23:52:55 user nova-compute[75341]:   <clock offset="utc">
Nov 14 23:52:55 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 23:52:55 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 23:52:55 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 14 23:52:55 user nova-compute[75341]:   </clock>
Nov 14 23:52:55 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 14 23:52:55 user nova-compute[75341]:     <model>Nehalem</model>
Nov 14 23:52:55 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 23:52:55 user nova-compute[75341]:   </cpu>
Nov 14 23:52:55 user nova-compute[75341]:   <devices>
Nov 14 23:52:55 user nova-compute[75341]:     <disk type="file" device="disk">
Nov 14 23:52:55 user nova-compute[75341]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 23:52:55 user nova-compute[75341]:       <source file="/opt/stack/data/nova/instances/12c9a7d6-03a5-4fd2-9082-c68758f1542f/disk"/>
Nov 14 23:52:55 user nova-compute[75341]:       <target dev="vda" bus="virtio"/>
Nov 14 23:52:55 user nova-compute[75341]:     </disk>
Nov 14 23:52:55 user nova-compute[75341]:     <disk type="block" device="disk">
Nov 14 23:52:55 user nova-compute[75341]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:52:55 user nova-compute[75341]:       <source dev="/dev/sdb"/>
Nov 14 23:52:55 user nova-compute[75341]:       <target dev="vdb" bus="virtio"/>
Nov 14 23:52:55 user nova-compute[75341]:       <serial>9efe345e-fc79-46f6-973c-ed817a24dd05</serial>
Nov 14 23:52:55 user nova-compute[75341]:     </disk>
Nov 14 23:52:55 user nova-compute[75341]:     <interface type="ethernet">
Nov 14 23:52:55 user nova-compute[75341]:       <mac address="fa:16:3e:3c:51:b6"/>
Nov 14 23:52:55 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:52:55 user nova-compute[75341]:       <mtu size="1442"/>
Nov 14 23:52:55 user nova-compute[75341]:       <target dev="tap1def089a-31"/>
Nov 14 23:52:55 user nova-compute[75341]:     </interface>
Nov 14 23:52:55 user nova-compute[75341]:     <serial type="pty">
Nov 14 23:52:55 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/12c9a7d6-03a5-4fd2-9082-c68758f1542f/console.log" append="off"/>
Nov 14 23:52:55 user nova-compute[75341]:     </serial>
Nov 14 23:52:55 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 23:52:55 user nova-compute[75341]:     <video>
Nov 14 23:52:55 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:52:55 user nova-compute[75341]:     </video>
Nov 14 23:52:55 user nova-compute[75341]:     <rng model="virtio">
Nov 14 23:52:55 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 14 23:52:55 user nova-compute[75341]:     </rng>
Nov 14 23:52:55 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 14 23:52:55 user nova-compute[75341]:     <memballoon model="virtio">
Nov 14 23:52:55 user nova-compute[75341]:       <stats period="10"/>
Nov 14 23:52:55 user nova-compute[75341]:     </memballoon>
Nov 14 23:52:55 user nova-compute[75341]:   </devices>
Nov 14 23:52:55 user nova-compute[75341]: </domain>
Nov 14 23:52:55 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 23:52:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T23:50:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-354068924',display_name='tempest-ServerActionsTestOtherA-server-270852724',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-354068924',id=34,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5He922s8rk+PmMGVsYQr5cOK2M7RyE6pRHPukFN7KTwHIYhqpey5pP25XxRxS64/nnTZtZU0s7MKkpDVnG7pj8Bq4MwPLqGCEvlosZZWTgxDQbmYxiYN/iVtJlhcHp1A==',key_name='tempest-keypair-1680109364',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:50:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f4c69a942b4f4b97a1a3152dea86c7fb',ramdisk_id='',reservation_id='r-hde50h2m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1796396043',owner_user_name='tempest-ServerActionsTestOtherA-1796396043-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:52:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='442aae0161f347d0a79b168a1b60286a',uuid=12c9a7d6-03a5-4fd2-9082-c68758f1542f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1def089a-31ed-4ac4-be68-4050fa9c9fe6", "address": "fa:16:3e:3c:51:b6", "network": {"id": "d86a8e7f-6658-4994-9a13-eb3163bd3865", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-635863702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c69a942b4f4b97a1a3152dea86c7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1def089a-31", "ovs_interfaceid": "1def089a-31ed-4ac4-be68-4050fa9c9fe6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 23:52:55 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Converting VIF {"id": "1def089a-31ed-4ac4-be68-4050fa9c9fe6", "address": "fa:16:3e:3c:51:b6", "network": {"id": "d86a8e7f-6658-4994-9a13-eb3163bd3865", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-635863702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c69a942b4f4b97a1a3152dea86c7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1def089a-31", "ovs_interfaceid": "1def089a-31ed-4ac4-be68-4050fa9c9fe6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:52:55 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3c:51:b6,bridge_name='br-int',has_traffic_filtering=True,id=1def089a-31ed-4ac4-be68-4050fa9c9fe6,network=Network(d86a8e7f-6658-4994-9a13-eb3163bd3865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1def089a-31') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:52:55 user nova-compute[75341]: DEBUG os_vif [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:51:b6,bridge_name='br-int',has_traffic_filtering=True,id=1def089a-31ed-4ac4-be68-4050fa9c9fe6,network=Network(d86a8e7f-6658-4994-9a13-eb3163bd3865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1def089a-31') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 23:52:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:52:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 23:52:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9606f2fe-d5b3-52bc-9133-fe1bec2b32b7', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:52:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:52:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1def089a-31, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:52:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1def089a-31, col_values=(('qos', UUID('7065acaa-c7e0-471c-8712-c5269ca15a6a')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:52:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1def089a-31, col_values=(('external_ids', {'iface-id': '1def089a-31ed-4ac4-be68-4050fa9c9fe6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:51:b6', 'vm-uuid': '12c9a7d6-03a5-4fd2-9082-c68758f1542f'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:52:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:52:56 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "refresh_cache-6382e432-838f-4d89-a743-cbaa37f50ab5" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:52:56 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquired lock "refresh_cache-6382e432-838f-4d89-a743-cbaa37f50ab5" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:52:56 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Forcefully refreshing network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 23:52:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:56 user nova-compute[75341]: INFO os_vif [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:51:b6,bridge_name='br-int',has_traffic_filtering=True,id=1def089a-31ed-4ac4-be68-4050fa9c9fe6,network=Network(d86a8e7f-6658-4994-9a13-eb3163bd3865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1def089a-31')
Nov 14 23:52:56 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:52:56 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:52:56 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] No VIF found with MAC fa:16:3e:3c:51:b6, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:52:56 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Updating instance_info_cache with network_info: [{"id": "61a9a4a7-170b-4ed9-8d52-8cb4defd1cae", "address": "fa:16:3e:0c:42:07", "network": {"id": "fcd22da6-016e-4872-a84c-4d82601c48d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-550677181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44bb8b1415c14bb59c4c35cc2b830875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61a9a4a7-17", "ovs_interfaceid": "61a9a4a7-170b-4ed9-8d52-8cb4defd1cae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:52:56 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Releasing lock "refresh_cache-6382e432-838f-4d89-a743-cbaa37f50ab5" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:52:56 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Updated the network info_cache for instance {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 23:52:56 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:52:56 user nova-compute[75341]: DEBUG nova.compute.manager [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Instance event wait completed in 0 seconds for  {{(pid=75341) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 23:52:56 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Guest created on hypervisor {{(pid=75341) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 23:52:56 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Instance spawned successfully.
Nov 14 23:52:56 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 23:52:56 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Found default for hw_cdrom_bus of ide {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:52:56 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Found default for hw_disk_bus of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:52:56 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Found default for hw_input_bus of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:52:56 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Found default for hw_pointer_model of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:52:56 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Found default for hw_video_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:52:56 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Found default for hw_vif_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:52:56 user nova-compute[75341]: INFO nova.compute.manager [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Took 5.49 seconds to spawn the instance on the hypervisor.
Nov 14 23:52:56 user nova-compute[75341]: DEBUG nova.compute.manager [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 23:52:56 user nova-compute[75341]: DEBUG nova.compute.manager [req-b9a47a88-6d64-4ac9-89ed-a8071500b557 req-2573b4dd-808c-4e56-872e-36d0d7ddfdc1 service nova] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Received event network-vif-plugged-8989d87f-615c-4cfe-9d3d-6c012e3fdf48 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:52:56 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-b9a47a88-6d64-4ac9-89ed-a8071500b557 req-2573b4dd-808c-4e56-872e-36d0d7ddfdc1 service nova] Acquiring lock "c62455e6-61af-45b1-899f-bad37dc57b22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:52:56 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-b9a47a88-6d64-4ac9-89ed-a8071500b557 req-2573b4dd-808c-4e56-872e-36d0d7ddfdc1 service nova] Lock "c62455e6-61af-45b1-899f-bad37dc57b22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:52:56 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-b9a47a88-6d64-4ac9-89ed-a8071500b557 req-2573b4dd-808c-4e56-872e-36d0d7ddfdc1 service nova] Lock "c62455e6-61af-45b1-899f-bad37dc57b22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:52:56 user nova-compute[75341]: DEBUG nova.compute.manager [req-b9a47a88-6d64-4ac9-89ed-a8071500b557 req-2573b4dd-808c-4e56-872e-36d0d7ddfdc1 service nova] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] No waiting events found dispatching network-vif-plugged-8989d87f-615c-4cfe-9d3d-6c012e3fdf48 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:52:56 user nova-compute[75341]: WARNING nova.compute.manager [req-b9a47a88-6d64-4ac9-89ed-a8071500b557 req-2573b4dd-808c-4e56-872e-36d0d7ddfdc1 service nova] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Received unexpected event network-vif-plugged-8989d87f-615c-4cfe-9d3d-6c012e3fdf48 for instance with vm_state building and task_state spawning.
Nov 14 23:52:56 user nova-compute[75341]: INFO nova.compute.manager [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Took 6.34 seconds to build instance.
Nov 14 23:52:56 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c152729a-9b91-48b1-b8f7-eb1cd056e5c1 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "c62455e6-61af-45b1-899f-bad37dc57b22" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.433s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:52:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:56 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:52:56 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:52:56 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:52:56 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:52:56 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:52:56 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75341) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 23:52:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:57 user nova-compute[75341]: DEBUG nova.compute.manager [req-e87fd57a-e0c2-4172-bc3e-b5a03e42be3a req-84cfe27e-3e2f-493f-acf9-40b8a0322f4b service nova] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Received event network-vif-plugged-1def089a-31ed-4ac4-be68-4050fa9c9fe6 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:52:57 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-e87fd57a-e0c2-4172-bc3e-b5a03e42be3a req-84cfe27e-3e2f-493f-acf9-40b8a0322f4b service nova] Acquiring lock "12c9a7d6-03a5-4fd2-9082-c68758f1542f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:52:57 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-e87fd57a-e0c2-4172-bc3e-b5a03e42be3a req-84cfe27e-3e2f-493f-acf9-40b8a0322f4b service nova] Lock "12c9a7d6-03a5-4fd2-9082-c68758f1542f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:52:57 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-e87fd57a-e0c2-4172-bc3e-b5a03e42be3a req-84cfe27e-3e2f-493f-acf9-40b8a0322f4b service nova] Lock "12c9a7d6-03a5-4fd2-9082-c68758f1542f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:52:57 user nova-compute[75341]: DEBUG nova.compute.manager [req-e87fd57a-e0c2-4172-bc3e-b5a03e42be3a req-84cfe27e-3e2f-493f-acf9-40b8a0322f4b service nova] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] No waiting events found dispatching network-vif-plugged-1def089a-31ed-4ac4-be68-4050fa9c9fe6 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:52:57 user nova-compute[75341]: WARNING nova.compute.manager [req-e87fd57a-e0c2-4172-bc3e-b5a03e42be3a req-84cfe27e-3e2f-493f-acf9-40b8a0322f4b service nova] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Received unexpected event network-vif-plugged-1def089a-31ed-4ac4-be68-4050fa9c9fe6 for instance with vm_state active and task_state rebuild_spawning.
Nov 14 23:52:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:52:59 user nova-compute[75341]: DEBUG nova.compute.manager [req-ea77a5c5-6cb7-4636-8d9f-0108dc2d65f8 req-fee862a1-b41a-4549-8631-9fe8798a7943 service nova] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Received event network-changed-0ac8d528-5147-460f-abf8-4e33ac66c4f4 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:52:59 user nova-compute[75341]: DEBUG nova.compute.manager [req-ea77a5c5-6cb7-4636-8d9f-0108dc2d65f8 req-fee862a1-b41a-4549-8631-9fe8798a7943 service nova] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Refreshing instance network info cache due to event network-changed-0ac8d528-5147-460f-abf8-4e33ac66c4f4. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:52:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ea77a5c5-6cb7-4636-8d9f-0108dc2d65f8 req-fee862a1-b41a-4549-8631-9fe8798a7943 service nova] Acquiring lock "refresh_cache-9ae467da-9fb5-4f4f-a3f8-fce2ac368dda" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:52:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ea77a5c5-6cb7-4636-8d9f-0108dc2d65f8 req-fee862a1-b41a-4549-8631-9fe8798a7943 service nova] Acquired lock "refresh_cache-9ae467da-9fb5-4f4f-a3f8-fce2ac368dda" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:52:59 user nova-compute[75341]: DEBUG nova.network.neutron [req-ea77a5c5-6cb7-4636-8d9f-0108dc2d65f8 req-fee862a1-b41a-4549-8631-9fe8798a7943 service nova] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Refreshing network info cache for port 0ac8d528-5147-460f-abf8-4e33ac66c4f4 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:52:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-18fd32de-037c-4c41-ba9c-da6091941d82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Acquiring lock "9ae467da-9fb5-4f4f-a3f8-fce2ac368dda" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:52:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-18fd32de-037c-4c41-ba9c-da6091941d82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lock "9ae467da-9fb5-4f4f-a3f8-fce2ac368dda" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:52:59 user nova-compute[75341]: DEBUG nova.objects.instance [None req-18fd32de-037c-4c41-ba9c-da6091941d82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lazy-loading 'flavor' on Instance uuid 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:52:59 user nova-compute[75341]: DEBUG nova.compute.manager [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Instance event wait completed in 0 seconds for  {{(pid=75341) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 23:52:59 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Guest created on hypervisor {{(pid=75341) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 23:52:59 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Instance spawned successfully.
Nov 14 23:52:59 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 23:52:59 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Found default for hw_cdrom_bus of ide {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:52:59 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Found default for hw_disk_bus of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:52:59 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Found default for hw_input_bus of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:52:59 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Found default for hw_pointer_model of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:52:59 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Found default for hw_video_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:52:59 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Found default for hw_vif_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:52:59 user nova-compute[75341]: DEBUG nova.compute.manager [req-ca0bf1ee-67e5-4b17-9265-9b5a682e7b79 req-6aa506ed-3364-4429-b8a7-03276790f5d6 service nova] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Received event network-vif-plugged-1def089a-31ed-4ac4-be68-4050fa9c9fe6 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:52:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ca0bf1ee-67e5-4b17-9265-9b5a682e7b79 req-6aa506ed-3364-4429-b8a7-03276790f5d6 service nova] Acquiring lock "12c9a7d6-03a5-4fd2-9082-c68758f1542f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:52:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ca0bf1ee-67e5-4b17-9265-9b5a682e7b79 req-6aa506ed-3364-4429-b8a7-03276790f5d6 service nova] Lock "12c9a7d6-03a5-4fd2-9082-c68758f1542f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:52:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ca0bf1ee-67e5-4b17-9265-9b5a682e7b79 req-6aa506ed-3364-4429-b8a7-03276790f5d6 service nova] Lock "12c9a7d6-03a5-4fd2-9082-c68758f1542f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:52:59 user nova-compute[75341]: DEBUG nova.compute.manager [req-ca0bf1ee-67e5-4b17-9265-9b5a682e7b79 req-6aa506ed-3364-4429-b8a7-03276790f5d6 service nova] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] No waiting events found dispatching network-vif-plugged-1def089a-31ed-4ac4-be68-4050fa9c9fe6 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:52:59 user nova-compute[75341]: WARNING nova.compute.manager [req-ca0bf1ee-67e5-4b17-9265-9b5a682e7b79 req-6aa506ed-3364-4429-b8a7-03276790f5d6 service nova] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Received unexpected event network-vif-plugged-1def089a-31ed-4ac4-be68-4050fa9c9fe6 for instance with vm_state active and task_state rebuild_spawning.
Nov 14 23:52:59 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-18fd32de-037c-4c41-ba9c-da6091941d82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Ignoring supplied device name: /dev/vdb
Nov 14 23:52:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-18fd32de-037c-4c41-ba9c-da6091941d82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lock "9ae467da-9fb5-4f4f-a3f8-fce2ac368dda" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.318s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:52:59 user nova-compute[75341]: DEBUG nova.compute.manager [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 23:52:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:52:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:52:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.003s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:52:59 user nova-compute[75341]: DEBUG nova.objects.instance [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75341) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 14 23:52:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-18fd32de-037c-4c41-ba9c-da6091941d82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Acquiring lock "9ae467da-9fb5-4f4f-a3f8-fce2ac368dda" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:52:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-18fd32de-037c-4c41-ba9c-da6091941d82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lock "9ae467da-9fb5-4f4f-a3f8-fce2ac368dda" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:52:59 user nova-compute[75341]: INFO nova.compute.manager [None req-18fd32de-037c-4c41-ba9c-da6091941d82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Attaching volume a9b61829-2b3b-458e-bc9f-95c318587a98 to /dev/vdb
Nov 14 23:53:00 user nova-compute[75341]: DEBUG nova.network.neutron [req-ea77a5c5-6cb7-4636-8d9f-0108dc2d65f8 req-fee862a1-b41a-4549-8631-9fe8798a7943 service nova] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Updated VIF entry in instance network info cache for port 0ac8d528-5147-460f-abf8-4e33ac66c4f4. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:53:00 user nova-compute[75341]: DEBUG nova.network.neutron [req-ea77a5c5-6cb7-4636-8d9f-0108dc2d65f8 req-fee862a1-b41a-4549-8631-9fe8798a7943 service nova] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Updating instance_info_cache with network_info: [{"id": "0ac8d528-5147-460f-abf8-4e33ac66c4f4", "address": "fa:16:3e:72:4d:66", "network": {"id": "a1cc71d9-4161-4044-ad08-02aa4a7aef1c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-73156846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f694dc021a9442a49bbde9f367fbefc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac8d528-51", "ovs_interfaceid": "0ac8d528-5147-460f-abf8-4e33ac66c4f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:53:00 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-9883b348-4fe2-402e-83f6-a4d8b8ca509e tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.111s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:53:00 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ea77a5c5-6cb7-4636-8d9f-0108dc2d65f8 req-fee862a1-b41a-4549-8631-9fe8798a7943 service nova] Releasing lock "refresh_cache-9ae467da-9fb5-4f4f-a3f8-fce2ac368dda" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:53:00 user nova-compute[75341]: DEBUG os_brick.utils [None req-18fd32de-037c-4c41-ba9c-da6091941d82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:53:00 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:00 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:00 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:00 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:00 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8c0581-34c5-4845-b754-7b97cc74f0fc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6d1cfca09c9\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:00 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:00 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:00 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[e724689d-c431-4580-9a6e-34c2fad91568]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:00 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:00 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:00 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4954d74-d8aa-4433-9e4a-085e4533126e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:00 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7f87fa-00f9-490d-ae35-78c509bd4155]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:00 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-18fd32de-037c-4c41-ba9c-da6091941d82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Running cmd (subprocess): nvme version {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:00 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-18fd32de-037c-4c41-ba9c-da6091941d82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] 'nvme version' failed. Not Retrying. {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:53:00 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.nvmeof [None req-18fd32de-037c-4c41-ba9c-da6091941d82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] nvme not present on system {{(pid=75341) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 23:53:00 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:00 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:53:00 user nova-compute[75341]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 23:53:00 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e097fc-ab56-4b82-890a-d07f82df236a]: (4, '') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:00 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-18fd32de-037c-4c41-ba9c-da6091941d82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75341) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 23:53:00 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-18fd32de-037c-4c41-ba9c-da6091941d82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 23:53:00 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-18fd32de-037c-4c41-ba9c-da6091941d82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] LIGHTOS: no hostnqn found. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 23:53:00 user nova-compute[75341]: DEBUG os_brick.utils [None req-18fd32de-037c-4c41-ba9c-da6091941d82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] <== get_connector_properties: return (171ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6d1cfca09c9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:53:00 user nova-compute[75341]: DEBUG nova.virt.block_device [None req-18fd32de-037c-4c41-ba9c-da6091941d82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Updating existing volume attachment record: b17f42a6-819e-4435-bf5f-7f3a1ed1ad86 {{(pid=75341) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 23:53:00 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:00 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 23:53:00 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c62455e6-61af-45b1-899f-bad37dc57b22/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:00 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c62455e6-61af-45b1-899f-bad37dc57b22/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:00 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c62455e6-61af-45b1-899f-bad37dc57b22/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:00 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c62455e6-61af-45b1-899f-bad37dc57b22/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:00 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk.rescue --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:00 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk.rescue --force-share --output=json" returned: 0 in 0.241s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:00 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk.rescue --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c9a7d6-03a5-4fd2-9082-c68758f1542f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c9a7d6-03a5-4fd2-9082-c68758f1542f/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c9a7d6-03a5-4fd2-9082-c68758f1542f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c9a7d6-03a5-4fd2-9082-c68758f1542f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:02 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 23:53:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5070fb03-8f40-426c-8c3e-192f6517f7c3/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5070fb03-8f40-426c-8c3e-192f6517f7c3/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5070fb03-8f40-426c-8c3e-192f6517f7c3/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5070fb03-8f40-426c-8c3e-192f6517f7c3/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53d7a6fe-3914-459a-9494-c75549af7b9f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53d7a6fe-3914-459a-9494-c75549af7b9f/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53d7a6fe-3914-459a-9494-c75549af7b9f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53d7a6fe-3914-459a-9494-c75549af7b9f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae467da-9fb5-4f4f-a3f8-fce2ac368dda/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae467da-9fb5-4f4f-a3f8-fce2ac368dda/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae467da-9fb5-4f4f-a3f8-fce2ac368dda/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae467da-9fb5-4f4f-a3f8-fce2ac368dda/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d93909b3-0373-492a-8ede-7c2cd76bcb88/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d93909b3-0373-492a-8ede-7c2cd76bcb88/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d93909b3-0373-492a-8ede-7c2cd76bcb88/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d93909b3-0373-492a-8ede-7c2cd76bcb88/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:04 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 23:53:05 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:53:05 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:53:05 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Hypervisor/Node resource view: name=user free_ram=7546MB free_disk=25.298370361328125GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75341) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 51045050-c7c6-49c5-acd4-2a76be0f466f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 6382e432-838f-4d89-a743-cbaa37f50ab5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 5070fb03-8f40-426c-8c3e-192f6517f7c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance defae731-4191-4526-99cc-a301cf5b3355 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 9996fc26-f3ad-40e2-91a5-51178c0194ef actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 2316aa9e-d4c9-43d0-9918-86265583aed1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 12c9a7d6-03a5-4fd2-9082-c68758f1542f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance d93909b3-0373-492a-8ede-7c2cd76bcb88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 53d7a6fe-3914-459a-9494-c75549af7b9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance c62455e6-61af-45b1-899f-bad37dc57b22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18fd32de-037c-4c41-ba9c-da6091941d82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Calling os-brick to attach iSCSI Volume {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fd32de-037c-4c41-ba9c-da6091941d82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wsoGTWxX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:53:05 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-18fd32de-037c-4c41-ba9c-da6091941d82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:53:05 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-18fd32de-037c-4c41-ba9c-da6091941d82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-18fd32de-037c-4c41-ba9c-da6091941d82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:53:05 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-18fd32de-037c-4c41-ba9c-da6091941d82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:53:05 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-18fd32de-037c-4c41-ba9c-da6091941d82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-18fd32de-037c-4c41-ba9c-da6091941d82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:53:05 user nova-compute[75341]: INFO os_brick.initiator.connectors.iscsi [None req-18fd32de-037c-4c41-ba9c-da6091941d82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 23:53:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98 -p 172.16.0.220:3260 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba55d69-0eed-41e5-9011-10449546b604]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fd32de-037c-4c41-ba9c-da6091941d82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 23:53:05 user nova-compute[75341]:  {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98 -p 172.16.0.220:3260 --interface default --op new {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4fb5f1f-0138-47e8-9b2f-bbdacec91150]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98] added\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fd32de-037c-4c41-ba9c-da6091941d82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98] added
Nov 14 23:53:05 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c2f4871-d665-4949-902f-ee52b9a8ba8f]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fd32de-037c-4c41-ba9c-da6091941d82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e936ba-c101-4434-9f89-b577c714241d]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fd32de-037c-4c41-ba9c-da6091941d82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wsoGTWxX {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wsoGTWxX" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5888b1-bc52-4bf0-a38e-43a08096a027]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fd32de-037c-4c41-ba9c-da6091941d82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wsoGTWxX'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[43464422-9e1b-44a2-b6ce-38bf129efbf1]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fd32de-037c-4c41-ba9c-da6091941d82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[df376b09-aada-4ffa-80e2-3b8ca3d2ad51]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fd32de-037c-4c41-ba9c-da6091941d82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)
Nov 14 23:53:05 user nova-compute[75341]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)
Nov 14 23:53:05 user nova-compute[75341]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)
Nov 14 23:53:05 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fd32de-037c-4c41-ba9c-da6091941d82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)
Nov 14 23:53:05 user nova-compute[75341]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)
Nov 14 23:53:05 user nova-compute[75341]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)
Nov 14 23:53:05 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98 -p 172.16.0.220:3260 --login {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c499b3-11c0-4f88-9894-5304025672a7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fd32de-037c-4c41-ba9c-da6091941d82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98, portal: 172.16.0.220,3260]
Nov 14 23:53:05 user nova-compute[75341]: Login to [iface: default, target: iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98, portal: 172.16.0.220,3260] successful.
Nov 14 23:53:05 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Compute_service record updated for user:user {{(pid=75341) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.578s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-42e8ac7d-aee8-4ca5-b761-e875a6a18ec4 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Acquiring lock "9996fc26-f3ad-40e2-91a5-51178c0194ef" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-42e8ac7d-aee8-4ca5-b761-e875a6a18ec4 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "9996fc26-f3ad-40e2-91a5-51178c0194ef" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-42e8ac7d-aee8-4ca5-b761-e875a6a18ec4 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Acquiring lock "9996fc26-f3ad-40e2-91a5-51178c0194ef-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-42e8ac7d-aee8-4ca5-b761-e875a6a18ec4 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "9996fc26-f3ad-40e2-91a5-51178c0194ef-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-42e8ac7d-aee8-4ca5-b761-e875a6a18ec4 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "9996fc26-f3ad-40e2-91a5-51178c0194ef-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:53:05 user nova-compute[75341]: INFO nova.compute.manager [None req-42e8ac7d-aee8-4ca5-b761-e875a6a18ec4 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] Terminating instance
Nov 14 23:53:05 user nova-compute[75341]: DEBUG nova.compute.manager [None req-42e8ac7d-aee8-4ca5-b761-e875a6a18ec4 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] Start destroying the instance on the hypervisor. {{(pid=75341) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4889483-857b-4253-8090-718688927ea1]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fd32de-037c-4c41-ba9c-da6091941d82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb4bfd6-ce76-456a-9a5b-25657bf2a335]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fd32de-037c-4c41-ba9c-da6091941d82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)
Nov 14 23:53:05 user nova-compute[75341]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)
Nov 14 23:53:05 user nova-compute[75341]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)
Nov 14 23:53:05 user nova-compute[75341]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98 (non-flash)
Nov 14 23:53:05 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fd32de-037c-4c41-ba9c-da6091941d82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)
Nov 14 23:53:05 user nova-compute[75341]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)
Nov 14 23:53:05 user nova-compute[75341]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)
Nov 14 23:53:05 user nova-compute[75341]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98 (non-flash)
Nov 14 23:53:05 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-18fd32de-037c-4c41-ba9c-da6091941d82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fd32de-037c-4c41-ba9c-da6091941d82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Connected to 172.16.0.220:3260 {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-18fd32de-037c-4c41-ba9c-da6091941d82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] HCTL ('34', '-', '-', 0) found on session 39 with lun 0 {{(pid=75341) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-18fd32de-037c-4c41-ba9c-da6091941d82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75341) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a37dd29-18a0-4b5b-92c8-77ce6d3d1268]: (4, ('- - 0', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-18fd32de-037c-4c41-ba9c-da6091941d82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fd32de-037c-4c41-ba9c-da6091941d82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wsoGTWxX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:05 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG nova.compute.manager [req-39b8e0b8-bd66-4d42-9a25-013c1f3cc58b req-2f036fd4-6838-4c93-9745-46c5c5de9717 service nova] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] Received event network-vif-unplugged-1bb06e1a-0451-48ae-b964-93c0cce50a0a {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-39b8e0b8-bd66-4d42-9a25-013c1f3cc58b req-2f036fd4-6838-4c93-9745-46c5c5de9717 service nova] Acquiring lock "9996fc26-f3ad-40e2-91a5-51178c0194ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-39b8e0b8-bd66-4d42-9a25-013c1f3cc58b req-2f036fd4-6838-4c93-9745-46c5c5de9717 service nova] Lock "9996fc26-f3ad-40e2-91a5-51178c0194ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-39b8e0b8-bd66-4d42-9a25-013c1f3cc58b req-2f036fd4-6838-4c93-9745-46c5c5de9717 service nova] Lock "9996fc26-f3ad-40e2-91a5-51178c0194ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG nova.compute.manager [req-39b8e0b8-bd66-4d42-9a25-013c1f3cc58b req-2f036fd4-6838-4c93-9745-46c5c5de9717 service nova] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] No waiting events found dispatching network-vif-unplugged-1bb06e1a-0451-48ae-b964-93c0cce50a0a {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG nova.compute.manager [req-39b8e0b8-bd66-4d42-9a25-013c1f3cc58b req-2f036fd4-6838-4c93-9745-46c5c5de9717 service nova] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] Received event network-vif-unplugged-1bb06e1a-0451-48ae-b964-93c0cce50a0a for instance with task_state deleting. {{(pid=75341) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-90052507-ee55-4b89-b377-63ba544bf7e7 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Acquiring lock "5070fb03-8f40-426c-8c3e-192f6517f7c3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-90052507-ee55-4b89-b377-63ba544bf7e7 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Lock "5070fb03-8f40-426c-8c3e-192f6517f7c3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-90052507-ee55-4b89-b377-63ba544bf7e7 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Acquiring lock "5070fb03-8f40-426c-8c3e-192f6517f7c3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-90052507-ee55-4b89-b377-63ba544bf7e7 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Lock "5070fb03-8f40-426c-8c3e-192f6517f7c3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-90052507-ee55-4b89-b377-63ba544bf7e7 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Lock "5070fb03-8f40-426c-8c3e-192f6517f7c3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:53:06 user nova-compute[75341]: INFO nova.compute.manager [None req-90052507-ee55-4b89-b377-63ba544bf7e7 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Terminating instance
Nov 14 23:53:06 user nova-compute[75341]: DEBUG nova.compute.manager [None req-90052507-ee55-4b89-b377-63ba544bf7e7 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Start destroying the instance on the hypervisor. {{(pid=75341) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 23:53:06 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] Instance destroyed successfully.
Nov 14 23:53:06 user nova-compute[75341]: DEBUG nova.objects.instance [None req-42e8ac7d-aee8-4ca5-b761-e875a6a18ec4 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lazy-loading 'resources' on Instance uuid 9996fc26-f3ad-40e2-91a5-51178c0194ef {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-42e8ac7d-aee8-4ca5-b761-e875a6a18ec4 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:48:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-21916805',display_name='tempest-TestVolumeBootPattern-volume-backed-server-21916805',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-21916805',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE4MZMWtIjuL8yZaIeHkrVx8VbbGzvBlRNbdew4mw+ozZV3QmI4vaa34OgjOosbw9r7xfhbJWz5DQgr7o8XqXL9po5mlyDeUpkdHZKoj3USMO1GDNKjQ9rNtUs8mVH6cuQ==',key_name='tempest-keypair-103389545',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:48:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='96674073965642f1af11221b4add8a6d',ramdisk_id='',reservation_id='r-a7czp6db',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-320933673',owner_user_name='tempest-TestVolumeBootPattern-320933673-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:48:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b08f7ddf6c2f4fd596e214d6ca56c234',uuid=9996fc26-f3ad-40e2-91a5-51178c0194ef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1bb06e1a-0451-48ae-b964-93c0cce50a0a", "address": "fa:16:3e:15:5d:17", "network": {"id": "227eb779-a064-477d-8447-45862017ae7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-3827253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96674073965642f1af11221b4add8a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb06e1a-04", "ovs_interfaceid": "1bb06e1a-0451-48ae-b964-93c0cce50a0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-42e8ac7d-aee8-4ca5-b761-e875a6a18ec4 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Converting VIF {"id": "1bb06e1a-0451-48ae-b964-93c0cce50a0a", "address": "fa:16:3e:15:5d:17", "network": {"id": "227eb779-a064-477d-8447-45862017ae7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-3827253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96674073965642f1af11221b4add8a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bb06e1a-04", "ovs_interfaceid": "1bb06e1a-0451-48ae-b964-93c0cce50a0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-42e8ac7d-aee8-4ca5-b761-e875a6a18ec4 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:5d:17,bridge_name='br-int',has_traffic_filtering=True,id=1bb06e1a-0451-48ae-b964-93c0cce50a0a,network=Network(227eb779-a064-477d-8447-45862017ae7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bb06e1a-04') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG os_vif [None req-42e8ac7d-aee8-4ca5-b761-e875a6a18ec4 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:5d:17,bridge_name='br-int',has_traffic_filtering=True,id=1bb06e1a-0451-48ae-b964-93c0cce50a0a,network=Network(227eb779-a064-477d-8447-45862017ae7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bb06e1a-04') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1bb06e1a-04, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a8928bc5-0030-4fba-8f78-e7dd52a48235) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:06 user nova-compute[75341]: INFO os_vif [None req-42e8ac7d-aee8-4ca5-b761-e875a6a18ec4 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:5d:17,bridge_name='br-int',has_traffic_filtering=True,id=1bb06e1a-0451-48ae-b964-93c0cce50a0a,network=Network(227eb779-a064-477d-8447-45862017ae7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bb06e1a-04')
Nov 14 23:53:06 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42e8ac7d-aee8-4ca5-b761-e875a6a18ec4 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] calling os-brick to detach iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-42e8ac7d-aee8-4ca5-b761-e875a6a18ec4 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, {'target_iqn': 'iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lTqdQVAF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:53:06 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-42e8ac7d-aee8-4ca5-b761-e875a6a18ec4 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:53:06 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-42e8ac7d-aee8-4ca5-b761-e875a6a18ec4 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-18fd32de-037c-4c41-ba9c-da6091941d82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-18fd32de-037c-4c41-ba9c-da6091941d82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] <== connect_volume: return (1377ms) {'type': 'block', 'scsi_wwn': '23132356430373461', 'path': '/dev/sdc'} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18fd32de-037c-4c41-ba9c-da6091941d82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23132356430373461', 'path': '/dev/sdc'} {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-42e8ac7d-aee8-4ca5-b761-e875a6a18ec4 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.211s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG nova.objects.instance [None req-18fd32de-037c-4c41-ba9c-da6091941d82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lazy-loading 'flavor' on Instance uuid 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[0693c51f-a74e-48a8-a1b2-0cd9f21fe8ac]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-42e8ac7d-aee8-4ca5-b761-e875a6a18ec4 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 23:53:06 user nova-compute[75341]: No targets found.
Nov 14 23:53:06 user nova-compute[75341]: iSNS:
Nov 14 23:53:06 user nova-compute[75341]: No targets found.
Nov 14 23:53:06 user nova-compute[75341]: STATIC:
Nov 14 23:53:06 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9
Nov 14 23:53:06 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:53:06 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:53:06 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05
Nov 14 23:53:06 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:53:06 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:53:06 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418
Nov 14 23:53:06 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:53:06 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:53:06 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98
Nov 14 23:53:06 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:53:06 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:53:06 user nova-compute[75341]: FIRMWARE:
Nov 14 23:53:06 user nova-compute[75341]: No targets found.
Nov 14 23:53:06 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-42e8ac7d-aee8-4ca5-b761-e875a6a18ec4 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 23:53:06 user nova-compute[75341]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 23:53:06 user nova-compute[75341]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75341) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-42e8ac7d-aee8-4ca5-b761-e875a6a18ec4 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9', 0)] {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f654da0-c880-480a-95b6-3fa6906962ba]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-18fd32de-037c-4c41-ba9c-da6091941d82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 23:53:06 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:53:06 user nova-compute[75341]:   <source dev="/dev/sdc"/>
Nov 14 23:53:06 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:53:06 user nova-compute[75341]:   <serial>a9b61829-2b3b-458e-bc9f-95c318587a98</serial>
Nov 14 23:53:06 user nova-compute[75341]: </disk>
Nov 14 23:53:06 user nova-compute[75341]:  {{(pid=75341) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a52e856-558a-4703-93ad-d344a738d3b5]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-42e8ac7d-aee8-4ca5-b761-e875a6a18ec4 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)
Nov 14 23:53:06 user nova-compute[75341]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)
Nov 14 23:53:06 user nova-compute[75341]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)
Nov 14 23:53:06 user nova-compute[75341]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98 (non-flash)
Nov 14 23:53:06 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-42e8ac7d-aee8-4ca5-b761-e875a6a18ec4 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 (non-flash)
Nov 14 23:53:06 user nova-compute[75341]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)
Nov 14 23:53:06 user nova-compute[75341]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)
Nov 14 23:53:06 user nova-compute[75341]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98 (non-flash)
Nov 14 23:53:06 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-42e8ac7d-aee8-4ca5-b761-e875a6a18ec4 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1850707a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9'): ({'sdd'}, set())}) {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-42e8ac7d-aee8-4ca5-b761-e875a6a18ec4 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Removing single pathed devices sdd {{(pid=75341) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[0afa4be5-90f0-4088-b011-c3e44463767a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG nova.compute.manager [req-c85d8a21-7035-47f3-88ab-b965ee9bcb1b req-3389ffd0-2f8c-4ed8-992c-350aa9c1d078 service nova] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Received event network-vif-unplugged-59640fb6-107f-4eec-90ec-730997028287 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-c85d8a21-7035-47f3-88ab-b965ee9bcb1b req-3389ffd0-2f8c-4ed8-992c-350aa9c1d078 service nova] Acquiring lock "5070fb03-8f40-426c-8c3e-192f6517f7c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-c85d8a21-7035-47f3-88ab-b965ee9bcb1b req-3389ffd0-2f8c-4ed8-992c-350aa9c1d078 service nova] Lock "5070fb03-8f40-426c-8c3e-192f6517f7c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-c85d8a21-7035-47f3-88ab-b965ee9bcb1b req-3389ffd0-2f8c-4ed8-992c-350aa9c1d078 service nova] Lock "5070fb03-8f40-426c-8c3e-192f6517f7c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG nova.compute.manager [req-c85d8a21-7035-47f3-88ab-b965ee9bcb1b req-3389ffd0-2f8c-4ed8-992c-350aa9c1d078 service nova] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] No waiting events found dispatching network-vif-unplugged-59640fb6-107f-4eec-90ec-730997028287 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG nova.compute.manager [req-c85d8a21-7035-47f3-88ab-b965ee9bcb1b req-3389ffd0-2f8c-4ed8-992c-350aa9c1d078 service nova] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Received event network-vif-unplugged-59640fb6-107f-4eec-90ec-730997028287 for instance with task_state deleting. {{(pid=75341) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[f771aec2-9205-4891-94f6-1f3ff8916d2f]: (4, ('ok\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-42e8ac7d-aee8-4ca5-b761-e875a6a18ec4 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Flushing IO for device /dev/sdd {{(pid=75341) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[68369b9f-2ae9-4a0c-9cbe-b1a923576def]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-42e8ac7d-aee8-4ca5-b761-e875a6a18ec4 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75341) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9a6ffe-2332-4562-9498-363679b13a16]: (4, ('1', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-42e8ac7d-aee8-4ca5-b761-e875a6a18ec4 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-42e8ac7d-aee8-4ca5-b761-e875a6a18ec4 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] SCSI volumes sdd have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-42e8ac7d-aee8-4ca5-b761-e875a6a18ec4 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9')] {{(pid=75341) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 23:53:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:07 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[af83485e-44e8-4568-acbd-afb243edcb39]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:07 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-42e8ac7d-aee8-4ca5-b761-e875a6a18ec4 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:53:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 -p 172.16.0.220:3260 --logout {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:07 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[275ebd02-8bce-4f43-ba33-fb5f700ebdf9]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:07 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-42e8ac7d-aee8-4ca5-b761-e875a6a18ec4 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9, portal: 172.16.0.220,3260]
Nov 14 23:53:07 user nova-compute[75341]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9, portal: 172.16.0.220,3260] successful.
Nov 14 23:53:07 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:53:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 -p 172.16.0.220:3260 --op delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d0580f2-e5df-4402-84ac-78a7ba95c0c9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:07 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3dc85be-0bec-4586-af0c-deb03e3bbc64]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:07 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-42e8ac7d-aee8-4ca5-b761-e875a6a18ec4 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:53:07 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-42e8ac7d-aee8-4ca5-b761-e875a6a18ec4 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:53:07 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-42e8ac7d-aee8-4ca5-b761-e875a6a18ec4 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] <== disconnect_volume: return (570ms) None {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:53:07 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42e8ac7d-aee8-4ca5-b761-e875a6a18ec4 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] Disconnected iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 23:53:07 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-42e8ac7d-aee8-4ca5-b761-e875a6a18ec4 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] Deleting instance files /opt/stack/data/nova/instances/9996fc26-f3ad-40e2-91a5-51178c0194ef_del
Nov 14 23:53:07 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-42e8ac7d-aee8-4ca5-b761-e875a6a18ec4 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] Deletion of /opt/stack/data/nova/instances/9996fc26-f3ad-40e2-91a5-51178c0194ef_del complete
Nov 14 23:53:07 user nova-compute[75341]: INFO nova.compute.manager [None req-42e8ac7d-aee8-4ca5-b761-e875a6a18ec4 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] Took 1.52 seconds to destroy the instance on the hypervisor.
Nov 14 23:53:07 user nova-compute[75341]: DEBUG oslo.service.loopingcall [None req-42e8ac7d-aee8-4ca5-b761-e875a6a18ec4 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75341) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 23:53:07 user nova-compute[75341]: DEBUG nova.compute.manager [-] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] Deallocating network for instance {{(pid=75341) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 23:53:07 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] deallocate_for_instance() {{(pid=75341) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 23:53:07 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-18fd32de-037c-4c41-ba9c-da6091941d82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:53:07 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-18fd32de-037c-4c41-ba9c-da6091941d82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:53:07 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-18fd32de-037c-4c41-ba9c-da6091941d82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] No VIF found with MAC fa:16:3e:72:4d:66, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:53:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-18fd32de-037c-4c41-ba9c-da6091941d82 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lock "9ae467da-9fb5-4f4f-a3f8-fce2ac368dda" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.410s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:53:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:07 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Instance destroyed successfully.
Nov 14 23:53:07 user nova-compute[75341]: DEBUG nova.objects.instance [None req-90052507-ee55-4b89-b377-63ba544bf7e7 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Lazy-loading 'resources' on Instance uuid 5070fb03-8f40-426c-8c3e-192f6517f7c3 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:53:07 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-90052507-ee55-4b89-b377-63ba544bf7e7 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:46:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-691673290',display_name='tempest-TestStampPattern-server-691673290',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-691673290',id=23,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3k4a6947+jIKLvmTnCELFNO1dnVN6DgXq9Xj0CmQaSvYB0hJlJ042GniTnSgjACK17rkv4NlkLk+t1g4KrW1PNXrKxIcV24jCAaqde0p0EUk9jn7Pe6DP8ihh+nNZNxg==',key_name='tempest-TestStampPattern-1455376223',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:46:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0af462be688d4127a8368ee3dcb2a340',ramdisk_id='',reservation_id='r-2znjrp9g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1579449792',owner_user_name='tempest-TestStampPattern-1579449792-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:49:13Z,user_data=None,user_id='1bea063034a84067bd8645aecfe3560d',uuid=5070fb03-8f40-426c-8c3e-192f6517f7c3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "59640fb6-107f-4eec-90ec-730997028287", "address": "fa:16:3e:9e:2f:c0", "network": {"id": "e9abba2c-7994-4781-a3ca-07e8e4be7825", "bridge": "br-int", "label": "tempest-TestStampPattern-1410971761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af462be688d4127a8368ee3dcb2a340", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59640fb6-10", "ovs_interfaceid": "59640fb6-107f-4eec-90ec-730997028287", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 23:53:07 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-90052507-ee55-4b89-b377-63ba544bf7e7 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Converting VIF {"id": "59640fb6-107f-4eec-90ec-730997028287", "address": "fa:16:3e:9e:2f:c0", "network": {"id": "e9abba2c-7994-4781-a3ca-07e8e4be7825", "bridge": "br-int", "label": "tempest-TestStampPattern-1410971761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af462be688d4127a8368ee3dcb2a340", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59640fb6-10", "ovs_interfaceid": "59640fb6-107f-4eec-90ec-730997028287", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:53:07 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-90052507-ee55-4b89-b377-63ba544bf7e7 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:2f:c0,bridge_name='br-int',has_traffic_filtering=True,id=59640fb6-107f-4eec-90ec-730997028287,network=Network(e9abba2c-7994-4781-a3ca-07e8e4be7825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59640fb6-10') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:53:07 user nova-compute[75341]: DEBUG os_vif [None req-90052507-ee55-4b89-b377-63ba544bf7e7 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:2f:c0,bridge_name='br-int',has_traffic_filtering=True,id=59640fb6-107f-4eec-90ec-730997028287,network=Network(e9abba2c-7994-4781-a3ca-07e8e4be7825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59640fb6-10') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 23:53:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap59640fb6-10, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:53:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:53:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=87597d7d-93fe-4e36-9a12-2ae691798a6d) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:53:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:53:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:07 user nova-compute[75341]: INFO os_vif [None req-90052507-ee55-4b89-b377-63ba544bf7e7 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:2f:c0,bridge_name='br-int',has_traffic_filtering=True,id=59640fb6-107f-4eec-90ec-730997028287,network=Network(e9abba2c-7994-4781-a3ca-07e8e4be7825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59640fb6-10')
Nov 14 23:53:07 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-90052507-ee55-4b89-b377-63ba544bf7e7 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Deleting instance files /opt/stack/data/nova/instances/5070fb03-8f40-426c-8c3e-192f6517f7c3_del
Nov 14 23:53:07 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-90052507-ee55-4b89-b377-63ba544bf7e7 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Deletion of /opt/stack/data/nova/instances/5070fb03-8f40-426c-8c3e-192f6517f7c3_del complete
Nov 14 23:53:07 user nova-compute[75341]: INFO nova.compute.manager [None req-90052507-ee55-4b89-b377-63ba544bf7e7 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 14 23:53:07 user nova-compute[75341]: DEBUG oslo.service.loopingcall [None req-90052507-ee55-4b89-b377-63ba544bf7e7 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75341) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 23:53:07 user nova-compute[75341]: DEBUG nova.compute.manager [-] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Deallocating network for instance {{(pid=75341) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 23:53:07 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] deallocate_for_instance() {{(pid=75341) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 23:53:07 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:53:07 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:53:08 user nova-compute[75341]: INFO nova.compute.manager [-] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] Took 0.81 seconds to deallocate network for instance.
Nov 14 23:53:08 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:53:08 user nova-compute[75341]: INFO nova.compute.manager [-] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Took 0.49 seconds to deallocate network for instance.
Nov 14 23:53:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-90052507-ee55-4b89-b377-63ba544bf7e7 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:53:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-90052507-ee55-4b89-b377-63ba544bf7e7 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:53:08 user nova-compute[75341]: DEBUG nova.compute.manager [req-4fd19dc6-77b2-46ed-ab4c-1b0c7f86e360 req-8816f834-d607-4154-aabd-d0d792ac8a4f service nova] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Received event network-changed-59640fb6-107f-4eec-90ec-730997028287 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:53:08 user nova-compute[75341]: DEBUG nova.compute.manager [req-4fd19dc6-77b2-46ed-ab4c-1b0c7f86e360 req-8816f834-d607-4154-aabd-d0d792ac8a4f service nova] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Refreshing instance network info cache due to event network-changed-59640fb6-107f-4eec-90ec-730997028287. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:53:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4fd19dc6-77b2-46ed-ab4c-1b0c7f86e360 req-8816f834-d607-4154-aabd-d0d792ac8a4f service nova] Acquiring lock "refresh_cache-5070fb03-8f40-426c-8c3e-192f6517f7c3" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:53:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4fd19dc6-77b2-46ed-ab4c-1b0c7f86e360 req-8816f834-d607-4154-aabd-d0d792ac8a4f service nova] Acquired lock "refresh_cache-5070fb03-8f40-426c-8c3e-192f6517f7c3" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:53:08 user nova-compute[75341]: DEBUG nova.network.neutron [req-4fd19dc6-77b2-46ed-ab4c-1b0c7f86e360 req-8816f834-d607-4154-aabd-d0d792ac8a4f service nova] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Refreshing network info cache for port 59640fb6-107f-4eec-90ec-730997028287 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:53:08 user nova-compute[75341]: DEBUG nova.network.neutron [req-4fd19dc6-77b2-46ed-ab4c-1b0c7f86e360 req-8816f834-d607-4154-aabd-d0d792ac8a4f service nova] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Instance cache missing network info. {{(pid=75341) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 23:53:08 user nova-compute[75341]: DEBUG nova.network.neutron [req-4fd19dc6-77b2-46ed-ab4c-1b0c7f86e360 req-8816f834-d607-4154-aabd-d0d792ac8a4f service nova] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:53:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4fd19dc6-77b2-46ed-ab4c-1b0c7f86e360 req-8816f834-d607-4154-aabd-d0d792ac8a4f service nova] Releasing lock "refresh_cache-5070fb03-8f40-426c-8c3e-192f6517f7c3" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:53:08 user nova-compute[75341]: DEBUG nova.compute.manager [req-4fd19dc6-77b2-46ed-ab4c-1b0c7f86e360 req-8816f834-d607-4154-aabd-d0d792ac8a4f service nova] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] Received event network-vif-plugged-1bb06e1a-0451-48ae-b964-93c0cce50a0a {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:53:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4fd19dc6-77b2-46ed-ab4c-1b0c7f86e360 req-8816f834-d607-4154-aabd-d0d792ac8a4f service nova] Acquiring lock "9996fc26-f3ad-40e2-91a5-51178c0194ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:53:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4fd19dc6-77b2-46ed-ab4c-1b0c7f86e360 req-8816f834-d607-4154-aabd-d0d792ac8a4f service nova] Lock "9996fc26-f3ad-40e2-91a5-51178c0194ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:53:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4fd19dc6-77b2-46ed-ab4c-1b0c7f86e360 req-8816f834-d607-4154-aabd-d0d792ac8a4f service nova] Lock "9996fc26-f3ad-40e2-91a5-51178c0194ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:53:08 user nova-compute[75341]: DEBUG nova.compute.manager [req-4fd19dc6-77b2-46ed-ab4c-1b0c7f86e360 req-8816f834-d607-4154-aabd-d0d792ac8a4f service nova] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] No waiting events found dispatching network-vif-plugged-1bb06e1a-0451-48ae-b964-93c0cce50a0a {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:53:08 user nova-compute[75341]: WARNING nova.compute.manager [req-4fd19dc6-77b2-46ed-ab4c-1b0c7f86e360 req-8816f834-d607-4154-aabd-d0d792ac8a4f service nova] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] Received unexpected event network-vif-plugged-1bb06e1a-0451-48ae-b964-93c0cce50a0a for instance with vm_state active and task_state deleting.
Nov 14 23:53:08 user nova-compute[75341]: DEBUG nova.compute.manager [req-4fd19dc6-77b2-46ed-ab4c-1b0c7f86e360 req-8816f834-d607-4154-aabd-d0d792ac8a4f service nova] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Received event network-vif-deleted-59640fb6-107f-4eec-90ec-730997028287 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:53:08 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-90052507-ee55-4b89-b377-63ba544bf7e7 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:53:08 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-90052507-ee55-4b89-b377-63ba544bf7e7 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:53:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-90052507-ee55-4b89-b377-63ba544bf7e7 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.496s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:53:08 user nova-compute[75341]: INFO nova.scheduler.client.report [None req-90052507-ee55-4b89-b377-63ba544bf7e7 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Deleted allocations for instance 5070fb03-8f40-426c-8c3e-192f6517f7c3
Nov 14 23:53:08 user nova-compute[75341]: INFO nova.compute.manager [None req-42e8ac7d-aee8-4ca5-b761-e875a6a18ec4 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] Took 0.76 seconds to detach 1 volumes for instance.
Nov 14 23:53:08 user nova-compute[75341]: DEBUG nova.compute.manager [None req-42e8ac7d-aee8-4ca5-b761-e875a6a18ec4 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] Deleting volume: 4d0580f2-e5df-4402-84ac-78a7ba95c0c9 {{(pid=75341) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 23:53:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-90052507-ee55-4b89-b377-63ba544bf7e7 tempest-TestStampPattern-1579449792 tempest-TestStampPattern-1579449792-project-member] Lock "5070fb03-8f40-426c-8c3e-192f6517f7c3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.374s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:53:08 user nova-compute[75341]: DEBUG nova.compute.manager [req-b115e44c-906b-4a0b-9c33-2cff9745c5e4 req-686f9166-34fc-4d43-b35e-1dfa1ed273f8 service nova] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Received event network-vif-plugged-59640fb6-107f-4eec-90ec-730997028287 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:53:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-b115e44c-906b-4a0b-9c33-2cff9745c5e4 req-686f9166-34fc-4d43-b35e-1dfa1ed273f8 service nova] Acquiring lock "5070fb03-8f40-426c-8c3e-192f6517f7c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:53:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-b115e44c-906b-4a0b-9c33-2cff9745c5e4 req-686f9166-34fc-4d43-b35e-1dfa1ed273f8 service nova] Lock "5070fb03-8f40-426c-8c3e-192f6517f7c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:53:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-b115e44c-906b-4a0b-9c33-2cff9745c5e4 req-686f9166-34fc-4d43-b35e-1dfa1ed273f8 service nova] Lock "5070fb03-8f40-426c-8c3e-192f6517f7c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:53:08 user nova-compute[75341]: DEBUG nova.compute.manager [req-b115e44c-906b-4a0b-9c33-2cff9745c5e4 req-686f9166-34fc-4d43-b35e-1dfa1ed273f8 service nova] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] No waiting events found dispatching network-vif-plugged-59640fb6-107f-4eec-90ec-730997028287 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:53:08 user nova-compute[75341]: WARNING nova.compute.manager [req-b115e44c-906b-4a0b-9c33-2cff9745c5e4 req-686f9166-34fc-4d43-b35e-1dfa1ed273f8 service nova] [instance: 5070fb03-8f40-426c-8c3e-192f6517f7c3] Received unexpected event network-vif-plugged-59640fb6-107f-4eec-90ec-730997028287 for instance with vm_state deleted and task_state None.
Nov 14 23:53:08 user nova-compute[75341]: DEBUG nova.compute.manager [req-b115e44c-906b-4a0b-9c33-2cff9745c5e4 req-686f9166-34fc-4d43-b35e-1dfa1ed273f8 service nova] [instance: 9996fc26-f3ad-40e2-91a5-51178c0194ef] Received event network-vif-deleted-1bb06e1a-0451-48ae-b964-93c0cce50a0a {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:53:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-42e8ac7d-aee8-4ca5-b761-e875a6a18ec4 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:53:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-42e8ac7d-aee8-4ca5-b761-e875a6a18ec4 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:53:09 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-42e8ac7d-aee8-4ca5-b761-e875a6a18ec4 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:53:09 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-42e8ac7d-aee8-4ca5-b761-e875a6a18ec4 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:53:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-42e8ac7d-aee8-4ca5-b761-e875a6a18ec4 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.378s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:53:09 user nova-compute[75341]: INFO nova.scheduler.client.report [None req-42e8ac7d-aee8-4ca5-b761-e875a6a18ec4 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Deleted allocations for instance 9996fc26-f3ad-40e2-91a5-51178c0194ef
Nov 14 23:53:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-42e8ac7d-aee8-4ca5-b761-e875a6a18ec4 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "9996fc26-f3ad-40e2-91a5-51178c0194ef" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.121s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:53:11 user nova-compute[75341]: DEBUG nova.compute.manager [req-42dd48eb-b4a1-40c1-870a-ab7cbdb7772e req-c9b87b4e-5a5e-4f7d-8046-30064b005e1f service nova] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Received event network-changed-712f4b2d-016e-43ab-a3f2-8439868a5055 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:53:11 user nova-compute[75341]: DEBUG nova.compute.manager [req-42dd48eb-b4a1-40c1-870a-ab7cbdb7772e req-c9b87b4e-5a5e-4f7d-8046-30064b005e1f service nova] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Refreshing instance network info cache due to event network-changed-712f4b2d-016e-43ab-a3f2-8439868a5055. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:53:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-42dd48eb-b4a1-40c1-870a-ab7cbdb7772e req-c9b87b4e-5a5e-4f7d-8046-30064b005e1f service nova] Acquiring lock "refresh_cache-d93909b3-0373-492a-8ede-7c2cd76bcb88" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:53:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-42dd48eb-b4a1-40c1-870a-ab7cbdb7772e req-c9b87b4e-5a5e-4f7d-8046-30064b005e1f service nova] Acquired lock "refresh_cache-d93909b3-0373-492a-8ede-7c2cd76bcb88" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:53:11 user nova-compute[75341]: DEBUG nova.network.neutron [req-42dd48eb-b4a1-40c1-870a-ab7cbdb7772e req-c9b87b4e-5a5e-4f7d-8046-30064b005e1f service nova] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Refreshing network info cache for port 712f4b2d-016e-43ab-a3f2-8439868a5055 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:53:11 user nova-compute[75341]: DEBUG nova.network.neutron [req-42dd48eb-b4a1-40c1-870a-ab7cbdb7772e req-c9b87b4e-5a5e-4f7d-8046-30064b005e1f service nova] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Updated VIF entry in instance network info cache for port 712f4b2d-016e-43ab-a3f2-8439868a5055. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:53:11 user nova-compute[75341]: DEBUG nova.network.neutron [req-42dd48eb-b4a1-40c1-870a-ab7cbdb7772e req-c9b87b4e-5a5e-4f7d-8046-30064b005e1f service nova] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Updating instance_info_cache with network_info: [{"id": "712f4b2d-016e-43ab-a3f2-8439868a5055", "address": "fa:16:3e:b8:ce:f2", "network": {"id": "9ad7204e-07f5-4676-b2de-09e036a92e61", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-718201239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542a85b3a6d14c77872f1957120ba655", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap712f4b2d-01", "ovs_interfaceid": "712f4b2d-016e-43ab-a3f2-8439868a5055", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:53:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-42dd48eb-b4a1-40c1-870a-ab7cbdb7772e req-c9b87b4e-5a5e-4f7d-8046-30064b005e1f service nova] Releasing lock "refresh_cache-d93909b3-0373-492a-8ede-7c2cd76bcb88" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:53:11 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-474cf219-ee74-430b-9cef-84dad7fde9b9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Acquiring lock "d93909b3-0373-492a-8ede-7c2cd76bcb88" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:53:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-474cf219-ee74-430b-9cef-84dad7fde9b9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "d93909b3-0373-492a-8ede-7c2cd76bcb88" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:53:13 user nova-compute[75341]: DEBUG nova.objects.instance [None req-474cf219-ee74-430b-9cef-84dad7fde9b9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lazy-loading 'flavor' on Instance uuid d93909b3-0373-492a-8ede-7c2cd76bcb88 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:53:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-474cf219-ee74-430b-9cef-84dad7fde9b9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "d93909b3-0373-492a-8ede-7c2cd76bcb88" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:53:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-474cf219-ee74-430b-9cef-84dad7fde9b9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Acquiring lock "d93909b3-0373-492a-8ede-7c2cd76bcb88" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:53:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-474cf219-ee74-430b-9cef-84dad7fde9b9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "d93909b3-0373-492a-8ede-7c2cd76bcb88" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:53:13 user nova-compute[75341]: INFO nova.compute.manager [None req-474cf219-ee74-430b-9cef-84dad7fde9b9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Attaching volume 9fe06215-8adc-4370-a4be-bc75863287c8 to /dev/vdb
Nov 14 23:53:13 user nova-compute[75341]: DEBUG os_brick.utils [None req-474cf219-ee74-430b-9cef-84dad7fde9b9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:53:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:13 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[056d1b0f-c9a5-4a17-9e9a-9d59b86d3876]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6d1cfca09c9\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:13 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3bec64a-94b1-4233-b224-7d731d6eddae]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:13 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09b3e29-9739-49bf-ab86-00802dc8c300]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:13 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[961f8ed5-ce63-41c6-a304-0601dc79faa5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-474cf219-ee74-430b-9cef-84dad7fde9b9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Running cmd (subprocess): nvme version {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-474cf219-ee74-430b-9cef-84dad7fde9b9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] 'nvme version' failed. Not Retrying. {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:53:13 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.nvmeof [None req-474cf219-ee74-430b-9cef-84dad7fde9b9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] nvme not present on system {{(pid=75341) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 23:53:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:53:13 user nova-compute[75341]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 23:53:13 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[326892c9-bcc4-4e2b-bc2e-45cefe4e40d1]: (4, '') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:13 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-474cf219-ee74-430b-9cef-84dad7fde9b9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75341) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 23:53:13 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-474cf219-ee74-430b-9cef-84dad7fde9b9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 23:53:13 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-474cf219-ee74-430b-9cef-84dad7fde9b9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] LIGHTOS: no hostnqn found. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 23:53:13 user nova-compute[75341]: DEBUG os_brick.utils [None req-474cf219-ee74-430b-9cef-84dad7fde9b9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6d1cfca09c9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:53:13 user nova-compute[75341]: DEBUG nova.virt.block_device [None req-474cf219-ee74-430b-9cef-84dad7fde9b9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Updating existing volume attachment record: e26e2722-3279-4e20-b07d-841af204b4d4 {{(pid=75341) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 23:53:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:17 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-474cf219-ee74-430b-9cef-84dad7fde9b9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Calling os-brick to attach iSCSI Volume {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 23:53:17 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-474cf219-ee74-430b-9cef-84dad7fde9b9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9fe06215-8adc-4370-a4be-bc75863287c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nAbXYqhW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:53:17 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-474cf219-ee74-430b-9cef-84dad7fde9b9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:53:17 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-474cf219-ee74-430b-9cef-84dad7fde9b9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:53:17 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-474cf219-ee74-430b-9cef-84dad7fde9b9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:53:17 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-474cf219-ee74-430b-9cef-84dad7fde9b9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:53:17 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-474cf219-ee74-430b-9cef-84dad7fde9b9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9fe06215-8adc-4370-a4be-bc75863287c8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:53:17 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-474cf219-ee74-430b-9cef-84dad7fde9b9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9fe06215-8adc-4370-a4be-bc75863287c8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:53:17 user nova-compute[75341]: INFO os_brick.initiator.connectors.iscsi [None req-474cf219-ee74-430b-9cef-84dad7fde9b9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 23:53:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fe06215-8adc-4370-a4be-bc75863287c8 -p 172.16.0.220:3260 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fe06215-8adc-4370-a4be-bc75863287c8 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:17 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2b30d1-c293-43d5-b03e-7061cdd5f64b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:17 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-474cf219-ee74-430b-9cef-84dad7fde9b9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 23:53:17 user nova-compute[75341]:  {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:53:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fe06215-8adc-4370-a4be-bc75863287c8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fe06215-8adc-4370-a4be-bc75863287c8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:17 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[449b0153-8e4e-49f0-b478-16062bdb54f3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9fe06215-8adc-4370-a4be-bc75863287c8] added\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:17 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-474cf219-ee74-430b-9cef-84dad7fde9b9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9fe06215-8adc-4370-a4be-bc75863287c8] added
Nov 14 23:53:17 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:53:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fe06215-8adc-4370-a4be-bc75863287c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fe06215-8adc-4370-a4be-bc75863287c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:17 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b5ffbb-5f78-4ace-8e65-ec1b829a353b]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:17 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-474cf219-ee74-430b-9cef-84dad7fde9b9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:53:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fe06215-8adc-4370-a4be-bc75863287c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fe06215-8adc-4370-a4be-bc75863287c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:17 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98fdf90-61ba-454b-b8a8-3ac18ad67d8f]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:17 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-474cf219-ee74-430b-9cef-84dad7fde9b9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:53:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fe06215-8adc-4370-a4be-bc75863287c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nAbXYqhW {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fe06215-8adc-4370-a4be-bc75863287c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nAbXYqhW" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:17 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0bf893d-aa91-4808-9be0-3e89ff8bed6a]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:17 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-474cf219-ee74-430b-9cef-84dad7fde9b9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nAbXYqhW'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:53:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fe06215-8adc-4370-a4be-bc75863287c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fe06215-8adc-4370-a4be-bc75863287c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:17 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee25120-5464-436c-afe6-b0a3c925dcab]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:17 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-474cf219-ee74-430b-9cef-84dad7fde9b9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:53:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:17 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[6668267e-2b08-4250-8d8c-2ec8dbf1c7cd]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:17 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-474cf219-ee74-430b-9cef-84dad7fde9b9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)
Nov 14 23:53:17 user nova-compute[75341]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)
Nov 14 23:53:17 user nova-compute[75341]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98 (non-flash)
Nov 14 23:53:17 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:53:17 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-474cf219-ee74-430b-9cef-84dad7fde9b9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)
Nov 14 23:53:17 user nova-compute[75341]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)
Nov 14 23:53:17 user nova-compute[75341]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98 (non-flash)
Nov 14 23:53:17 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:53:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fe06215-8adc-4370-a4be-bc75863287c8 -p 172.16.0.220:3260 --login {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:18 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fe06215-8adc-4370-a4be-bc75863287c8 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:18 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55e73f8-3fd1-4354-be22-2aadd5fc853a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9fe06215-8adc-4370-a4be-bc75863287c8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9fe06215-8adc-4370-a4be-bc75863287c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:18 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-474cf219-ee74-430b-9cef-84dad7fde9b9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9fe06215-8adc-4370-a4be-bc75863287c8, portal: 172.16.0.220,3260]
Nov 14 23:53:18 user nova-compute[75341]: Login to [iface: default, target: iqn.2010-10.org.openstack:9fe06215-8adc-4370-a4be-bc75863287c8, portal: 172.16.0.220,3260] successful.
Nov 14 23:53:18 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:53:18 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fe06215-8adc-4370-a4be-bc75863287c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:18 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fe06215-8adc-4370-a4be-bc75863287c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:18 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[6060585f-8d62-4f58-b88d-03e93cd608f5]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:18 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-474cf219-ee74-430b-9cef-84dad7fde9b9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:53:18 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:18 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:18 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf37057-0262-4a0a-8528-8634871431af]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fe06215-8adc-4370-a4be-bc75863287c8 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:18 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-474cf219-ee74-430b-9cef-84dad7fde9b9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)
Nov 14 23:53:18 user nova-compute[75341]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)
Nov 14 23:53:18 user nova-compute[75341]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98 (non-flash)
Nov 14 23:53:18 user nova-compute[75341]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fe06215-8adc-4370-a4be-bc75863287c8 (non-flash)
Nov 14 23:53:18 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:53:18 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-474cf219-ee74-430b-9cef-84dad7fde9b9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)
Nov 14 23:53:18 user nova-compute[75341]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)
Nov 14 23:53:18 user nova-compute[75341]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98 (non-flash)
Nov 14 23:53:18 user nova-compute[75341]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fe06215-8adc-4370-a4be-bc75863287c8 (non-flash)
Nov 14 23:53:18 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:53:18 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-474cf219-ee74-430b-9cef-84dad7fde9b9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9fe06215-8adc-4370-a4be-bc75863287c8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:53:18 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-474cf219-ee74-430b-9cef-84dad7fde9b9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Connected to 172.16.0.220:3260 {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 23:53:18 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-474cf219-ee74-430b-9cef-84dad7fde9b9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] HCTL ('35', '-', '-', 0) found on session 40 with lun 0 {{(pid=75341) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 23:53:18 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-474cf219-ee74-430b-9cef-84dad7fde9b9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75341) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 23:53:18 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:18 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:18 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[e009002b-8bdd-4d0f-9034-5fa137ca3e85]: (4, ('- - 0', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:18 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-474cf219-ee74-430b-9cef-84dad7fde9b9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 23:53:18 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-474cf219-ee74-430b-9cef-84dad7fde9b9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:9fe06215-8adc-4370-a4be-bc75863287c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nAbXYqhW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 23:53:19 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-941fe5d3-99b2-4936-8fc2-994ccbc6a801 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Acquiring lock "9ae467da-9fb5-4f4f-a3f8-fce2ac368dda" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:53:19 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-941fe5d3-99b2-4936-8fc2-994ccbc6a801 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lock "9ae467da-9fb5-4f4f-a3f8-fce2ac368dda" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:53:19 user nova-compute[75341]: INFO nova.compute.manager [None req-941fe5d3-99b2-4936-8fc2-994ccbc6a801 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Detaching volume a9b61829-2b3b-458e-bc9f-95c318587a98
Nov 14 23:53:19 user nova-compute[75341]: INFO nova.virt.block_device [None req-941fe5d3-99b2-4936-8fc2-994ccbc6a801 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Attempting to driver detach volume a9b61829-2b3b-458e-bc9f-95c318587a98 from mountpoint /dev/vdb
Nov 14 23:53:19 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-941fe5d3-99b2-4936-8fc2-994ccbc6a801 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Attempting to detach device vdb from instance 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda from the persistent domain config. {{(pid=75341) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 23:53:19 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-941fe5d3-99b2-4936-8fc2-994ccbc6a801 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 23:53:19 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:53:19 user nova-compute[75341]:   <source dev="/dev/sdc"/>
Nov 14 23:53:19 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:53:19 user nova-compute[75341]:   <serial>a9b61829-2b3b-458e-bc9f-95c318587a98</serial>
Nov 14 23:53:19 user nova-compute[75341]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 23:53:19 user nova-compute[75341]: </disk>
Nov 14 23:53:19 user nova-compute[75341]:  {{(pid=75341) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 23:53:19 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-941fe5d3-99b2-4936-8fc2-994ccbc6a801 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Successfully detached device vdb from instance 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda from the persistent domain config.
Nov 14 23:53:19 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-941fe5d3-99b2-4936-8fc2-994ccbc6a801 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda from the live domain config. {{(pid=75341) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 23:53:19 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-941fe5d3-99b2-4936-8fc2-994ccbc6a801 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 23:53:19 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:53:19 user nova-compute[75341]:   <source dev="/dev/sdc"/>
Nov 14 23:53:19 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:53:19 user nova-compute[75341]:   <serial>a9b61829-2b3b-458e-bc9f-95c318587a98</serial>
Nov 14 23:53:19 user nova-compute[75341]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 23:53:19 user nova-compute[75341]: </disk>
Nov 14 23:53:19 user nova-compute[75341]:  {{(pid=75341) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 23:53:19 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-474cf219-ee74-430b-9cef-84dad7fde9b9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:53:19 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-474cf219-ee74-430b-9cef-84dad7fde9b9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '26135363830313036', 'path': '/dev/sdd'} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:53:19 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-474cf219-ee74-430b-9cef-84dad7fde9b9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135363830313036', 'path': '/dev/sdd'} {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 23:53:19 user nova-compute[75341]: DEBUG nova.objects.instance [None req-474cf219-ee74-430b-9cef-84dad7fde9b9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lazy-loading 'flavor' on Instance uuid d93909b3-0373-492a-8ede-7c2cd76bcb88 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:53:19 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6953d47b-5d5e-4841-91bd-63144de18a9b tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Acquiring lock "9ae467da-9fb5-4f4f-a3f8-fce2ac368dda" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:53:19 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-474cf219-ee74-430b-9cef-84dad7fde9b9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 23:53:19 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:53:19 user nova-compute[75341]:   <source dev="/dev/sdd"/>
Nov 14 23:53:19 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:53:19 user nova-compute[75341]:   <serial>9fe06215-8adc-4370-a4be-bc75863287c8</serial>
Nov 14 23:53:19 user nova-compute[75341]: </disk>
Nov 14 23:53:19 user nova-compute[75341]:  {{(pid=75341) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 23:53:19 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-474cf219-ee74-430b-9cef-84dad7fde9b9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:53:19 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-474cf219-ee74-430b-9cef-84dad7fde9b9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:53:19 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-474cf219-ee74-430b-9cef-84dad7fde9b9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] No VIF found with MAC fa:16:3e:b8:ce:f2, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:53:19 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-474cf219-ee74-430b-9cef-84dad7fde9b9 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "d93909b3-0373-492a-8ede-7c2cd76bcb88" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.543s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:53:19 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-941fe5d3-99b2-4936-8fc2-994ccbc6a801 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda {{(pid=75341) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 23:53:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1d4d733-1ebb-4784-971e-854a6e966e16 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Acquiring lock "d93909b3-0373-492a-8ede-7c2cd76bcb88" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:53:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1d4d733-1ebb-4784-971e-854a6e966e16 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "d93909b3-0373-492a-8ede-7c2cd76bcb88" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:53:21 user nova-compute[75341]: INFO nova.compute.manager [None req-a1d4d733-1ebb-4784-971e-854a6e966e16 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Detaching volume 9fe06215-8adc-4370-a4be-bc75863287c8
Nov 14 23:53:21 user nova-compute[75341]: INFO nova.virt.block_device [None req-a1d4d733-1ebb-4784-971e-854a6e966e16 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Attempting to driver detach volume 9fe06215-8adc-4370-a4be-bc75863287c8 from mountpoint /dev/vdb
Nov 14 23:53:21 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1d4d733-1ebb-4784-971e-854a6e966e16 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Attempting to detach device vdb from instance d93909b3-0373-492a-8ede-7c2cd76bcb88 from the persistent domain config. {{(pid=75341) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 23:53:21 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-a1d4d733-1ebb-4784-971e-854a6e966e16 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 23:53:21 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:53:21 user nova-compute[75341]:   <source dev="/dev/sdd"/>
Nov 14 23:53:21 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:53:21 user nova-compute[75341]:   <serial>9fe06215-8adc-4370-a4be-bc75863287c8</serial>
Nov 14 23:53:21 user nova-compute[75341]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 23:53:21 user nova-compute[75341]: </disk>
Nov 14 23:53:21 user nova-compute[75341]:  {{(pid=75341) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 23:53:21 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-a1d4d733-1ebb-4784-971e-854a6e966e16 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Successfully detached device vdb from instance d93909b3-0373-492a-8ede-7c2cd76bcb88 from the persistent domain config.
Nov 14 23:53:21 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1d4d733-1ebb-4784-971e-854a6e966e16 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d93909b3-0373-492a-8ede-7c2cd76bcb88 from the live domain config. {{(pid=75341) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 23:53:21 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-a1d4d733-1ebb-4784-971e-854a6e966e16 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 23:53:21 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:53:21 user nova-compute[75341]:   <source dev="/dev/sdd"/>
Nov 14 23:53:21 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:53:21 user nova-compute[75341]:   <serial>9fe06215-8adc-4370-a4be-bc75863287c8</serial>
Nov 14 23:53:21 user nova-compute[75341]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 23:53:21 user nova-compute[75341]: </disk>
Nov 14 23:53:21 user nova-compute[75341]:  {{(pid=75341) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 23:53:21 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:21 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1d4d733-1ebb-4784-971e-854a6e966e16 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d93909b3-0373-492a-8ede-7c2cd76bcb88 {{(pid=75341) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 23:53:21 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:22 user nova-compute[75341]: DEBUG nova.objects.instance [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lazy-loading 'flavor' on Instance uuid 2316aa9e-d4c9-43d0-9918-86265583aed1 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:53:22 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Acquiring lock "refresh_cache-2316aa9e-d4c9-43d0-9918-86265583aed1" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:53:22 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Acquired lock "refresh_cache-2316aa9e-d4c9-43d0-9918-86265583aed1" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:53:22 user nova-compute[75341]: DEBUG nova.network.neutron [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 23:53:22 user nova-compute[75341]: DEBUG nova.objects.instance [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lazy-loading 'info_cache' on Instance uuid 2316aa9e-d4c9-43d0-9918-86265583aed1 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:53:22 user nova-compute[75341]: DEBUG nova.objects.base [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Object Instance<2316aa9e-d4c9-43d0-9918-86265583aed1> lazy-loaded attributes: flavor,info_cache {{(pid=75341) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 23:53:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:22 user nova-compute[75341]: DEBUG nova.network.neutron [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Updating instance_info_cache with network_info: [{"id": "71caa935-899c-4716-9953-ae35733e691e", "address": "fa:16:3e:3d:1f:4a", "network": {"id": "167936c8-5f28-439e-9a1f-d9356b3a1ec9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374167607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e601d11e75d4ec4b7c05e615c67fe20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71caa935-89", "ovs_interfaceid": "71caa935-899c-4716-9953-ae35733e691e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:53:22 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Releasing lock "refresh_cache-2316aa9e-d4c9-43d0-9918-86265583aed1" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:53:22 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Instance destroyed successfully.
Nov 14 23:53:22 user nova-compute[75341]: DEBUG nova.objects.instance [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lazy-loading 'resources' on Instance uuid 2316aa9e-d4c9-43d0-9918-86265583aed1 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:53:22 user nova-compute[75341]: DEBUG nova.objects.base [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Object Instance<2316aa9e-d4c9-43d0-9918-86265583aed1> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75341) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 23:53:22 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:49:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-154597700',display_name='tempest-AttachVolumeTestJSON-server-154597700',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-154597700',id=32,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaFgRJa61ME1XpWOzpNtbuqeAV1SySIMy7vrqCjTh61rgrkmD4lVtobnjyZbOLvU5WmBzUQHKYD/KyyedZ/uzEQoe71Auc/XFD5jRK6KaS6v9fK21UKVH1TMup4zwPhng==',key_name='tempest-keypair-1222319400',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:49:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0e601d11e75d4ec4b7c05e615c67fe20',ramdisk_id='',reservation_id='r-2tbsxelf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1907700292',owner_user_name='tempest-AttachVolumeTestJSON-1907700292-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:51:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa84b131dff84566810c44b553b09ba8',uuid=2316aa9e-d4c9-43d0-9918-86265583aed1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "71caa935-899c-4716-9953-ae35733e691e", "address": "fa:16:3e:3d:1f:4a", "network": {"id": "167936c8-5f28-439e-9a1f-d9356b3a1ec9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374167607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e601d11e75d4ec4b7c05e615c67fe20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71caa935-89", "ovs_interfaceid": "71caa935-899c-4716-9953-ae35733e691e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 23:53:22 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Converting VIF {"id": "71caa935-899c-4716-9953-ae35733e691e", "address": "fa:16:3e:3d:1f:4a", "network": {"id": "167936c8-5f28-439e-9a1f-d9356b3a1ec9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374167607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e601d11e75d4ec4b7c05e615c67fe20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71caa935-89", "ovs_interfaceid": "71caa935-899c-4716-9953-ae35733e691e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:53:22 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:1f:4a,bridge_name='br-int',has_traffic_filtering=True,id=71caa935-899c-4716-9953-ae35733e691e,network=Network(167936c8-5f28-439e-9a1f-d9356b3a1ec9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71caa935-89') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:53:22 user nova-compute[75341]: DEBUG os_vif [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:1f:4a,bridge_name='br-int',has_traffic_filtering=True,id=71caa935-899c-4716-9953-ae35733e691e,network=Network(167936c8-5f28-439e-9a1f-d9356b3a1ec9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71caa935-89') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 23:53:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap71caa935-89, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:53:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:53:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=05abdd52-df10-4cd3-95b6-84557f31372f) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:53:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:53:22 user nova-compute[75341]: INFO os_vif [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:1f:4a,bridge_name='br-int',has_traffic_filtering=True,id=71caa935-899c-4716-9953-ae35733e691e,network=Network(167936c8-5f28-439e-9a1f-d9356b3a1ec9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71caa935-89')
Nov 14 23:53:22 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] calling os-brick to detach iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 23:53:22 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, {'target_iqn': 'iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GWOJaprl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:53:22 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:53:22 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:53:22 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:53:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:22 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[007da9ab-d5c4-477c-8c1a-5a9f9bd6cb63]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9fe06215-8adc-4370-a4be-bc75863287c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:22 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 23:53:22 user nova-compute[75341]: No targets found.
Nov 14 23:53:22 user nova-compute[75341]: iSNS:
Nov 14 23:53:22 user nova-compute[75341]: No targets found.
Nov 14 23:53:22 user nova-compute[75341]: STATIC:
Nov 14 23:53:22 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05
Nov 14 23:53:22 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:53:22 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:53:22 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418
Nov 14 23:53:22 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:53:22 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:53:22 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:9fe06215-8adc-4370-a4be-bc75863287c8
Nov 14 23:53:22 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:53:22 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:53:22 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98
Nov 14 23:53:22 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:53:22 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:53:22 user nova-compute[75341]: FIRMWARE:
Nov 14 23:53:22 user nova-compute[75341]: No targets found.
Nov 14 23:53:22 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:53:22 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 23:53:22 user nova-compute[75341]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 23:53:22 user nova-compute[75341]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75341) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 23:53:22 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418', 0)] {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 23:53:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:22 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff8e98b-0c7c-4114-8718-a1d1c48edb27]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fe06215-8adc-4370-a4be-bc75863287c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:22 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab0d5a4-1f3b-45cc-9f36-ce2dd46dbead]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fe06215-8adc-4370-a4be-bc75863287c8 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:22 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)
Nov 14 23:53:22 user nova-compute[75341]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)
Nov 14 23:53:22 user nova-compute[75341]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98 (non-flash)
Nov 14 23:53:22 user nova-compute[75341]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fe06215-8adc-4370-a4be-bc75863287c8 (non-flash)
Nov 14 23:53:22 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:53:22 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)
Nov 14 23:53:22 user nova-compute[75341]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)
Nov 14 23:53:22 user nova-compute[75341]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98 (non-flash)
Nov 14 23:53:22 user nova-compute[75341]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fe06215-8adc-4370-a4be-bc75863287c8 (non-flash)
Nov 14 23:53:22 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:53:22 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18706cfbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418'): ({'sde'}, set())}) {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 23:53:22 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Removing single pathed devices sde {{(pid=75341) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 23:53:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:22 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38deafe-346c-4a1a-a9d2-ba790c103bb3]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:22 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[97cf7611-d7b8-4849-b121-6da3dae053d3]: (4, ('ok\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:22 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Flushing IO for device /dev/sde {{(pid=75341) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 23:53:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[1979583a-efb3-4b17-a02c-88ee38e4da05]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75341) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[373b3701-331f-4065-a672-3d675763eda3]: (4, ('1', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] SCSI volumes sde have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418')] {{(pid=75341) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75f98c8-7115-4146-9550-90f867b9ad52]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 -p 172.16.0.220:3260 --logout {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[00056ee5-8d18-4b35-8ed0-8133118915d4]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418, portal: 172.16.0.220,3260]
Nov 14 23:53:23 user nova-compute[75341]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418, portal: 172.16.0.220,3260] successful.
Nov 14 23:53:23 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 -p 172.16.0.220:3260 --op delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[617156cf-d9bb-4763-8ed6-6d8cdd6ce8b5]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] <== disconnect_volume: return (345ms) None {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Disconnected iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Start _get_guest_xml network_info=[{"id": "71caa935-899c-4716-9953-ae35733e691e", "address": "fa:16:3e:3d:1f:4a", "network": {"id": "167936c8-5f28-439e-9a1f-d9356b3a1ec9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374167607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e601d11e75d4ec4b7c05e615c67fe20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71caa935-89", "ovs_interfaceid": "71caa935-899c-4716-9953-ae35733e691e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encrypted': False, 'image_id': 'e46abb82-b810-490e-a8a1-ccdc5fa1a796'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': None, 'attachment_id': 'd66f8e3c-1505-430a-835e-7de2c680a97e', 'mount_device': '/dev/vdb', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GWOJaprl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '2316aa9e-d4c9-43d0-9918-86265583aed1', 'attached_at': '', 'detached_at': '', 'volume_id': '7cdb17e6-f80d-473e-9b68-71710b6ce418', 'serial': '7cdb17e6-f80d-473e-9b68-71710b6ce418'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG nova.objects.instance [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lazy-loading 'numa_topology' on Instance uuid 2316aa9e-d4c9-43d0-9918-86265583aed1 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG nova.objects.base [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Object Instance<2316aa9e-d4c9-43d0-9918-86265583aed1> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75341) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 23:53:23 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:53:23 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:53:23 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG nova.objects.instance [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2316aa9e-d4c9-43d0-9918-86265583aed1 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG nova.objects.base [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Object Instance<2316aa9e-d4c9-43d0-9918-86265583aed1> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75341) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Calling os-brick to attach iSCSI Volume {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GWOJaprl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:53:23 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:53:23 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:53:23 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:53:23 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:53:23 user nova-compute[75341]: INFO os_brick.initiator.connectors.iscsi [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 23:53:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 -p 172.16.0.220:3260 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[0642a9b9-6869-4af8-b0e8-9fd7ca5168b3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 23:53:23 user nova-compute[75341]:  {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 -p 172.16.0.220:3260 --interface default --op new {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3ab7cc-802a-4dfc-928c-0d090702f487]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418] added\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418] added
Nov 14 23:53:23 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89f5b87-efb0-4936-a782-3ae4a18a3279]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[380ebb87-e7b3-47a9-8b5e-4891e5db1adf]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GWOJaprl {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GWOJaprl" returned: 0 in 0.029s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[13500a4f-aec7-4a2f-962a-c7ad61954788]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GWOJaprl'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca01c7e-e938-4694-9669-04832427192e]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[6372074f-d421-484c-a327-51430770913a]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fe06215-8adc-4370-a4be-bc75863287c8 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)
Nov 14 23:53:23 user nova-compute[75341]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98 (non-flash)
Nov 14 23:53:23 user nova-compute[75341]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fe06215-8adc-4370-a4be-bc75863287c8 (non-flash)
Nov 14 23:53:23 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)
Nov 14 23:53:23 user nova-compute[75341]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98 (non-flash)
Nov 14 23:53:23 user nova-compute[75341]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fe06215-8adc-4370-a4be-bc75863287c8 (non-flash)
Nov 14 23:53:23 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 -p 172.16.0.220:3260 --login {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d0eede-e669-4fc8-af99-e76746414857]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418, portal: 172.16.0.220,3260]
Nov 14 23:53:23 user nova-compute[75341]: Login to [iface: default, target: iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418, portal: 172.16.0.220,3260] successful.
Nov 14 23:53:23 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[18174576-3ca7-4634-8111-ff2cc3761261]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1958188-b03d-4fbb-a082-379fdfca9d9d]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fe06215-8adc-4370-a4be-bc75863287c8 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)
Nov 14 23:53:23 user nova-compute[75341]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98 (non-flash)
Nov 14 23:53:23 user nova-compute[75341]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fe06215-8adc-4370-a4be-bc75863287c8 (non-flash)
Nov 14 23:53:23 user nova-compute[75341]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)
Nov 14 23:53:23 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)
Nov 14 23:53:23 user nova-compute[75341]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98 (non-flash)
Nov 14 23:53:23 user nova-compute[75341]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fe06215-8adc-4370-a4be-bc75863287c8 (non-flash)
Nov 14 23:53:23 user nova-compute[75341]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)
Nov 14 23:53:23 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Connected to 172.16.0.220:3260 {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] HCTL ('36', '-', '-', 0) found on session 41 with lun 0 {{(pid=75341) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75341) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[394dcdd6-b818-4230-9e1b-9a8c001b695b]: (4, ('- - 0', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:23 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Searching for a device in session 41 and hctl ['36', '*', '*', 0] yield: None {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 23:53:24 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Searching for a device in session 41 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 23:53:24 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GWOJaprl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 23:53:24 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:53:24 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '26230623739373336', 'path': '/dev/sde'} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:53:24 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26230623739373336', 'path': '/dev/sde'} {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 23:53:24 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:49:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-154597700',display_name='tempest-AttachVolumeTestJSON-server-154597700',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-154597700',id=32,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaFgRJa61ME1XpWOzpNtbuqeAV1SySIMy7vrqCjTh61rgrkmD4lVtobnjyZbOLvU5WmBzUQHKYD/KyyedZ/uzEQoe71Auc/XFD5jRK6KaS6v9fK21UKVH1TMup4zwPhng==',key_name='tempest-keypair-1222319400',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:49:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0e601d11e75d4ec4b7c05e615c67fe20',ramdisk_id='',reservation_id='r-2tbsxelf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1907700292',owner_user_name='tempest-AttachVolumeTestJSON-1907700292-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:51:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa84b131dff84566810c44b553b09ba8',uuid=2316aa9e-d4c9-43d0-9918-86265583aed1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "71caa935-899c-4716-9953-ae35733e691e", "address": "fa:16:3e:3d:1f:4a", "network": {"id": "167936c8-5f28-439e-9a1f-d9356b3a1ec9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374167607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e601d11e75d4ec4b7c05e615c67fe20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71caa935-89", "ovs_interfaceid": "71caa935-899c-4716-9953-ae35733e691e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:53:24 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Converting VIF {"id": "71caa935-899c-4716-9953-ae35733e691e", "address": "fa:16:3e:3d:1f:4a", "network": {"id": "167936c8-5f28-439e-9a1f-d9356b3a1ec9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374167607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e601d11e75d4ec4b7c05e615c67fe20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71caa935-89", "ovs_interfaceid": "71caa935-899c-4716-9953-ae35733e691e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:53:24 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:1f:4a,bridge_name='br-int',has_traffic_filtering=True,id=71caa935-899c-4716-9953-ae35733e691e,network=Network(167936c8-5f28-439e-9a1f-d9356b3a1ec9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71caa935-89') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:53:24 user nova-compute[75341]: DEBUG nova.objects.instance [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lazy-loading 'pci_devices' on Instance uuid 2316aa9e-d4c9-43d0-9918-86265583aed1 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:53:24 user nova-compute[75341]: DEBUG nova.objects.base [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Object Instance<2316aa9e-d4c9-43d0-9918-86265583aed1> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75341) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 23:53:24 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] End _get_guest_xml xml=<domain type="kvm">
Nov 14 23:53:24 user nova-compute[75341]:   <uuid>2316aa9e-d4c9-43d0-9918-86265583aed1</uuid>
Nov 14 23:53:24 user nova-compute[75341]:   <name>instance-00000020</name>
Nov 14 23:53:24 user nova-compute[75341]:   <memory>524288</memory>
Nov 14 23:53:24 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 14 23:53:24 user nova-compute[75341]:   <metadata>
Nov 14 23:53:24 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 23:53:24 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 14 23:53:24 user nova-compute[75341]:       <nova:name>tempest-AttachVolumeTestJSON-server-154597700</nova:name>
Nov 14 23:53:24 user nova-compute[75341]:       <nova:creationTime>2023-11-14 23:53:23</nova:creationTime>
Nov 14 23:53:24 user nova-compute[75341]:       <nova:flavor name="m1.tiny">
Nov 14 23:53:24 user nova-compute[75341]:         <nova:memory>512</nova:memory>
Nov 14 23:53:24 user nova-compute[75341]:         <nova:disk>1</nova:disk>
Nov 14 23:53:24 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 14 23:53:24 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 23:53:24 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 14 23:53:24 user nova-compute[75341]:       </nova:flavor>
Nov 14 23:53:24 user nova-compute[75341]:       <nova:owner>
Nov 14 23:53:24 user nova-compute[75341]:         <nova:user uuid="aa84b131dff84566810c44b553b09ba8">tempest-AttachVolumeTestJSON-1907700292-project-member</nova:user>
Nov 14 23:53:24 user nova-compute[75341]:         <nova:project uuid="0e601d11e75d4ec4b7c05e615c67fe20">tempest-AttachVolumeTestJSON-1907700292</nova:project>
Nov 14 23:53:24 user nova-compute[75341]:       </nova:owner>
Nov 14 23:53:24 user nova-compute[75341]:       <nova:root type="image" uuid="e46abb82-b810-490e-a8a1-ccdc5fa1a796"/>
Nov 14 23:53:24 user nova-compute[75341]:       <nova:ports>
Nov 14 23:53:24 user nova-compute[75341]:         <nova:port uuid="71caa935-899c-4716-9953-ae35733e691e">
Nov 14 23:53:24 user nova-compute[75341]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 23:53:24 user nova-compute[75341]:         </nova:port>
Nov 14 23:53:24 user nova-compute[75341]:       </nova:ports>
Nov 14 23:53:24 user nova-compute[75341]:     </nova:instance>
Nov 14 23:53:24 user nova-compute[75341]:   </metadata>
Nov 14 23:53:24 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 14 23:53:24 user nova-compute[75341]:     <system>
Nov 14 23:53:24 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 23:53:24 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 14 23:53:24 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 14 23:53:24 user nova-compute[75341]:       <entry name="serial">2316aa9e-d4c9-43d0-9918-86265583aed1</entry>
Nov 14 23:53:24 user nova-compute[75341]:       <entry name="uuid">2316aa9e-d4c9-43d0-9918-86265583aed1</entry>
Nov 14 23:53:24 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 14 23:53:24 user nova-compute[75341]:     </system>
Nov 14 23:53:24 user nova-compute[75341]:   </sysinfo>
Nov 14 23:53:24 user nova-compute[75341]:   <os>
Nov 14 23:53:24 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 23:53:24 user nova-compute[75341]:     <boot dev="hd"/>
Nov 14 23:53:24 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 14 23:53:24 user nova-compute[75341]:   </os>
Nov 14 23:53:24 user nova-compute[75341]:   <features>
Nov 14 23:53:24 user nova-compute[75341]:     <acpi/>
Nov 14 23:53:24 user nova-compute[75341]:     <apic/>
Nov 14 23:53:24 user nova-compute[75341]:     <vmcoreinfo/>
Nov 14 23:53:24 user nova-compute[75341]:   </features>
Nov 14 23:53:24 user nova-compute[75341]:   <clock offset="utc">
Nov 14 23:53:24 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 23:53:24 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 23:53:24 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 14 23:53:24 user nova-compute[75341]:   </clock>
Nov 14 23:53:24 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 14 23:53:24 user nova-compute[75341]:     <model>Nehalem</model>
Nov 14 23:53:24 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 23:53:24 user nova-compute[75341]:   </cpu>
Nov 14 23:53:24 user nova-compute[75341]:   <devices>
Nov 14 23:53:24 user nova-compute[75341]:     <disk type="file" device="disk">
Nov 14 23:53:24 user nova-compute[75341]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 23:53:24 user nova-compute[75341]:       <source file="/opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/disk"/>
Nov 14 23:53:24 user nova-compute[75341]:       <target dev="vda" bus="virtio"/>
Nov 14 23:53:24 user nova-compute[75341]:     </disk>
Nov 14 23:53:24 user nova-compute[75341]:     <disk type="block" device="disk">
Nov 14 23:53:24 user nova-compute[75341]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:53:24 user nova-compute[75341]:       <source dev="/dev/sde"/>
Nov 14 23:53:24 user nova-compute[75341]:       <target dev="vdb" bus="virtio"/>
Nov 14 23:53:24 user nova-compute[75341]:       <serial>7cdb17e6-f80d-473e-9b68-71710b6ce418</serial>
Nov 14 23:53:24 user nova-compute[75341]:     </disk>
Nov 14 23:53:24 user nova-compute[75341]:     <interface type="ethernet">
Nov 14 23:53:24 user nova-compute[75341]:       <mac address="fa:16:3e:3d:1f:4a"/>
Nov 14 23:53:24 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:53:24 user nova-compute[75341]:       <mtu size="1442"/>
Nov 14 23:53:24 user nova-compute[75341]:       <target dev="tap71caa935-89"/>
Nov 14 23:53:24 user nova-compute[75341]:     </interface>
Nov 14 23:53:24 user nova-compute[75341]:     <serial type="pty">
Nov 14 23:53:24 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/console.log" append="off"/>
Nov 14 23:53:24 user nova-compute[75341]:     </serial>
Nov 14 23:53:24 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 23:53:24 user nova-compute[75341]:     <video>
Nov 14 23:53:24 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:53:24 user nova-compute[75341]:     </video>
Nov 14 23:53:24 user nova-compute[75341]:     <rng model="virtio">
Nov 14 23:53:24 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 14 23:53:24 user nova-compute[75341]:     </rng>
Nov 14 23:53:24 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 14 23:53:24 user nova-compute[75341]:     <memballoon model="virtio">
Nov 14 23:53:24 user nova-compute[75341]:       <stats period="10"/>
Nov 14 23:53:24 user nova-compute[75341]:     </memballoon>
Nov 14 23:53:24 user nova-compute[75341]:   </devices>
Nov 14 23:53:24 user nova-compute[75341]: </domain>
Nov 14 23:53:24 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 23:53:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:25 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:25 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 23:53:25 user nova-compute[75341]: DEBUG nova.objects.instance [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2316aa9e-d4c9-43d0-9918-86265583aed1 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:53:25 user nova-compute[75341]: DEBUG nova.objects.base [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Object Instance<2316aa9e-d4c9-43d0-9918-86265583aed1> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75341) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 23:53:25 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:25 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.390s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:25 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/disk. size=1073741824 {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 23:53:25 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:25 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:25 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Cannot resize image /opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/disk to a smaller size. {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 23:53:25 user nova-compute[75341]: DEBUG nova.objects.instance [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lazy-loading 'migration_context' on Instance uuid 2316aa9e-d4c9-43d0-9918-86265583aed1 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:53:25 user nova-compute[75341]: DEBUG nova.objects.base [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Object Instance<2316aa9e-d4c9-43d0-9918-86265583aed1> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75341) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 23:53:25 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:49:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-154597700',display_name='tempest-AttachVolumeTestJSON-server-154597700',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-154597700',id=32,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaFgRJa61ME1XpWOzpNtbuqeAV1SySIMy7vrqCjTh61rgrkmD4lVtobnjyZbOLvU5WmBzUQHKYD/KyyedZ/uzEQoe71Auc/XFD5jRK6KaS6v9fK21UKVH1TMup4zwPhng==',key_name='tempest-keypair-1222319400',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:49:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='0e601d11e75d4ec4b7c05e615c67fe20',ramdisk_id='',reservation_id='r-2tbsxelf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1907700292',owner_user_name='tempest-AttachVolumeTestJSON-1907700292-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:51:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa84b131dff84566810c44b553b09ba8',uuid=2316aa9e-d4c9-43d0-9918-86265583aed1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "71caa935-899c-4716-9953-ae35733e691e", "address": "fa:16:3e:3d:1f:4a", "network": {"id": "167936c8-5f28-439e-9a1f-d9356b3a1ec9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374167607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e601d11e75d4ec4b7c05e615c67fe20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71caa935-89", "ovs_interfaceid": "71caa935-899c-4716-9953-ae35733e691e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 23:53:25 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Converting VIF {"id": "71caa935-899c-4716-9953-ae35733e691e", "address": "fa:16:3e:3d:1f:4a", "network": {"id": "167936c8-5f28-439e-9a1f-d9356b3a1ec9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374167607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e601d11e75d4ec4b7c05e615c67fe20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71caa935-89", "ovs_interfaceid": "71caa935-899c-4716-9953-ae35733e691e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:53:25 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:1f:4a,bridge_name='br-int',has_traffic_filtering=True,id=71caa935-899c-4716-9953-ae35733e691e,network=Network(167936c8-5f28-439e-9a1f-d9356b3a1ec9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71caa935-89') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:53:25 user nova-compute[75341]: DEBUG os_vif [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:1f:4a,bridge_name='br-int',has_traffic_filtering=True,id=71caa935-899c-4716-9953-ae35733e691e,network=Network(167936c8-5f28-439e-9a1f-d9356b3a1ec9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71caa935-89') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 23:53:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:53:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 23:53:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bacad1c4-5f95-5d0b-b16d-03bac3402380', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:53:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:53:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap71caa935-89, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:53:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap71caa935-89, col_values=(('qos', UUID('684651ef-f885-43a6-ae10-5e7ab48ad06f')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:53:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap71caa935-89, col_values=(('external_ids', {'iface-id': '71caa935-899c-4716-9953-ae35733e691e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:1f:4a', 'vm-uuid': '2316aa9e-d4c9-43d0-9918-86265583aed1'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:53:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:53:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:25 user nova-compute[75341]: INFO os_vif [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:1f:4a,bridge_name='br-int',has_traffic_filtering=True,id=71caa935-899c-4716-9953-ae35733e691e,network=Network(167936c8-5f28-439e-9a1f-d9356b3a1ec9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71caa935-89')
Nov 14 23:53:26 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:27 user nova-compute[75341]: DEBUG nova.compute.manager [req-fd8915a1-a2af-469c-8280-1108780f835c req-18652eba-cadb-4b8b-bd9a-f420ff7539c2 service nova] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Received event network-vif-plugged-71caa935-899c-4716-9953-ae35733e691e {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:53:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-fd8915a1-a2af-469c-8280-1108780f835c req-18652eba-cadb-4b8b-bd9a-f420ff7539c2 service nova] Acquiring lock "2316aa9e-d4c9-43d0-9918-86265583aed1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:53:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-fd8915a1-a2af-469c-8280-1108780f835c req-18652eba-cadb-4b8b-bd9a-f420ff7539c2 service nova] Lock "2316aa9e-d4c9-43d0-9918-86265583aed1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:53:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-fd8915a1-a2af-469c-8280-1108780f835c req-18652eba-cadb-4b8b-bd9a-f420ff7539c2 service nova] Lock "2316aa9e-d4c9-43d0-9918-86265583aed1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:53:27 user nova-compute[75341]: DEBUG nova.compute.manager [req-fd8915a1-a2af-469c-8280-1108780f835c req-18652eba-cadb-4b8b-bd9a-f420ff7539c2 service nova] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] No waiting events found dispatching network-vif-plugged-71caa935-899c-4716-9953-ae35733e691e {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:53:27 user nova-compute[75341]: WARNING nova.compute.manager [req-fd8915a1-a2af-469c-8280-1108780f835c req-18652eba-cadb-4b8b-bd9a-f420ff7539c2 service nova] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Received unexpected event network-vif-plugged-71caa935-899c-4716-9953-ae35733e691e for instance with vm_state stopped and task_state powering-on.
Nov 14 23:53:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:29 user nova-compute[75341]: DEBUG nova.compute.manager [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Instance event wait completed in 0 seconds for  {{(pid=75341) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 23:53:29 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Instance rebooted successfully.
Nov 14 23:53:29 user nova-compute[75341]: DEBUG nova.compute.manager [None req-3841b922-6362-4b4c-842a-104b1148fdc8 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 23:53:29 user nova-compute[75341]: DEBUG nova.compute.manager [req-4a087070-b725-4d1a-8fa4-8edc7f6611ed req-d260603b-72ee-4dce-8063-915bc5a4b968 service nova] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Received event network-vif-plugged-71caa935-899c-4716-9953-ae35733e691e {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:53:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4a087070-b725-4d1a-8fa4-8edc7f6611ed req-d260603b-72ee-4dce-8063-915bc5a4b968 service nova] Acquiring lock "2316aa9e-d4c9-43d0-9918-86265583aed1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:53:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4a087070-b725-4d1a-8fa4-8edc7f6611ed req-d260603b-72ee-4dce-8063-915bc5a4b968 service nova] Lock "2316aa9e-d4c9-43d0-9918-86265583aed1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:53:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4a087070-b725-4d1a-8fa4-8edc7f6611ed req-d260603b-72ee-4dce-8063-915bc5a4b968 service nova] Lock "2316aa9e-d4c9-43d0-9918-86265583aed1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:53:29 user nova-compute[75341]: DEBUG nova.compute.manager [req-4a087070-b725-4d1a-8fa4-8edc7f6611ed req-d260603b-72ee-4dce-8063-915bc5a4b968 service nova] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] No waiting events found dispatching network-vif-plugged-71caa935-899c-4716-9953-ae35733e691e {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:53:29 user nova-compute[75341]: WARNING nova.compute.manager [req-4a087070-b725-4d1a-8fa4-8edc7f6611ed req-d260603b-72ee-4dce-8063-915bc5a4b968 service nova] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Received unexpected event network-vif-plugged-71caa935-899c-4716-9953-ae35733e691e for instance with vm_state stopped and task_state powering-on.
Nov 14 23:53:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:35 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:39 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-941fe5d3-99b2-4936-8fc2-994ccbc6a801 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda is timed out.
Nov 14 23:53:39 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-941fe5d3-99b2-4936-8fc2-994ccbc6a801 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Successfully detached device vdb from instance 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda from the live domain config.
Nov 14 23:53:39 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-941fe5d3-99b2-4936-8fc2-994ccbc6a801 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] calling os-brick to detach iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 23:53:39 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-941fe5d3-99b2-4936-8fc2-994ccbc6a801 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, {'target_iqn': 'iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wsoGTWxX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:53:39 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-941fe5d3-99b2-4936-8fc2-994ccbc6a801 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:53:39 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-941fe5d3-99b2-4936-8fc2-994ccbc6a801 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:53:39 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-941fe5d3-99b2-4936-8fc2-994ccbc6a801 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:53:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:39 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee93390d-60e5-4e73-94f5-5365ae00fcf2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9fe06215-8adc-4370-a4be-bc75863287c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:39 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-941fe5d3-99b2-4936-8fc2-994ccbc6a801 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 23:53:39 user nova-compute[75341]: No targets found.
Nov 14 23:53:39 user nova-compute[75341]: iSNS:
Nov 14 23:53:39 user nova-compute[75341]: No targets found.
Nov 14 23:53:39 user nova-compute[75341]: STATIC:
Nov 14 23:53:39 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05
Nov 14 23:53:39 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:53:39 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:53:39 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418
Nov 14 23:53:39 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:53:39 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:53:39 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:9fe06215-8adc-4370-a4be-bc75863287c8
Nov 14 23:53:39 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:53:39 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:53:39 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98
Nov 14 23:53:39 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:53:39 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:53:39 user nova-compute[75341]: FIRMWARE:
Nov 14 23:53:39 user nova-compute[75341]: No targets found.
Nov 14 23:53:39 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:53:39 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-941fe5d3-99b2-4936-8fc2-994ccbc6a801 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 23:53:39 user nova-compute[75341]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 23:53:39 user nova-compute[75341]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75341) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 23:53:39 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-941fe5d3-99b2-4936-8fc2-994ccbc6a801 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98', 0)] {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 23:53:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:39 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb19d584-ca49-4299-94e3-8c413c64c4e7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fe06215-8adc-4370-a4be-bc75863287c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:39 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee16e62-c39e-4417-9f63-2361ff764c4b]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fe06215-8adc-4370-a4be-bc75863287c8 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:39 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-941fe5d3-99b2-4936-8fc2-994ccbc6a801 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)
Nov 14 23:53:39 user nova-compute[75341]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98 (non-flash)
Nov 14 23:53:39 user nova-compute[75341]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fe06215-8adc-4370-a4be-bc75863287c8 (non-flash)
Nov 14 23:53:39 user nova-compute[75341]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)
Nov 14 23:53:39 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:53:39 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-941fe5d3-99b2-4936-8fc2-994ccbc6a801 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)
Nov 14 23:53:39 user nova-compute[75341]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98 (non-flash)
Nov 14 23:53:39 user nova-compute[75341]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fe06215-8adc-4370-a4be-bc75863287c8 (non-flash)
Nov 14 23:53:39 user nova-compute[75341]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)
Nov 14 23:53:39 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:53:39 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-941fe5d3-99b2-4936-8fc2-994ccbc6a801 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f187027c1f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98'): ({'sdc'}, set())}) {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 23:53:39 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-941fe5d3-99b2-4936-8fc2-994ccbc6a801 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Removing single pathed devices sdc {{(pid=75341) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 23:53:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:39 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f19747-bf96-4a75-b7da-12065d384796]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:39 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[258df427-0d82-4ed7-b2c0-e95575934c07]: (4, ('ok\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:39 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-941fe5d3-99b2-4936-8fc2-994ccbc6a801 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Flushing IO for device /dev/sdc {{(pid=75341) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 23:53:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:39 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[705d80ea-0ea9-4ab2-a481-7347a07f02e3]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:39 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-941fe5d3-99b2-4936-8fc2-994ccbc6a801 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75341) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 23:53:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:40 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:40 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a814223-b7f7-48b8-8cf6-9673d161d683]: (4, ('1', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:40 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-941fe5d3-99b2-4936-8fc2-994ccbc6a801 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 23:53:40 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-941fe5d3-99b2-4936-8fc2-994ccbc6a801 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] SCSI volumes sdc have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 23:53:40 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-941fe5d3-99b2-4936-8fc2-994ccbc6a801 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98')] {{(pid=75341) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 23:53:40 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:40 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:40 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[56bfb912-f55c-48b1-9580-31e4fee49a96]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:40 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-941fe5d3-99b2-4936-8fc2-994ccbc6a801 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:53:40 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98 -p 172.16.0.220:3260 --logout {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:40 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:40 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73afe4f-a72e-491a-8155-8475d5b4aab5]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:40 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-941fe5d3-99b2-4936-8fc2-994ccbc6a801 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98, portal: 172.16.0.220,3260]
Nov 14 23:53:40 user nova-compute[75341]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98, portal: 172.16.0.220,3260] successful.
Nov 14 23:53:40 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:53:40 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98 -p 172.16.0.220:3260 --op delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:40 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:40 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd004663-742e-476d-88f2-0abc603d2886]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:40 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-941fe5d3-99b2-4936-8fc2-994ccbc6a801 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:53:40 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-941fe5d3-99b2-4936-8fc2-994ccbc6a801 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:53:40 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-941fe5d3-99b2-4936-8fc2-994ccbc6a801 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] <== disconnect_volume: return (351ms) None {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:53:40 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-941fe5d3-99b2-4936-8fc2-994ccbc6a801 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Disconnected iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 23:53:40 user nova-compute[75341]: DEBUG nova.compute.manager [req-255fbf0b-a9ad-474a-abcb-79241fceb2a9 req-03a98f10-cbda-4ffd-83a7-29d6aefe2ba0 service nova] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Received event network-changed-d5f6d779-3733-459c-8144-771980cd9ec2 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:53:40 user nova-compute[75341]: DEBUG nova.compute.manager [req-255fbf0b-a9ad-474a-abcb-79241fceb2a9 req-03a98f10-cbda-4ffd-83a7-29d6aefe2ba0 service nova] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Refreshing instance network info cache due to event network-changed-d5f6d779-3733-459c-8144-771980cd9ec2. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:53:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-255fbf0b-a9ad-474a-abcb-79241fceb2a9 req-03a98f10-cbda-4ffd-83a7-29d6aefe2ba0 service nova] Acquiring lock "refresh_cache-53d7a6fe-3914-459a-9494-c75549af7b9f" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:53:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-255fbf0b-a9ad-474a-abcb-79241fceb2a9 req-03a98f10-cbda-4ffd-83a7-29d6aefe2ba0 service nova] Acquired lock "refresh_cache-53d7a6fe-3914-459a-9494-c75549af7b9f" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:53:40 user nova-compute[75341]: DEBUG nova.network.neutron [req-255fbf0b-a9ad-474a-abcb-79241fceb2a9 req-03a98f10-cbda-4ffd-83a7-29d6aefe2ba0 service nova] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Refreshing network info cache for port d5f6d779-3733-459c-8144-771980cd9ec2 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:53:40 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:53:40 user nova-compute[75341]: DEBUG nova.objects.instance [None req-941fe5d3-99b2-4936-8fc2-994ccbc6a801 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lazy-loading 'flavor' on Instance uuid 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-941fe5d3-99b2-4936-8fc2-994ccbc6a801 tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lock "9ae467da-9fb5-4f4f-a3f8-fce2ac368dda" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.047s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6953d47b-5d5e-4841-91bd-63144de18a9b tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lock "9ae467da-9fb5-4f4f-a3f8-fce2ac368dda" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.900s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6953d47b-5d5e-4841-91bd-63144de18a9b tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Acquiring lock "9ae467da-9fb5-4f4f-a3f8-fce2ac368dda-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6953d47b-5d5e-4841-91bd-63144de18a9b tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lock "9ae467da-9fb5-4f4f-a3f8-fce2ac368dda-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6953d47b-5d5e-4841-91bd-63144de18a9b tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lock "9ae467da-9fb5-4f4f-a3f8-fce2ac368dda-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:53:41 user nova-compute[75341]: INFO nova.compute.manager [None req-6953d47b-5d5e-4841-91bd-63144de18a9b tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Terminating instance
Nov 14 23:53:41 user nova-compute[75341]: DEBUG nova.compute.manager [None req-6953d47b-5d5e-4841-91bd-63144de18a9b tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Start destroying the instance on the hypervisor. {{(pid=75341) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG nova.network.neutron [req-255fbf0b-a9ad-474a-abcb-79241fceb2a9 req-03a98f10-cbda-4ffd-83a7-29d6aefe2ba0 service nova] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Updated VIF entry in instance network info cache for port d5f6d779-3733-459c-8144-771980cd9ec2. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG nova.network.neutron [req-255fbf0b-a9ad-474a-abcb-79241fceb2a9 req-03a98f10-cbda-4ffd-83a7-29d6aefe2ba0 service nova] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Updating instance_info_cache with network_info: [{"id": "d5f6d779-3733-459c-8144-771980cd9ec2", "address": "fa:16:3e:14:63:0c", "network": {"id": "e4c01dfd-427e-4d61-92e0-170e541b1fb9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2053751717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "080d7a9c1501453d94616cf03ea12473", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f6d779-37", "ovs_interfaceid": "d5f6d779-3733-459c-8144-771980cd9ec2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-255fbf0b-a9ad-474a-abcb-79241fceb2a9 req-03a98f10-cbda-4ffd-83a7-29d6aefe2ba0 service nova] Releasing lock "refresh_cache-53d7a6fe-3914-459a-9494-c75549af7b9f" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:53:41 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1d4d733-1ebb-4784-971e-854a6e966e16 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d93909b3-0373-492a-8ede-7c2cd76bcb88 is timed out.
Nov 14 23:53:41 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-a1d4d733-1ebb-4784-971e-854a6e966e16 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Successfully detached device vdb from instance d93909b3-0373-492a-8ede-7c2cd76bcb88 from the live domain config.
Nov 14 23:53:41 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1d4d733-1ebb-4784-971e-854a6e966e16 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] calling os-brick to detach iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d4d733-1ebb-4784-971e-854a6e966e16 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, {'target_iqn': 'iqn.2010-10.org.openstack:9fe06215-8adc-4370-a4be-bc75863287c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nAbXYqhW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:53:41 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-a1d4d733-1ebb-4784-971e-854a6e966e16 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:53:41 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-a1d4d733-1ebb-4784-971e-854a6e966e16 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-a1d4d733-1ebb-4784-971e-854a6e966e16 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[f657e4e1-b3ee-437b-8dad-f70c285403c5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9fe06215-8adc-4370-a4be-bc75863287c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d4d733-1ebb-4784-971e-854a6e966e16 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 23:53:41 user nova-compute[75341]: No targets found.
Nov 14 23:53:41 user nova-compute[75341]: iSNS:
Nov 14 23:53:41 user nova-compute[75341]: No targets found.
Nov 14 23:53:41 user nova-compute[75341]: STATIC:
Nov 14 23:53:41 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05
Nov 14 23:53:41 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:53:41 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:53:41 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418
Nov 14 23:53:41 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:53:41 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:53:41 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:9fe06215-8adc-4370-a4be-bc75863287c8
Nov 14 23:53:41 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:53:41 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:53:41 user nova-compute[75341]: FIRMWARE:
Nov 14 23:53:41 user nova-compute[75341]: No targets found.
Nov 14 23:53:41 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d4d733-1ebb-4784-971e-854a6e966e16 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 23:53:41 user nova-compute[75341]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 23:53:41 user nova-compute[75341]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75341) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d4d733-1ebb-4784-971e-854a6e966e16 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9fe06215-8adc-4370-a4be-bc75863287c8', 0)] {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c466db-10a3-4c1f-acca-899a44eba298]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fe06215-8adc-4370-a4be-bc75863287c8\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5fa454-9a5c-43fc-9100-88de7138b729]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fe06215-8adc-4370-a4be-bc75863287c8 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d4d733-1ebb-4784-971e-854a6e966e16 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)
Nov 14 23:53:41 user nova-compute[75341]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fe06215-8adc-4370-a4be-bc75863287c8 (non-flash)
Nov 14 23:53:41 user nova-compute[75341]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)
Nov 14 23:53:41 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d4d733-1ebb-4784-971e-854a6e966e16 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)
Nov 14 23:53:41 user nova-compute[75341]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fe06215-8adc-4370-a4be-bc75863287c8 (non-flash)
Nov 14 23:53:41 user nova-compute[75341]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)
Nov 14 23:53:41 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d4d733-1ebb-4784-971e-854a6e966e16 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18701ee320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9fe06215-8adc-4370-a4be-bc75863287c8'): ({'sdd'}, set())}) {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-a1d4d733-1ebb-4784-971e-854a6e966e16 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Removing single pathed devices sdd {{(pid=75341) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b08e79-8afe-4447-a99e-5c04ceaa0a48]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe8ebfe-3a0c-4009-b770-ac84abc0c798]: (4, ('ok\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-a1d4d733-1ebb-4784-971e-854a6e966e16 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Flushing IO for device /dev/sdd {{(pid=75341) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[3390d659-d0c0-4a0e-9b44-9a6f1fe821bc]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-a1d4d733-1ebb-4784-971e-854a6e966e16 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75341) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ff9bb8-2aae-41d4-95f1-65492cad101b]: (4, ('1', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-a1d4d733-1ebb-4784-971e-854a6e966e16 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-a1d4d733-1ebb-4784-971e-854a6e966e16 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] SCSI volumes sdd have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d4d733-1ebb-4784-971e-854a6e966e16 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9fe06215-8adc-4370-a4be-bc75863287c8')] {{(pid=75341) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fe06215-8adc-4370-a4be-bc75863287c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fe06215-8adc-4370-a4be-bc75863287c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a30570-f09a-45d0-81ed-84008c76c9cf]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d4d733-1ebb-4784-971e-854a6e966e16 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fe06215-8adc-4370-a4be-bc75863287c8 -p 172.16.0.220:3260 --logout {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:41 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Instance destroyed successfully.
Nov 14 23:53:41 user nova-compute[75341]: DEBUG nova.objects.instance [None req-6953d47b-5d5e-4841-91bd-63144de18a9b tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lazy-loading 'resources' on Instance uuid 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-6953d47b-5d5e-4841-91bd-63144de18a9b tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:51:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-858091869',display_name='tempest-VolumesSnapshotTestJSON-instance-858091869',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-858091869',id=35,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOtU4Pktbdyp+rAxebRS1Lf5w3oyVZ6otPK/Z7aaavIiS0Whae/I/ID/IsuZkN2wQYssXsm12CkdoL6OZOUZBcpV3M8qDitWaYSgGM0YRUh7iRuhtRm4QndkquGbkH7qeQ==',key_name='tempest-keypair-1785368385',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:51:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f694dc021a9442a49bbde9f367fbefc6',ramdisk_id='',reservation_id='r-lkvbm8k2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1856831414',owner_user_name='tempest-VolumesSnapshotTestJSON-1856831414-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:51:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='526fe3083ac541b79d7dbfb9b5abaf7c',uuid=9ae467da-9fb5-4f4f-a3f8-fce2ac368dda,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ac8d528-5147-460f-abf8-4e33ac66c4f4", "address": "fa:16:3e:72:4d:66", "network": {"id": "a1cc71d9-4161-4044-ad08-02aa4a7aef1c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-73156846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f694dc021a9442a49bbde9f367fbefc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac8d528-51", "ovs_interfaceid": "0ac8d528-5147-460f-abf8-4e33ac66c4f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-6953d47b-5d5e-4841-91bd-63144de18a9b tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Converting VIF {"id": "0ac8d528-5147-460f-abf8-4e33ac66c4f4", "address": "fa:16:3e:72:4d:66", "network": {"id": "a1cc71d9-4161-4044-ad08-02aa4a7aef1c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-73156846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f694dc021a9442a49bbde9f367fbefc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac8d528-51", "ovs_interfaceid": "0ac8d528-5147-460f-abf8-4e33ac66c4f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-6953d47b-5d5e-4841-91bd-63144de18a9b tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:72:4d:66,bridge_name='br-int',has_traffic_filtering=True,id=0ac8d528-5147-460f-abf8-4e33ac66c4f4,network=Network(a1cc71d9-4161-4044-ad08-02aa4a7aef1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ac8d528-51') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG os_vif [None req-6953d47b-5d5e-4841-91bd-63144de18a9b tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:4d:66,bridge_name='br-int',has_traffic_filtering=True,id=0ac8d528-5147-460f-abf8-4e33ac66c4f4,network=Network(a1cc71d9-4161-4044-ad08-02aa4a7aef1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ac8d528-51') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ac8d528-51, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d659d4c6-b182-4f37-bcc7-0a9f01ef3a87) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:41 user nova-compute[75341]: INFO os_vif [None req-6953d47b-5d5e-4841-91bd-63144de18a9b tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:4d:66,bridge_name='br-int',has_traffic_filtering=True,id=0ac8d528-5147-460f-abf8-4e33ac66c4f4,network=Network(a1cc71d9-4161-4044-ad08-02aa4a7aef1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ac8d528-51')
Nov 14 23:53:41 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6953d47b-5d5e-4841-91bd-63144de18a9b tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] calling os-brick to detach iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6953d47b-5d5e-4841-91bd-63144de18a9b tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, {'target_iqn': 'iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wsoGTWxX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:53:41 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-6953d47b-5d5e-4841-91bd-63144de18a9b tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:53:41 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-6953d47b-5d5e-4841-91bd-63144de18a9b tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fe06215-8adc-4370-a4be-bc75863287c8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b796642-b099-4c88-9e6b-d6748e42b9dc]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:9fe06215-8adc-4370-a4be-bc75863287c8, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:9fe06215-8adc-4370-a4be-bc75863287c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d4d733-1ebb-4784-971e-854a6e966e16 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:9fe06215-8adc-4370-a4be-bc75863287c8, portal: 172.16.0.220,3260]
Nov 14 23:53:41 user nova-compute[75341]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:9fe06215-8adc-4370-a4be-bc75863287c8, portal: 172.16.0.220,3260] successful.
Nov 14 23:53:41 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fe06215-8adc-4370-a4be-bc75863287c8 -p 172.16.0.220:3260 --op delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fe06215-8adc-4370-a4be-bc75863287c8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a91830-9519-470a-9aa3-2572fc78201e]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d4d733-1ebb-4784-971e-854a6e966e16 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-a1d4d733-1ebb-4784-971e-854a6e966e16 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.378s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d4d733-1ebb-4784-971e-854a6e966e16 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] <== disconnect_volume: return (380ms) None {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1d4d733-1ebb-4784-971e-854a6e966e16 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Disconnected iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-6953d47b-5d5e-4841-91bd-63144de18a9b tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.047s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:53:41 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:42 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[5edd2a43-4065-4d81-853c-51974c8ff4c6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:42 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6953d47b-5d5e-4841-91bd-63144de18a9b tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 23:53:42 user nova-compute[75341]: No targets found.
Nov 14 23:53:42 user nova-compute[75341]: iSNS:
Nov 14 23:53:42 user nova-compute[75341]: No targets found.
Nov 14 23:53:42 user nova-compute[75341]: STATIC:
Nov 14 23:53:42 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05
Nov 14 23:53:42 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:53:42 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:53:42 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418
Nov 14 23:53:42 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:53:42 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:53:42 user nova-compute[75341]: FIRMWARE:
Nov 14 23:53:42 user nova-compute[75341]: No targets found.
Nov 14 23:53:42 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:53:42 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6953d47b-5d5e-4841-91bd-63144de18a9b tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 23:53:42 user nova-compute[75341]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 23:53:42 user nova-compute[75341]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75341) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 23:53:42 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6953d47b-5d5e-4841-91bd-63144de18a9b tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9b61829-2b3b-458e-bc9f-95c318587a98', 0)] {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 23:53:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:42 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a12466-157f-409b-9573-cf482e1d8c34]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:42 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d81cf9-8df0-452d-b167-ae9dd1897f04]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:42 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6953d47b-5d5e-4841-91bd-63144de18a9b tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)
Nov 14 23:53:42 user nova-compute[75341]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)
Nov 14 23:53:42 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:53:42 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6953d47b-5d5e-4841-91bd-63144de18a9b tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)
Nov 14 23:53:42 user nova-compute[75341]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)
Nov 14 23:53:42 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:53:42 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6953d47b-5d5e-4841-91bd-63144de18a9b tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f189023c820>, {}) {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 23:53:42 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6953d47b-5d5e-4841-91bd-63144de18a9b tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Disconnecting from: [] {{(pid=75341) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 23:53:42 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-6953d47b-5d5e-4841-91bd-63144de18a9b tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.077s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:53:42 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6953d47b-5d5e-4841-91bd-63144de18a9b tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] <== disconnect_volume: return (124ms) None {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:53:42 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6953d47b-5d5e-4841-91bd-63144de18a9b tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Disconnected iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 23:53:42 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-6953d47b-5d5e-4841-91bd-63144de18a9b tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Deleting instance files /opt/stack/data/nova/instances/9ae467da-9fb5-4f4f-a3f8-fce2ac368dda_del
Nov 14 23:53:42 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-6953d47b-5d5e-4841-91bd-63144de18a9b tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Deletion of /opt/stack/data/nova/instances/9ae467da-9fb5-4f4f-a3f8-fce2ac368dda_del complete
Nov 14 23:53:42 user nova-compute[75341]: INFO nova.compute.manager [None req-6953d47b-5d5e-4841-91bd-63144de18a9b tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Took 1.06 seconds to destroy the instance on the hypervisor.
Nov 14 23:53:42 user nova-compute[75341]: DEBUG oslo.service.loopingcall [None req-6953d47b-5d5e-4841-91bd-63144de18a9b tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75341) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 23:53:42 user nova-compute[75341]: DEBUG nova.compute.manager [-] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Deallocating network for instance {{(pid=75341) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 23:53:42 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] deallocate_for_instance() {{(pid=75341) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 23:53:42 user nova-compute[75341]: DEBUG nova.compute.manager [req-d4f9bed6-8a7b-4a54-a34c-5f38cd1360fd req-a2822658-842b-4b79-bb13-c6d442ad2cbb service nova] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Received event network-vif-unplugged-0ac8d528-5147-460f-abf8-4e33ac66c4f4 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:53:42 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-d4f9bed6-8a7b-4a54-a34c-5f38cd1360fd req-a2822658-842b-4b79-bb13-c6d442ad2cbb service nova] Acquiring lock "9ae467da-9fb5-4f4f-a3f8-fce2ac368dda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:53:42 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-d4f9bed6-8a7b-4a54-a34c-5f38cd1360fd req-a2822658-842b-4b79-bb13-c6d442ad2cbb service nova] Lock "9ae467da-9fb5-4f4f-a3f8-fce2ac368dda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:53:42 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-d4f9bed6-8a7b-4a54-a34c-5f38cd1360fd req-a2822658-842b-4b79-bb13-c6d442ad2cbb service nova] Lock "9ae467da-9fb5-4f4f-a3f8-fce2ac368dda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:53:42 user nova-compute[75341]: DEBUG nova.compute.manager [req-d4f9bed6-8a7b-4a54-a34c-5f38cd1360fd req-a2822658-842b-4b79-bb13-c6d442ad2cbb service nova] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] No waiting events found dispatching network-vif-unplugged-0ac8d528-5147-460f-abf8-4e33ac66c4f4 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:53:42 user nova-compute[75341]: DEBUG nova.compute.manager [req-d4f9bed6-8a7b-4a54-a34c-5f38cd1360fd req-a2822658-842b-4b79-bb13-c6d442ad2cbb service nova] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Received event network-vif-unplugged-0ac8d528-5147-460f-abf8-4e33ac66c4f4 for instance with task_state deleting. {{(pid=75341) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 23:53:42 user nova-compute[75341]: DEBUG nova.compute.manager [req-d4f9bed6-8a7b-4a54-a34c-5f38cd1360fd req-a2822658-842b-4b79-bb13-c6d442ad2cbb service nova] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Received event network-vif-plugged-0ac8d528-5147-460f-abf8-4e33ac66c4f4 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:53:42 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-d4f9bed6-8a7b-4a54-a34c-5f38cd1360fd req-a2822658-842b-4b79-bb13-c6d442ad2cbb service nova] Acquiring lock "9ae467da-9fb5-4f4f-a3f8-fce2ac368dda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:53:42 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-d4f9bed6-8a7b-4a54-a34c-5f38cd1360fd req-a2822658-842b-4b79-bb13-c6d442ad2cbb service nova] Lock "9ae467da-9fb5-4f4f-a3f8-fce2ac368dda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:53:42 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-d4f9bed6-8a7b-4a54-a34c-5f38cd1360fd req-a2822658-842b-4b79-bb13-c6d442ad2cbb service nova] Lock "9ae467da-9fb5-4f4f-a3f8-fce2ac368dda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:53:42 user nova-compute[75341]: DEBUG nova.compute.manager [req-d4f9bed6-8a7b-4a54-a34c-5f38cd1360fd req-a2822658-842b-4b79-bb13-c6d442ad2cbb service nova] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] No waiting events found dispatching network-vif-plugged-0ac8d528-5147-460f-abf8-4e33ac66c4f4 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:53:42 user nova-compute[75341]: WARNING nova.compute.manager [req-d4f9bed6-8a7b-4a54-a34c-5f38cd1360fd req-a2822658-842b-4b79-bb13-c6d442ad2cbb service nova] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Received unexpected event network-vif-plugged-0ac8d528-5147-460f-abf8-4e33ac66c4f4 for instance with vm_state active and task_state deleting.
Nov 14 23:53:42 user nova-compute[75341]: DEBUG nova.objects.instance [None req-a1d4d733-1ebb-4784-971e-854a6e966e16 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lazy-loading 'flavor' on Instance uuid d93909b3-0373-492a-8ede-7c2cd76bcb88 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:53:42 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1d4d733-1ebb-4784-971e-854a6e966e16 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "d93909b3-0373-492a-8ede-7c2cd76bcb88" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.768s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:53:43 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:53:43 user nova-compute[75341]: DEBUG nova.compute.manager [req-c490abf4-fd16-4ee4-8d00-f47968d17b6b req-6eb38360-6fc5-494e-a190-1f0fe1a56dfa service nova] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Received event network-vif-deleted-0ac8d528-5147-460f-abf8-4e33ac66c4f4 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:53:43 user nova-compute[75341]: INFO nova.compute.manager [req-c490abf4-fd16-4ee4-8d00-f47968d17b6b req-6eb38360-6fc5-494e-a190-1f0fe1a56dfa service nova] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Neutron deleted interface 0ac8d528-5147-460f-abf8-4e33ac66c4f4; detaching it from the instance and deleting it from the info cache
Nov 14 23:53:43 user nova-compute[75341]: DEBUG nova.network.neutron [req-c490abf4-fd16-4ee4-8d00-f47968d17b6b req-6eb38360-6fc5-494e-a190-1f0fe1a56dfa service nova] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:53:43 user nova-compute[75341]: INFO nova.compute.manager [-] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Took 1.05 seconds to deallocate network for instance.
Nov 14 23:53:43 user nova-compute[75341]: DEBUG nova.compute.manager [req-c490abf4-fd16-4ee4-8d00-f47968d17b6b req-6eb38360-6fc5-494e-a190-1f0fe1a56dfa service nova] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Detach interface failed, port_id=0ac8d528-5147-460f-abf8-4e33ac66c4f4, reason: Instance 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda could not be found. {{(pid=75341) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 23:53:43 user nova-compute[75341]: WARNING nova.volume.cinder [None req-6953d47b-5d5e-4841-91bd-63144de18a9b tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Attachment b17f42a6-819e-4435-bf5f-7f3a1ed1ad86 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = b17f42a6-819e-4435-bf5f-7f3a1ed1ad86. (HTTP 404) (Request-ID: req-7ed38ee2-7570-4bce-ac78-e781ee0d0fe8)
Nov 14 23:53:43 user nova-compute[75341]: INFO nova.compute.manager [None req-6953d47b-5d5e-4841-91bd-63144de18a9b tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] [instance: 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda] Took 0.04 seconds to detach 1 volumes for instance.
Nov 14 23:53:43 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6953d47b-5d5e-4841-91bd-63144de18a9b tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:53:43 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6953d47b-5d5e-4841-91bd-63144de18a9b tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:53:43 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b25ce3c3-7d8c-453b-89de-1c4390436167 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Acquiring lock "53d7a6fe-3914-459a-9494-c75549af7b9f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:53:43 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b25ce3c3-7d8c-453b-89de-1c4390436167 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lock "53d7a6fe-3914-459a-9494-c75549af7b9f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:53:43 user nova-compute[75341]: DEBUG nova.objects.instance [None req-b25ce3c3-7d8c-453b-89de-1c4390436167 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lazy-loading 'flavor' on Instance uuid 53d7a6fe-3914-459a-9494-c75549af7b9f {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:53:43 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b25ce3c3-7d8c-453b-89de-1c4390436167 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lock "53d7a6fe-3914-459a-9494-c75549af7b9f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.079s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:53:43 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-6953d47b-5d5e-4841-91bd-63144de18a9b tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:53:43 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-6953d47b-5d5e-4841-91bd-63144de18a9b tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:53:43 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6953d47b-5d5e-4841-91bd-63144de18a9b tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.379s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:53:43 user nova-compute[75341]: INFO nova.scheduler.client.report [None req-6953d47b-5d5e-4841-91bd-63144de18a9b tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Deleted allocations for instance 9ae467da-9fb5-4f4f-a3f8-fce2ac368dda
Nov 14 23:53:43 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b25ce3c3-7d8c-453b-89de-1c4390436167 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Acquiring lock "53d7a6fe-3914-459a-9494-c75549af7b9f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:53:43 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b25ce3c3-7d8c-453b-89de-1c4390436167 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lock "53d7a6fe-3914-459a-9494-c75549af7b9f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:53:43 user nova-compute[75341]: INFO nova.compute.manager [None req-b25ce3c3-7d8c-453b-89de-1c4390436167 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Attaching volume b63b88f7-c7be-4d8c-8b3b-f0b8bcf7c715 to /dev/vdb
Nov 14 23:53:43 user nova-compute[75341]: DEBUG os_brick.utils [None req-b25ce3c3-7d8c-453b-89de-1c4390436167 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:53:43 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:43 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6953d47b-5d5e-4841-91bd-63144de18a9b tempest-VolumesSnapshotTestJSON-1856831414 tempest-VolumesSnapshotTestJSON-1856831414-project-member] Lock "9ae467da-9fb5-4f4f-a3f8-fce2ac368dda" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.754s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:53:43 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:43 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[228ae195-e2d8-40b6-97a4-1051409dc29e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6d1cfca09c9\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:43 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:43 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:43 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[b572f9af-b47c-4586-9d2a-173eb633e2b0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:43 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:43 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:43 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce75135-b17d-447b-8ee1-d09207e53de2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:43 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[6871ed6b-8908-491e-9837-2f8f9fab417e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:43 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-b25ce3c3-7d8c-453b-89de-1c4390436167 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Running cmd (subprocess): nvme version {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:43 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-b25ce3c3-7d8c-453b-89de-1c4390436167 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] 'nvme version' failed. Not Retrying. {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:53:43 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b25ce3c3-7d8c-453b-89de-1c4390436167 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] nvme not present on system {{(pid=75341) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 23:53:43 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:43 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:53:43 user nova-compute[75341]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 23:53:43 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a533f52-9616-465e-9bac-bb75d0a4b891]: (4, '') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:43 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-b25ce3c3-7d8c-453b-89de-1c4390436167 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75341) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 23:53:43 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-b25ce3c3-7d8c-453b-89de-1c4390436167 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 23:53:43 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-b25ce3c3-7d8c-453b-89de-1c4390436167 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] LIGHTOS: no hostnqn found. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 23:53:43 user nova-compute[75341]: DEBUG os_brick.utils [None req-b25ce3c3-7d8c-453b-89de-1c4390436167 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6d1cfca09c9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:53:43 user nova-compute[75341]: DEBUG nova.virt.block_device [None req-b25ce3c3-7d8c-453b-89de-1c4390436167 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Updating existing volume attachment record: 0d964307-373c-4f0e-b0be-e3a9c0d4fb0c {{(pid=75341) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 23:53:46 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:46 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:48 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b25ce3c3-7d8c-453b-89de-1c4390436167 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Calling os-brick to attach iSCSI Volume {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 23:53:48 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b25ce3c3-7d8c-453b-89de-1c4390436167 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b63b88f7-c7be-4d8c-8b3b-f0b8bcf7c715', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sQeZoWzd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:53:48 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-b25ce3c3-7d8c-453b-89de-1c4390436167 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:53:48 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-b25ce3c3-7d8c-453b-89de-1c4390436167 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:53:48 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-b25ce3c3-7d8c-453b-89de-1c4390436167 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:53:48 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-b25ce3c3-7d8c-453b-89de-1c4390436167 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:53:48 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-b25ce3c3-7d8c-453b-89de-1c4390436167 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b63b88f7-c7be-4d8c-8b3b-f0b8bcf7c715" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:53:48 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-b25ce3c3-7d8c-453b-89de-1c4390436167 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b63b88f7-c7be-4d8c-8b3b-f0b8bcf7c715" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:53:48 user nova-compute[75341]: INFO os_brick.initiator.connectors.iscsi [None req-b25ce3c3-7d8c-453b-89de-1c4390436167 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 23:53:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b63b88f7-c7be-4d8c-8b3b-f0b8bcf7c715 -p 172.16.0.220:3260 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b63b88f7-c7be-4d8c-8b3b-f0b8bcf7c715 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:48 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[057567e9-2b66-4aee-bb4e-26ad0f413dbb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:48 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b25ce3c3-7d8c-453b-89de-1c4390436167 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 23:53:48 user nova-compute[75341]:  {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:53:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b63b88f7-c7be-4d8c-8b3b-f0b8bcf7c715 -p 172.16.0.220:3260 --interface default --op new {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b63b88f7-c7be-4d8c-8b3b-f0b8bcf7c715 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:48 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d05302-40a9-4531-becb-fd557a8eaf83]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b63b88f7-c7be-4d8c-8b3b-f0b8bcf7c715] added\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:48 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b25ce3c3-7d8c-453b-89de-1c4390436167 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b63b88f7-c7be-4d8c-8b3b-f0b8bcf7c715] added
Nov 14 23:53:48 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:53:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b63b88f7-c7be-4d8c-8b3b-f0b8bcf7c715 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b63b88f7-c7be-4d8c-8b3b-f0b8bcf7c715 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:48 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[88661027-ae8f-411d-9c6f-ecae4d777240]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:48 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b25ce3c3-7d8c-453b-89de-1c4390436167 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:53:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b63b88f7-c7be-4d8c-8b3b-f0b8bcf7c715 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b63b88f7-c7be-4d8c-8b3b-f0b8bcf7c715 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:48 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[6017c227-0d37-4bc6-b439-2be6f4054af5]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:48 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b25ce3c3-7d8c-453b-89de-1c4390436167 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:53:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b63b88f7-c7be-4d8c-8b3b-f0b8bcf7c715 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sQeZoWzd {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b63b88f7-c7be-4d8c-8b3b-f0b8bcf7c715 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sQeZoWzd" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:48 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[9020ac40-6e73-4ff4-a5d9-3dd1a07ce284]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:48 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b25ce3c3-7d8c-453b-89de-1c4390436167 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sQeZoWzd'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:53:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b63b88f7-c7be-4d8c-8b3b-f0b8bcf7c715 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b63b88f7-c7be-4d8c-8b3b-f0b8bcf7c715 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:48 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ab1df5-52be-429c-80d1-dd5ebf4b7fd7]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:48 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b25ce3c3-7d8c-453b-89de-1c4390436167 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:53:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:48 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d32ca0-6e46-4896-ad45-b5b40bcac725]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:48 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b25ce3c3-7d8c-453b-89de-1c4390436167 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)
Nov 14 23:53:48 user nova-compute[75341]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)
Nov 14 23:53:48 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:53:48 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b25ce3c3-7d8c-453b-89de-1c4390436167 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)
Nov 14 23:53:48 user nova-compute[75341]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)
Nov 14 23:53:48 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:53:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b63b88f7-c7be-4d8c-8b3b-f0b8bcf7c715 -p 172.16.0.220:3260 --login {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b63b88f7-c7be-4d8c-8b3b-f0b8bcf7c715 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:48 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd61b8e-1b94-49bd-bbb9-a08fe598090a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b63b88f7-c7be-4d8c-8b3b-f0b8bcf7c715, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b63b88f7-c7be-4d8c-8b3b-f0b8bcf7c715, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:48 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b25ce3c3-7d8c-453b-89de-1c4390436167 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b63b88f7-c7be-4d8c-8b3b-f0b8bcf7c715, portal: 172.16.0.220,3260]
Nov 14 23:53:48 user nova-compute[75341]: Login to [iface: default, target: iqn.2010-10.org.openstack:b63b88f7-c7be-4d8c-8b3b-f0b8bcf7c715, portal: 172.16.0.220,3260] successful.
Nov 14 23:53:48 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:53:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b63b88f7-c7be-4d8c-8b3b-f0b8bcf7c715 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b63b88f7-c7be-4d8c-8b3b-f0b8bcf7c715 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:48 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5a9d3d-36d4-47f5-8a58-0fef9cefeb1d]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:48 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b25ce3c3-7d8c-453b-89de-1c4390436167 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:53:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:48 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f78ec9a-2038-4d7e-a7fd-c1180df7a3c4]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63b88f7-c7be-4d8c-8b3b-f0b8bcf7c715 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:48 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b25ce3c3-7d8c-453b-89de-1c4390436167 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)
Nov 14 23:53:48 user nova-compute[75341]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)
Nov 14 23:53:48 user nova-compute[75341]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63b88f7-c7be-4d8c-8b3b-f0b8bcf7c715 (non-flash)
Nov 14 23:53:48 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:53:48 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b25ce3c3-7d8c-453b-89de-1c4390436167 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)
Nov 14 23:53:48 user nova-compute[75341]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)
Nov 14 23:53:48 user nova-compute[75341]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63b88f7-c7be-4d8c-8b3b-f0b8bcf7c715 (non-flash)
Nov 14 23:53:48 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:53:48 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-b25ce3c3-7d8c-453b-89de-1c4390436167 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b63b88f7-c7be-4d8c-8b3b-f0b8bcf7c715" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:53:48 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b25ce3c3-7d8c-453b-89de-1c4390436167 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Connected to 172.16.0.220:3260 {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 23:53:48 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-b25ce3c3-7d8c-453b-89de-1c4390436167 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] HCTL ('34', '-', '-', 0) found on session 42 with lun 0 {{(pid=75341) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 23:53:48 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-b25ce3c3-7d8c-453b-89de-1c4390436167 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75341) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 23:53:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:48 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[9736a6fa-a079-4e1a-99c7-ee53ae62e25e]: (4, ('- - 0', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:53:48 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-b25ce3c3-7d8c-453b-89de-1c4390436167 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 23:53:48 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b25ce3c3-7d8c-453b-89de-1c4390436167 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b63b88f7-c7be-4d8c-8b3b-f0b8bcf7c715', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sQeZoWzd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 23:53:49 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-b25ce3c3-7d8c-453b-89de-1c4390436167 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:53:49 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-b25ce3c3-7d8c-453b-89de-1c4390436167 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '23835306233323363', 'path': '/dev/sdc'} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:53:49 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b25ce3c3-7d8c-453b-89de-1c4390436167 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23835306233323363', 'path': '/dev/sdc'} {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 23:53:49 user nova-compute[75341]: DEBUG nova.objects.instance [None req-b25ce3c3-7d8c-453b-89de-1c4390436167 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lazy-loading 'flavor' on Instance uuid 53d7a6fe-3914-459a-9494-c75549af7b9f {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:53:50 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-b25ce3c3-7d8c-453b-89de-1c4390436167 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 23:53:50 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:53:50 user nova-compute[75341]:   <source dev="/dev/sdc"/>
Nov 14 23:53:50 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:53:50 user nova-compute[75341]:   <serial>b63b88f7-c7be-4d8c-8b3b-f0b8bcf7c715</serial>
Nov 14 23:53:50 user nova-compute[75341]: </disk>
Nov 14 23:53:50 user nova-compute[75341]:  {{(pid=75341) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 23:53:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:50 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b25ce3c3-7d8c-453b-89de-1c4390436167 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:53:50 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b25ce3c3-7d8c-453b-89de-1c4390436167 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:53:50 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b25ce3c3-7d8c-453b-89de-1c4390436167 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] No VIF found with MAC fa:16:3e:14:63:0c, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:53:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b25ce3c3-7d8c-453b-89de-1c4390436167 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lock "53d7a6fe-3914-459a-9494-c75549af7b9f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.903s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:53:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:52 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:53:53 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:53:54 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:53:55 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:53:55 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75341) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 23:53:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:53:57 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:53:57 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Starting heal instance info cache {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 23:53:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "refresh_cache-defae731-4191-4526-99cc-a301cf5b3355" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:53:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquired lock "refresh_cache-defae731-4191-4526-99cc-a301cf5b3355" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:53:58 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: defae731-4191-4526-99cc-a301cf5b3355] Forcefully refreshing network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 23:53:58 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: defae731-4191-4526-99cc-a301cf5b3355] Updating instance_info_cache with network_info: [{"id": "10b83231-0b39-4dee-95db-bb6a03d70fc0", "address": "fa:16:3e:b7:3a:83", "network": {"id": "d86a8e7f-6658-4994-9a13-eb3163bd3865", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-635863702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c69a942b4f4b97a1a3152dea86c7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10b83231-0b", "ovs_interfaceid": "10b83231-0b39-4dee-95db-bb6a03d70fc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:53:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Releasing lock "refresh_cache-defae731-4191-4526-99cc-a301cf5b3355" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:53:58 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: defae731-4191-4526-99cc-a301cf5b3355] Updated the network info_cache for instance {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 23:53:58 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:53:58 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:53:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:53:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.003s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:53:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:53:58 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75341) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 23:53:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:59 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 23:53:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c62455e6-61af-45b1-899f-bad37dc57b22/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c62455e6-61af-45b1-899f-bad37dc57b22/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c62455e6-61af-45b1-899f-bad37dc57b22/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c62455e6-61af-45b1-899f-bad37dc57b22/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk.rescue --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk.rescue --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:53:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:53:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:54:00 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:54:00 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:54:00 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:54:00 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c9a7d6-03a5-4fd2-9082-c68758f1542f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:54:00 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c9a7d6-03a5-4fd2-9082-c68758f1542f/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:54:00 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c9a7d6-03a5-4fd2-9082-c68758f1542f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:54:00 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c9a7d6-03a5-4fd2-9082-c68758f1542f/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:54:00 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 23:54:00 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:54:00 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:54:00 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:54:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:54:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53d7a6fe-3914-459a-9494-c75549af7b9f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:54:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53d7a6fe-3914-459a-9494-c75549af7b9f/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:54:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53d7a6fe-3914-459a-9494-c75549af7b9f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:54:01 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-26d2c562-b0b5-43bf-a82b-f9b1a686ab42 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Acquiring lock "53d7a6fe-3914-459a-9494-c75549af7b9f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:54:01 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-26d2c562-b0b5-43bf-a82b-f9b1a686ab42 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lock "53d7a6fe-3914-459a-9494-c75549af7b9f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:54:01 user nova-compute[75341]: INFO nova.compute.manager [None req-26d2c562-b0b5-43bf-a82b-f9b1a686ab42 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Detaching volume b63b88f7-c7be-4d8c-8b3b-f0b8bcf7c715
Nov 14 23:54:01 user nova-compute[75341]: INFO nova.virt.block_device [None req-26d2c562-b0b5-43bf-a82b-f9b1a686ab42 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Attempting to driver detach volume b63b88f7-c7be-4d8c-8b3b-f0b8bcf7c715 from mountpoint /dev/vdb
Nov 14 23:54:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53d7a6fe-3914-459a-9494-c75549af7b9f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:54:01 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 23:54:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:54:01 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-26d2c562-b0b5-43bf-a82b-f9b1a686ab42 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Attempting to detach device vdb from instance 53d7a6fe-3914-459a-9494-c75549af7b9f from the persistent domain config. {{(pid=75341) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 23:54:01 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-26d2c562-b0b5-43bf-a82b-f9b1a686ab42 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 23:54:01 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:54:01 user nova-compute[75341]:   <source dev="/dev/sdc"/>
Nov 14 23:54:01 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:54:01 user nova-compute[75341]:   <serial>b63b88f7-c7be-4d8c-8b3b-f0b8bcf7c715</serial>
Nov 14 23:54:01 user nova-compute[75341]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 23:54:01 user nova-compute[75341]: </disk>
Nov 14 23:54:01 user nova-compute[75341]:  {{(pid=75341) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 23:54:01 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-26d2c562-b0b5-43bf-a82b-f9b1a686ab42 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Successfully detached device vdb from instance 53d7a6fe-3914-459a-9494-c75549af7b9f from the persistent domain config.
Nov 14 23:54:01 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-26d2c562-b0b5-43bf-a82b-f9b1a686ab42 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 53d7a6fe-3914-459a-9494-c75549af7b9f from the live domain config. {{(pid=75341) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 23:54:01 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-26d2c562-b0b5-43bf-a82b-f9b1a686ab42 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 23:54:01 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:54:01 user nova-compute[75341]:   <source dev="/dev/sdc"/>
Nov 14 23:54:01 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:54:01 user nova-compute[75341]:   <serial>b63b88f7-c7be-4d8c-8b3b-f0b8bcf7c715</serial>
Nov 14 23:54:01 user nova-compute[75341]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 23:54:01 user nova-compute[75341]: </disk>
Nov 14 23:54:01 user nova-compute[75341]:  {{(pid=75341) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 23:54:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:54:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:54:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:54:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d93909b3-0373-492a-8ede-7c2cd76bcb88/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:54:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:54:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:54:02 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-26d2c562-b0b5-43bf-a82b-f9b1a686ab42 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 53d7a6fe-3914-459a-9494-c75549af7b9f {{(pid=75341) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 23:54:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d93909b3-0373-492a-8ede-7c2cd76bcb88/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:54:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d93909b3-0373-492a-8ede-7c2cd76bcb88/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:54:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d93909b3-0373-492a-8ede-7c2cd76bcb88/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:54:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:54:02 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:54:02 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:54:02 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Hypervisor/Node resource view: name=user free_ram=7671MB free_disk=25.381546020507812GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75341) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 23:54:02 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:54:02 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:54:02 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 51045050-c7c6-49c5-acd4-2a76be0f466f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:54:02 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 6382e432-838f-4d89-a743-cbaa37f50ab5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:54:02 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance defae731-4191-4526-99cc-a301cf5b3355 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:54:02 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 2316aa9e-d4c9-43d0-9918-86265583aed1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:54:02 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 12c9a7d6-03a5-4fd2-9082-c68758f1542f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:54:02 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance d93909b3-0373-492a-8ede-7c2cd76bcb88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:54:02 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 53d7a6fe-3914-459a-9494-c75549af7b9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:54:02 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance c62455e6-61af-45b1-899f-bad37dc57b22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:54:02 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 23:54:02 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 23:54:03 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:54:03 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:54:03 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Compute_service record updated for user:user {{(pid=75341) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 23:54:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.407s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:54:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Acquiring lock "f7f2b24d-1987-4a59-9a49-25e387be923d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:54:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "f7f2b24d-1987-4a59-9a49-25e387be923d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:54:03 user nova-compute[75341]: DEBUG nova.compute.manager [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] Starting instance... {{(pid=75341) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 23:54:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:54:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:54:03 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75341) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 23:54:03 user nova-compute[75341]: INFO nova.compute.claims [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] Claim successful on node user
Nov 14 23:54:04 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:54:04 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:54:04 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.379s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:54:04 user nova-compute[75341]: DEBUG nova.compute.manager [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] Start building networks asynchronously for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 23:54:04 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:54:04 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:54:04 user nova-compute[75341]: DEBUG nova.compute.manager [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] Allocating IP information in the background. {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 23:54:04 user nova-compute[75341]: DEBUG nova.network.neutron [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] allocate_for_instance() {{(pid=75341) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 23:54:04 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 23:54:04 user nova-compute[75341]: DEBUG nova.compute.manager [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] Start building block device mappings for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 23:54:04 user nova-compute[75341]: DEBUG nova.policy [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b08f7ddf6c2f4fd596e214d6ca56c234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96674073965642f1af11221b4add8a6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75341) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 23:54:04 user nova-compute[75341]: INFO nova.virt.block_device [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] Booting with volume a5f672e8-ffa6-4986-99a8-819fe39ccf36 at /dev/vda
Nov 14 23:54:04 user nova-compute[75341]: DEBUG os_brick.utils [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:54:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:54:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:54:04 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd903d5a-3bd3-49b1-8b69-39222f90db17]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6d1cfca09c9\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:54:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:54:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:54:04 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23a636c-9d97-4c66-8879-08c77cfb727e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:54:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:54:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:54:04 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[7818b93c-0bad-4b40-8ad4-e0074008a8fe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:54:04 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d0a6b6-0440-4eb3-81d8-852e55f51587]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:54:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Running cmd (subprocess): nvme version {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:54:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] 'nvme version' failed. Not Retrying. {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:54:04 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.nvmeof [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] nvme not present on system {{(pid=75341) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 23:54:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:54:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:54:04 user nova-compute[75341]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 23:54:04 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[90baaf94-7579-4a95-b7d1-67260dc4f8ce]: (4, '') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:54:04 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75341) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 23:54:04 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 23:54:04 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] LIGHTOS: no hostnqn found. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 23:54:04 user nova-compute[75341]: DEBUG os_brick.utils [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6d1cfca09c9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:54:04 user nova-compute[75341]: DEBUG nova.virt.block_device [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] Updating existing volume attachment record: 6f33f14d-0b8d-4ec9-9d3c-d42fa950b080 {{(pid=75341) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 23:54:04 user nova-compute[75341]: DEBUG nova.network.neutron [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] Successfully created port: 9a0f0fb5-7e45-46c9-a476-7b1380c9f42b {{(pid=75341) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 23:54:04 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:54:05 user nova-compute[75341]: DEBUG nova.network.neutron [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] Successfully updated port: 9a0f0fb5-7e45-46c9-a476-7b1380c9f42b {{(pid=75341) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 23:54:05 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Acquiring lock "refresh_cache-f7f2b24d-1987-4a59-9a49-25e387be923d" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:54:05 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Acquired lock "refresh_cache-f7f2b24d-1987-4a59-9a49-25e387be923d" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:54:05 user nova-compute[75341]: DEBUG nova.network.neutron [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 23:54:05 user nova-compute[75341]: DEBUG nova.compute.manager [req-a5abade2-726a-48dc-918e-0c39715219fa req-e3161d3b-55f2-4b3f-87c1-b6ce0089f231 service nova] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] Received event network-changed-9a0f0fb5-7e45-46c9-a476-7b1380c9f42b {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:54:05 user nova-compute[75341]: DEBUG nova.compute.manager [req-a5abade2-726a-48dc-918e-0c39715219fa req-e3161d3b-55f2-4b3f-87c1-b6ce0089f231 service nova] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] Refreshing instance network info cache due to event network-changed-9a0f0fb5-7e45-46c9-a476-7b1380c9f42b. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:54:05 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a5abade2-726a-48dc-918e-0c39715219fa req-e3161d3b-55f2-4b3f-87c1-b6ce0089f231 service nova] Acquiring lock "refresh_cache-f7f2b24d-1987-4a59-9a49-25e387be923d" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:54:05 user nova-compute[75341]: DEBUG nova.network.neutron [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] Instance cache missing network info. {{(pid=75341) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 23:54:05 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:54:05 user nova-compute[75341]: DEBUG nova.network.neutron [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] Updating instance_info_cache with network_info: [{"id": "9a0f0fb5-7e45-46c9-a476-7b1380c9f42b", "address": "fa:16:3e:5c:6d:40", "network": {"id": "227eb779-a064-477d-8447-45862017ae7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-3827253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96674073965642f1af11221b4add8a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a0f0fb5-7e", "ovs_interfaceid": "9a0f0fb5-7e45-46c9-a476-7b1380c9f42b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:54:05 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Releasing lock "refresh_cache-f7f2b24d-1987-4a59-9a49-25e387be923d" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:54:05 user nova-compute[75341]: DEBUG nova.compute.manager [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] Instance network_info: |[{"id": "9a0f0fb5-7e45-46c9-a476-7b1380c9f42b", "address": "fa:16:3e:5c:6d:40", "network": {"id": "227eb779-a064-477d-8447-45862017ae7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-3827253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96674073965642f1af11221b4add8a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a0f0fb5-7e", "ovs_interfaceid": "9a0f0fb5-7e45-46c9-a476-7b1380c9f42b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 23:54:05 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a5abade2-726a-48dc-918e-0c39715219fa req-e3161d3b-55f2-4b3f-87c1-b6ce0089f231 service nova] Acquired lock "refresh_cache-f7f2b24d-1987-4a59-9a49-25e387be923d" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:54:05 user nova-compute[75341]: DEBUG nova.network.neutron [req-a5abade2-726a-48dc-918e-0c39715219fa req-e3161d3b-55f2-4b3f-87c1-b6ce0089f231 service nova] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] Refreshing network info cache for port 9a0f0fb5-7e45-46c9-a476-7b1380c9f42b {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:54:06 user nova-compute[75341]: DEBUG nova.network.neutron [req-a5abade2-726a-48dc-918e-0c39715219fa req-e3161d3b-55f2-4b3f-87c1-b6ce0089f231 service nova] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] Updated VIF entry in instance network info cache for port 9a0f0fb5-7e45-46c9-a476-7b1380c9f42b. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:54:06 user nova-compute[75341]: DEBUG nova.network.neutron [req-a5abade2-726a-48dc-918e-0c39715219fa req-e3161d3b-55f2-4b3f-87c1-b6ce0089f231 service nova] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] Updating instance_info_cache with network_info: [{"id": "9a0f0fb5-7e45-46c9-a476-7b1380c9f42b", "address": "fa:16:3e:5c:6d:40", "network": {"id": "227eb779-a064-477d-8447-45862017ae7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-3827253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96674073965642f1af11221b4add8a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a0f0fb5-7e", "ovs_interfaceid": "9a0f0fb5-7e45-46c9-a476-7b1380c9f42b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:54:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a5abade2-726a-48dc-918e-0c39715219fa req-e3161d3b-55f2-4b3f-87c1-b6ce0089f231 service nova] Releasing lock "refresh_cache-f7f2b24d-1987-4a59-9a49-25e387be923d" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:54:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG nova.compute.manager [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] Start spawning the instance on the hypervisor. {{(pid=75341) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] Creating instance directory {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 23:54:09 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] Creating image(s)
Nov 14 23:54:09 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] Did not create local disks {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] Ensure instance console log exists: /opt/stack/data/nova/instances/f7f2b24d-1987-4a59-9a49-25e387be923d/console.log {{(pid=75341) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] Start _get_guest_xml network_info=[{"id": "9a0f0fb5-7e45-46c9-a476-7b1380c9f42b", "address": "fa:16:3e:5c:6d:40", "network": {"id": "227eb779-a064-477d-8447-45862017ae7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-3827253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96674073965642f1af11221b4add8a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a0f0fb5-7e", "ovs_interfaceid": "9a0f0fb5-7e45-46c9-a476-7b1380c9f42b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '6f33f14d-0b8d-4ec9-9d3c-d42fa950b080', 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qFHBPzGf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f7f2b24d-1987-4a59-9a49-25e387be923d', 'attached_at': '', 'detached_at': '', 'volume_id': 'a5f672e8-ffa6-4986-99a8-819fe39ccf36', 'serial': 'a5f672e8-ffa6-4986-99a8-819fe39ccf36'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 23:54:09 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:54:09 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:54:09 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] Calling os-brick to attach iSCSI Volume {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qFHBPzGf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:54:09 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:54:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:54:09 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:54:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:54:09 user nova-compute[75341]: INFO os_brick.initiator.connectors.iscsi [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 23:54:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 -p 172.16.0.220:3260 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa1d9bc-89c1-4a1c-87bf-fdae487f9d99]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 23:54:09 user nova-compute[75341]:  {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 -p 172.16.0.220:3260 --interface default --op new {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[969f5abd-39aa-4cfb-a5f2-c090757506fd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36] added\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36] added
Nov 14 23:54:09 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e24f35-f832-477a-a9da-866275606ca9]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[794a18db-e314-4b5a-a7c2-6608f26ab35a]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qFHBPzGf {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qFHBPzGf" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d9924b-009d-4400-abba-cf76e271f91a]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qFHBPzGf'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c46f21-1aeb-48d3-9e4e-8ee179380e94]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c57048-af20-48b8-ac43-af9060859e54]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63b88f7-c7be-4d8c-8b3b-f0b8bcf7c715 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)
Nov 14 23:54:09 user nova-compute[75341]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)
Nov 14 23:54:09 user nova-compute[75341]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63b88f7-c7be-4d8c-8b3b-f0b8bcf7c715 (non-flash)
Nov 14 23:54:09 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)
Nov 14 23:54:09 user nova-compute[75341]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)
Nov 14 23:54:09 user nova-compute[75341]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63b88f7-c7be-4d8c-8b3b-f0b8bcf7c715 (non-flash)
Nov 14 23:54:09 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 -p 172.16.0.220:3260 --login {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0997ed-c79a-4c65-a215-80c5fa70dd4f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36, portal: 172.16.0.220,3260]
Nov 14 23:54:09 user nova-compute[75341]: Login to [iface: default, target: iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36, portal: 172.16.0.220,3260] successful.
Nov 14 23:54:09 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9a7b88-051c-4e31-ad6a-ebfa448d619a]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ca10ee-9fcf-4b92-b000-4961f6090da4]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63b88f7-c7be-4d8c-8b3b-f0b8bcf7c715 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)
Nov 14 23:54:09 user nova-compute[75341]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)
Nov 14 23:54:09 user nova-compute[75341]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63b88f7-c7be-4d8c-8b3b-f0b8bcf7c715 (non-flash)
Nov 14 23:54:09 user nova-compute[75341]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)
Nov 14 23:54:09 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)
Nov 14 23:54:09 user nova-compute[75341]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)
Nov 14 23:54:09 user nova-compute[75341]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63b88f7-c7be-4d8c-8b3b-f0b8bcf7c715 (non-flash)
Nov 14 23:54:09 user nova-compute[75341]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)
Nov 14 23:54:09 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Connected to 172.16.0.220:3260 {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] HCTL ('35', '-', '-', 0) found on session 43 with lun 0 {{(pid=75341) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75341) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb56c516-4ce4-4a8c-934c-c01591854527]: (4, ('- - 0', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 23:54:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qFHBPzGf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 23:54:10 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:54:10 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '26536393737656136', 'path': '/dev/sdd'} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:54:10 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26536393737656136', 'path': '/dev/sdd'} {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 23:54:10 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:54:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-133786393',display_name='tempest-TestVolumeBootPattern-server-133786393',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-133786393',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN7m+PTR/lRAnqFJ5INzHZER+6KEezVf2NqND5YLAUMiY/B8DjdO2ameMcKY7PyF3FV92+jHAoJaiByyFu7+plRebNNPsSYlc8sL/IhL0WhnAYWxdc2ydVL4yfconkjd2A==',key_name='tempest-TestVolumeBootPattern-1320135145',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96674073965642f1af11221b4add8a6d',ramdisk_id='',reservation_id='r-4zw5rshd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-320933673',owner_user_name='tempest-TestVolumeBootPattern-320933673-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:54:04Z,user_data=None,user_id='b08f7ddf6c2f4fd596e214d6ca56c234',uuid=f7f2b24d-1987-4a59-9a49-25e387be923d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a0f0fb5-7e45-46c9-a476-7b1380c9f42b", "address": "fa:16:3e:5c:6d:40", "network": {"id": "227eb779-a064-477d-8447-45862017ae7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-3827253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96674073965642f1af11221b4add8a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a0f0fb5-7e", "ovs_interfaceid": "9a0f0fb5-7e45-46c9-a476-7b1380c9f42b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:54:10 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Converting VIF {"id": "9a0f0fb5-7e45-46c9-a476-7b1380c9f42b", "address": "fa:16:3e:5c:6d:40", "network": {"id": "227eb779-a064-477d-8447-45862017ae7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-3827253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96674073965642f1af11221b4add8a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a0f0fb5-7e", "ovs_interfaceid": "9a0f0fb5-7e45-46c9-a476-7b1380c9f42b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:54:10 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:6d:40,bridge_name='br-int',has_traffic_filtering=True,id=9a0f0fb5-7e45-46c9-a476-7b1380c9f42b,network=Network(227eb779-a064-477d-8447-45862017ae7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a0f0fb5-7e') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:54:10 user nova-compute[75341]: DEBUG nova.objects.instance [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lazy-loading 'pci_devices' on Instance uuid f7f2b24d-1987-4a59-9a49-25e387be923d {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:54:10 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] End _get_guest_xml xml=<domain type="kvm">
Nov 14 23:54:10 user nova-compute[75341]:   <uuid>f7f2b24d-1987-4a59-9a49-25e387be923d</uuid>
Nov 14 23:54:10 user nova-compute[75341]:   <name>instance-00000027</name>
Nov 14 23:54:10 user nova-compute[75341]:   <memory>524288</memory>
Nov 14 23:54:10 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 14 23:54:10 user nova-compute[75341]:   <metadata>
Nov 14 23:54:10 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 23:54:10 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 14 23:54:10 user nova-compute[75341]:       <nova:name>tempest-TestVolumeBootPattern-server-133786393</nova:name>
Nov 14 23:54:10 user nova-compute[75341]:       <nova:creationTime>2023-11-14 23:54:09</nova:creationTime>
Nov 14 23:54:10 user nova-compute[75341]:       <nova:flavor name="m1.tiny">
Nov 14 23:54:10 user nova-compute[75341]:         <nova:memory>512</nova:memory>
Nov 14 23:54:10 user nova-compute[75341]:         <nova:disk>1</nova:disk>
Nov 14 23:54:10 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 14 23:54:10 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 23:54:10 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 14 23:54:10 user nova-compute[75341]:       </nova:flavor>
Nov 14 23:54:10 user nova-compute[75341]:       <nova:owner>
Nov 14 23:54:10 user nova-compute[75341]:         <nova:user uuid="b08f7ddf6c2f4fd596e214d6ca56c234">tempest-TestVolumeBootPattern-320933673-project-member</nova:user>
Nov 14 23:54:10 user nova-compute[75341]:         <nova:project uuid="96674073965642f1af11221b4add8a6d">tempest-TestVolumeBootPattern-320933673</nova:project>
Nov 14 23:54:10 user nova-compute[75341]:       </nova:owner>
Nov 14 23:54:10 user nova-compute[75341]:       <nova:ports>
Nov 14 23:54:10 user nova-compute[75341]:         <nova:port uuid="9a0f0fb5-7e45-46c9-a476-7b1380c9f42b">
Nov 14 23:54:10 user nova-compute[75341]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 23:54:10 user nova-compute[75341]:         </nova:port>
Nov 14 23:54:10 user nova-compute[75341]:       </nova:ports>
Nov 14 23:54:10 user nova-compute[75341]:     </nova:instance>
Nov 14 23:54:10 user nova-compute[75341]:   </metadata>
Nov 14 23:54:10 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 14 23:54:10 user nova-compute[75341]:     <system>
Nov 14 23:54:10 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 23:54:10 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 14 23:54:10 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 14 23:54:10 user nova-compute[75341]:       <entry name="serial">f7f2b24d-1987-4a59-9a49-25e387be923d</entry>
Nov 14 23:54:10 user nova-compute[75341]:       <entry name="uuid">f7f2b24d-1987-4a59-9a49-25e387be923d</entry>
Nov 14 23:54:10 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 14 23:54:10 user nova-compute[75341]:     </system>
Nov 14 23:54:10 user nova-compute[75341]:   </sysinfo>
Nov 14 23:54:10 user nova-compute[75341]:   <os>
Nov 14 23:54:10 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 23:54:10 user nova-compute[75341]:     <boot dev="hd"/>
Nov 14 23:54:10 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 14 23:54:10 user nova-compute[75341]:   </os>
Nov 14 23:54:10 user nova-compute[75341]:   <features>
Nov 14 23:54:10 user nova-compute[75341]:     <acpi/>
Nov 14 23:54:10 user nova-compute[75341]:     <apic/>
Nov 14 23:54:10 user nova-compute[75341]:     <vmcoreinfo/>
Nov 14 23:54:10 user nova-compute[75341]:   </features>
Nov 14 23:54:10 user nova-compute[75341]:   <clock offset="utc">
Nov 14 23:54:10 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 23:54:10 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 23:54:10 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 14 23:54:10 user nova-compute[75341]:   </clock>
Nov 14 23:54:10 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 14 23:54:10 user nova-compute[75341]:     <model>Nehalem</model>
Nov 14 23:54:10 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 23:54:10 user nova-compute[75341]:   </cpu>
Nov 14 23:54:10 user nova-compute[75341]:   <devices>
Nov 14 23:54:10 user nova-compute[75341]:     <disk type="block" device="disk">
Nov 14 23:54:10 user nova-compute[75341]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:54:10 user nova-compute[75341]:       <source dev="/dev/sdd"/>
Nov 14 23:54:10 user nova-compute[75341]:       <target dev="vda" bus="virtio"/>
Nov 14 23:54:10 user nova-compute[75341]:       <serial>a5f672e8-ffa6-4986-99a8-819fe39ccf36</serial>
Nov 14 23:54:10 user nova-compute[75341]:     </disk>
Nov 14 23:54:10 user nova-compute[75341]:     <interface type="ethernet">
Nov 14 23:54:10 user nova-compute[75341]:       <mac address="fa:16:3e:5c:6d:40"/>
Nov 14 23:54:10 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:54:10 user nova-compute[75341]:       <mtu size="1442"/>
Nov 14 23:54:10 user nova-compute[75341]:       <target dev="tap9a0f0fb5-7e"/>
Nov 14 23:54:10 user nova-compute[75341]:     </interface>
Nov 14 23:54:10 user nova-compute[75341]:     <serial type="pty">
Nov 14 23:54:10 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/f7f2b24d-1987-4a59-9a49-25e387be923d/console.log" append="off"/>
Nov 14 23:54:10 user nova-compute[75341]:     </serial>
Nov 14 23:54:10 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 23:54:10 user nova-compute[75341]:     <video>
Nov 14 23:54:10 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:54:10 user nova-compute[75341]:     </video>
Nov 14 23:54:10 user nova-compute[75341]:     <rng model="virtio">
Nov 14 23:54:10 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 14 23:54:10 user nova-compute[75341]:     </rng>
Nov 14 23:54:10 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 14 23:54:10 user nova-compute[75341]:     <memballoon model="virtio">
Nov 14 23:54:10 user nova-compute[75341]:       <stats period="10"/>
Nov 14 23:54:10 user nova-compute[75341]:     </memballoon>
Nov 14 23:54:10 user nova-compute[75341]:   </devices>
Nov 14 23:54:10 user nova-compute[75341]: </domain>
Nov 14 23:54:10 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 23:54:10 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:54:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-133786393',display_name='tempest-TestVolumeBootPattern-server-133786393',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-133786393',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN7m+PTR/lRAnqFJ5INzHZER+6KEezVf2NqND5YLAUMiY/B8DjdO2ameMcKY7PyF3FV92+jHAoJaiByyFu7+plRebNNPsSYlc8sL/IhL0WhnAYWxdc2ydVL4yfconkjd2A==',key_name='tempest-TestVolumeBootPattern-1320135145',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96674073965642f1af11221b4add8a6d',ramdisk_id='',reservation_id='r-4zw5rshd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-320933673',owner_user_name='tempest-TestVolumeBootPattern-320933673-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:54:04Z,user_data=None,user_id='b08f7ddf6c2f4fd596e214d6ca56c234',uuid=f7f2b24d-1987-4a59-9a49-25e387be923d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a0f0fb5-7e45-46c9-a476-7b1380c9f42b", "address": "fa:16:3e:5c:6d:40", "network": {"id": "227eb779-a064-477d-8447-45862017ae7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-3827253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96674073965642f1af11221b4add8a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a0f0fb5-7e", "ovs_interfaceid": "9a0f0fb5-7e45-46c9-a476-7b1380c9f42b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 23:54:10 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Converting VIF {"id": "9a0f0fb5-7e45-46c9-a476-7b1380c9f42b", "address": "fa:16:3e:5c:6d:40", "network": {"id": "227eb779-a064-477d-8447-45862017ae7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-3827253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96674073965642f1af11221b4add8a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a0f0fb5-7e", "ovs_interfaceid": "9a0f0fb5-7e45-46c9-a476-7b1380c9f42b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:54:10 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:6d:40,bridge_name='br-int',has_traffic_filtering=True,id=9a0f0fb5-7e45-46c9-a476-7b1380c9f42b,network=Network(227eb779-a064-477d-8447-45862017ae7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a0f0fb5-7e') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:54:10 user nova-compute[75341]: DEBUG os_vif [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:6d:40,bridge_name='br-int',has_traffic_filtering=True,id=9a0f0fb5-7e45-46c9-a476-7b1380c9f42b,network=Network(227eb779-a064-477d-8447-45862017ae7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a0f0fb5-7e') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 23:54:10 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:54:10 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:54:10 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 23:54:10 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:54:10 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ddb2b5cd-8339-512f-9446-ab4c8ba5f153', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:54:10 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:54:10 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:54:10 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:54:10 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9a0f0fb5-7e, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:54:10 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9a0f0fb5-7e, col_values=(('qos', UUID('09bc56de-627d-4b37-97c6-6467ecb36a0e')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:54:10 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9a0f0fb5-7e, col_values=(('external_ids', {'iface-id': '9a0f0fb5-7e45-46c9-a476-7b1380c9f42b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:6d:40', 'vm-uuid': 'f7f2b24d-1987-4a59-9a49-25e387be923d'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:54:10 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:54:10 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:54:10 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:54:10 user nova-compute[75341]: INFO os_vif [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:6d:40,bridge_name='br-int',has_traffic_filtering=True,id=9a0f0fb5-7e45-46c9-a476-7b1380c9f42b,network=Network(227eb779-a064-477d-8447-45862017ae7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a0f0fb5-7e')
Nov 14 23:54:10 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:54:10 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] No VIF found with MAC fa:16:3e:5c:6d:40, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:54:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1a9a5f7a-dbef-47e3-a84d-d17a5fca4570 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Acquiring lock "d93909b3-0373-492a-8ede-7c2cd76bcb88" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:54:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1a9a5f7a-dbef-47e3-a84d-d17a5fca4570 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "d93909b3-0373-492a-8ede-7c2cd76bcb88" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:54:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1a9a5f7a-dbef-47e3-a84d-d17a5fca4570 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Acquiring lock "d93909b3-0373-492a-8ede-7c2cd76bcb88-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:54:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1a9a5f7a-dbef-47e3-a84d-d17a5fca4570 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "d93909b3-0373-492a-8ede-7c2cd76bcb88-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:54:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1a9a5f7a-dbef-47e3-a84d-d17a5fca4570 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "d93909b3-0373-492a-8ede-7c2cd76bcb88-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:54:11 user nova-compute[75341]: INFO nova.compute.manager [None req-1a9a5f7a-dbef-47e3-a84d-d17a5fca4570 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Terminating instance
Nov 14 23:54:11 user nova-compute[75341]: DEBUG nova.compute.manager [None req-1a9a5f7a-dbef-47e3-a84d-d17a5fca4570 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Start destroying the instance on the hypervisor. {{(pid=75341) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 23:54:11 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:54:11 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:54:11 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:54:11 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:54:11 user nova-compute[75341]: DEBUG nova.compute.manager [req-e121f527-0522-4187-bf0e-2b3e88910648 req-110218ef-8d7b-4142-bc73-757f21947fff service nova] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Received event network-vif-unplugged-712f4b2d-016e-43ab-a3f2-8439868a5055 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:54:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-e121f527-0522-4187-bf0e-2b3e88910648 req-110218ef-8d7b-4142-bc73-757f21947fff service nova] Acquiring lock "d93909b3-0373-492a-8ede-7c2cd76bcb88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:54:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-e121f527-0522-4187-bf0e-2b3e88910648 req-110218ef-8d7b-4142-bc73-757f21947fff service nova] Lock "d93909b3-0373-492a-8ede-7c2cd76bcb88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:54:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-e121f527-0522-4187-bf0e-2b3e88910648 req-110218ef-8d7b-4142-bc73-757f21947fff service nova] Lock "d93909b3-0373-492a-8ede-7c2cd76bcb88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:54:11 user nova-compute[75341]: DEBUG nova.compute.manager [req-e121f527-0522-4187-bf0e-2b3e88910648 req-110218ef-8d7b-4142-bc73-757f21947fff service nova] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] No waiting events found dispatching network-vif-unplugged-712f4b2d-016e-43ab-a3f2-8439868a5055 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:54:11 user nova-compute[75341]: DEBUG nova.compute.manager [req-e121f527-0522-4187-bf0e-2b3e88910648 req-110218ef-8d7b-4142-bc73-757f21947fff service nova] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Received event network-vif-unplugged-712f4b2d-016e-43ab-a3f2-8439868a5055 for instance with task_state deleting. {{(pid=75341) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 23:54:11 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:54:11 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:54:11 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:54:11 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:54:12 user nova-compute[75341]: DEBUG nova.compute.manager [req-b74121ef-c8ff-4ab4-ab76-762adce80158 req-c36496af-962e-4fbb-9ae7-cc5a0276e6c9 service nova] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] Received event network-vif-plugged-9a0f0fb5-7e45-46c9-a476-7b1380c9f42b {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:54:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-b74121ef-c8ff-4ab4-ab76-762adce80158 req-c36496af-962e-4fbb-9ae7-cc5a0276e6c9 service nova] Acquiring lock "f7f2b24d-1987-4a59-9a49-25e387be923d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:54:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-b74121ef-c8ff-4ab4-ab76-762adce80158 req-c36496af-962e-4fbb-9ae7-cc5a0276e6c9 service nova] Lock "f7f2b24d-1987-4a59-9a49-25e387be923d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:54:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-b74121ef-c8ff-4ab4-ab76-762adce80158 req-c36496af-962e-4fbb-9ae7-cc5a0276e6c9 service nova] Lock "f7f2b24d-1987-4a59-9a49-25e387be923d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:54:12 user nova-compute[75341]: DEBUG nova.compute.manager [req-b74121ef-c8ff-4ab4-ab76-762adce80158 req-c36496af-962e-4fbb-9ae7-cc5a0276e6c9 service nova] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] No waiting events found dispatching network-vif-plugged-9a0f0fb5-7e45-46c9-a476-7b1380c9f42b {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:54:12 user nova-compute[75341]: WARNING nova.compute.manager [req-b74121ef-c8ff-4ab4-ab76-762adce80158 req-c36496af-962e-4fbb-9ae7-cc5a0276e6c9 service nova] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] Received unexpected event network-vif-plugged-9a0f0fb5-7e45-46c9-a476-7b1380c9f42b for instance with vm_state building and task_state spawning.
Nov 14 23:54:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:54:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:54:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:54:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:54:12 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Instance destroyed successfully.
Nov 14 23:54:12 user nova-compute[75341]: DEBUG nova.objects.instance [None req-1a9a5f7a-dbef-47e3-a84d-d17a5fca4570 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lazy-loading 'resources' on Instance uuid d93909b3-0373-492a-8ede-7c2cd76bcb88 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:54:12 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-1a9a5f7a-dbef-47e3-a84d-d17a5fca4570 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:51:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-816790972',display_name='tempest-AttachVolumeNegativeTest-server-816790972',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-816790972',id=36,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNLoMHYiXP+lnUfFr9VBMtRBENQvr4tntDvm0V4M76GOF/XPqEfCrcy6vvrkcVqVY+sG28wrpEuJ8f8B5tl5C58TmswRFkgI+t/pYWvSxr0BQI1JFPuNhEcMdz7EBh2qkg==',key_name='tempest-keypair-568184015',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:51:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='542a85b3a6d14c77872f1957120ba655',ramdisk_id='',reservation_id='r-a51qm104',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-802469934',owner_user_name='tempest-AttachVolumeNegativeTest-802469934-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:51:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d0b6eae0d3124f70982781555ccc7ec0',uuid=d93909b3-0373-492a-8ede-7c2cd76bcb88,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "712f4b2d-016e-43ab-a3f2-8439868a5055", "address": "fa:16:3e:b8:ce:f2", "network": {"id": "9ad7204e-07f5-4676-b2de-09e036a92e61", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-718201239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542a85b3a6d14c77872f1957120ba655", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap712f4b2d-01", "ovs_interfaceid": "712f4b2d-016e-43ab-a3f2-8439868a5055", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 23:54:12 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-1a9a5f7a-dbef-47e3-a84d-d17a5fca4570 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Converting VIF {"id": "712f4b2d-016e-43ab-a3f2-8439868a5055", "address": "fa:16:3e:b8:ce:f2", "network": {"id": "9ad7204e-07f5-4676-b2de-09e036a92e61", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-718201239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542a85b3a6d14c77872f1957120ba655", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap712f4b2d-01", "ovs_interfaceid": "712f4b2d-016e-43ab-a3f2-8439868a5055", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:54:12 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-1a9a5f7a-dbef-47e3-a84d-d17a5fca4570 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b8:ce:f2,bridge_name='br-int',has_traffic_filtering=True,id=712f4b2d-016e-43ab-a3f2-8439868a5055,network=Network(9ad7204e-07f5-4676-b2de-09e036a92e61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap712f4b2d-01') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:54:12 user nova-compute[75341]: DEBUG os_vif [None req-1a9a5f7a-dbef-47e3-a84d-d17a5fca4570 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:ce:f2,bridge_name='br-int',has_traffic_filtering=True,id=712f4b2d-016e-43ab-a3f2-8439868a5055,network=Network(9ad7204e-07f5-4676-b2de-09e036a92e61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap712f4b2d-01') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 23:54:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:54:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap712f4b2d-01, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:54:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:54:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:54:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:54:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c1baf467-79c0-4a6b-a1da-e44fc3548a2e) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:54:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:54:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:54:12 user nova-compute[75341]: INFO os_vif [None req-1a9a5f7a-dbef-47e3-a84d-d17a5fca4570 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:ce:f2,bridge_name='br-int',has_traffic_filtering=True,id=712f4b2d-016e-43ab-a3f2-8439868a5055,network=Network(9ad7204e-07f5-4676-b2de-09e036a92e61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap712f4b2d-01')
Nov 14 23:54:12 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-1a9a5f7a-dbef-47e3-a84d-d17a5fca4570 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Deleting instance files /opt/stack/data/nova/instances/d93909b3-0373-492a-8ede-7c2cd76bcb88_del
Nov 14 23:54:12 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-1a9a5f7a-dbef-47e3-a84d-d17a5fca4570 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Deletion of /opt/stack/data/nova/instances/d93909b3-0373-492a-8ede-7c2cd76bcb88_del complete
Nov 14 23:54:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:54:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:54:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:54:12 user nova-compute[75341]: INFO nova.compute.manager [None req-1a9a5f7a-dbef-47e3-a84d-d17a5fca4570 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Took 1.37 seconds to destroy the instance on the hypervisor.
Nov 14 23:54:12 user nova-compute[75341]: DEBUG oslo.service.loopingcall [None req-1a9a5f7a-dbef-47e3-a84d-d17a5fca4570 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75341) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 23:54:12 user nova-compute[75341]: DEBUG nova.compute.manager [-] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Deallocating network for instance {{(pid=75341) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 23:54:12 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] deallocate_for_instance() {{(pid=75341) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 23:54:13 user nova-compute[75341]: DEBUG nova.compute.manager [req-4ed18b83-9c3f-49de-840b-a78b6c84bca7 req-12255eb4-2310-4ac7-9974-03db5072998e service nova] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Received event network-vif-plugged-712f4b2d-016e-43ab-a3f2-8439868a5055 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:54:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4ed18b83-9c3f-49de-840b-a78b6c84bca7 req-12255eb4-2310-4ac7-9974-03db5072998e service nova] Acquiring lock "d93909b3-0373-492a-8ede-7c2cd76bcb88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:54:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4ed18b83-9c3f-49de-840b-a78b6c84bca7 req-12255eb4-2310-4ac7-9974-03db5072998e service nova] Lock "d93909b3-0373-492a-8ede-7c2cd76bcb88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:54:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4ed18b83-9c3f-49de-840b-a78b6c84bca7 req-12255eb4-2310-4ac7-9974-03db5072998e service nova] Lock "d93909b3-0373-492a-8ede-7c2cd76bcb88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:54:13 user nova-compute[75341]: DEBUG nova.compute.manager [req-4ed18b83-9c3f-49de-840b-a78b6c84bca7 req-12255eb4-2310-4ac7-9974-03db5072998e service nova] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] No waiting events found dispatching network-vif-plugged-712f4b2d-016e-43ab-a3f2-8439868a5055 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:54:13 user nova-compute[75341]: WARNING nova.compute.manager [req-4ed18b83-9c3f-49de-840b-a78b6c84bca7 req-12255eb4-2310-4ac7-9974-03db5072998e service nova] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Received unexpected event network-vif-plugged-712f4b2d-016e-43ab-a3f2-8439868a5055 for instance with vm_state active and task_state deleting.
Nov 14 23:54:13 user nova-compute[75341]: DEBUG nova.compute.manager [req-4ed18b83-9c3f-49de-840b-a78b6c84bca7 req-12255eb4-2310-4ac7-9974-03db5072998e service nova] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Received event network-vif-plugged-712f4b2d-016e-43ab-a3f2-8439868a5055 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:54:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4ed18b83-9c3f-49de-840b-a78b6c84bca7 req-12255eb4-2310-4ac7-9974-03db5072998e service nova] Acquiring lock "d93909b3-0373-492a-8ede-7c2cd76bcb88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:54:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4ed18b83-9c3f-49de-840b-a78b6c84bca7 req-12255eb4-2310-4ac7-9974-03db5072998e service nova] Lock "d93909b3-0373-492a-8ede-7c2cd76bcb88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:54:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4ed18b83-9c3f-49de-840b-a78b6c84bca7 req-12255eb4-2310-4ac7-9974-03db5072998e service nova] Lock "d93909b3-0373-492a-8ede-7c2cd76bcb88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:54:13 user nova-compute[75341]: DEBUG nova.compute.manager [req-4ed18b83-9c3f-49de-840b-a78b6c84bca7 req-12255eb4-2310-4ac7-9974-03db5072998e service nova] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] No waiting events found dispatching network-vif-plugged-712f4b2d-016e-43ab-a3f2-8439868a5055 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:54:13 user nova-compute[75341]: WARNING nova.compute.manager [req-4ed18b83-9c3f-49de-840b-a78b6c84bca7 req-12255eb4-2310-4ac7-9974-03db5072998e service nova] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Received unexpected event network-vif-plugged-712f4b2d-016e-43ab-a3f2-8439868a5055 for instance with vm_state active and task_state deleting.
Nov 14 23:54:13 user nova-compute[75341]: DEBUG nova.compute.manager [req-4ed18b83-9c3f-49de-840b-a78b6c84bca7 req-12255eb4-2310-4ac7-9974-03db5072998e service nova] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Received event network-vif-plugged-712f4b2d-016e-43ab-a3f2-8439868a5055 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:54:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4ed18b83-9c3f-49de-840b-a78b6c84bca7 req-12255eb4-2310-4ac7-9974-03db5072998e service nova] Acquiring lock "d93909b3-0373-492a-8ede-7c2cd76bcb88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:54:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4ed18b83-9c3f-49de-840b-a78b6c84bca7 req-12255eb4-2310-4ac7-9974-03db5072998e service nova] Lock "d93909b3-0373-492a-8ede-7c2cd76bcb88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:54:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4ed18b83-9c3f-49de-840b-a78b6c84bca7 req-12255eb4-2310-4ac7-9974-03db5072998e service nova] Lock "d93909b3-0373-492a-8ede-7c2cd76bcb88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:54:13 user nova-compute[75341]: DEBUG nova.compute.manager [req-4ed18b83-9c3f-49de-840b-a78b6c84bca7 req-12255eb4-2310-4ac7-9974-03db5072998e service nova] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] No waiting events found dispatching network-vif-plugged-712f4b2d-016e-43ab-a3f2-8439868a5055 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:54:13 user nova-compute[75341]: WARNING nova.compute.manager [req-4ed18b83-9c3f-49de-840b-a78b6c84bca7 req-12255eb4-2310-4ac7-9974-03db5072998e service nova] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Received unexpected event network-vif-plugged-712f4b2d-016e-43ab-a3f2-8439868a5055 for instance with vm_state active and task_state deleting.
Nov 14 23:54:13 user nova-compute[75341]: DEBUG nova.compute.manager [req-4ed18b83-9c3f-49de-840b-a78b6c84bca7 req-12255eb4-2310-4ac7-9974-03db5072998e service nova] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Received event network-vif-unplugged-712f4b2d-016e-43ab-a3f2-8439868a5055 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:54:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4ed18b83-9c3f-49de-840b-a78b6c84bca7 req-12255eb4-2310-4ac7-9974-03db5072998e service nova] Acquiring lock "d93909b3-0373-492a-8ede-7c2cd76bcb88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:54:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4ed18b83-9c3f-49de-840b-a78b6c84bca7 req-12255eb4-2310-4ac7-9974-03db5072998e service nova] Lock "d93909b3-0373-492a-8ede-7c2cd76bcb88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:54:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4ed18b83-9c3f-49de-840b-a78b6c84bca7 req-12255eb4-2310-4ac7-9974-03db5072998e service nova] Lock "d93909b3-0373-492a-8ede-7c2cd76bcb88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:54:13 user nova-compute[75341]: DEBUG nova.compute.manager [req-4ed18b83-9c3f-49de-840b-a78b6c84bca7 req-12255eb4-2310-4ac7-9974-03db5072998e service nova] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] No waiting events found dispatching network-vif-unplugged-712f4b2d-016e-43ab-a3f2-8439868a5055 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:54:13 user nova-compute[75341]: DEBUG nova.compute.manager [req-4ed18b83-9c3f-49de-840b-a78b6c84bca7 req-12255eb4-2310-4ac7-9974-03db5072998e service nova] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Received event network-vif-unplugged-712f4b2d-016e-43ab-a3f2-8439868a5055 for instance with task_state deleting. {{(pid=75341) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 23:54:13 user nova-compute[75341]: DEBUG nova.compute.manager [req-4ed18b83-9c3f-49de-840b-a78b6c84bca7 req-12255eb4-2310-4ac7-9974-03db5072998e service nova] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Received event network-vif-plugged-712f4b2d-016e-43ab-a3f2-8439868a5055 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:54:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4ed18b83-9c3f-49de-840b-a78b6c84bca7 req-12255eb4-2310-4ac7-9974-03db5072998e service nova] Acquiring lock "d93909b3-0373-492a-8ede-7c2cd76bcb88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:54:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4ed18b83-9c3f-49de-840b-a78b6c84bca7 req-12255eb4-2310-4ac7-9974-03db5072998e service nova] Lock "d93909b3-0373-492a-8ede-7c2cd76bcb88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:54:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4ed18b83-9c3f-49de-840b-a78b6c84bca7 req-12255eb4-2310-4ac7-9974-03db5072998e service nova] Lock "d93909b3-0373-492a-8ede-7c2cd76bcb88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:54:13 user nova-compute[75341]: DEBUG nova.compute.manager [req-4ed18b83-9c3f-49de-840b-a78b6c84bca7 req-12255eb4-2310-4ac7-9974-03db5072998e service nova] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] No waiting events found dispatching network-vif-plugged-712f4b2d-016e-43ab-a3f2-8439868a5055 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:54:13 user nova-compute[75341]: WARNING nova.compute.manager [req-4ed18b83-9c3f-49de-840b-a78b6c84bca7 req-12255eb4-2310-4ac7-9974-03db5072998e service nova] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Received unexpected event network-vif-plugged-712f4b2d-016e-43ab-a3f2-8439868a5055 for instance with vm_state active and task_state deleting.
Nov 14 23:54:13 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:54:13 user nova-compute[75341]: INFO nova.compute.manager [-] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Took 1.12 seconds to deallocate network for instance.
Nov 14 23:54:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1a9a5f7a-dbef-47e3-a84d-d17a5fca4570 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:54:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1a9a5f7a-dbef-47e3-a84d-d17a5fca4570 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.014s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:54:14 user nova-compute[75341]: DEBUG nova.compute.manager [req-1a3aa596-7cec-4475-8c31-0a822957203f req-8ed29812-eb98-4ed2-8ab2-2f9d8f947bbe service nova] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] Received event network-vif-plugged-9a0f0fb5-7e45-46c9-a476-7b1380c9f42b {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:54:14 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-1a3aa596-7cec-4475-8c31-0a822957203f req-8ed29812-eb98-4ed2-8ab2-2f9d8f947bbe service nova] Acquiring lock "f7f2b24d-1987-4a59-9a49-25e387be923d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:54:14 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-1a3aa596-7cec-4475-8c31-0a822957203f req-8ed29812-eb98-4ed2-8ab2-2f9d8f947bbe service nova] Lock "f7f2b24d-1987-4a59-9a49-25e387be923d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:54:14 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-1a3aa596-7cec-4475-8c31-0a822957203f req-8ed29812-eb98-4ed2-8ab2-2f9d8f947bbe service nova] Lock "f7f2b24d-1987-4a59-9a49-25e387be923d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:54:14 user nova-compute[75341]: DEBUG nova.compute.manager [req-1a3aa596-7cec-4475-8c31-0a822957203f req-8ed29812-eb98-4ed2-8ab2-2f9d8f947bbe service nova] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] No waiting events found dispatching network-vif-plugged-9a0f0fb5-7e45-46c9-a476-7b1380c9f42b {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:54:14 user nova-compute[75341]: WARNING nova.compute.manager [req-1a3aa596-7cec-4475-8c31-0a822957203f req-8ed29812-eb98-4ed2-8ab2-2f9d8f947bbe service nova] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] Received unexpected event network-vif-plugged-9a0f0fb5-7e45-46c9-a476-7b1380c9f42b for instance with vm_state building and task_state spawning.
Nov 14 23:54:14 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-1a9a5f7a-dbef-47e3-a84d-d17a5fca4570 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:54:14 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-1a9a5f7a-dbef-47e3-a84d-d17a5fca4570 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:54:14 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1a9a5f7a-dbef-47e3-a84d-d17a5fca4570 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.480s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:54:14 user nova-compute[75341]: INFO nova.scheduler.client.report [None req-1a9a5f7a-dbef-47e3-a84d-d17a5fca4570 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Deleted allocations for instance d93909b3-0373-492a-8ede-7c2cd76bcb88
Nov 14 23:54:14 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1a9a5f7a-dbef-47e3-a84d-d17a5fca4570 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "d93909b3-0373-492a-8ede-7c2cd76bcb88" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.238s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:54:14 user nova-compute[75341]: DEBUG nova.compute.manager [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] Instance event wait completed in 0 seconds for  {{(pid=75341) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 23:54:14 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] Guest created on hypervisor {{(pid=75341) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 23:54:14 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] Instance spawned successfully.
Nov 14 23:54:14 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 23:54:14 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] Found default for hw_cdrom_bus of ide {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:54:14 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] Found default for hw_disk_bus of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:54:14 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] Found default for hw_input_bus of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:54:14 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] Found default for hw_pointer_model of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:54:14 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] Found default for hw_video_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:54:14 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] Found default for hw_vif_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:54:14 user nova-compute[75341]: INFO nova.compute.manager [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] Took 5.65 seconds to spawn the instance on the hypervisor.
Nov 14 23:54:14 user nova-compute[75341]: DEBUG nova.compute.manager [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 23:54:14 user nova-compute[75341]: INFO nova.compute.manager [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] Took 11.16 seconds to build instance.
Nov 14 23:54:14 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-46d6cdae-83ac-498c-8a39-5ae223912b79 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "f7f2b24d-1987-4a59-9a49-25e387be923d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.259s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:54:15 user nova-compute[75341]: DEBUG nova.compute.manager [req-aebc965e-f785-441c-b6ad-e91f7409b9c7 req-eedda552-0d67-49e8-b94d-e55a76a5227c service nova] [instance: d93909b3-0373-492a-8ede-7c2cd76bcb88] Received event network-vif-deleted-712f4b2d-016e-43ab-a3f2-8439868a5055 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:54:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:54:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:54:22 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-26d2c562-b0b5-43bf-a82b-f9b1a686ab42 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 53d7a6fe-3914-459a-9494-c75549af7b9f is timed out.
Nov 14 23:54:22 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-26d2c562-b0b5-43bf-a82b-f9b1a686ab42 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Successfully detached device vdb from instance 53d7a6fe-3914-459a-9494-c75549af7b9f from the live domain config.
Nov 14 23:54:22 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26d2c562-b0b5-43bf-a82b-f9b1a686ab42 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] calling os-brick to detach iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 23:54:22 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-26d2c562-b0b5-43bf-a82b-f9b1a686ab42 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, {'target_iqn': 'iqn.2010-10.org.openstack:b63b88f7-c7be-4d8c-8b3b-f0b8bcf7c715', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sQeZoWzd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:54:22 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-26d2c562-b0b5-43bf-a82b-f9b1a686ab42 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:54:22 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-26d2c562-b0b5-43bf-a82b-f9b1a686ab42 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:54:22 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-26d2c562-b0b5-43bf-a82b-f9b1a686ab42 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:54:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:54:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:54:22 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[85587a42-3ef2-4757-aad1-ad4e38214129]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b63b88f7-c7be-4d8c-8b3b-f0b8bcf7c715\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:54:22 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-26d2c562-b0b5-43bf-a82b-f9b1a686ab42 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 23:54:22 user nova-compute[75341]: No targets found.
Nov 14 23:54:22 user nova-compute[75341]: iSNS:
Nov 14 23:54:22 user nova-compute[75341]: No targets found.
Nov 14 23:54:22 user nova-compute[75341]: STATIC:
Nov 14 23:54:22 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36
Nov 14 23:54:22 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:54:22 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:54:22 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05
Nov 14 23:54:22 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:54:22 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:54:22 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418
Nov 14 23:54:22 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:54:22 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:54:22 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:b63b88f7-c7be-4d8c-8b3b-f0b8bcf7c715
Nov 14 23:54:22 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:54:22 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:54:22 user nova-compute[75341]: FIRMWARE:
Nov 14 23:54:22 user nova-compute[75341]: No targets found.
Nov 14 23:54:22 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:54:22 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-26d2c562-b0b5-43bf-a82b-f9b1a686ab42 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 23:54:22 user nova-compute[75341]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 23:54:22 user nova-compute[75341]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75341) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 23:54:22 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-26d2c562-b0b5-43bf-a82b-f9b1a686ab42 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b63b88f7-c7be-4d8c-8b3b-f0b8bcf7c715', 0)] {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 23:54:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:54:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:54:22 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ebbe3c-9d6e-4113-9867-acdc91838c96]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b63b88f7-c7be-4d8c-8b3b-f0b8bcf7c715\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:54:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:54:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:54:22 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[512fee36-d70d-4b23-9426-ef31a7dc7db3]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63b88f7-c7be-4d8c-8b3b-f0b8bcf7c715 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:54:22 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-26d2c562-b0b5-43bf-a82b-f9b1a686ab42 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)
Nov 14 23:54:22 user nova-compute[75341]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)
Nov 14 23:54:22 user nova-compute[75341]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63b88f7-c7be-4d8c-8b3b-f0b8bcf7c715 (non-flash)
Nov 14 23:54:22 user nova-compute[75341]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)
Nov 14 23:54:22 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:54:22 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-26d2c562-b0b5-43bf-a82b-f9b1a686ab42 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)
Nov 14 23:54:22 user nova-compute[75341]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)
Nov 14 23:54:22 user nova-compute[75341]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63b88f7-c7be-4d8c-8b3b-f0b8bcf7c715 (non-flash)
Nov 14 23:54:22 user nova-compute[75341]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)
Nov 14 23:54:22 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:54:22 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-26d2c562-b0b5-43bf-a82b-f9b1a686ab42 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18507a9900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b63b88f7-c7be-4d8c-8b3b-f0b8bcf7c715'): ({'sdc'}, set())}) {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 23:54:22 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-26d2c562-b0b5-43bf-a82b-f9b1a686ab42 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Removing single pathed devices sdc {{(pid=75341) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 23:54:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:54:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:54:22 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e358ac3-b9f0-492b-a4a8-7203237bb7bc]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:54:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:54:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:54:22 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed30b61-f70d-4e54-9a67-64e686d50228]: (4, ('ok\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:54:22 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-26d2c562-b0b5-43bf-a82b-f9b1a686ab42 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Flushing IO for device /dev/sdc {{(pid=75341) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 23:54:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:54:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:54:22 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe67a45-a209-4357-b3f1-94cd45487c78]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:54:22 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-26d2c562-b0b5-43bf-a82b-f9b1a686ab42 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75341) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 23:54:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:54:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.061s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:54:22 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[db61fc6a-1dbc-4317-9bc2-300e6432c10a]: (4, ('1', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:54:22 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-26d2c562-b0b5-43bf-a82b-f9b1a686ab42 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 23:54:22 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-26d2c562-b0b5-43bf-a82b-f9b1a686ab42 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] SCSI volumes sdc have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 23:54:22 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-26d2c562-b0b5-43bf-a82b-f9b1a686ab42 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b63b88f7-c7be-4d8c-8b3b-f0b8bcf7c715')] {{(pid=75341) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 23:54:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b63b88f7-c7be-4d8c-8b3b-f0b8bcf7c715 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:54:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b63b88f7-c7be-4d8c-8b3b-f0b8bcf7c715 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:54:22 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6f8f2b-9200-40fe-9a36-d68bc72a5ce1]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:54:22 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-26d2c562-b0b5-43bf-a82b-f9b1a686ab42 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:54:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b63b88f7-c7be-4d8c-8b3b-f0b8bcf7c715 -p 172.16.0.220:3260 --logout {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:54:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b63b88f7-c7be-4d8c-8b3b-f0b8bcf7c715 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:54:22 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[42af9ce6-bda2-4d4b-b8af-42b0eae4dd72]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:b63b88f7-c7be-4d8c-8b3b-f0b8bcf7c715, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:b63b88f7-c7be-4d8c-8b3b-f0b8bcf7c715, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:54:22 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-26d2c562-b0b5-43bf-a82b-f9b1a686ab42 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:b63b88f7-c7be-4d8c-8b3b-f0b8bcf7c715, portal: 172.16.0.220,3260]
Nov 14 23:54:22 user nova-compute[75341]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:b63b88f7-c7be-4d8c-8b3b-f0b8bcf7c715, portal: 172.16.0.220,3260] successful.
Nov 14 23:54:22 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:54:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b63b88f7-c7be-4d8c-8b3b-f0b8bcf7c715 -p 172.16.0.220:3260 --op delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:54:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b63b88f7-c7be-4d8c-8b3b-f0b8bcf7c715 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:54:22 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4a810d-c094-4b4b-9350-b1371bdf9472]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:54:22 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-26d2c562-b0b5-43bf-a82b-f9b1a686ab42 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:54:22 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-26d2c562-b0b5-43bf-a82b-f9b1a686ab42 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.387s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:54:22 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-26d2c562-b0b5-43bf-a82b-f9b1a686ab42 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] <== disconnect_volume: return (388ms) None {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:54:22 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26d2c562-b0b5-43bf-a82b-f9b1a686ab42 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Disconnected iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 23:54:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:54:23 user nova-compute[75341]: DEBUG nova.objects.instance [None req-26d2c562-b0b5-43bf-a82b-f9b1a686ab42 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lazy-loading 'flavor' on Instance uuid 53d7a6fe-3914-459a-9494-c75549af7b9f {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:54:23 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-26d2c562-b0b5-43bf-a82b-f9b1a686ab42 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lock "53d7a6fe-3914-459a-9494-c75549af7b9f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.815s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:54:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:54:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:54:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:54:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:54:36 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:54:37 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:54:40 user nova-compute[75341]: DEBUG nova.compute.manager [req-831e4044-0e3c-406b-9f95-43a2c1b9bbfe req-3985012f-ed35-4ce0-9c96-decc95f18609 service nova] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Received event network-changed-8989d87f-615c-4cfe-9d3d-6c012e3fdf48 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:54:40 user nova-compute[75341]: DEBUG nova.compute.manager [req-831e4044-0e3c-406b-9f95-43a2c1b9bbfe req-3985012f-ed35-4ce0-9c96-decc95f18609 service nova] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Refreshing instance network info cache due to event network-changed-8989d87f-615c-4cfe-9d3d-6c012e3fdf48. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:54:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-831e4044-0e3c-406b-9f95-43a2c1b9bbfe req-3985012f-ed35-4ce0-9c96-decc95f18609 service nova] Acquiring lock "refresh_cache-c62455e6-61af-45b1-899f-bad37dc57b22" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:54:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-831e4044-0e3c-406b-9f95-43a2c1b9bbfe req-3985012f-ed35-4ce0-9c96-decc95f18609 service nova] Acquired lock "refresh_cache-c62455e6-61af-45b1-899f-bad37dc57b22" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:54:40 user nova-compute[75341]: DEBUG nova.network.neutron [req-831e4044-0e3c-406b-9f95-43a2c1b9bbfe req-3985012f-ed35-4ce0-9c96-decc95f18609 service nova] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Refreshing network info cache for port 8989d87f-615c-4cfe-9d3d-6c012e3fdf48 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:54:41 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a3d39924-11aa-49e2-8cac-7b3ed18c30c9 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Acquiring lock "c62455e6-61af-45b1-899f-bad37dc57b22" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:54:41 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a3d39924-11aa-49e2-8cac-7b3ed18c30c9 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "c62455e6-61af-45b1-899f-bad37dc57b22" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:54:41 user nova-compute[75341]: DEBUG nova.objects.instance [None req-a3d39924-11aa-49e2-8cac-7b3ed18c30c9 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lazy-loading 'flavor' on Instance uuid c62455e6-61af-45b1-899f-bad37dc57b22 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:54:41 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a3d39924-11aa-49e2-8cac-7b3ed18c30c9 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "c62455e6-61af-45b1-899f-bad37dc57b22" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:54:41 user nova-compute[75341]: DEBUG nova.network.neutron [req-831e4044-0e3c-406b-9f95-43a2c1b9bbfe req-3985012f-ed35-4ce0-9c96-decc95f18609 service nova] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Updated VIF entry in instance network info cache for port 8989d87f-615c-4cfe-9d3d-6c012e3fdf48. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:54:41 user nova-compute[75341]: DEBUG nova.network.neutron [req-831e4044-0e3c-406b-9f95-43a2c1b9bbfe req-3985012f-ed35-4ce0-9c96-decc95f18609 service nova] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Updating instance_info_cache with network_info: [{"id": "8989d87f-615c-4cfe-9d3d-6c012e3fdf48", "address": "fa:16:3e:2d:04:44", "network": {"id": "fcd22da6-016e-4872-a84c-4d82601c48d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-550677181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44bb8b1415c14bb59c4c35cc2b830875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8989d87f-61", "ovs_interfaceid": "8989d87f-615c-4cfe-9d3d-6c012e3fdf48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:54:41 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a3d39924-11aa-49e2-8cac-7b3ed18c30c9 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Acquiring lock "c62455e6-61af-45b1-899f-bad37dc57b22" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:54:41 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a3d39924-11aa-49e2-8cac-7b3ed18c30c9 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "c62455e6-61af-45b1-899f-bad37dc57b22" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:54:41 user nova-compute[75341]: INFO nova.compute.manager [None req-a3d39924-11aa-49e2-8cac-7b3ed18c30c9 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Attaching volume fc6f285e-df58-4f26-b0d1-9b3344d9fc00 to /dev/vdb
Nov 14 23:54:41 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-831e4044-0e3c-406b-9f95-43a2c1b9bbfe req-3985012f-ed35-4ce0-9c96-decc95f18609 service nova] Releasing lock "refresh_cache-c62455e6-61af-45b1-899f-bad37dc57b22" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:54:41 user nova-compute[75341]: DEBUG os_brick.utils [None req-a3d39924-11aa-49e2-8cac-7b3ed18c30c9 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:54:41 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:54:41 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:54:41 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c7fa8a9-9ec1-43c1-98c0-c632430a47bd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6d1cfca09c9\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:54:41 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:54:41 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:54:41 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d31c90-f457-4817-a9da-eebfd6eb3255]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:54:41 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:54:41 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:54:41 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[045aff94-6a7a-4f82-bc3e-81e9b78c06c0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:54:41 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[36df9d67-ee1b-486d-88b6-cf39f92a1d1a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:54:41 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a3d39924-11aa-49e2-8cac-7b3ed18c30c9 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Running cmd (subprocess): nvme version {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:54:41 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a3d39924-11aa-49e2-8cac-7b3ed18c30c9 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] 'nvme version' failed. Not Retrying. {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:54:41 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a3d39924-11aa-49e2-8cac-7b3ed18c30c9 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] nvme not present on system {{(pid=75341) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 23:54:41 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:54:41 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:54:41 user nova-compute[75341]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 23:54:41 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[f974c999-5377-4713-b595-f563a96e02e9]: (4, '') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:54:41 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-a3d39924-11aa-49e2-8cac-7b3ed18c30c9 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75341) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 23:54:41 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-a3d39924-11aa-49e2-8cac-7b3ed18c30c9 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 23:54:41 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-a3d39924-11aa-49e2-8cac-7b3ed18c30c9 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] LIGHTOS: no hostnqn found. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 23:54:41 user nova-compute[75341]: DEBUG os_brick.utils [None req-a3d39924-11aa-49e2-8cac-7b3ed18c30c9 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6d1cfca09c9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:54:41 user nova-compute[75341]: DEBUG nova.virt.block_device [None req-a3d39924-11aa-49e2-8cac-7b3ed18c30c9 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Updating existing volume attachment record: 9a63fe24-a4ba-4453-af95-41c67dd83f2b {{(pid=75341) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 23:54:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:54:42 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:54:43 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:54:46 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:54:47 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:54:47 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3d39924-11aa-49e2-8cac-7b3ed18c30c9 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Calling os-brick to attach iSCSI Volume {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 23:54:47 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d39924-11aa-49e2-8cac-7b3ed18c30c9 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JwYsOTFV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:54:47 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-a3d39924-11aa-49e2-8cac-7b3ed18c30c9 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:54:47 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-a3d39924-11aa-49e2-8cac-7b3ed18c30c9 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:54:47 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-a3d39924-11aa-49e2-8cac-7b3ed18c30c9 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:54:47 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-a3d39924-11aa-49e2-8cac-7b3ed18c30c9 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:54:47 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-a3d39924-11aa-49e2-8cac-7b3ed18c30c9 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:54:47 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-a3d39924-11aa-49e2-8cac-7b3ed18c30c9 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:54:47 user nova-compute[75341]: INFO os_brick.initiator.connectors.iscsi [None req-a3d39924-11aa-49e2-8cac-7b3ed18c30c9 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 23:54:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 -p 172.16.0.220:3260 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:54:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:54:47 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9a09d2-6f7c-44c0-ab4a-7e53b74f30a0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:54:47 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d39924-11aa-49e2-8cac-7b3ed18c30c9 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 23:54:47 user nova-compute[75341]:  {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:54:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 -p 172.16.0.220:3260 --interface default --op new {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:54:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:54:47 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d61f205-723c-4618-b885-9ca44f7ec0de]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00] added\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:54:47 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d39924-11aa-49e2-8cac-7b3ed18c30c9 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00] added
Nov 14 23:54:47 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:54:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:54:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:54:47 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9889bd1-a973-479a-b908-b978f585b9c5]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:54:47 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d39924-11aa-49e2-8cac-7b3ed18c30c9 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:54:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:54:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:54:47 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[518314fc-4d3a-43c1-8774-196b4ab6f0ec]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:54:47 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d39924-11aa-49e2-8cac-7b3ed18c30c9 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:54:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JwYsOTFV {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:54:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JwYsOTFV" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:54:47 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[539f77c9-5fa0-45c4-8993-345c9d318a17]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:54:47 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d39924-11aa-49e2-8cac-7b3ed18c30c9 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JwYsOTFV'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:54:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:54:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:54:47 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[319dce62-b1a1-4316-a335-1f7fcde73a25]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:54:47 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d39924-11aa-49e2-8cac-7b3ed18c30c9 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:54:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:54:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:54:48 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e574f8d-0102-4488-9d5a-70159f8468c2]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:54:48 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d39924-11aa-49e2-8cac-7b3ed18c30c9 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)
Nov 14 23:54:48 user nova-compute[75341]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)
Nov 14 23:54:48 user nova-compute[75341]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)
Nov 14 23:54:48 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:54:48 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d39924-11aa-49e2-8cac-7b3ed18c30c9 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)
Nov 14 23:54:48 user nova-compute[75341]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)
Nov 14 23:54:48 user nova-compute[75341]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)
Nov 14 23:54:48 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:54:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 -p 172.16.0.220:3260 --login {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:54:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:54:48 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e46a724-ddb0-4fd3-a1f4-8427a7905a9a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:54:48 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d39924-11aa-49e2-8cac-7b3ed18c30c9 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00, portal: 172.16.0.220,3260]
Nov 14 23:54:48 user nova-compute[75341]: Login to [iface: default, target: iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00, portal: 172.16.0.220,3260] successful.
Nov 14 23:54:48 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:54:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:54:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:54:48 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67b5a1b-c987-4376-bccc-4b278e172e16]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:54:48 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d39924-11aa-49e2-8cac-7b3ed18c30c9 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:54:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:54:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:54:48 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e7c082-3047-4c8d-9b92-2cdf2dc01a84]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:54:48 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d39924-11aa-49e2-8cac-7b3ed18c30c9 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)
Nov 14 23:54:48 user nova-compute[75341]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)
Nov 14 23:54:48 user nova-compute[75341]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)
Nov 14 23:54:48 user nova-compute[75341]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)
Nov 14 23:54:48 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:54:48 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d39924-11aa-49e2-8cac-7b3ed18c30c9 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)
Nov 14 23:54:48 user nova-compute[75341]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)
Nov 14 23:54:48 user nova-compute[75341]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)
Nov 14 23:54:48 user nova-compute[75341]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)
Nov 14 23:54:48 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:54:48 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-a3d39924-11aa-49e2-8cac-7b3ed18c30c9 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:54:48 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d39924-11aa-49e2-8cac-7b3ed18c30c9 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Connected to 172.16.0.220:3260 {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 23:54:48 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-a3d39924-11aa-49e2-8cac-7b3ed18c30c9 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] HCTL ('34', '-', '-', 0) found on session 44 with lun 0 {{(pid=75341) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 23:54:48 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-a3d39924-11aa-49e2-8cac-7b3ed18c30c9 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75341) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 23:54:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:54:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:54:48 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8d04a8-5469-47a2-9afe-c77726fa18b9]: (4, ('- - 0', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:54:48 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-a3d39924-11aa-49e2-8cac-7b3ed18c30c9 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 23:54:48 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d39924-11aa-49e2-8cac-7b3ed18c30c9 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JwYsOTFV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 23:54:49 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-a3d39924-11aa-49e2-8cac-7b3ed18c30c9 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:54:49 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d39924-11aa-49e2-8cac-7b3ed18c30c9 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23733643434653736', 'path': '/dev/sdc'} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:54:49 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3d39924-11aa-49e2-8cac-7b3ed18c30c9 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733643434653736', 'path': '/dev/sdc'} {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 23:54:49 user nova-compute[75341]: DEBUG nova.objects.instance [None req-a3d39924-11aa-49e2-8cac-7b3ed18c30c9 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lazy-loading 'flavor' on Instance uuid c62455e6-61af-45b1-899f-bad37dc57b22 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:54:49 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-a3d39924-11aa-49e2-8cac-7b3ed18c30c9 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 23:54:49 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:54:49 user nova-compute[75341]:   <source dev="/dev/sdc"/>
Nov 14 23:54:49 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:54:49 user nova-compute[75341]:   <serial>fc6f285e-df58-4f26-b0d1-9b3344d9fc00</serial>
Nov 14 23:54:49 user nova-compute[75341]: </disk>
Nov 14 23:54:49 user nova-compute[75341]:  {{(pid=75341) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 23:54:49 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a3d39924-11aa-49e2-8cac-7b3ed18c30c9 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:54:49 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a3d39924-11aa-49e2-8cac-7b3ed18c30c9 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:54:49 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a3d39924-11aa-49e2-8cac-7b3ed18c30c9 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] No VIF found with MAC fa:16:3e:2d:04:44, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:54:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a3d39924-11aa-49e2-8cac-7b3ed18c30c9 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "c62455e6-61af-45b1-899f-bad37dc57b22" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.511s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:54:50 user nova-compute[75341]: INFO nova.compute.manager [None req-f4602974-9808-4283-8a4f-9fd7011970ff tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Rescuing
Nov 14 23:54:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f4602974-9808-4283-8a4f-9fd7011970ff tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Acquiring lock "refresh_cache-c62455e6-61af-45b1-899f-bad37dc57b22" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:54:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f4602974-9808-4283-8a4f-9fd7011970ff tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Acquired lock "refresh_cache-c62455e6-61af-45b1-899f-bad37dc57b22" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:54:50 user nova-compute[75341]: DEBUG nova.network.neutron [None req-f4602974-9808-4283-8a4f-9fd7011970ff tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 23:54:50 user nova-compute[75341]: DEBUG nova.network.neutron [None req-f4602974-9808-4283-8a4f-9fd7011970ff tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Updating instance_info_cache with network_info: [{"id": "8989d87f-615c-4cfe-9d3d-6c012e3fdf48", "address": "fa:16:3e:2d:04:44", "network": {"id": "fcd22da6-016e-4872-a84c-4d82601c48d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-550677181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44bb8b1415c14bb59c4c35cc2b830875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8989d87f-61", "ovs_interfaceid": "8989d87f-615c-4cfe-9d3d-6c012e3fdf48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:54:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f4602974-9808-4283-8a4f-9fd7011970ff tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Releasing lock "refresh_cache-c62455e6-61af-45b1-899f-bad37dc57b22" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:54:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:54:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:54:51 user nova-compute[75341]: DEBUG nova.compute.manager [req-ce7c8d83-1c1f-4ab4-a3ba-36a92bd1bbe1 req-57a6b042-e8ff-4769-bb8e-9d7099863ea2 service nova] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Received event network-vif-unplugged-8989d87f-615c-4cfe-9d3d-6c012e3fdf48 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:54:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ce7c8d83-1c1f-4ab4-a3ba-36a92bd1bbe1 req-57a6b042-e8ff-4769-bb8e-9d7099863ea2 service nova] Acquiring lock "c62455e6-61af-45b1-899f-bad37dc57b22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:54:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ce7c8d83-1c1f-4ab4-a3ba-36a92bd1bbe1 req-57a6b042-e8ff-4769-bb8e-9d7099863ea2 service nova] Lock "c62455e6-61af-45b1-899f-bad37dc57b22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:54:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ce7c8d83-1c1f-4ab4-a3ba-36a92bd1bbe1 req-57a6b042-e8ff-4769-bb8e-9d7099863ea2 service nova] Lock "c62455e6-61af-45b1-899f-bad37dc57b22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:54:51 user nova-compute[75341]: DEBUG nova.compute.manager [req-ce7c8d83-1c1f-4ab4-a3ba-36a92bd1bbe1 req-57a6b042-e8ff-4769-bb8e-9d7099863ea2 service nova] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] No waiting events found dispatching network-vif-unplugged-8989d87f-615c-4cfe-9d3d-6c012e3fdf48 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:54:51 user nova-compute[75341]: WARNING nova.compute.manager [req-ce7c8d83-1c1f-4ab4-a3ba-36a92bd1bbe1 req-57a6b042-e8ff-4769-bb8e-9d7099863ea2 service nova] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Received unexpected event network-vif-unplugged-8989d87f-615c-4cfe-9d3d-6c012e3fdf48 for instance with vm_state active and task_state rescuing.
Nov 14 23:54:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:54:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:54:51 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Instance destroyed successfully.
Nov 14 23:54:51 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-f4602974-9808-4283-8a4f-9fd7011970ff tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Attempting rescue
Nov 14 23:54:51 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-f4602974-9808-4283-8a4f-9fd7011970ff tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75341) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 23:54:51 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-f4602974-9808-4283-8a4f-9fd7011970ff tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Instance directory exists: not creating {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 23:54:51 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-f4602974-9808-4283-8a4f-9fd7011970ff tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Creating image(s)
Nov 14 23:54:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f4602974-9808-4283-8a4f-9fd7011970ff tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Acquiring lock "/opt/stack/data/nova/instances/c62455e6-61af-45b1-899f-bad37dc57b22/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:54:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f4602974-9808-4283-8a4f-9fd7011970ff tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "/opt/stack/data/nova/instances/c62455e6-61af-45b1-899f-bad37dc57b22/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:54:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f4602974-9808-4283-8a4f-9fd7011970ff tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "/opt/stack/data/nova/instances/c62455e6-61af-45b1-899f-bad37dc57b22/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:54:51 user nova-compute[75341]: DEBUG nova.objects.instance [None req-f4602974-9808-4283-8a4f-9fd7011970ff tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lazy-loading 'trusted_certs' on Instance uuid c62455e6-61af-45b1-899f-bad37dc57b22 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:54:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f4602974-9808-4283-8a4f-9fd7011970ff tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Acquiring lock "4754efee9a6d73d3647f2add2cfe86c291949740" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:54:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f4602974-9808-4283-8a4f-9fd7011970ff tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:54:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-f4602974-9808-4283-8a4f-9fd7011970ff tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:54:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-f4602974-9808-4283-8a4f-9fd7011970ff tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.173s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:54:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-f4602974-9808-4283-8a4f-9fd7011970ff tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/c62455e6-61af-45b1-899f-bad37dc57b22/disk.rescue {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:54:51 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-f4602974-9808-4283-8a4f-9fd7011970ff tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/c62455e6-61af-45b1-899f-bad37dc57b22/disk.rescue" returned: 0 in 0.047s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:54:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f4602974-9808-4283-8a4f-9fd7011970ff tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:54:51 user nova-compute[75341]: DEBUG nova.objects.instance [None req-f4602974-9808-4283-8a4f-9fd7011970ff tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lazy-loading 'migration_context' on Instance uuid c62455e6-61af-45b1-899f-bad37dc57b22 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:54:51 user nova-compute[75341]: DEBUG nova.objects.base [None req-f4602974-9808-4283-8a4f-9fd7011970ff tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Object Instance<c62455e6-61af-45b1-899f-bad37dc57b22> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75341) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 23:54:51 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-f4602974-9808-4283-8a4f-9fd7011970ff tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Created local disks {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 23:54:51 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-f4602974-9808-4283-8a4f-9fd7011970ff tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Start _get_guest_xml network_info=[{"id": "8989d87f-615c-4cfe-9d3d-6c012e3fdf48", "address": "fa:16:3e:2d:04:44", "network": {"id": "fcd22da6-016e-4872-a84c-4d82601c48d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-550677181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-550677181-network", "vif_mac": "fa:16:3e:2d:04:44"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44bb8b1415c14bb59c4c35cc2b830875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8989d87f-61", "ovs_interfaceid": "8989d87f-615c-4cfe-9d3d-6c012e3fdf48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e46abb82-b810-490e-a8a1-ccdc5fa1a796', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 23:54:51 user nova-compute[75341]: DEBUG nova.objects.instance [None req-f4602974-9808-4283-8a4f-9fd7011970ff tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lazy-loading 'resources' on Instance uuid c62455e6-61af-45b1-899f-bad37dc57b22 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:54:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:54:52 user nova-compute[75341]: DEBUG nova.objects.base [None req-f4602974-9808-4283-8a4f-9fd7011970ff tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Object Instance<c62455e6-61af-45b1-899f-bad37dc57b22> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75341) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 23:54:52 user nova-compute[75341]: DEBUG nova.objects.instance [None req-f4602974-9808-4283-8a4f-9fd7011970ff tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lazy-loading 'numa_topology' on Instance uuid c62455e6-61af-45b1-899f-bad37dc57b22 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:54:52 user nova-compute[75341]: DEBUG nova.objects.base [None req-f4602974-9808-4283-8a4f-9fd7011970ff tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Object Instance<c62455e6-61af-45b1-899f-bad37dc57b22> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75341) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 23:54:52 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-f4602974-9808-4283-8a4f-9fd7011970ff tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:54:52 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-f4602974-9808-4283-8a4f-9fd7011970ff tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:54:52 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-f4602974-9808-4283-8a4f-9fd7011970ff tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 23:54:52 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-f4602974-9808-4283-8a4f-9fd7011970ff tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 23:54:52 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-f4602974-9808-4283-8a4f-9fd7011970ff tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 23:54:52 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-f4602974-9808-4283-8a4f-9fd7011970ff tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 23:54:52 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-f4602974-9808-4283-8a4f-9fd7011970ff tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 23:54:52 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-f4602974-9808-4283-8a4f-9fd7011970ff tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 23:54:52 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-f4602974-9808-4283-8a4f-9fd7011970ff tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 23:54:52 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-f4602974-9808-4283-8a4f-9fd7011970ff tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 23:54:52 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-f4602974-9808-4283-8a4f-9fd7011970ff tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 23:54:52 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-f4602974-9808-4283-8a4f-9fd7011970ff tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 23:54:52 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-f4602974-9808-4283-8a4f-9fd7011970ff tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 23:54:52 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-f4602974-9808-4283-8a4f-9fd7011970ff tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 23:54:52 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-f4602974-9808-4283-8a4f-9fd7011970ff tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 23:54:52 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-f4602974-9808-4283-8a4f-9fd7011970ff tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 23:54:52 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-f4602974-9808-4283-8a4f-9fd7011970ff tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 23:54:52 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-f4602974-9808-4283-8a4f-9fd7011970ff tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 23:54:52 user nova-compute[75341]: DEBUG nova.objects.instance [None req-f4602974-9808-4283-8a4f-9fd7011970ff tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lazy-loading 'vcpu_model' on Instance uuid c62455e6-61af-45b1-899f-bad37dc57b22 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:54:52 user nova-compute[75341]: DEBUG nova.objects.base [None req-f4602974-9808-4283-8a4f-9fd7011970ff tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Object Instance<c62455e6-61af-45b1-899f-bad37dc57b22> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75341) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 23:54:52 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-f4602974-9808-4283-8a4f-9fd7011970ff tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:52:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1462035552',display_name='tempest-ServerRescueNegativeTestJSON-server-1462035552',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1462035552',id=38,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNs4W2OktPVBOZWeaKzDzmXrUWs93ClVQv27cek+6cQRNCqjAwvdx6Y93/zXFXRb3ClOs1rK9E9IRD2QFgmNu1bmmVuar6AjgojHBaCfi643v9btLecoeDIfapdQ5VGE1g==',key_name='tempest-keypair-1814364720',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:52:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='44bb8b1415c14bb59c4c35cc2b830875',ramdisk_id='',reservation_id='r-zjkidlzv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1956631656',owner_user_name='tempest-ServerRescueNegativeTestJSON-1956631656-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:52:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c49a358e2f942f3a9777910ee755575',uuid=c62455e6-61af-45b1-899f-bad37dc57b22,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8989d87f-615c-4cfe-9d3d-6c012e3fdf48", "address": "fa:16:3e:2d:04:44", "network": {"id": "fcd22da6-016e-4872-a84c-4d82601c48d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-550677181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-550677181-network", "vif_mac": "fa:16:3e:2d:04:44"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44bb8b1415c14bb59c4c35cc2b830875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8989d87f-61", "ovs_interfaceid": "8989d87f-615c-4cfe-9d3d-6c012e3fdf48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:54:52 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-f4602974-9808-4283-8a4f-9fd7011970ff tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Converting VIF {"id": "8989d87f-615c-4cfe-9d3d-6c012e3fdf48", "address": "fa:16:3e:2d:04:44", "network": {"id": "fcd22da6-016e-4872-a84c-4d82601c48d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-550677181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-550677181-network", "vif_mac": "fa:16:3e:2d:04:44"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44bb8b1415c14bb59c4c35cc2b830875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8989d87f-61", "ovs_interfaceid": "8989d87f-615c-4cfe-9d3d-6c012e3fdf48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:54:52 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-f4602974-9808-4283-8a4f-9fd7011970ff tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2d:04:44,bridge_name='br-int',has_traffic_filtering=True,id=8989d87f-615c-4cfe-9d3d-6c012e3fdf48,network=Network(fcd22da6-016e-4872-a84c-4d82601c48d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8989d87f-61') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:54:52 user nova-compute[75341]: DEBUG nova.objects.instance [None req-f4602974-9808-4283-8a4f-9fd7011970ff tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lazy-loading 'pci_devices' on Instance uuid c62455e6-61af-45b1-899f-bad37dc57b22 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:54:52 user nova-compute[75341]: DEBUG nova.objects.base [None req-f4602974-9808-4283-8a4f-9fd7011970ff tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Object Instance<c62455e6-61af-45b1-899f-bad37dc57b22> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75341) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 23:54:52 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-f4602974-9808-4283-8a4f-9fd7011970ff tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] End _get_guest_xml xml=<domain type="kvm">
Nov 14 23:54:52 user nova-compute[75341]:   <uuid>c62455e6-61af-45b1-899f-bad37dc57b22</uuid>
Nov 14 23:54:52 user nova-compute[75341]:   <name>instance-00000026</name>
Nov 14 23:54:52 user nova-compute[75341]:   <memory>524288</memory>
Nov 14 23:54:52 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 14 23:54:52 user nova-compute[75341]:   <metadata>
Nov 14 23:54:52 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 23:54:52 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 14 23:54:52 user nova-compute[75341]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1462035552</nova:name>
Nov 14 23:54:52 user nova-compute[75341]:       <nova:creationTime>2023-11-14 23:54:52</nova:creationTime>
Nov 14 23:54:52 user nova-compute[75341]:       <nova:flavor name="m1.tiny">
Nov 14 23:54:52 user nova-compute[75341]:         <nova:memory>512</nova:memory>
Nov 14 23:54:52 user nova-compute[75341]:         <nova:disk>1</nova:disk>
Nov 14 23:54:52 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 14 23:54:52 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 23:54:52 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 14 23:54:52 user nova-compute[75341]:       </nova:flavor>
Nov 14 23:54:52 user nova-compute[75341]:       <nova:owner>
Nov 14 23:54:52 user nova-compute[75341]:         <nova:user uuid="3c49a358e2f942f3a9777910ee755575">tempest-ServerRescueNegativeTestJSON-1956631656-project-member</nova:user>
Nov 14 23:54:52 user nova-compute[75341]:         <nova:project uuid="44bb8b1415c14bb59c4c35cc2b830875">tempest-ServerRescueNegativeTestJSON-1956631656</nova:project>
Nov 14 23:54:52 user nova-compute[75341]:       </nova:owner>
Nov 14 23:54:52 user nova-compute[75341]:       <nova:root type="image" uuid="e46abb82-b810-490e-a8a1-ccdc5fa1a796"/>
Nov 14 23:54:52 user nova-compute[75341]:       <nova:ports>
Nov 14 23:54:52 user nova-compute[75341]:         <nova:port uuid="8989d87f-615c-4cfe-9d3d-6c012e3fdf48">
Nov 14 23:54:52 user nova-compute[75341]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 23:54:52 user nova-compute[75341]:         </nova:port>
Nov 14 23:54:52 user nova-compute[75341]:       </nova:ports>
Nov 14 23:54:52 user nova-compute[75341]:     </nova:instance>
Nov 14 23:54:52 user nova-compute[75341]:   </metadata>
Nov 14 23:54:52 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 14 23:54:52 user nova-compute[75341]:     <system>
Nov 14 23:54:52 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 23:54:52 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 14 23:54:52 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 14 23:54:52 user nova-compute[75341]:       <entry name="serial">c62455e6-61af-45b1-899f-bad37dc57b22</entry>
Nov 14 23:54:52 user nova-compute[75341]:       <entry name="uuid">c62455e6-61af-45b1-899f-bad37dc57b22</entry>
Nov 14 23:54:52 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 14 23:54:52 user nova-compute[75341]:     </system>
Nov 14 23:54:52 user nova-compute[75341]:   </sysinfo>
Nov 14 23:54:52 user nova-compute[75341]:   <os>
Nov 14 23:54:52 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 23:54:52 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 14 23:54:52 user nova-compute[75341]:   </os>
Nov 14 23:54:52 user nova-compute[75341]:   <features>
Nov 14 23:54:52 user nova-compute[75341]:     <acpi/>
Nov 14 23:54:52 user nova-compute[75341]:     <apic/>
Nov 14 23:54:52 user nova-compute[75341]:     <vmcoreinfo/>
Nov 14 23:54:52 user nova-compute[75341]:   </features>
Nov 14 23:54:52 user nova-compute[75341]:   <clock offset="utc">
Nov 14 23:54:52 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 23:54:52 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 23:54:52 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 14 23:54:52 user nova-compute[75341]:   </clock>
Nov 14 23:54:52 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 14 23:54:52 user nova-compute[75341]:     <model>Nehalem</model>
Nov 14 23:54:52 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 23:54:52 user nova-compute[75341]:   </cpu>
Nov 14 23:54:52 user nova-compute[75341]:   <devices>
Nov 14 23:54:52 user nova-compute[75341]:     <disk type="file" device="disk">
Nov 14 23:54:52 user nova-compute[75341]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 23:54:52 user nova-compute[75341]:       <source file="/opt/stack/data/nova/instances/c62455e6-61af-45b1-899f-bad37dc57b22/disk.rescue"/>
Nov 14 23:54:52 user nova-compute[75341]:       <target dev="vda" bus="virtio"/>
Nov 14 23:54:52 user nova-compute[75341]:     </disk>
Nov 14 23:54:52 user nova-compute[75341]:     <disk type="file" device="disk">
Nov 14 23:54:52 user nova-compute[75341]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 23:54:52 user nova-compute[75341]:       <source file="/opt/stack/data/nova/instances/c62455e6-61af-45b1-899f-bad37dc57b22/disk"/>
Nov 14 23:54:52 user nova-compute[75341]:       <target dev="vdb" bus="virtio"/>
Nov 14 23:54:52 user nova-compute[75341]:     </disk>
Nov 14 23:54:52 user nova-compute[75341]:     <interface type="ethernet">
Nov 14 23:54:52 user nova-compute[75341]:       <mac address="fa:16:3e:2d:04:44"/>
Nov 14 23:54:52 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:54:52 user nova-compute[75341]:       <mtu size="1442"/>
Nov 14 23:54:52 user nova-compute[75341]:       <target dev="tap8989d87f-61"/>
Nov 14 23:54:52 user nova-compute[75341]:     </interface>
Nov 14 23:54:52 user nova-compute[75341]:     <serial type="pty">
Nov 14 23:54:52 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/c62455e6-61af-45b1-899f-bad37dc57b22/console.log" append="off"/>
Nov 14 23:54:52 user nova-compute[75341]:     </serial>
Nov 14 23:54:52 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 23:54:52 user nova-compute[75341]:     <video>
Nov 14 23:54:52 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:54:52 user nova-compute[75341]:     </video>
Nov 14 23:54:52 user nova-compute[75341]:     <rng model="virtio">
Nov 14 23:54:52 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 14 23:54:52 user nova-compute[75341]:     </rng>
Nov 14 23:54:52 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 14 23:54:52 user nova-compute[75341]:     <memballoon model="virtio">
Nov 14 23:54:52 user nova-compute[75341]:       <stats period="10"/>
Nov 14 23:54:52 user nova-compute[75341]:     </memballoon>
Nov 14 23:54:52 user nova-compute[75341]:   </devices>
Nov 14 23:54:52 user nova-compute[75341]: </domain>
Nov 14 23:54:52 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 23:54:52 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Instance destroyed successfully.
Nov 14 23:54:52 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-f4602974-9808-4283-8a4f-9fd7011970ff tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:54:52 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-f4602974-9808-4283-8a4f-9fd7011970ff tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:54:52 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-f4602974-9808-4283-8a4f-9fd7011970ff tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] No VIF found with MAC fa:16:3e:2d:04:44, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:54:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:54:53 user nova-compute[75341]: DEBUG nova.compute.manager [req-432865ef-b00b-41ae-9a60-fb8bb46909c5 req-1e3d93b4-2885-43ef-8be0-fec4c1ab1457 service nova] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Received event network-vif-plugged-8989d87f-615c-4cfe-9d3d-6c012e3fdf48 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:54:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-432865ef-b00b-41ae-9a60-fb8bb46909c5 req-1e3d93b4-2885-43ef-8be0-fec4c1ab1457 service nova] Acquiring lock "c62455e6-61af-45b1-899f-bad37dc57b22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:54:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-432865ef-b00b-41ae-9a60-fb8bb46909c5 req-1e3d93b4-2885-43ef-8be0-fec4c1ab1457 service nova] Lock "c62455e6-61af-45b1-899f-bad37dc57b22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:54:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-432865ef-b00b-41ae-9a60-fb8bb46909c5 req-1e3d93b4-2885-43ef-8be0-fec4c1ab1457 service nova] Lock "c62455e6-61af-45b1-899f-bad37dc57b22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:54:53 user nova-compute[75341]: DEBUG nova.compute.manager [req-432865ef-b00b-41ae-9a60-fb8bb46909c5 req-1e3d93b4-2885-43ef-8be0-fec4c1ab1457 service nova] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] No waiting events found dispatching network-vif-plugged-8989d87f-615c-4cfe-9d3d-6c012e3fdf48 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:54:53 user nova-compute[75341]: WARNING nova.compute.manager [req-432865ef-b00b-41ae-9a60-fb8bb46909c5 req-1e3d93b4-2885-43ef-8be0-fec4c1ab1457 service nova] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Received unexpected event network-vif-plugged-8989d87f-615c-4cfe-9d3d-6c012e3fdf48 for instance with vm_state active and task_state rescuing.
Nov 14 23:54:53 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:54:53 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:54:53 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:54:53 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:54:53 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:54:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:54:55 user nova-compute[75341]: DEBUG nova.compute.manager [req-c117e30b-ed29-4374-b041-89bd5ddf638c req-d1a40026-1904-4251-b58b-76f2044da7a7 service nova] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Received event network-vif-plugged-8989d87f-615c-4cfe-9d3d-6c012e3fdf48 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:54:55 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-c117e30b-ed29-4374-b041-89bd5ddf638c req-d1a40026-1904-4251-b58b-76f2044da7a7 service nova] Acquiring lock "c62455e6-61af-45b1-899f-bad37dc57b22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:54:55 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-c117e30b-ed29-4374-b041-89bd5ddf638c req-d1a40026-1904-4251-b58b-76f2044da7a7 service nova] Lock "c62455e6-61af-45b1-899f-bad37dc57b22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:54:55 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-c117e30b-ed29-4374-b041-89bd5ddf638c req-d1a40026-1904-4251-b58b-76f2044da7a7 service nova] Lock "c62455e6-61af-45b1-899f-bad37dc57b22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:54:55 user nova-compute[75341]: DEBUG nova.compute.manager [req-c117e30b-ed29-4374-b041-89bd5ddf638c req-d1a40026-1904-4251-b58b-76f2044da7a7 service nova] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] No waiting events found dispatching network-vif-plugged-8989d87f-615c-4cfe-9d3d-6c012e3fdf48 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:54:55 user nova-compute[75341]: WARNING nova.compute.manager [req-c117e30b-ed29-4374-b041-89bd5ddf638c req-d1a40026-1904-4251-b58b-76f2044da7a7 service nova] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Received unexpected event network-vif-plugged-8989d87f-615c-4cfe-9d3d-6c012e3fdf48 for instance with vm_state active and task_state rescuing.
Nov 14 23:54:55 user nova-compute[75341]: DEBUG nova.compute.manager [req-c117e30b-ed29-4374-b041-89bd5ddf638c req-d1a40026-1904-4251-b58b-76f2044da7a7 service nova] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Received event network-vif-plugged-8989d87f-615c-4cfe-9d3d-6c012e3fdf48 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:54:55 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-c117e30b-ed29-4374-b041-89bd5ddf638c req-d1a40026-1904-4251-b58b-76f2044da7a7 service nova] Acquiring lock "c62455e6-61af-45b1-899f-bad37dc57b22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:54:55 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-c117e30b-ed29-4374-b041-89bd5ddf638c req-d1a40026-1904-4251-b58b-76f2044da7a7 service nova] Lock "c62455e6-61af-45b1-899f-bad37dc57b22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:54:55 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-c117e30b-ed29-4374-b041-89bd5ddf638c req-d1a40026-1904-4251-b58b-76f2044da7a7 service nova] Lock "c62455e6-61af-45b1-899f-bad37dc57b22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:54:55 user nova-compute[75341]: DEBUG nova.compute.manager [req-c117e30b-ed29-4374-b041-89bd5ddf638c req-d1a40026-1904-4251-b58b-76f2044da7a7 service nova] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] No waiting events found dispatching network-vif-plugged-8989d87f-615c-4cfe-9d3d-6c012e3fdf48 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:54:55 user nova-compute[75341]: WARNING nova.compute.manager [req-c117e30b-ed29-4374-b041-89bd5ddf638c req-d1a40026-1904-4251-b58b-76f2044da7a7 service nova] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Received unexpected event network-vif-plugged-8989d87f-615c-4cfe-9d3d-6c012e3fdf48 for instance with vm_state active and task_state rescuing.
Nov 14 23:54:55 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-17016637-f161-4338-b0af-8f772f55c81e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Acquiring lock "53d7a6fe-3914-459a-9494-c75549af7b9f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:54:55 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-17016637-f161-4338-b0af-8f772f55c81e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lock "53d7a6fe-3914-459a-9494-c75549af7b9f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:54:55 user nova-compute[75341]: DEBUG nova.objects.instance [None req-17016637-f161-4338-b0af-8f772f55c81e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lazy-loading 'flavor' on Instance uuid 53d7a6fe-3914-459a-9494-c75549af7b9f {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:54:55 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-17016637-f161-4338-b0af-8f772f55c81e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lock "53d7a6fe-3914-459a-9494-c75549af7b9f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:54:55 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-17016637-f161-4338-b0af-8f772f55c81e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Acquiring lock "53d7a6fe-3914-459a-9494-c75549af7b9f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:54:55 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-17016637-f161-4338-b0af-8f772f55c81e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lock "53d7a6fe-3914-459a-9494-c75549af7b9f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:54:55 user nova-compute[75341]: INFO nova.compute.manager [None req-17016637-f161-4338-b0af-8f772f55c81e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Attaching volume 1e2c9575-b7df-420a-8b27-7a5c2a75cc71 to /dev/vdb
Nov 14 23:54:55 user nova-compute[75341]: DEBUG os_brick.utils [None req-17016637-f161-4338-b0af-8f772f55c81e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:54:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:54:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:54:55 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[9098e263-07d4-44ad-a8aa-fc39765e4049]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6d1cfca09c9\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:54:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:54:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:54:55 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[563de987-b5a7-4aed-ba6e-29b96948fa84]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:54:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:54:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:54:55 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe49417-0ec0-47f0-ad1a-c94faf6b2272]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:54:55 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[107aba0e-f577-40ef-a7f2-b187df44d359]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:54:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-17016637-f161-4338-b0af-8f772f55c81e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Running cmd (subprocess): nvme version {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:54:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-17016637-f161-4338-b0af-8f772f55c81e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] 'nvme version' failed. Not Retrying. {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:54:56 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.nvmeof [None req-17016637-f161-4338-b0af-8f772f55c81e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] nvme not present on system {{(pid=75341) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 23:54:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:54:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:54:56 user nova-compute[75341]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 23:54:56 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f37d10a-2494-4746-b41f-88b7e248393d]: (4, '') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:54:56 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-17016637-f161-4338-b0af-8f772f55c81e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75341) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 23:54:56 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-17016637-f161-4338-b0af-8f772f55c81e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 23:54:56 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-17016637-f161-4338-b0af-8f772f55c81e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] LIGHTOS: no hostnqn found. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 23:54:56 user nova-compute[75341]: DEBUG os_brick.utils [None req-17016637-f161-4338-b0af-8f772f55c81e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6d1cfca09c9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:54:56 user nova-compute[75341]: DEBUG nova.virt.block_device [None req-17016637-f161-4338-b0af-8f772f55c81e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Updating existing volume attachment record: fa018a85-6a8c-4c2e-9bd1-175e770b8400 {{(pid=75341) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 23:54:56 user nova-compute[75341]: DEBUG nova.compute.manager [None req-f4602974-9808-4283-8a4f-9fd7011970ff tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 23:54:56 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:54:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:54:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:54:57 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:54:57 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75341) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 23:54:58 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:54:58 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:54:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:54:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:54:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:54:58 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75341) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 23:54:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:54:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:54:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:54:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:54:59 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 23:54:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c62455e6-61af-45b1-899f-bad37dc57b22/disk.rescue --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:54:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c62455e6-61af-45b1-899f-bad37dc57b22/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:54:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c62455e6-61af-45b1-899f-bad37dc57b22/disk.rescue --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:54:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c62455e6-61af-45b1-899f-bad37dc57b22/disk.rescue --force-share --output=json" returned: 0 in 0.227s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:54:59 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /opt/stack/data/nova/instances/c62455e6-61af-45b1-899f-bad37dc57b22/disk (vdb) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 23:54:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk.rescue --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:00 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk.rescue --force-share --output=json" returned: 0 in 0.227s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:00 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk.rescue --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:00 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:00 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:00 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:00 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:00 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:00 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c9a7d6-03a5-4fd2-9082-c68758f1542f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:00 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17016637-f161-4338-b0af-8f772f55c81e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Calling os-brick to attach iSCSI Volume {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 23:55:00 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-17016637-f161-4338-b0af-8f772f55c81e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1e2c9575-b7df-420a-8b27-7a5c2a75cc71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UeQbjNyL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:55:00 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-17016637-f161-4338-b0af-8f772f55c81e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:55:00 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-17016637-f161-4338-b0af-8f772f55c81e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:55:00 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-17016637-f161-4338-b0af-8f772f55c81e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:55:00 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-17016637-f161-4338-b0af-8f772f55c81e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:55:00 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-17016637-f161-4338-b0af-8f772f55c81e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e2c9575-b7df-420a-8b27-7a5c2a75cc71" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:55:00 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-17016637-f161-4338-b0af-8f772f55c81e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e2c9575-b7df-420a-8b27-7a5c2a75cc71" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:55:00 user nova-compute[75341]: INFO os_brick.initiator.connectors.iscsi [None req-17016637-f161-4338-b0af-8f772f55c81e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 23:55:00 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e2c9575-b7df-420a-8b27-7a5c2a75cc71 -p 172.16.0.220:3260 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:00 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e2c9575-b7df-420a-8b27-7a5c2a75cc71 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:00 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[8955812e-801b-42ff-be96-420ba8ef5cc4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:55:00 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-17016637-f161-4338-b0af-8f772f55c81e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 23:55:00 user nova-compute[75341]:  {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:55:00 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e2c9575-b7df-420a-8b27-7a5c2a75cc71 -p 172.16.0.220:3260 --interface default --op new {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:00 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e2c9575-b7df-420a-8b27-7a5c2a75cc71 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:00 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef33808-1076-4721-83c7-aa34b7faa203]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1e2c9575-b7df-420a-8b27-7a5c2a75cc71] added\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:55:00 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-17016637-f161-4338-b0af-8f772f55c81e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1e2c9575-b7df-420a-8b27-7a5c2a75cc71] added
Nov 14 23:55:00 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:55:00 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e2c9575-b7df-420a-8b27-7a5c2a75cc71 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e2c9575-b7df-420a-8b27-7a5c2a75cc71 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:01 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[0110f1da-3aec-46ef-b758-74e64d79c6d0]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:55:01 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-17016637-f161-4338-b0af-8f772f55c81e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:55:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c9a7d6-03a5-4fd2-9082-c68758f1542f/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c9a7d6-03a5-4fd2-9082-c68758f1542f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e2c9575-b7df-420a-8b27-7a5c2a75cc71 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e2c9575-b7df-420a-8b27-7a5c2a75cc71 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:01 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3fd6cb-ef13-463c-9f56-8dad2e30c564]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:55:01 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-17016637-f161-4338-b0af-8f772f55c81e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:55:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e2c9575-b7df-420a-8b27-7a5c2a75cc71 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UeQbjNyL {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e2c9575-b7df-420a-8b27-7a5c2a75cc71 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UeQbjNyL" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:01 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[82db73e8-ade4-4093-b3f9-b143683e23ed]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:55:01 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-17016637-f161-4338-b0af-8f772f55c81e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UeQbjNyL'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:55:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e2c9575-b7df-420a-8b27-7a5c2a75cc71 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e2c9575-b7df-420a-8b27-7a5c2a75cc71 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:01 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[711201ce-70c9-40db-8ebc-28b7b1a6f34a]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:55:01 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-17016637-f161-4338-b0af-8f772f55c81e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:55:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:01 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[326a940c-d5d6-4024-be93-f3b52aebd0f0]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:55:01 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-17016637-f161-4338-b0af-8f772f55c81e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)
Nov 14 23:55:01 user nova-compute[75341]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)
Nov 14 23:55:01 user nova-compute[75341]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)
Nov 14 23:55:01 user nova-compute[75341]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)
Nov 14 23:55:01 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:55:01 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-17016637-f161-4338-b0af-8f772f55c81e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)
Nov 14 23:55:01 user nova-compute[75341]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)
Nov 14 23:55:01 user nova-compute[75341]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)
Nov 14 23:55:01 user nova-compute[75341]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)
Nov 14 23:55:01 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:55:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e2c9575-b7df-420a-8b27-7a5c2a75cc71 -p 172.16.0.220:3260 --login {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c9a7d6-03a5-4fd2-9082-c68758f1542f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:01 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 23:55:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e2c9575-b7df-420a-8b27-7a5c2a75cc71 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:01 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bbad1a1-1b08-4c39-b3f1-39d5798af359]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1e2c9575-b7df-420a-8b27-7a5c2a75cc71, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1e2c9575-b7df-420a-8b27-7a5c2a75cc71, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:55:01 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-17016637-f161-4338-b0af-8f772f55c81e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1e2c9575-b7df-420a-8b27-7a5c2a75cc71, portal: 172.16.0.220,3260]
Nov 14 23:55:01 user nova-compute[75341]: Login to [iface: default, target: iqn.2010-10.org.openstack:1e2c9575-b7df-420a-8b27-7a5c2a75cc71, portal: 172.16.0.220,3260] successful.
Nov 14 23:55:01 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:55:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e2c9575-b7df-420a-8b27-7a5c2a75cc71 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e2c9575-b7df-420a-8b27-7a5c2a75cc71 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:01 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[13519a61-ac39-4602-b79f-e88943a46d3c]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:55:01 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-17016637-f161-4338-b0af-8f772f55c81e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:55:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:01 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cdac1c1-724b-4e3d-82ff-c0bd890f79d1]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e2c9575-b7df-420a-8b27-7a5c2a75cc71 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:55:01 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-17016637-f161-4338-b0af-8f772f55c81e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)
Nov 14 23:55:01 user nova-compute[75341]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)
Nov 14 23:55:01 user nova-compute[75341]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)
Nov 14 23:55:01 user nova-compute[75341]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)
Nov 14 23:55:01 user nova-compute[75341]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e2c9575-b7df-420a-8b27-7a5c2a75cc71 (non-flash)
Nov 14 23:55:01 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:55:01 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-17016637-f161-4338-b0af-8f772f55c81e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)
Nov 14 23:55:01 user nova-compute[75341]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)
Nov 14 23:55:01 user nova-compute[75341]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)
Nov 14 23:55:01 user nova-compute[75341]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)
Nov 14 23:55:01 user nova-compute[75341]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e2c9575-b7df-420a-8b27-7a5c2a75cc71 (non-flash)
Nov 14 23:55:01 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:55:01 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-17016637-f161-4338-b0af-8f772f55c81e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e2c9575-b7df-420a-8b27-7a5c2a75cc71" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.399s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:55:01 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-17016637-f161-4338-b0af-8f772f55c81e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Connected to 172.16.0.220:3260 {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 23:55:01 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-17016637-f161-4338-b0af-8f772f55c81e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] HCTL ('37', '-', '-', 0) found on session 45 with lun 0 {{(pid=75341) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 23:55:01 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-17016637-f161-4338-b0af-8f772f55c81e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75341) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 23:55:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:01 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[232ca961-92c2-4db1-a297-7831c64fa82f]: (4, ('- - 0', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:55:01 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-17016637-f161-4338-b0af-8f772f55c81e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Searching for a device in session 45 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 23:55:01 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-17016637-f161-4338-b0af-8f772f55c81e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:1e2c9575-b7df-420a-8b27-7a5c2a75cc71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UeQbjNyL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 23:55:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53d7a6fe-3914-459a-9494-c75549af7b9f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53d7a6fe-3914-459a-9494-c75549af7b9f/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53d7a6fe-3914-459a-9494-c75549af7b9f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53d7a6fe-3914-459a-9494-c75549af7b9f/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:02 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 23:55:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-17016637-f161-4338-b0af-8f772f55c81e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.468s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:55:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-17016637-f161-4338-b0af-8f772f55c81e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] <== connect_volume: return (1472ms) {'type': 'block', 'scsi_wwn': '23834356463353132', 'path': '/dev/sdf'} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:55:02 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17016637-f161-4338-b0af-8f772f55c81e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23834356463353132', 'path': '/dev/sdf'} {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 23:55:02 user nova-compute[75341]: DEBUG nova.objects.instance [None req-17016637-f161-4338-b0af-8f772f55c81e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lazy-loading 'flavor' on Instance uuid 53d7a6fe-3914-459a-9494-c75549af7b9f {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:55:02 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-17016637-f161-4338-b0af-8f772f55c81e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 23:55:02 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:55:02 user nova-compute[75341]:   <source dev="/dev/sdf"/>
Nov 14 23:55:02 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:55:02 user nova-compute[75341]:   <serial>1e2c9575-b7df-420a-8b27-7a5c2a75cc71</serial>
Nov 14 23:55:02 user nova-compute[75341]: </disk>
Nov 14 23:55:02 user nova-compute[75341]:  {{(pid=75341) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 23:55:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:03 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:55:03 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:55:03 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:55:03 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Hypervisor/Node resource view: name=user free_ram=7938MB free_disk=25.376556396484375GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75341) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 23:55:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:55:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:55:03 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-17016637-f161-4338-b0af-8f772f55c81e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:55:03 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-17016637-f161-4338-b0af-8f772f55c81e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:55:03 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-17016637-f161-4338-b0af-8f772f55c81e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] No VIF found with MAC fa:16:3e:14:63:0c, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:55:03 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 51045050-c7c6-49c5-acd4-2a76be0f466f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:55:03 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 6382e432-838f-4d89-a743-cbaa37f50ab5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:55:03 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance defae731-4191-4526-99cc-a301cf5b3355 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:55:03 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 2316aa9e-d4c9-43d0-9918-86265583aed1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:55:03 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 12c9a7d6-03a5-4fd2-9082-c68758f1542f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:55:03 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 53d7a6fe-3914-459a-9494-c75549af7b9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:55:03 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance c62455e6-61af-45b1-899f-bad37dc57b22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:55:03 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance f7f2b24d-1987-4a59-9a49-25e387be923d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:55:03 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 23:55:03 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 23:55:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-17016637-f161-4338-b0af-8f772f55c81e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lock "53d7a6fe-3914-459a-9494-c75549af7b9f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.606s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:55:03 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:55:03 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:55:03 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Compute_service record updated for user:user {{(pid=75341) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 23:55:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.433s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:55:04 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:55:04 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:55:04 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Starting heal instance info cache {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 23:55:04 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "refresh_cache-2316aa9e-d4c9-43d0-9918-86265583aed1" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:55:04 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquired lock "refresh_cache-2316aa9e-d4c9-43d0-9918-86265583aed1" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:55:04 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Forcefully refreshing network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 23:55:05 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Updating instance_info_cache with network_info: [{"id": "71caa935-899c-4716-9953-ae35733e691e", "address": "fa:16:3e:3d:1f:4a", "network": {"id": "167936c8-5f28-439e-9a1f-d9356b3a1ec9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374167607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e601d11e75d4ec4b7c05e615c67fe20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71caa935-89", "ovs_interfaceid": "71caa935-899c-4716-9953-ae35733e691e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:55:05 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Releasing lock "refresh_cache-2316aa9e-d4c9-43d0-9918-86265583aed1" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:55:05 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Updated the network info_cache for instance {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 23:55:05 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:55:05 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Acquiring lock "cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:55:05 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:55:05 user nova-compute[75341]: DEBUG nova.compute.manager [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] Starting instance... {{(pid=75341) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 23:55:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:55:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:55:06 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75341) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 23:55:06 user nova-compute[75341]: INFO nova.compute.claims [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] Claim successful on node user
Nov 14 23:55:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-19713718-c52c-4434-9230-c432e8e97e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Acquiring lock "53d7a6fe-3914-459a-9494-c75549af7b9f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:55:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-19713718-c52c-4434-9230-c432e8e97e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lock "53d7a6fe-3914-459a-9494-c75549af7b9f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:55:06 user nova-compute[75341]: INFO nova.compute.manager [None req-19713718-c52c-4434-9230-c432e8e97e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Detaching volume 1e2c9575-b7df-420a-8b27-7a5c2a75cc71
Nov 14 23:55:06 user nova-compute[75341]: INFO nova.virt.block_device [None req-19713718-c52c-4434-9230-c432e8e97e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Attempting to driver detach volume 1e2c9575-b7df-420a-8b27-7a5c2a75cc71 from mountpoint /dev/vdb
Nov 14 23:55:06 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-19713718-c52c-4434-9230-c432e8e97e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Attempting to detach device vdb from instance 53d7a6fe-3914-459a-9494-c75549af7b9f from the persistent domain config. {{(pid=75341) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 23:55:06 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-19713718-c52c-4434-9230-c432e8e97e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 23:55:06 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:55:06 user nova-compute[75341]:   <source dev="/dev/sdf"/>
Nov 14 23:55:06 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:55:06 user nova-compute[75341]:   <serial>1e2c9575-b7df-420a-8b27-7a5c2a75cc71</serial>
Nov 14 23:55:06 user nova-compute[75341]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 23:55:06 user nova-compute[75341]: </disk>
Nov 14 23:55:06 user nova-compute[75341]:  {{(pid=75341) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 23:55:06 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-19713718-c52c-4434-9230-c432e8e97e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Successfully detached device vdb from instance 53d7a6fe-3914-459a-9494-c75549af7b9f from the persistent domain config.
Nov 14 23:55:06 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-19713718-c52c-4434-9230-c432e8e97e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 53d7a6fe-3914-459a-9494-c75549af7b9f from the live domain config. {{(pid=75341) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 23:55:06 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-19713718-c52c-4434-9230-c432e8e97e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 23:55:06 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:55:06 user nova-compute[75341]:   <source dev="/dev/sdf"/>
Nov 14 23:55:06 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:55:06 user nova-compute[75341]:   <serial>1e2c9575-b7df-420a-8b27-7a5c2a75cc71</serial>
Nov 14 23:55:06 user nova-compute[75341]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 23:55:06 user nova-compute[75341]: </disk>
Nov 14 23:55:06 user nova-compute[75341]:  {{(pid=75341) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 23:55:06 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:55:06 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:55:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.392s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:55:06 user nova-compute[75341]: DEBUG nova.compute.manager [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] Start building networks asynchronously for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 23:55:06 user nova-compute[75341]: DEBUG nova.compute.manager [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] Allocating IP information in the background. {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 23:55:06 user nova-compute[75341]: DEBUG nova.network.neutron [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] allocate_for_instance() {{(pid=75341) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 23:55:06 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 23:55:06 user nova-compute[75341]: DEBUG nova.compute.manager [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] Start building block device mappings for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 23:55:06 user nova-compute[75341]: DEBUG nova.policy [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd0b6eae0d3124f70982781555ccc7ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '542a85b3a6d14c77872f1957120ba655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75341) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 23:55:06 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-19713718-c52c-4434-9230-c432e8e97e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 53d7a6fe-3914-459a-9494-c75549af7b9f {{(pid=75341) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 23:55:06 user nova-compute[75341]: DEBUG nova.compute.manager [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] Start spawning the instance on the hypervisor. {{(pid=75341) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 23:55:06 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] Creating instance directory {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 23:55:06 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] Creating image(s)
Nov 14 23:55:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Acquiring lock "/opt/stack/data/nova/instances/cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:55:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "/opt/stack/data/nova/instances/cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:55:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "/opt/stack/data/nova/instances/cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:55:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.184s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Acquiring lock "4754efee9a6d73d3647f2add2cfe86c291949740" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:55:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:55:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:55:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.179s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e/disk 1073741824 {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e/disk 1073741824" returned: 0 in 0.069s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:55:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:07 user nova-compute[75341]: DEBUG nova.network.neutron [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] Successfully created port: a3595789-ed45-4588-a234-ac1682f304a1 {{(pid=75341) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 23:55:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.180s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:07 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e/disk. size=1073741824 {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 23:55:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:07 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Cannot resize image /opt/stack/data/nova/instances/cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e/disk to a smaller size. {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 23:55:07 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] Created local disks {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 23:55:07 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] Ensure instance console log exists: /opt/stack/data/nova/instances/cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e/console.log {{(pid=75341) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 23:55:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:55:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:55:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:55:07 user nova-compute[75341]: DEBUG nova.network.neutron [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] Successfully updated port: a3595789-ed45-4588-a234-ac1682f304a1 {{(pid=75341) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 23:55:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Acquiring lock "refresh_cache-cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:55:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Acquired lock "refresh_cache-cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:55:07 user nova-compute[75341]: DEBUG nova.network.neutron [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 23:55:07 user nova-compute[75341]: DEBUG nova.compute.manager [req-ebb9a317-986d-4ad3-8e2a-9ade7e6d16b9 req-04614a7d-a2cb-45f8-aa85-5c9fd47231bf service nova] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] Received event network-changed-a3595789-ed45-4588-a234-ac1682f304a1 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:55:07 user nova-compute[75341]: DEBUG nova.compute.manager [req-ebb9a317-986d-4ad3-8e2a-9ade7e6d16b9 req-04614a7d-a2cb-45f8-aa85-5c9fd47231bf service nova] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] Refreshing instance network info cache due to event network-changed-a3595789-ed45-4588-a234-ac1682f304a1. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:55:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ebb9a317-986d-4ad3-8e2a-9ade7e6d16b9 req-04614a7d-a2cb-45f8-aa85-5c9fd47231bf service nova] Acquiring lock "refresh_cache-cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:55:07 user nova-compute[75341]: DEBUG nova.network.neutron [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] Instance cache missing network info. {{(pid=75341) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 23:55:08 user nova-compute[75341]: DEBUG nova.network.neutron [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] Updating instance_info_cache with network_info: [{"id": "a3595789-ed45-4588-a234-ac1682f304a1", "address": "fa:16:3e:b0:df:79", "network": {"id": "9ad7204e-07f5-4676-b2de-09e036a92e61", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-718201239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542a85b3a6d14c77872f1957120ba655", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3595789-ed", "ovs_interfaceid": "a3595789-ed45-4588-a234-ac1682f304a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:55:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Releasing lock "refresh_cache-cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:55:08 user nova-compute[75341]: DEBUG nova.compute.manager [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] Instance network_info: |[{"id": "a3595789-ed45-4588-a234-ac1682f304a1", "address": "fa:16:3e:b0:df:79", "network": {"id": "9ad7204e-07f5-4676-b2de-09e036a92e61", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-718201239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542a85b3a6d14c77872f1957120ba655", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3595789-ed", "ovs_interfaceid": "a3595789-ed45-4588-a234-ac1682f304a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 23:55:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ebb9a317-986d-4ad3-8e2a-9ade7e6d16b9 req-04614a7d-a2cb-45f8-aa85-5c9fd47231bf service nova] Acquired lock "refresh_cache-cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:55:08 user nova-compute[75341]: DEBUG nova.network.neutron [req-ebb9a317-986d-4ad3-8e2a-9ade7e6d16b9 req-04614a7d-a2cb-45f8-aa85-5c9fd47231bf service nova] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] Refreshing network info cache for port a3595789-ed45-4588-a234-ac1682f304a1 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:55:08 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] Start _get_guest_xml network_info=[{"id": "a3595789-ed45-4588-a234-ac1682f304a1", "address": "fa:16:3e:b0:df:79", "network": {"id": "9ad7204e-07f5-4676-b2de-09e036a92e61", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-718201239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542a85b3a6d14c77872f1957120ba655", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3595789-ed", "ovs_interfaceid": "a3595789-ed45-4588-a234-ac1682f304a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encrypted': False, 'image_id': 'e46abb82-b810-490e-a8a1-ccdc5fa1a796'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 23:55:08 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:55:08 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:55:08 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 23:55:08 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 23:55:08 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 23:55:08 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 23:55:08 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 23:55:08 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 23:55:08 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 23:55:08 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 23:55:08 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 23:55:08 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 23:55:08 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 23:55:08 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 23:55:08 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 23:55:08 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 23:55:08 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 23:55:08 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 23:55:08 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:55:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-814064283',display_name='tempest-AttachVolumeNegativeTest-server-814064283',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-814064283',id=40,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAmK/AcbGyY7tn9Md9lo2LQ82r4mszW75NBOK6fzOspuqWHpRwk6vEJ42oV460fvfzuY67PwbF1tQd+nllEzYRyG5RiKAHkWOSpvirFrlzJ2Xe3CJyAcaUG36kneAGfSOw==',key_name='tempest-keypair-1191600092',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='542a85b3a6d14c77872f1957120ba655',ramdisk_id='',reservation_id='r-odqe6on6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-802469934',owner_user_name='tempest-AttachVolumeNegativeTest-802469934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:55:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d0b6eae0d3124f70982781555ccc7ec0',uuid=cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3595789-ed45-4588-a234-ac1682f304a1", "address": "fa:16:3e:b0:df:79", "network": {"id": "9ad7204e-07f5-4676-b2de-09e036a92e61", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-718201239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542a85b3a6d14c77872f1957120ba655", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3595789-ed", "ovs_interfaceid": "a3595789-ed45-4588-a234-ac1682f304a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:55:08 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Converting VIF {"id": "a3595789-ed45-4588-a234-ac1682f304a1", "address": "fa:16:3e:b0:df:79", "network": {"id": "9ad7204e-07f5-4676-b2de-09e036a92e61", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-718201239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542a85b3a6d14c77872f1957120ba655", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3595789-ed", "ovs_interfaceid": "a3595789-ed45-4588-a234-ac1682f304a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:55:08 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:df:79,bridge_name='br-int',has_traffic_filtering=True,id=a3595789-ed45-4588-a234-ac1682f304a1,network=Network(9ad7204e-07f5-4676-b2de-09e036a92e61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3595789-ed') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:55:08 user nova-compute[75341]: DEBUG nova.objects.instance [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lazy-loading 'pci_devices' on Instance uuid cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:55:08 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:55:08 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] End _get_guest_xml xml=<domain type="kvm">
Nov 14 23:55:08 user nova-compute[75341]:   <uuid>cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e</uuid>
Nov 14 23:55:08 user nova-compute[75341]:   <name>instance-00000028</name>
Nov 14 23:55:08 user nova-compute[75341]:   <memory>524288</memory>
Nov 14 23:55:08 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 14 23:55:08 user nova-compute[75341]:   <metadata>
Nov 14 23:55:08 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 23:55:08 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 14 23:55:08 user nova-compute[75341]:       <nova:name>tempest-AttachVolumeNegativeTest-server-814064283</nova:name>
Nov 14 23:55:08 user nova-compute[75341]:       <nova:creationTime>2023-11-14 23:55:08</nova:creationTime>
Nov 14 23:55:08 user nova-compute[75341]:       <nova:flavor name="m1.tiny">
Nov 14 23:55:08 user nova-compute[75341]:         <nova:memory>512</nova:memory>
Nov 14 23:55:08 user nova-compute[75341]:         <nova:disk>1</nova:disk>
Nov 14 23:55:08 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 14 23:55:08 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 23:55:08 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 14 23:55:08 user nova-compute[75341]:       </nova:flavor>
Nov 14 23:55:08 user nova-compute[75341]:       <nova:owner>
Nov 14 23:55:08 user nova-compute[75341]:         <nova:user uuid="d0b6eae0d3124f70982781555ccc7ec0">tempest-AttachVolumeNegativeTest-802469934-project-member</nova:user>
Nov 14 23:55:08 user nova-compute[75341]:         <nova:project uuid="542a85b3a6d14c77872f1957120ba655">tempest-AttachVolumeNegativeTest-802469934</nova:project>
Nov 14 23:55:08 user nova-compute[75341]:       </nova:owner>
Nov 14 23:55:08 user nova-compute[75341]:       <nova:root type="image" uuid="e46abb82-b810-490e-a8a1-ccdc5fa1a796"/>
Nov 14 23:55:08 user nova-compute[75341]:       <nova:ports>
Nov 14 23:55:08 user nova-compute[75341]:         <nova:port uuid="a3595789-ed45-4588-a234-ac1682f304a1">
Nov 14 23:55:08 user nova-compute[75341]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 23:55:08 user nova-compute[75341]:         </nova:port>
Nov 14 23:55:08 user nova-compute[75341]:       </nova:ports>
Nov 14 23:55:08 user nova-compute[75341]:     </nova:instance>
Nov 14 23:55:08 user nova-compute[75341]:   </metadata>
Nov 14 23:55:08 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 14 23:55:08 user nova-compute[75341]:     <system>
Nov 14 23:55:08 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 23:55:08 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 14 23:55:08 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 14 23:55:08 user nova-compute[75341]:       <entry name="serial">cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e</entry>
Nov 14 23:55:08 user nova-compute[75341]:       <entry name="uuid">cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e</entry>
Nov 14 23:55:08 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 14 23:55:08 user nova-compute[75341]:     </system>
Nov 14 23:55:08 user nova-compute[75341]:   </sysinfo>
Nov 14 23:55:08 user nova-compute[75341]:   <os>
Nov 14 23:55:08 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 23:55:08 user nova-compute[75341]:     <boot dev="hd"/>
Nov 14 23:55:08 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 14 23:55:08 user nova-compute[75341]:   </os>
Nov 14 23:55:08 user nova-compute[75341]:   <features>
Nov 14 23:55:08 user nova-compute[75341]:     <acpi/>
Nov 14 23:55:08 user nova-compute[75341]:     <apic/>
Nov 14 23:55:08 user nova-compute[75341]:     <vmcoreinfo/>
Nov 14 23:55:08 user nova-compute[75341]:   </features>
Nov 14 23:55:08 user nova-compute[75341]:   <clock offset="utc">
Nov 14 23:55:08 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 23:55:08 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 23:55:08 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 14 23:55:08 user nova-compute[75341]:   </clock>
Nov 14 23:55:08 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 14 23:55:08 user nova-compute[75341]:     <model>Nehalem</model>
Nov 14 23:55:08 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 23:55:08 user nova-compute[75341]:   </cpu>
Nov 14 23:55:08 user nova-compute[75341]:   <devices>
Nov 14 23:55:08 user nova-compute[75341]:     <disk type="file" device="disk">
Nov 14 23:55:08 user nova-compute[75341]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 23:55:08 user nova-compute[75341]:       <source file="/opt/stack/data/nova/instances/cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e/disk"/>
Nov 14 23:55:08 user nova-compute[75341]:       <target dev="vda" bus="virtio"/>
Nov 14 23:55:08 user nova-compute[75341]:     </disk>
Nov 14 23:55:08 user nova-compute[75341]:     <interface type="ethernet">
Nov 14 23:55:08 user nova-compute[75341]:       <mac address="fa:16:3e:b0:df:79"/>
Nov 14 23:55:08 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:55:08 user nova-compute[75341]:       <mtu size="1442"/>
Nov 14 23:55:08 user nova-compute[75341]:       <target dev="tapa3595789-ed"/>
Nov 14 23:55:08 user nova-compute[75341]:     </interface>
Nov 14 23:55:08 user nova-compute[75341]:     <serial type="pty">
Nov 14 23:55:08 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e/console.log" append="off"/>
Nov 14 23:55:08 user nova-compute[75341]:     </serial>
Nov 14 23:55:08 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 23:55:08 user nova-compute[75341]:     <video>
Nov 14 23:55:08 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:55:08 user nova-compute[75341]:     </video>
Nov 14 23:55:08 user nova-compute[75341]:     <rng model="virtio">
Nov 14 23:55:08 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 14 23:55:08 user nova-compute[75341]:     </rng>
Nov 14 23:55:08 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 14 23:55:08 user nova-compute[75341]:     <memballoon model="virtio">
Nov 14 23:55:08 user nova-compute[75341]:       <stats period="10"/>
Nov 14 23:55:08 user nova-compute[75341]:     </memballoon>
Nov 14 23:55:08 user nova-compute[75341]:   </devices>
Nov 14 23:55:08 user nova-compute[75341]: </domain>
Nov 14 23:55:08 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 23:55:08 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:55:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-814064283',display_name='tempest-AttachVolumeNegativeTest-server-814064283',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-814064283',id=40,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAmK/AcbGyY7tn9Md9lo2LQ82r4mszW75NBOK6fzOspuqWHpRwk6vEJ42oV460fvfzuY67PwbF1tQd+nllEzYRyG5RiKAHkWOSpvirFrlzJ2Xe3CJyAcaUG36kneAGfSOw==',key_name='tempest-keypair-1191600092',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='542a85b3a6d14c77872f1957120ba655',ramdisk_id='',reservation_id='r-odqe6on6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-802469934',owner_user_name='tempest-AttachVolumeNegativeTest-802469934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:55:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d0b6eae0d3124f70982781555ccc7ec0',uuid=cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3595789-ed45-4588-a234-ac1682f304a1", "address": "fa:16:3e:b0:df:79", "network": {"id": "9ad7204e-07f5-4676-b2de-09e036a92e61", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-718201239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542a85b3a6d14c77872f1957120ba655", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3595789-ed", "ovs_interfaceid": "a3595789-ed45-4588-a234-ac1682f304a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 23:55:08 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Converting VIF {"id": "a3595789-ed45-4588-a234-ac1682f304a1", "address": "fa:16:3e:b0:df:79", "network": {"id": "9ad7204e-07f5-4676-b2de-09e036a92e61", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-718201239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542a85b3a6d14c77872f1957120ba655", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3595789-ed", "ovs_interfaceid": "a3595789-ed45-4588-a234-ac1682f304a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:55:08 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:df:79,bridge_name='br-int',has_traffic_filtering=True,id=a3595789-ed45-4588-a234-ac1682f304a1,network=Network(9ad7204e-07f5-4676-b2de-09e036a92e61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3595789-ed') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:55:08 user nova-compute[75341]: DEBUG os_vif [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:df:79,bridge_name='br-int',has_traffic_filtering=True,id=a3595789-ed45-4588-a234-ac1682f304a1,network=Network(9ad7204e-07f5-4676-b2de-09e036a92e61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3595789-ed') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 23:55:08 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:55:08 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:55:08 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 23:55:08 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:55:08 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fad71119-f8f9-587d-8b92-a3999c6b54e5', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:55:08 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:55:08 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:55:08 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa3595789-ed, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:55:08 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa3595789-ed, col_values=(('qos', UUID('731dbd2a-0b42-4e4e-964b-28d949ae2fad')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:55:08 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa3595789-ed, col_values=(('external_ids', {'iface-id': 'a3595789-ed45-4588-a234-ac1682f304a1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:df:79', 'vm-uuid': 'cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:55:08 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:55:08 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:55:08 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:55:08 user nova-compute[75341]: INFO os_vif [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:df:79,bridge_name='br-int',has_traffic_filtering=True,id=a3595789-ed45-4588-a234-ac1682f304a1,network=Network(9ad7204e-07f5-4676-b2de-09e036a92e61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3595789-ed')
Nov 14 23:55:08 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:55:08 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] No VIF found with MAC fa:16:3e:b0:df:79, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:55:08 user nova-compute[75341]: DEBUG nova.network.neutron [req-ebb9a317-986d-4ad3-8e2a-9ade7e6d16b9 req-04614a7d-a2cb-45f8-aa85-5c9fd47231bf service nova] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] Updated VIF entry in instance network info cache for port a3595789-ed45-4588-a234-ac1682f304a1. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:55:08 user nova-compute[75341]: DEBUG nova.network.neutron [req-ebb9a317-986d-4ad3-8e2a-9ade7e6d16b9 req-04614a7d-a2cb-45f8-aa85-5c9fd47231bf service nova] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] Updating instance_info_cache with network_info: [{"id": "a3595789-ed45-4588-a234-ac1682f304a1", "address": "fa:16:3e:b0:df:79", "network": {"id": "9ad7204e-07f5-4676-b2de-09e036a92e61", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-718201239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542a85b3a6d14c77872f1957120ba655", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3595789-ed", "ovs_interfaceid": "a3595789-ed45-4588-a234-ac1682f304a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:55:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ebb9a317-986d-4ad3-8e2a-9ade7e6d16b9 req-04614a7d-a2cb-45f8-aa85-5c9fd47231bf service nova] Releasing lock "refresh_cache-cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:55:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:55:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:55:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:55:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:55:09 user nova-compute[75341]: DEBUG nova.compute.manager [req-a9fb003f-958e-45ec-9bc6-6c507c6237c9 req-f46307a8-1666-43c5-9622-c977a5eea6c1 service nova] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] Received event network-vif-plugged-a3595789-ed45-4588-a234-ac1682f304a1 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:55:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a9fb003f-958e-45ec-9bc6-6c507c6237c9 req-f46307a8-1666-43c5-9622-c977a5eea6c1 service nova] Acquiring lock "cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:55:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a9fb003f-958e-45ec-9bc6-6c507c6237c9 req-f46307a8-1666-43c5-9622-c977a5eea6c1 service nova] Lock "cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:55:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a9fb003f-958e-45ec-9bc6-6c507c6237c9 req-f46307a8-1666-43c5-9622-c977a5eea6c1 service nova] Lock "cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:55:09 user nova-compute[75341]: DEBUG nova.compute.manager [req-a9fb003f-958e-45ec-9bc6-6c507c6237c9 req-f46307a8-1666-43c5-9622-c977a5eea6c1 service nova] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] No waiting events found dispatching network-vif-plugged-a3595789-ed45-4588-a234-ac1682f304a1 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:55:09 user nova-compute[75341]: WARNING nova.compute.manager [req-a9fb003f-958e-45ec-9bc6-6c507c6237c9 req-f46307a8-1666-43c5-9622-c977a5eea6c1 service nova] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] Received unexpected event network-vif-plugged-a3595789-ed45-4588-a234-ac1682f304a1 for instance with vm_state building and task_state spawning.
Nov 14 23:55:10 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:55:10 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:55:10 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:55:11 user nova-compute[75341]: DEBUG nova.compute.manager [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] Instance event wait completed in 0 seconds for  {{(pid=75341) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 23:55:11 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] Guest created on hypervisor {{(pid=75341) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 23:55:11 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] Instance spawned successfully.
Nov 14 23:55:11 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 23:55:11 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] Found default for hw_cdrom_bus of ide {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:55:11 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] Found default for hw_disk_bus of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:55:11 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] Found default for hw_input_bus of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:55:11 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] Found default for hw_pointer_model of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:55:11 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] Found default for hw_video_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:55:11 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] Found default for hw_vif_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:55:11 user nova-compute[75341]: INFO nova.compute.manager [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] Took 5.27 seconds to spawn the instance on the hypervisor.
Nov 14 23:55:11 user nova-compute[75341]: DEBUG nova.compute.manager [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 23:55:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:55:12 user nova-compute[75341]: DEBUG nova.compute.manager [req-74aae367-c28a-45d5-bc77-b0d958318408 req-dbdde6ea-189b-4a10-9147-2d6bc84a481f service nova] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] Received event network-vif-plugged-a3595789-ed45-4588-a234-ac1682f304a1 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:55:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-74aae367-c28a-45d5-bc77-b0d958318408 req-dbdde6ea-189b-4a10-9147-2d6bc84a481f service nova] Acquiring lock "cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:55:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-74aae367-c28a-45d5-bc77-b0d958318408 req-dbdde6ea-189b-4a10-9147-2d6bc84a481f service nova] Lock "cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:55:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-74aae367-c28a-45d5-bc77-b0d958318408 req-dbdde6ea-189b-4a10-9147-2d6bc84a481f service nova] Lock "cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:55:12 user nova-compute[75341]: DEBUG nova.compute.manager [req-74aae367-c28a-45d5-bc77-b0d958318408 req-dbdde6ea-189b-4a10-9147-2d6bc84a481f service nova] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] No waiting events found dispatching network-vif-plugged-a3595789-ed45-4588-a234-ac1682f304a1 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:55:12 user nova-compute[75341]: WARNING nova.compute.manager [req-74aae367-c28a-45d5-bc77-b0d958318408 req-dbdde6ea-189b-4a10-9147-2d6bc84a481f service nova] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] Received unexpected event network-vif-plugged-a3595789-ed45-4588-a234-ac1682f304a1 for instance with vm_state building and task_state spawning.
Nov 14 23:55:12 user nova-compute[75341]: INFO nova.compute.manager [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] Took 6.07 seconds to build instance.
Nov 14 23:55:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-23c34c23-c3a7-45e1-8873-cc45f287709c tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.178s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:55:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:55:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-2ef9a83d-87be-429d-b7d1-c920b102ed85 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Acquiring lock "2316aa9e-d4c9-43d0-9918-86265583aed1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:55:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-2ef9a83d-87be-429d-b7d1-c920b102ed85 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "2316aa9e-d4c9-43d0-9918-86265583aed1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:55:13 user nova-compute[75341]: INFO nova.compute.manager [None req-2ef9a83d-87be-429d-b7d1-c920b102ed85 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Detaching volume 7cdb17e6-f80d-473e-9b68-71710b6ce418
Nov 14 23:55:13 user nova-compute[75341]: INFO nova.virt.block_device [None req-2ef9a83d-87be-429d-b7d1-c920b102ed85 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Attempting to driver detach volume 7cdb17e6-f80d-473e-9b68-71710b6ce418 from mountpoint /dev/vdb
Nov 14 23:55:13 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-2ef9a83d-87be-429d-b7d1-c920b102ed85 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Attempting to detach device vdb from instance 2316aa9e-d4c9-43d0-9918-86265583aed1 from the persistent domain config. {{(pid=75341) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 23:55:13 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-2ef9a83d-87be-429d-b7d1-c920b102ed85 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 23:55:13 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:55:13 user nova-compute[75341]:   <source dev="/dev/sde"/>
Nov 14 23:55:13 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:55:13 user nova-compute[75341]:   <serial>7cdb17e6-f80d-473e-9b68-71710b6ce418</serial>
Nov 14 23:55:13 user nova-compute[75341]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 23:55:13 user nova-compute[75341]: </disk>
Nov 14 23:55:13 user nova-compute[75341]:  {{(pid=75341) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 23:55:13 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-2ef9a83d-87be-429d-b7d1-c920b102ed85 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Successfully detached device vdb from instance 2316aa9e-d4c9-43d0-9918-86265583aed1 from the persistent domain config.
Nov 14 23:55:13 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-2ef9a83d-87be-429d-b7d1-c920b102ed85 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2316aa9e-d4c9-43d0-9918-86265583aed1 from the live domain config. {{(pid=75341) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 23:55:13 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-2ef9a83d-87be-429d-b7d1-c920b102ed85 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 23:55:13 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:55:13 user nova-compute[75341]:   <source dev="/dev/sde"/>
Nov 14 23:55:13 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:55:13 user nova-compute[75341]:   <serial>7cdb17e6-f80d-473e-9b68-71710b6ce418</serial>
Nov 14 23:55:13 user nova-compute[75341]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 23:55:13 user nova-compute[75341]: </disk>
Nov 14 23:55:13 user nova-compute[75341]:  {{(pid=75341) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 23:55:13 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-2ef9a83d-87be-429d-b7d1-c920b102ed85 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2316aa9e-d4c9-43d0-9918-86265583aed1 {{(pid=75341) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 23:55:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:55:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:55:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:55:23 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:55:26 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-19713718-c52c-4434-9230-c432e8e97e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 53d7a6fe-3914-459a-9494-c75549af7b9f is timed out.
Nov 14 23:55:26 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-19713718-c52c-4434-9230-c432e8e97e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Successfully detached device vdb from instance 53d7a6fe-3914-459a-9494-c75549af7b9f from the live domain config.
Nov 14 23:55:26 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19713718-c52c-4434-9230-c432e8e97e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] calling os-brick to detach iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 23:55:26 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-19713718-c52c-4434-9230-c432e8e97e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, {'target_iqn': 'iqn.2010-10.org.openstack:1e2c9575-b7df-420a-8b27-7a5c2a75cc71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UeQbjNyL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:55:26 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-19713718-c52c-4434-9230-c432e8e97e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:55:26 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-19713718-c52c-4434-9230-c432e8e97e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:55:26 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-19713718-c52c-4434-9230-c432e8e97e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:55:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:26 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[251123d7-aced-4e2b-924f-42449554cd7d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e2c9575-b7df-420a-8b27-7a5c2a75cc71\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:55:26 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-19713718-c52c-4434-9230-c432e8e97e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 23:55:26 user nova-compute[75341]: No targets found.
Nov 14 23:55:26 user nova-compute[75341]: iSNS:
Nov 14 23:55:26 user nova-compute[75341]: No targets found.
Nov 14 23:55:26 user nova-compute[75341]: STATIC:
Nov 14 23:55:26 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36
Nov 14 23:55:26 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:55:26 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:55:26 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05
Nov 14 23:55:26 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:55:26 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:55:26 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418
Nov 14 23:55:26 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:55:26 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:55:26 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00
Nov 14 23:55:26 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:55:26 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:55:26 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:1e2c9575-b7df-420a-8b27-7a5c2a75cc71
Nov 14 23:55:26 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:55:26 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:55:26 user nova-compute[75341]: FIRMWARE:
Nov 14 23:55:26 user nova-compute[75341]: No targets found.
Nov 14 23:55:26 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:55:26 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-19713718-c52c-4434-9230-c432e8e97e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 23:55:26 user nova-compute[75341]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 23:55:26 user nova-compute[75341]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75341) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 23:55:26 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-19713718-c52c-4434-9230-c432e8e97e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e2c9575-b7df-420a-8b27-7a5c2a75cc71', 0)] {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 23:55:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:26 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36a4d73-d601-4e05-b4d2-2a8292ab7c9f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e2c9575-b7df-420a-8b27-7a5c2a75cc71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:55:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:26 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e56cef9-e17e-4968-b9d8-3148dcd1e4bc]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e2c9575-b7df-420a-8b27-7a5c2a75cc71 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:55:26 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-19713718-c52c-4434-9230-c432e8e97e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)
Nov 14 23:55:26 user nova-compute[75341]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)
Nov 14 23:55:26 user nova-compute[75341]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)
Nov 14 23:55:26 user nova-compute[75341]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)
Nov 14 23:55:26 user nova-compute[75341]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e2c9575-b7df-420a-8b27-7a5c2a75cc71 (non-flash)
Nov 14 23:55:26 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:55:26 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-19713718-c52c-4434-9230-c432e8e97e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)
Nov 14 23:55:26 user nova-compute[75341]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)
Nov 14 23:55:26 user nova-compute[75341]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)
Nov 14 23:55:26 user nova-compute[75341]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)
Nov 14 23:55:26 user nova-compute[75341]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e2c9575-b7df-420a-8b27-7a5c2a75cc71 (non-flash)
Nov 14 23:55:26 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:55:26 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-19713718-c52c-4434-9230-c432e8e97e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f185055b490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e2c9575-b7df-420a-8b27-7a5c2a75cc71'): ({'sdf'}, set())}) {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 23:55:26 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-19713718-c52c-4434-9230-c432e8e97e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Removing single pathed devices sdf {{(pid=75341) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 23:55:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:26 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a64a34-e3a0-4301-a2ef-28a851184479]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:55:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:26 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af77d8d-20e7-4daa-9924-66f19c09b6ac]: (4, ('ok\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:55:26 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-19713718-c52c-4434-9230-c432e8e97e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Flushing IO for device /dev/sdf {{(pid=75341) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 23:55:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:26 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eacca90-95f6-484e-b3dd-7c41979ab1b9]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:55:26 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-19713718-c52c-4434-9230-c432e8e97e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75341) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 23:55:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.052s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:26 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[8015f47f-36f2-4d0b-8295-4f617c617e3f]: (4, ('1', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:55:26 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-19713718-c52c-4434-9230-c432e8e97e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 23:55:26 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-19713718-c52c-4434-9230-c432e8e97e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] SCSI volumes sdf have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 23:55:26 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-19713718-c52c-4434-9230-c432e8e97e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e2c9575-b7df-420a-8b27-7a5c2a75cc71')] {{(pid=75341) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 23:55:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e2c9575-b7df-420a-8b27-7a5c2a75cc71 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e2c9575-b7df-420a-8b27-7a5c2a75cc71 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:26 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d24e857-1dd4-44de-bbaa-a54248b3e6fc]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:55:26 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-19713718-c52c-4434-9230-c432e8e97e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:55:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e2c9575-b7df-420a-8b27-7a5c2a75cc71 -p 172.16.0.220:3260 --logout {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e2c9575-b7df-420a-8b27-7a5c2a75cc71 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:26 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d59d21-e220-411c-8232-93935743edb9]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:1e2c9575-b7df-420a-8b27-7a5c2a75cc71, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:1e2c9575-b7df-420a-8b27-7a5c2a75cc71, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:55:26 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-19713718-c52c-4434-9230-c432e8e97e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:1e2c9575-b7df-420a-8b27-7a5c2a75cc71, portal: 172.16.0.220,3260]
Nov 14 23:55:26 user nova-compute[75341]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:1e2c9575-b7df-420a-8b27-7a5c2a75cc71, portal: 172.16.0.220,3260] successful.
Nov 14 23:55:26 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:55:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e2c9575-b7df-420a-8b27-7a5c2a75cc71 -p 172.16.0.220:3260 --op delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:27 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e2c9575-b7df-420a-8b27-7a5c2a75cc71 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:27 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[23799ad2-4e5c-40d0-aaa9-f7b38afeb18a]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:55:27 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-19713718-c52c-4434-9230-c432e8e97e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:55:27 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-19713718-c52c-4434-9230-c432e8e97e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:55:27 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-19713718-c52c-4434-9230-c432e8e97e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] <== disconnect_volume: return (327ms) None {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:55:27 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19713718-c52c-4434-9230-c432e8e97e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Disconnected iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 23:55:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:55:27 user nova-compute[75341]: DEBUG nova.objects.instance [None req-19713718-c52c-4434-9230-c432e8e97e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lazy-loading 'flavor' on Instance uuid 53d7a6fe-3914-459a-9494-c75549af7b9f {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:55:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-19713718-c52c-4434-9230-c432e8e97e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lock "53d7a6fe-3914-459a-9494-c75549af7b9f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.720s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:55:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:55:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:55:33 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:55:33 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-2ef9a83d-87be-429d-b7d1-c920b102ed85 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2316aa9e-d4c9-43d0-9918-86265583aed1 is timed out.
Nov 14 23:55:33 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-2ef9a83d-87be-429d-b7d1-c920b102ed85 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Successfully detached device vdb from instance 2316aa9e-d4c9-43d0-9918-86265583aed1 from the live domain config.
Nov 14 23:55:33 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ef9a83d-87be-429d-b7d1-c920b102ed85 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] calling os-brick to detach iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 23:55:33 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef9a83d-87be-429d-b7d1-c920b102ed85 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, {'target_iqn': 'iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GWOJaprl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:55:33 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-2ef9a83d-87be-429d-b7d1-c920b102ed85 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:55:33 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-2ef9a83d-87be-429d-b7d1-c920b102ed85 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:55:33 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-2ef9a83d-87be-429d-b7d1-c920b102ed85 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:55:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:33 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23b42dd-465a-49a1-81ea-80df20b2ebbf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:55:33 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef9a83d-87be-429d-b7d1-c920b102ed85 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 23:55:33 user nova-compute[75341]: No targets found.
Nov 14 23:55:33 user nova-compute[75341]: iSNS:
Nov 14 23:55:33 user nova-compute[75341]: No targets found.
Nov 14 23:55:33 user nova-compute[75341]: STATIC:
Nov 14 23:55:33 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36
Nov 14 23:55:33 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:55:33 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:55:33 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05
Nov 14 23:55:33 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:55:33 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:55:33 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418
Nov 14 23:55:33 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:55:33 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:55:33 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00
Nov 14 23:55:33 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:55:33 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:55:33 user nova-compute[75341]: FIRMWARE:
Nov 14 23:55:33 user nova-compute[75341]: No targets found.
Nov 14 23:55:33 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:55:33 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef9a83d-87be-429d-b7d1-c920b102ed85 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 23:55:33 user nova-compute[75341]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 23:55:33 user nova-compute[75341]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75341) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 23:55:33 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef9a83d-87be-429d-b7d1-c920b102ed85 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418', 0)] {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 23:55:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:33 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[0097296e-5f15-4934-9cee-698fb776595a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:55:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:34 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:34 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[200fba27-09bf-4109-9fe3-abe1e2ba0afc]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:55:34 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef9a83d-87be-429d-b7d1-c920b102ed85 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)
Nov 14 23:55:34 user nova-compute[75341]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)
Nov 14 23:55:34 user nova-compute[75341]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)
Nov 14 23:55:34 user nova-compute[75341]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)
Nov 14 23:55:34 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:55:34 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef9a83d-87be-429d-b7d1-c920b102ed85 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)
Nov 14 23:55:34 user nova-compute[75341]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 (non-flash)
Nov 14 23:55:34 user nova-compute[75341]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)
Nov 14 23:55:34 user nova-compute[75341]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)
Nov 14 23:55:34 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:55:34 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef9a83d-87be-429d-b7d1-c920b102ed85 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f185055ab00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418'): ({'sde'}, set())}) {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 23:55:34 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-2ef9a83d-87be-429d-b7d1-c920b102ed85 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Removing single pathed devices sde {{(pid=75341) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 23:55:34 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:34 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:34 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a00f3a-d22d-4f2e-8476-f5956f1f075c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:55:34 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:34 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:34 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d408876-d5cf-4ffb-8951-4a71b3622f79]: (4, ('ok\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:55:34 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-2ef9a83d-87be-429d-b7d1-c920b102ed85 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Flushing IO for device /dev/sde {{(pid=75341) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 23:55:34 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:34 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:34 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd75ef1a-1f25-4ac5-9be8-861eedb6ef3c]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:55:34 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-2ef9a83d-87be-429d-b7d1-c920b102ed85 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75341) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 23:55:34 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:34 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:34 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[80dbcaad-6347-408b-8992-403251c790c1]: (4, ('1', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:55:34 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-2ef9a83d-87be-429d-b7d1-c920b102ed85 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 23:55:34 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-2ef9a83d-87be-429d-b7d1-c920b102ed85 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] SCSI volumes sde have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 23:55:34 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef9a83d-87be-429d-b7d1-c920b102ed85 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418')] {{(pid=75341) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 23:55:34 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:34 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:34 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0081cad-1a9e-4eb2-bff7-f03cefa33816]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:55:34 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef9a83d-87be-429d-b7d1-c920b102ed85 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:55:34 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 -p 172.16.0.220:3260 --logout {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:34 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:34 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9d3e54-bc8e-4015-a1c2-4012955b36b9]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:55:34 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef9a83d-87be-429d-b7d1-c920b102ed85 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418, portal: 172.16.0.220,3260]
Nov 14 23:55:34 user nova-compute[75341]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418, portal: 172.16.0.220,3260] successful.
Nov 14 23:55:34 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:55:34 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 -p 172.16.0.220:3260 --op delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:34 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cdb17e6-f80d-473e-9b68-71710b6ce418 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:34 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[6835d6cf-bc94-45f6-ac7d-5800e890a793]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:55:34 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef9a83d-87be-429d-b7d1-c920b102ed85 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:55:34 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-2ef9a83d-87be-429d-b7d1-c920b102ed85 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:55:34 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ef9a83d-87be-429d-b7d1-c920b102ed85 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] <== disconnect_volume: return (321ms) None {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:55:34 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ef9a83d-87be-429d-b7d1-c920b102ed85 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Disconnected iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 23:55:34 user nova-compute[75341]: DEBUG nova.objects.instance [None req-2ef9a83d-87be-429d-b7d1-c920b102ed85 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lazy-loading 'flavor' on Instance uuid 2316aa9e-d4c9-43d0-9918-86265583aed1 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:55:35 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-2ef9a83d-87be-429d-b7d1-c920b102ed85 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "2316aa9e-d4c9-43d0-9918-86265583aed1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.669s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:55:35 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-31ce5458-6ffa-411a-a886-5d160cb9884d tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Acquiring lock "2316aa9e-d4c9-43d0-9918-86265583aed1" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:55:35 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-31ce5458-6ffa-411a-a886-5d160cb9884d tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "2316aa9e-d4c9-43d0-9918-86265583aed1" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:55:35 user nova-compute[75341]: DEBUG nova.compute.manager [None req-31ce5458-6ffa-411a-a886-5d160cb9884d tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 23:55:35 user nova-compute[75341]: DEBUG nova.compute.manager [None req-31ce5458-6ffa-411a-a886-5d160cb9884d tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75341) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 14 23:55:35 user nova-compute[75341]: DEBUG nova.objects.instance [None req-31ce5458-6ffa-411a-a886-5d160cb9884d tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lazy-loading 'flavor' on Instance uuid 2316aa9e-d4c9-43d0-9918-86265583aed1 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:55:35 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:55:35 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:55:35 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:55:35 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:55:35 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:55:36 user nova-compute[75341]: DEBUG nova.compute.manager [req-cc9035ab-cfe2-48d5-9359-93496392592c req-c4359637-207c-406b-91c9-226db209ca96 service nova] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Received event network-vif-unplugged-71caa935-899c-4716-9953-ae35733e691e {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:55:36 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-cc9035ab-cfe2-48d5-9359-93496392592c req-c4359637-207c-406b-91c9-226db209ca96 service nova] Acquiring lock "2316aa9e-d4c9-43d0-9918-86265583aed1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:55:36 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-cc9035ab-cfe2-48d5-9359-93496392592c req-c4359637-207c-406b-91c9-226db209ca96 service nova] Lock "2316aa9e-d4c9-43d0-9918-86265583aed1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:55:36 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-cc9035ab-cfe2-48d5-9359-93496392592c req-c4359637-207c-406b-91c9-226db209ca96 service nova] Lock "2316aa9e-d4c9-43d0-9918-86265583aed1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:55:36 user nova-compute[75341]: DEBUG nova.compute.manager [req-cc9035ab-cfe2-48d5-9359-93496392592c req-c4359637-207c-406b-91c9-226db209ca96 service nova] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] No waiting events found dispatching network-vif-unplugged-71caa935-899c-4716-9953-ae35733e691e {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:55:36 user nova-compute[75341]: WARNING nova.compute.manager [req-cc9035ab-cfe2-48d5-9359-93496392592c req-c4359637-207c-406b-91c9-226db209ca96 service nova] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Received unexpected event network-vif-unplugged-71caa935-899c-4716-9953-ae35733e691e for instance with vm_state active and task_state powering-off.
Nov 14 23:55:36 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Instance destroyed successfully.
Nov 14 23:55:36 user nova-compute[75341]: DEBUG nova.compute.manager [None req-31ce5458-6ffa-411a-a886-5d160cb9884d tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 23:55:36 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-31ce5458-6ffa-411a-a886-5d160cb9884d tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "2316aa9e-d4c9-43d0-9918-86265583aed1" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.854s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:55:37 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:55:37 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-dd6dbb7f-1a53-47fc-b1dd-1c1ddcda8e01 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Acquiring lock "12c9a7d6-03a5-4fd2-9082-c68758f1542f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:55:37 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-dd6dbb7f-1a53-47fc-b1dd-1c1ddcda8e01 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "12c9a7d6-03a5-4fd2-9082-c68758f1542f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:55:37 user nova-compute[75341]: INFO nova.compute.manager [None req-dd6dbb7f-1a53-47fc-b1dd-1c1ddcda8e01 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Detaching volume 9efe345e-fc79-46f6-973c-ed817a24dd05
Nov 14 23:55:37 user nova-compute[75341]: INFO nova.virt.block_device [None req-dd6dbb7f-1a53-47fc-b1dd-1c1ddcda8e01 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Attempting to driver detach volume 9efe345e-fc79-46f6-973c-ed817a24dd05 from mountpoint /dev/vdb
Nov 14 23:55:37 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-dd6dbb7f-1a53-47fc-b1dd-1c1ddcda8e01 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Attempting to detach device vdb from instance 12c9a7d6-03a5-4fd2-9082-c68758f1542f from the persistent domain config. {{(pid=75341) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 23:55:37 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-dd6dbb7f-1a53-47fc-b1dd-1c1ddcda8e01 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 23:55:37 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:55:37 user nova-compute[75341]:   <source dev="/dev/sdb"/>
Nov 14 23:55:37 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:55:37 user nova-compute[75341]:   <serial>9efe345e-fc79-46f6-973c-ed817a24dd05</serial>
Nov 14 23:55:37 user nova-compute[75341]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 23:55:37 user nova-compute[75341]: </disk>
Nov 14 23:55:37 user nova-compute[75341]:  {{(pid=75341) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 23:55:37 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-dd6dbb7f-1a53-47fc-b1dd-1c1ddcda8e01 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Successfully detached device vdb from instance 12c9a7d6-03a5-4fd2-9082-c68758f1542f from the persistent domain config.
Nov 14 23:55:37 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-dd6dbb7f-1a53-47fc-b1dd-1c1ddcda8e01 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 12c9a7d6-03a5-4fd2-9082-c68758f1542f from the live domain config. {{(pid=75341) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 23:55:37 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-dd6dbb7f-1a53-47fc-b1dd-1c1ddcda8e01 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 23:55:37 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:55:37 user nova-compute[75341]:   <source dev="/dev/sdb"/>
Nov 14 23:55:37 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:55:37 user nova-compute[75341]:   <serial>9efe345e-fc79-46f6-973c-ed817a24dd05</serial>
Nov 14 23:55:37 user nova-compute[75341]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 23:55:37 user nova-compute[75341]: </disk>
Nov 14 23:55:37 user nova-compute[75341]:  {{(pid=75341) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 23:55:38 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-dd6dbb7f-1a53-47fc-b1dd-1c1ddcda8e01 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 12c9a7d6-03a5-4fd2-9082-c68758f1542f {{(pid=75341) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 23:55:38 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:55:38 user nova-compute[75341]: DEBUG nova.compute.manager [req-50b81d87-825b-4f47-a32a-66099011f524 req-a2947e5f-fd6b-4788-aeeb-be14a48294e1 service nova] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Received event network-vif-plugged-71caa935-899c-4716-9953-ae35733e691e {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:55:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-50b81d87-825b-4f47-a32a-66099011f524 req-a2947e5f-fd6b-4788-aeeb-be14a48294e1 service nova] Acquiring lock "2316aa9e-d4c9-43d0-9918-86265583aed1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:55:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-50b81d87-825b-4f47-a32a-66099011f524 req-a2947e5f-fd6b-4788-aeeb-be14a48294e1 service nova] Lock "2316aa9e-d4c9-43d0-9918-86265583aed1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:55:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-50b81d87-825b-4f47-a32a-66099011f524 req-a2947e5f-fd6b-4788-aeeb-be14a48294e1 service nova] Lock "2316aa9e-d4c9-43d0-9918-86265583aed1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:55:38 user nova-compute[75341]: DEBUG nova.compute.manager [req-50b81d87-825b-4f47-a32a-66099011f524 req-a2947e5f-fd6b-4788-aeeb-be14a48294e1 service nova] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] No waiting events found dispatching network-vif-plugged-71caa935-899c-4716-9953-ae35733e691e {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:55:38 user nova-compute[75341]: WARNING nova.compute.manager [req-50b81d87-825b-4f47-a32a-66099011f524 req-a2947e5f-fd6b-4788-aeeb-be14a48294e1 service nova] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Received unexpected event network-vif-plugged-71caa935-899c-4716-9953-ae35733e691e for instance with vm_state stopped and task_state None.
Nov 14 23:55:42 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:55:43 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:55:48 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:55:53 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:55:53 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:55:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:55:54 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:55:54 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Cleaning up deleted instances {{(pid=75341) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 23:55:54 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] There are 0 instances to clean {{(pid=75341) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 23:55:55 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:55:56 user nova-compute[75341]: DEBUG nova.compute.manager [req-de7451aa-6b2f-4916-91a5-bf66ade8b42b req-248efc8d-68a1-49ad-a1ff-7504eb56c8b0 service nova] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] Received event network-changed-9a0f0fb5-7e45-46c9-a476-7b1380c9f42b {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:55:56 user nova-compute[75341]: DEBUG nova.compute.manager [req-de7451aa-6b2f-4916-91a5-bf66ade8b42b req-248efc8d-68a1-49ad-a1ff-7504eb56c8b0 service nova] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] Refreshing instance network info cache due to event network-changed-9a0f0fb5-7e45-46c9-a476-7b1380c9f42b. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:55:56 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-de7451aa-6b2f-4916-91a5-bf66ade8b42b req-248efc8d-68a1-49ad-a1ff-7504eb56c8b0 service nova] Acquiring lock "refresh_cache-f7f2b24d-1987-4a59-9a49-25e387be923d" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:55:56 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-de7451aa-6b2f-4916-91a5-bf66ade8b42b req-248efc8d-68a1-49ad-a1ff-7504eb56c8b0 service nova] Acquired lock "refresh_cache-f7f2b24d-1987-4a59-9a49-25e387be923d" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:55:56 user nova-compute[75341]: DEBUG nova.network.neutron [req-de7451aa-6b2f-4916-91a5-bf66ade8b42b req-248efc8d-68a1-49ad-a1ff-7504eb56c8b0 service nova] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] Refreshing network info cache for port 9a0f0fb5-7e45-46c9-a476-7b1380c9f42b {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:55:56 user nova-compute[75341]: DEBUG nova.network.neutron [req-de7451aa-6b2f-4916-91a5-bf66ade8b42b req-248efc8d-68a1-49ad-a1ff-7504eb56c8b0 service nova] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] Updated VIF entry in instance network info cache for port 9a0f0fb5-7e45-46c9-a476-7b1380c9f42b. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:55:56 user nova-compute[75341]: DEBUG nova.network.neutron [req-de7451aa-6b2f-4916-91a5-bf66ade8b42b req-248efc8d-68a1-49ad-a1ff-7504eb56c8b0 service nova] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] Updating instance_info_cache with network_info: [{"id": "9a0f0fb5-7e45-46c9-a476-7b1380c9f42b", "address": "fa:16:3e:5c:6d:40", "network": {"id": "227eb779-a064-477d-8447-45862017ae7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-3827253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96674073965642f1af11221b4add8a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a0f0fb5-7e", "ovs_interfaceid": "9a0f0fb5-7e45-46c9-a476-7b1380c9f42b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:55:56 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-de7451aa-6b2f-4916-91a5-bf66ade8b42b req-248efc8d-68a1-49ad-a1ff-7504eb56c8b0 service nova] Releasing lock "refresh_cache-f7f2b24d-1987-4a59-9a49-25e387be923d" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:55:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:55:57 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e8853a99-de0a-450f-97cf-eae1727baf9a tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Acquiring lock "f7f2b24d-1987-4a59-9a49-25e387be923d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:55:57 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e8853a99-de0a-450f-97cf-eae1727baf9a tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "f7f2b24d-1987-4a59-9a49-25e387be923d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:55:57 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e8853a99-de0a-450f-97cf-eae1727baf9a tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Acquiring lock "f7f2b24d-1987-4a59-9a49-25e387be923d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:55:57 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e8853a99-de0a-450f-97cf-eae1727baf9a tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "f7f2b24d-1987-4a59-9a49-25e387be923d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:55:57 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e8853a99-de0a-450f-97cf-eae1727baf9a tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "f7f2b24d-1987-4a59-9a49-25e387be923d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:55:57 user nova-compute[75341]: INFO nova.compute.manager [None req-e8853a99-de0a-450f-97cf-eae1727baf9a tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] Terminating instance
Nov 14 23:55:57 user nova-compute[75341]: DEBUG nova.compute.manager [None req-e8853a99-de0a-450f-97cf-eae1727baf9a tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] Start destroying the instance on the hypervisor. {{(pid=75341) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 23:55:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:55:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:55:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:55:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG nova.compute.manager [req-cbf782df-beb8-45bd-8217-91836e1c2f48 req-97bd29d1-8787-4706-ae9c-081bb9f1f814 service nova] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] Received event network-vif-unplugged-9a0f0fb5-7e45-46c9-a476-7b1380c9f42b {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-cbf782df-beb8-45bd-8217-91836e1c2f48 req-97bd29d1-8787-4706-ae9c-081bb9f1f814 service nova] Acquiring lock "f7f2b24d-1987-4a59-9a49-25e387be923d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-cbf782df-beb8-45bd-8217-91836e1c2f48 req-97bd29d1-8787-4706-ae9c-081bb9f1f814 service nova] Lock "f7f2b24d-1987-4a59-9a49-25e387be923d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-cbf782df-beb8-45bd-8217-91836e1c2f48 req-97bd29d1-8787-4706-ae9c-081bb9f1f814 service nova] Lock "f7f2b24d-1987-4a59-9a49-25e387be923d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG nova.compute.manager [req-cbf782df-beb8-45bd-8217-91836e1c2f48 req-97bd29d1-8787-4706-ae9c-081bb9f1f814 service nova] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] No waiting events found dispatching network-vif-unplugged-9a0f0fb5-7e45-46c9-a476-7b1380c9f42b {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG nova.compute.manager [req-cbf782df-beb8-45bd-8217-91836e1c2f48 req-97bd29d1-8787-4706-ae9c-081bb9f1f814 service nova] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] Received event network-vif-unplugged-9a0f0fb5-7e45-46c9-a476-7b1380c9f42b for instance with task_state deleting. {{(pid=75341) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG nova.compute.manager [req-cbf782df-beb8-45bd-8217-91836e1c2f48 req-97bd29d1-8787-4706-ae9c-081bb9f1f814 service nova] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] Received event network-vif-plugged-9a0f0fb5-7e45-46c9-a476-7b1380c9f42b {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-cbf782df-beb8-45bd-8217-91836e1c2f48 req-97bd29d1-8787-4706-ae9c-081bb9f1f814 service nova] Acquiring lock "f7f2b24d-1987-4a59-9a49-25e387be923d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-cbf782df-beb8-45bd-8217-91836e1c2f48 req-97bd29d1-8787-4706-ae9c-081bb9f1f814 service nova] Lock "f7f2b24d-1987-4a59-9a49-25e387be923d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-cbf782df-beb8-45bd-8217-91836e1c2f48 req-97bd29d1-8787-4706-ae9c-081bb9f1f814 service nova] Lock "f7f2b24d-1987-4a59-9a49-25e387be923d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG nova.compute.manager [req-cbf782df-beb8-45bd-8217-91836e1c2f48 req-97bd29d1-8787-4706-ae9c-081bb9f1f814 service nova] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] No waiting events found dispatching network-vif-plugged-9a0f0fb5-7e45-46c9-a476-7b1380c9f42b {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:55:58 user nova-compute[75341]: WARNING nova.compute.manager [req-cbf782df-beb8-45bd-8217-91836e1c2f48 req-97bd29d1-8787-4706-ae9c-081bb9f1f814 service nova] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] Received unexpected event network-vif-plugged-9a0f0fb5-7e45-46c9-a476-7b1380c9f42b for instance with vm_state active and task_state deleting.
Nov 14 23:55:58 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-dd6dbb7f-1a53-47fc-b1dd-1c1ddcda8e01 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 12c9a7d6-03a5-4fd2-9082-c68758f1542f is timed out.
Nov 14 23:55:58 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-dd6dbb7f-1a53-47fc-b1dd-1c1ddcda8e01 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Successfully detached device vdb from instance 12c9a7d6-03a5-4fd2-9082-c68758f1542f from the live domain config.
Nov 14 23:55:58 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd6dbb7f-1a53-47fc-b1dd-1c1ddcda8e01 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] calling os-brick to detach iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd6dbb7f-1a53-47fc-b1dd-1c1ddcda8e01 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, {'target_iqn': 'iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WYmGxpur', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:55:58 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-dd6dbb7f-1a53-47fc-b1dd-1c1ddcda8e01 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:55:58 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-dd6dbb7f-1a53-47fc-b1dd-1c1ddcda8e01 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-dd6dbb7f-1a53-47fc-b1dd-1c1ddcda8e01 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea28cbf0-b8f9-4b73-8bb2-89f82adf55c8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd6dbb7f-1a53-47fc-b1dd-1c1ddcda8e01 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 23:55:58 user nova-compute[75341]: No targets found.
Nov 14 23:55:58 user nova-compute[75341]: iSNS:
Nov 14 23:55:58 user nova-compute[75341]: No targets found.
Nov 14 23:55:58 user nova-compute[75341]: STATIC:
Nov 14 23:55:58 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36
Nov 14 23:55:58 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:55:58 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:55:58 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05
Nov 14 23:55:58 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:55:58 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:55:58 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00
Nov 14 23:55:58 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:55:58 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:55:58 user nova-compute[75341]: FIRMWARE:
Nov 14 23:55:58 user nova-compute[75341]: No targets found.
Nov 14 23:55:58 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd6dbb7f-1a53-47fc-b1dd-1c1ddcda8e01 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 23:55:58 user nova-compute[75341]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 23:55:58 user nova-compute[75341]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75341) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd6dbb7f-1a53-47fc-b1dd-1c1ddcda8e01 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05', 0)] {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9685360-5e65-4e71-9134-a877dbd4f03b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c191c7-37e6-43d3-9f8d-712245cfc201]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd6dbb7f-1a53-47fc-b1dd-1c1ddcda8e01 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)
Nov 14 23:55:58 user nova-compute[75341]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)
Nov 14 23:55:58 user nova-compute[75341]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)
Nov 14 23:55:58 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd6dbb7f-1a53-47fc-b1dd-1c1ddcda8e01 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 (non-flash)
Nov 14 23:55:58 user nova-compute[75341]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)
Nov 14 23:55:58 user nova-compute[75341]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)
Nov 14 23:55:58 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd6dbb7f-1a53-47fc-b1dd-1c1ddcda8e01 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1850707a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05'): ({'sdb'}, set())}) {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-dd6dbb7f-1a53-47fc-b1dd-1c1ddcda8e01 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Removing single pathed devices sdb {{(pid=75341) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58a18ec-89cc-4a82-b17e-b6489288c5f9]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[97cc7ed6-885f-4271-865b-e9cbfd3cb170]: (4, ('ok\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-dd6dbb7f-1a53-47fc-b1dd-1c1ddcda8e01 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Flushing IO for device /dev/sdb {{(pid=75341) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bca3baa-da98-441a-8798-218a8dc964f8]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-dd6dbb7f-1a53-47fc-b1dd-1c1ddcda8e01 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75341) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:58 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] Instance destroyed successfully.
Nov 14 23:55:58 user nova-compute[75341]: DEBUG nova.objects.instance [None req-e8853a99-de0a-450f-97cf-eae1727baf9a tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lazy-loading 'resources' on Instance uuid f7f2b24d-1987-4a59-9a49-25e387be923d {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-e8853a99-de0a-450f-97cf-eae1727baf9a tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:54:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-133786393',display_name='tempest-TestVolumeBootPattern-server-133786393',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-133786393',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN7m+PTR/lRAnqFJ5INzHZER+6KEezVf2NqND5YLAUMiY/B8DjdO2ameMcKY7PyF3FV92+jHAoJaiByyFu7+plRebNNPsSYlc8sL/IhL0WhnAYWxdc2ydVL4yfconkjd2A==',key_name='tempest-TestVolumeBootPattern-1320135145',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:54:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='96674073965642f1af11221b4add8a6d',ramdisk_id='',reservation_id='r-4zw5rshd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-320933673',owner_user_name='tempest-TestVolumeBootPattern-320933673-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:54:15Z,user_data=None,user_id='b08f7ddf6c2f4fd596e214d6ca56c234',uuid=f7f2b24d-1987-4a59-9a49-25e387be923d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a0f0fb5-7e45-46c9-a476-7b1380c9f42b", "address": "fa:16:3e:5c:6d:40", "network": {"id": "227eb779-a064-477d-8447-45862017ae7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-3827253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96674073965642f1af11221b4add8a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a0f0fb5-7e", "ovs_interfaceid": "9a0f0fb5-7e45-46c9-a476-7b1380c9f42b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-e8853a99-de0a-450f-97cf-eae1727baf9a tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Converting VIF {"id": "9a0f0fb5-7e45-46c9-a476-7b1380c9f42b", "address": "fa:16:3e:5c:6d:40", "network": {"id": "227eb779-a064-477d-8447-45862017ae7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-3827253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96674073965642f1af11221b4add8a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a0f0fb5-7e", "ovs_interfaceid": "9a0f0fb5-7e45-46c9-a476-7b1380c9f42b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-e8853a99-de0a-450f-97cf-eae1727baf9a tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:6d:40,bridge_name='br-int',has_traffic_filtering=True,id=9a0f0fb5-7e45-46c9-a476-7b1380c9f42b,network=Network(227eb779-a064-477d-8447-45862017ae7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a0f0fb5-7e') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG os_vif [None req-e8853a99-de0a-450f-97cf-eae1727baf9a tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:6d:40,bridge_name='br-int',has_traffic_filtering=True,id=9a0f0fb5-7e45-46c9-a476-7b1380c9f42b,network=Network(227eb779-a064-477d-8447-45862017ae7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a0f0fb5-7e') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9a0f0fb5-7e, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbdee1e-4d1f-43c8-b582-d7b4008efbdf]: (4, ('1', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-dd6dbb7f-1a53-47fc-b1dd-1c1ddcda8e01 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-dd6dbb7f-1a53-47fc-b1dd-1c1ddcda8e01 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] SCSI volumes sdb have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd6dbb7f-1a53-47fc-b1dd-1c1ddcda8e01 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05')] {{(pid=75341) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=09bc56de-627d-4b37-97c6-6467ecb36a0e) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[b261c48b-1a8e-4c5b-97c6-751870bef72e]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd6dbb7f-1a53-47fc-b1dd-1c1ddcda8e01 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 -p 172.16.0.220:3260 --logout {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:58 user nova-compute[75341]: INFO os_vif [None req-e8853a99-de0a-450f-97cf-eae1727baf9a tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:6d:40,bridge_name='br-int',has_traffic_filtering=True,id=9a0f0fb5-7e45-46c9-a476-7b1380c9f42b,network=Network(227eb779-a064-477d-8447-45862017ae7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a0f0fb5-7e')
Nov 14 23:55:58 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8853a99-de0a-450f-97cf-eae1727baf9a tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] calling os-brick to detach iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8853a99-de0a-450f-97cf-eae1727baf9a tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, {'target_iqn': 'iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qFHBPzGf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:55:58 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-e8853a99-de0a-450f-97cf-eae1727baf9a tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:55:58 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-e8853a99-de0a-450f-97cf-eae1727baf9a tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aad0f03-f02b-4028-b938-10a238111c73]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd6dbb7f-1a53-47fc-b1dd-1c1ddcda8e01 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05, portal: 172.16.0.220,3260]
Nov 14 23:55:58 user nova-compute[75341]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05, portal: 172.16.0.220,3260] successful.
Nov 14 23:55:58 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 -p 172.16.0.220:3260 --op delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9efe345e-fc79-46f6-973c-ed817a24dd05 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[002dd521-f063-4b00-b0e5-44971866b688]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd6dbb7f-1a53-47fc-b1dd-1c1ddcda8e01 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-dd6dbb7f-1a53-47fc-b1dd-1c1ddcda8e01 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd6dbb7f-1a53-47fc-b1dd-1c1ddcda8e01 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] <== disconnect_volume: return (314ms) None {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd6dbb7f-1a53-47fc-b1dd-1c1ddcda8e01 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Disconnected iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-e8853a99-de0a-450f-97cf-eae1727baf9a tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.092s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f99b71-f238-4dff-9962-577bb3d99acd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8853a99-de0a-450f-97cf-eae1727baf9a tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 23:55:58 user nova-compute[75341]: No targets found.
Nov 14 23:55:58 user nova-compute[75341]: iSNS:
Nov 14 23:55:58 user nova-compute[75341]: No targets found.
Nov 14 23:55:58 user nova-compute[75341]: STATIC:
Nov 14 23:55:58 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36
Nov 14 23:55:58 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:55:58 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:55:58 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00
Nov 14 23:55:58 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:55:58 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:55:58 user nova-compute[75341]: FIRMWARE:
Nov 14 23:55:58 user nova-compute[75341]: No targets found.
Nov 14 23:55:58 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8853a99-de0a-450f-97cf-eae1727baf9a tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 23:55:58 user nova-compute[75341]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 23:55:58 user nova-compute[75341]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75341) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8853a99-de0a-450f-97cf-eae1727baf9a tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36', 0)] {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9ad41b-3382-4a4d-8434-eecc30238ae2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8d701d-4b3b-4547-98f2-4a7a47a96a0c]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8853a99-de0a-450f-97cf-eae1727baf9a tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)
Nov 14 23:55:58 user nova-compute[75341]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)
Nov 14 23:55:58 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8853a99-de0a-450f-97cf-eae1727baf9a tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)
Nov 14 23:55:58 user nova-compute[75341]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)
Nov 14 23:55:58 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8853a99-de0a-450f-97cf-eae1727baf9a tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18507057e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36'): ({'sdd'}, set())}) {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-e8853a99-de0a-450f-97cf-eae1727baf9a tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Removing single pathed devices sdd {{(pid=75341) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[f887d9dc-138e-40e1-8e95-2f227ad3030c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68342c5-f54f-4f96-a607-d0ed8bbbcea6]: (4, ('ok\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-e8853a99-de0a-450f-97cf-eae1727baf9a tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Flushing IO for device /dev/sdd {{(pid=75341) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ccf668-9514-46a5-8461-14d37f04db78]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-e8853a99-de0a-450f-97cf-eae1727baf9a tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75341) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[50974316-fd43-40df-9900-ade5f67f1116]: (4, ('1', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-e8853a99-de0a-450f-97cf-eae1727baf9a tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-e8853a99-de0a-450f-97cf-eae1727baf9a tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] SCSI volumes sdd have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8853a99-de0a-450f-97cf-eae1727baf9a tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36')] {{(pid=75341) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e2759a4-0f64-43c5-8b2c-aaa4bc0c9418]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8853a99-de0a-450f-97cf-eae1727baf9a tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 -p 172.16.0.220:3260 --logout {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[1393a5f7-4e29-4401-bda6-9a2e3c173c8f]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8853a99-de0a-450f-97cf-eae1727baf9a tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36, portal: 172.16.0.220,3260]
Nov 14 23:55:58 user nova-compute[75341]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36, portal: 172.16.0.220,3260] successful.
Nov 14 23:55:58 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 -p 172.16.0.220:3260 --op delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[406223b5-d831-4bf1-affd-6d96b4c61ab7]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8853a99-de0a-450f-97cf-eae1727baf9a tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-e8853a99-de0a-450f-97cf-eae1727baf9a tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8853a99-de0a-450f-97cf-eae1727baf9a tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] <== disconnect_volume: return (381ms) None {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8853a99-de0a-450f-97cf-eae1727baf9a tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] Disconnected iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 23:55:58 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-e8853a99-de0a-450f-97cf-eae1727baf9a tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] Deleting instance files /opt/stack/data/nova/instances/f7f2b24d-1987-4a59-9a49-25e387be923d_del
Nov 14 23:55:58 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-e8853a99-de0a-450f-97cf-eae1727baf9a tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] Deletion of /opt/stack/data/nova/instances/f7f2b24d-1987-4a59-9a49-25e387be923d_del complete
Nov 14 23:55:58 user nova-compute[75341]: INFO nova.compute.manager [None req-e8853a99-de0a-450f-97cf-eae1727baf9a tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] Took 1.31 seconds to destroy the instance on the hypervisor.
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo.service.loopingcall [None req-e8853a99-de0a-450f-97cf-eae1727baf9a tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75341) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG nova.compute.manager [-] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] Deallocating network for instance {{(pid=75341) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] deallocate_for_instance() {{(pid=75341) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:55:58 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75341) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 23:55:59 user nova-compute[75341]: DEBUG nova.objects.instance [None req-dd6dbb7f-1a53-47fc-b1dd-1c1ddcda8e01 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lazy-loading 'flavor' on Instance uuid 12c9a7d6-03a5-4fd2-9082-c68758f1542f {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:55:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-dd6dbb7f-1a53-47fc-b1dd-1c1ddcda8e01 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "12c9a7d6-03a5-4fd2-9082-c68758f1542f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.721s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:55:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-91257e49-1111-4991-9aa7-c40475830c6b tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Acquiring lock "53d7a6fe-3914-459a-9494-c75549af7b9f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:55:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-91257e49-1111-4991-9aa7-c40475830c6b tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lock "53d7a6fe-3914-459a-9494-c75549af7b9f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:55:59 user nova-compute[75341]: DEBUG nova.objects.instance [None req-91257e49-1111-4991-9aa7-c40475830c6b tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lazy-loading 'flavor' on Instance uuid 53d7a6fe-3914-459a-9494-c75549af7b9f {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:55:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-91257e49-1111-4991-9aa7-c40475830c6b tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lock "53d7a6fe-3914-459a-9494-c75549af7b9f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:55:59 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:55:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-91257e49-1111-4991-9aa7-c40475830c6b tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Acquiring lock "53d7a6fe-3914-459a-9494-c75549af7b9f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:55:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-91257e49-1111-4991-9aa7-c40475830c6b tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lock "53d7a6fe-3914-459a-9494-c75549af7b9f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:55:59 user nova-compute[75341]: INFO nova.compute.manager [None req-91257e49-1111-4991-9aa7-c40475830c6b tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Attaching volume 4dbb919d-8262-462e-b0a8-448ce0689412 to /dev/vdb
Nov 14 23:55:59 user nova-compute[75341]: INFO nova.compute.manager [-] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] Took 0.68 seconds to deallocate network for instance.
Nov 14 23:55:59 user nova-compute[75341]: DEBUG nova.compute.manager [req-d14a803d-b98c-40ac-8c6e-16aa962a04e0 req-e6c10dc1-6207-4ea6-8860-8578104eab03 service nova] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] Received event network-vif-deleted-9a0f0fb5-7e45-46c9-a476-7b1380c9f42b {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:55:59 user nova-compute[75341]: INFO nova.compute.manager [req-d14a803d-b98c-40ac-8c6e-16aa962a04e0 req-e6c10dc1-6207-4ea6-8860-8578104eab03 service nova] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] Neutron deleted interface 9a0f0fb5-7e45-46c9-a476-7b1380c9f42b; detaching it from the instance and deleting it from the info cache
Nov 14 23:55:59 user nova-compute[75341]: DEBUG nova.network.neutron [req-d14a803d-b98c-40ac-8c6e-16aa962a04e0 req-e6c10dc1-6207-4ea6-8860-8578104eab03 service nova] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:55:59 user nova-compute[75341]: DEBUG nova.compute.manager [req-d14a803d-b98c-40ac-8c6e-16aa962a04e0 req-e6c10dc1-6207-4ea6-8860-8578104eab03 service nova] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] Detach interface failed, port_id=9a0f0fb5-7e45-46c9-a476-7b1380c9f42b, reason: Instance f7f2b24d-1987-4a59-9a49-25e387be923d could not be found. {{(pid=75341) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 23:55:59 user nova-compute[75341]: DEBUG os_brick.utils [None req-91257e49-1111-4991-9aa7-c40475830c6b tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:55:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:59 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[945c84c0-467f-49a5-b9fb-f62c0689ab1b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6d1cfca09c9\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:55:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:59 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d489775-da30-4bf3-9742-df1da1acba66]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:55:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:55:59 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a1c71e-87f7-4639-b1bb-b54946d6e2e0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:55:59 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98c0684-360d-490f-ab82-83ca65e2425d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:55:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-91257e49-1111-4991-9aa7-c40475830c6b tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Running cmd (subprocess): nvme version {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-91257e49-1111-4991-9aa7-c40475830c6b tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] 'nvme version' failed. Not Retrying. {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:55:59 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.nvmeof [None req-91257e49-1111-4991-9aa7-c40475830c6b tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] nvme not present on system {{(pid=75341) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 23:55:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:55:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:55:59 user nova-compute[75341]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 23:55:59 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b837236-57b2-4a28-8935-d1302edfb6d0]: (4, '') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:55:59 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-91257e49-1111-4991-9aa7-c40475830c6b tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75341) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 23:55:59 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-91257e49-1111-4991-9aa7-c40475830c6b tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 23:55:59 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-91257e49-1111-4991-9aa7-c40475830c6b tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] LIGHTOS: no hostnqn found. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 23:55:59 user nova-compute[75341]: DEBUG os_brick.utils [None req-91257e49-1111-4991-9aa7-c40475830c6b tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6d1cfca09c9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:55:59 user nova-compute[75341]: DEBUG nova.virt.block_device [None req-91257e49-1111-4991-9aa7-c40475830c6b tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Updating existing volume attachment record: bcfb2e09-656c-42a6-88f9-b564ae5ac4a8 {{(pid=75341) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 23:56:00 user nova-compute[75341]: INFO nova.compute.manager [None req-e8853a99-de0a-450f-97cf-eae1727baf9a tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: f7f2b24d-1987-4a59-9a49-25e387be923d] Took 0.74 seconds to detach 1 volumes for instance.
Nov 14 23:56:00 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e8853a99-de0a-450f-97cf-eae1727baf9a tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:56:00 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e8853a99-de0a-450f-97cf-eae1727baf9a tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:56:00 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-e8853a99-de0a-450f-97cf-eae1727baf9a tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:56:00 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-e8853a99-de0a-450f-97cf-eae1727baf9a tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:56:00 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e8853a99-de0a-450f-97cf-eae1727baf9a tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.277s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:56:00 user nova-compute[75341]: INFO nova.scheduler.client.report [None req-e8853a99-de0a-450f-97cf-eae1727baf9a tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Deleted allocations for instance f7f2b24d-1987-4a59-9a49-25e387be923d
Nov 14 23:56:00 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e8853a99-de0a-450f-97cf-eae1727baf9a tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "f7f2b24d-1987-4a59-9a49-25e387be923d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.209s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:56:00 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:56:00 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:56:00 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Starting heal instance info cache {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 23:56:01 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "refresh_cache-12c9a7d6-03a5-4fd2-9082-c68758f1542f" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:56:01 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquired lock "refresh_cache-12c9a7d6-03a5-4fd2-9082-c68758f1542f" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:56:01 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Forcefully refreshing network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 23:56:01 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Updating instance_info_cache with network_info: [{"id": "1def089a-31ed-4ac4-be68-4050fa9c9fe6", "address": "fa:16:3e:3c:51:b6", "network": {"id": "d86a8e7f-6658-4994-9a13-eb3163bd3865", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-635863702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c69a942b4f4b97a1a3152dea86c7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1def089a-31", "ovs_interfaceid": "1def089a-31ed-4ac4-be68-4050fa9c9fe6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:56:01 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Releasing lock "refresh_cache-12c9a7d6-03a5-4fd2-9082-c68758f1542f" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:56:01 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Updated the network info_cache for instance {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 23:56:01 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:56:01 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:56:01 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:56:01 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:56:01 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75341) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 23:56:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:56:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:56:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:56:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:56:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c62455e6-61af-45b1-899f-bad37dc57b22/disk.rescue --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:56:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:56:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c62455e6-61af-45b1-899f-bad37dc57b22/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:56:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c62455e6-61af-45b1-899f-bad37dc57b22/disk.rescue --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:56:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c62455e6-61af-45b1-899f-bad37dc57b22/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:56:02 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /opt/stack/data/nova/instances/c62455e6-61af-45b1-899f-bad37dc57b22/disk (vdb) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 23:56:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk.rescue --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:56:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:56:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk.rescue --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:56:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:56:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:56:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:56:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:56:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:56:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c9a7d6-03a5-4fd2-9082-c68758f1542f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:56:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c9a7d6-03a5-4fd2-9082-c68758f1542f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:56:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c9a7d6-03a5-4fd2-9082-c68758f1542f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:56:03 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:56:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c9a7d6-03a5-4fd2-9082-c68758f1542f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:56:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:56:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:56:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:56:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:56:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53d7a6fe-3914-459a-9494-c75549af7b9f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:56:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53d7a6fe-3914-459a-9494-c75549af7b9f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:56:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53d7a6fe-3914-459a-9494-c75549af7b9f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:56:04 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91257e49-1111-4991-9aa7-c40475830c6b tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Calling os-brick to attach iSCSI Volume {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 23:56:04 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-91257e49-1111-4991-9aa7-c40475830c6b tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4dbb919d-8262-462e-b0a8-448ce0689412', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pObYfuoy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:56:04 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-91257e49-1111-4991-9aa7-c40475830c6b tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:56:04 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-91257e49-1111-4991-9aa7-c40475830c6b tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:56:04 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-91257e49-1111-4991-9aa7-c40475830c6b tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:56:04 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-91257e49-1111-4991-9aa7-c40475830c6b tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:56:04 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-91257e49-1111-4991-9aa7-c40475830c6b tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4dbb919d-8262-462e-b0a8-448ce0689412" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:56:04 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-91257e49-1111-4991-9aa7-c40475830c6b tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4dbb919d-8262-462e-b0a8-448ce0689412" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:56:04 user nova-compute[75341]: INFO os_brick.initiator.connectors.iscsi [None req-91257e49-1111-4991-9aa7-c40475830c6b tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 23:56:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dbb919d-8262-462e-b0a8-448ce0689412 -p 172.16.0.220:3260 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:56:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dbb919d-8262-462e-b0a8-448ce0689412 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:56:04 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[63408018-9458-41e4-8cea-e5273775c54d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:56:04 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-91257e49-1111-4991-9aa7-c40475830c6b tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 23:56:04 user nova-compute[75341]:  {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:56:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dbb919d-8262-462e-b0a8-448ce0689412 -p 172.16.0.220:3260 --interface default --op new {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:56:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dbb919d-8262-462e-b0a8-448ce0689412 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:56:04 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[d460b4da-d67b-4f23-a403-a35de4ef1aa5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4dbb919d-8262-462e-b0a8-448ce0689412] added\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:56:04 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-91257e49-1111-4991-9aa7-c40475830c6b tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4dbb919d-8262-462e-b0a8-448ce0689412] added
Nov 14 23:56:04 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:56:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dbb919d-8262-462e-b0a8-448ce0689412 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:56:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dbb919d-8262-462e-b0a8-448ce0689412 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:56:04 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[23700764-e692-4ae8-b938-96fe33cd83db]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:56:04 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-91257e49-1111-4991-9aa7-c40475830c6b tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:56:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dbb919d-8262-462e-b0a8-448ce0689412 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:56:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dbb919d-8262-462e-b0a8-448ce0689412 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:56:04 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ba07d8-5315-4485-963a-25c49aa2d2cf]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:56:04 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-91257e49-1111-4991-9aa7-c40475830c6b tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:56:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dbb919d-8262-462e-b0a8-448ce0689412 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pObYfuoy {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:56:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dbb919d-8262-462e-b0a8-448ce0689412 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pObYfuoy" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:56:04 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[6715f115-0750-4ac5-82e9-8c1f05566963]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:56:04 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-91257e49-1111-4991-9aa7-c40475830c6b tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pObYfuoy'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:56:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dbb919d-8262-462e-b0a8-448ce0689412 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:56:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53d7a6fe-3914-459a-9494-c75549af7b9f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:56:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dbb919d-8262-462e-b0a8-448ce0689412 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:56:04 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae9abc1-4c1b-46e7-b183-731fd157260f]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:56:04 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-91257e49-1111-4991-9aa7-c40475830c6b tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:56:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:56:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:56:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:56:04 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[76cbd221-06f4-461f-b733-8b1d94021f3b]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:56:04 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-91257e49-1111-4991-9aa7-c40475830c6b tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)
Nov 14 23:56:04 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:56:04 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-91257e49-1111-4991-9aa7-c40475830c6b tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)
Nov 14 23:56:04 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:56:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dbb919d-8262-462e-b0a8-448ce0689412 -p 172.16.0.220:3260 --login {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:56:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dbb919d-8262-462e-b0a8-448ce0689412 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:56:04 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b4f82c-9ec5-44c4-8232-cb720d81aa52]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4dbb919d-8262-462e-b0a8-448ce0689412, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4dbb919d-8262-462e-b0a8-448ce0689412, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:56:04 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-91257e49-1111-4991-9aa7-c40475830c6b tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4dbb919d-8262-462e-b0a8-448ce0689412, portal: 172.16.0.220,3260]
Nov 14 23:56:04 user nova-compute[75341]: Login to [iface: default, target: iqn.2010-10.org.openstack:4dbb919d-8262-462e-b0a8-448ce0689412, portal: 172.16.0.220,3260] successful.
Nov 14 23:56:04 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:56:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dbb919d-8262-462e-b0a8-448ce0689412 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:56:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dbb919d-8262-462e-b0a8-448ce0689412 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:56:04 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a7dd8ef-a2d3-4243-96ca-3fa6c94aec6e]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:56:04 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-91257e49-1111-4991-9aa7-c40475830c6b tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:56:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:56:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:56:04 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[262e5d53-afe0-466c-bae7-67e18cc00e29]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dbb919d-8262-462e-b0a8-448ce0689412 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:56:04 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-91257e49-1111-4991-9aa7-c40475830c6b tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)
Nov 14 23:56:04 user nova-compute[75341]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dbb919d-8262-462e-b0a8-448ce0689412 (non-flash)
Nov 14 23:56:04 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:56:04 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-91257e49-1111-4991-9aa7-c40475830c6b tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)
Nov 14 23:56:04 user nova-compute[75341]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dbb919d-8262-462e-b0a8-448ce0689412 (non-flash)
Nov 14 23:56:04 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:56:04 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-91257e49-1111-4991-9aa7-c40475830c6b tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4dbb919d-8262-462e-b0a8-448ce0689412" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:56:04 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-91257e49-1111-4991-9aa7-c40475830c6b tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Connected to 172.16.0.220:3260 {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 23:56:04 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-91257e49-1111-4991-9aa7-c40475830c6b tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=75341) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 23:56:04 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-91257e49-1111-4991-9aa7-c40475830c6b tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75341) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 23:56:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:56:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:56:04 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1aac69-f42d-41a7-b651-1c75b7c5c000]: (4, ('- - 0', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:56:04 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-91257e49-1111-4991-9aa7-c40475830c6b tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 23:56:04 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-91257e49-1111-4991-9aa7-c40475830c6b tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4dbb919d-8262-462e-b0a8-448ce0689412', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pObYfuoy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 23:56:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:56:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:56:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:56:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:56:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:56:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:56:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:56:05 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:56:05 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:56:05 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Hypervisor/Node resource view: name=user free_ram=8075MB free_disk=25.345211029052734GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75341) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 23:56:05 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:56:05 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:56:05 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-91257e49-1111-4991-9aa7-c40475830c6b tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:56:05 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-91257e49-1111-4991-9aa7-c40475830c6b tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '26264323536343137', 'path': '/dev/sdb'} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:56:05 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91257e49-1111-4991-9aa7-c40475830c6b tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26264323536343137', 'path': '/dev/sdb'} {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 23:56:05 user nova-compute[75341]: DEBUG nova.objects.instance [None req-91257e49-1111-4991-9aa7-c40475830c6b tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lazy-loading 'flavor' on Instance uuid 53d7a6fe-3914-459a-9494-c75549af7b9f {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:56:05 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-91257e49-1111-4991-9aa7-c40475830c6b tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 23:56:05 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:56:05 user nova-compute[75341]:   <source dev="/dev/sdb"/>
Nov 14 23:56:05 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:56:05 user nova-compute[75341]:   <serial>4dbb919d-8262-462e-b0a8-448ce0689412</serial>
Nov 14 23:56:05 user nova-compute[75341]: </disk>
Nov 14 23:56:05 user nova-compute[75341]:  {{(pid=75341) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 23:56:05 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 51045050-c7c6-49c5-acd4-2a76be0f466f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:56:05 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 6382e432-838f-4d89-a743-cbaa37f50ab5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:56:05 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance defae731-4191-4526-99cc-a301cf5b3355 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:56:05 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 2316aa9e-d4c9-43d0-9918-86265583aed1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:56:05 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 12c9a7d6-03a5-4fd2-9082-c68758f1542f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:56:05 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 53d7a6fe-3914-459a-9494-c75549af7b9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:56:05 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance c62455e6-61af-45b1-899f-bad37dc57b22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:56:05 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:56:05 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 23:56:05 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 23:56:05 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Refreshing inventories for resource provider 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 23:56:05 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Updating ProviderTree inventory for provider 8fa114cc-b541-418f-865c-16c44294e72d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 23:56:05 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Updating inventory in ProviderTree for provider 8fa114cc-b541-418f-865c-16c44294e72d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 23:56:05 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Refreshing aggregate associations for resource provider 8fa114cc-b541-418f-865c-16c44294e72d, aggregates: None {{(pid=75341) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 23:56:05 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Refreshing trait associations for resource provider 8fa114cc-b541-418f-865c-16c44294e72d, traits: COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_MMX,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000E {{(pid=75341) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 23:56:05 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-91257e49-1111-4991-9aa7-c40475830c6b tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:56:05 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-91257e49-1111-4991-9aa7-c40475830c6b tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:56:05 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-91257e49-1111-4991-9aa7-c40475830c6b tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] No VIF found with MAC fa:16:3e:14:63:0c, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:56:05 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:56:05 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:56:05 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-91257e49-1111-4991-9aa7-c40475830c6b tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lock "53d7a6fe-3914-459a-9494-c75549af7b9f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.361s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:56:05 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Compute_service record updated for user:user {{(pid=75341) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 23:56:05 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.646s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:56:05 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:56:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:56:07 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:56:07 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:56:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-7551eb70-0b84-4b26-854c-6f487515b618 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Acquiring lock "53d7a6fe-3914-459a-9494-c75549af7b9f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:56:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-7551eb70-0b84-4b26-854c-6f487515b618 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lock "53d7a6fe-3914-459a-9494-c75549af7b9f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:56:07 user nova-compute[75341]: INFO nova.compute.manager [None req-7551eb70-0b84-4b26-854c-6f487515b618 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Detaching volume 4dbb919d-8262-462e-b0a8-448ce0689412
Nov 14 23:56:07 user nova-compute[75341]: INFO nova.virt.block_device [None req-7551eb70-0b84-4b26-854c-6f487515b618 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Attempting to driver detach volume 4dbb919d-8262-462e-b0a8-448ce0689412 from mountpoint /dev/vdb
Nov 14 23:56:07 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-7551eb70-0b84-4b26-854c-6f487515b618 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Attempting to detach device vdb from instance 53d7a6fe-3914-459a-9494-c75549af7b9f from the persistent domain config. {{(pid=75341) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 23:56:07 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-7551eb70-0b84-4b26-854c-6f487515b618 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 23:56:07 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:56:07 user nova-compute[75341]:   <source dev="/dev/sdb"/>
Nov 14 23:56:07 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:56:07 user nova-compute[75341]:   <serial>4dbb919d-8262-462e-b0a8-448ce0689412</serial>
Nov 14 23:56:07 user nova-compute[75341]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 23:56:07 user nova-compute[75341]: </disk>
Nov 14 23:56:07 user nova-compute[75341]:  {{(pid=75341) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 23:56:07 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-7551eb70-0b84-4b26-854c-6f487515b618 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Successfully detached device vdb from instance 53d7a6fe-3914-459a-9494-c75549af7b9f from the persistent domain config.
Nov 14 23:56:07 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-7551eb70-0b84-4b26-854c-6f487515b618 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 53d7a6fe-3914-459a-9494-c75549af7b9f from the live domain config. {{(pid=75341) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 23:56:07 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-7551eb70-0b84-4b26-854c-6f487515b618 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 23:56:07 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:56:07 user nova-compute[75341]:   <source dev="/dev/sdb"/>
Nov 14 23:56:07 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:56:07 user nova-compute[75341]:   <serial>4dbb919d-8262-462e-b0a8-448ce0689412</serial>
Nov 14 23:56:07 user nova-compute[75341]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 23:56:07 user nova-compute[75341]: </disk>
Nov 14 23:56:07 user nova-compute[75341]:  {{(pid=75341) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 23:56:08 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-7551eb70-0b84-4b26-854c-6f487515b618 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 53d7a6fe-3914-459a-9494-c75549af7b9f {{(pid=75341) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 23:56:08 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:56:08 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:56:08 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75341) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 23:56:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:56:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:56:17 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:56:18 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Triggering sync for uuid 51045050-c7c6-49c5-acd4-2a76be0f466f {{(pid=75341) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 23:56:18 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Triggering sync for uuid 6382e432-838f-4d89-a743-cbaa37f50ab5 {{(pid=75341) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 23:56:18 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Triggering sync for uuid defae731-4191-4526-99cc-a301cf5b3355 {{(pid=75341) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 23:56:18 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Triggering sync for uuid 2316aa9e-d4c9-43d0-9918-86265583aed1 {{(pid=75341) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 23:56:18 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Triggering sync for uuid 53d7a6fe-3914-459a-9494-c75549af7b9f {{(pid=75341) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 23:56:18 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Triggering sync for uuid c62455e6-61af-45b1-899f-bad37dc57b22 {{(pid=75341) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 23:56:18 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Triggering sync for uuid cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e {{(pid=75341) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 23:56:18 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Triggering sync for uuid 12c9a7d6-03a5-4fd2-9082-c68758f1542f {{(pid=75341) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 23:56:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "51045050-c7c6-49c5-acd4-2a76be0f466f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:56:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "51045050-c7c6-49c5-acd4-2a76be0f466f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:56:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "6382e432-838f-4d89-a743-cbaa37f50ab5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:56:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "6382e432-838f-4d89-a743-cbaa37f50ab5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:56:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "defae731-4191-4526-99cc-a301cf5b3355" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:56:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "defae731-4191-4526-99cc-a301cf5b3355" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:56:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "2316aa9e-d4c9-43d0-9918-86265583aed1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:56:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "2316aa9e-d4c9-43d0-9918-86265583aed1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:56:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "53d7a6fe-3914-459a-9494-c75549af7b9f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:56:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "c62455e6-61af-45b1-899f-bad37dc57b22" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:56:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "c62455e6-61af-45b1-899f-bad37dc57b22" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:56:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:56:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:56:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "12c9a7d6-03a5-4fd2-9082-c68758f1542f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:56:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "12c9a7d6-03a5-4fd2-9082-c68758f1542f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:56:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "51045050-c7c6-49c5-acd4-2a76be0f466f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:56:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "6382e432-838f-4d89-a743-cbaa37f50ab5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:56:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "defae731-4191-4526-99cc-a301cf5b3355" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:56:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "c62455e6-61af-45b1-899f-bad37dc57b22" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:56:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.048s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:56:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "2316aa9e-d4c9-43d0-9918-86265583aed1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:56:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "12c9a7d6-03a5-4fd2-9082-c68758f1542f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:56:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:56:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:56:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 23:56:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 23:56:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 23:56:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:56:23 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:56:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-430935a2-1377-42be-a87d-f1025b49e740 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Acquiring lock "12c9a7d6-03a5-4fd2-9082-c68758f1542f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:56:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-430935a2-1377-42be-a87d-f1025b49e740 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "12c9a7d6-03a5-4fd2-9082-c68758f1542f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:56:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-430935a2-1377-42be-a87d-f1025b49e740 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Acquiring lock "12c9a7d6-03a5-4fd2-9082-c68758f1542f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:56:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-430935a2-1377-42be-a87d-f1025b49e740 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "12c9a7d6-03a5-4fd2-9082-c68758f1542f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:56:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-430935a2-1377-42be-a87d-f1025b49e740 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "12c9a7d6-03a5-4fd2-9082-c68758f1542f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:56:27 user nova-compute[75341]: INFO nova.compute.manager [None req-430935a2-1377-42be-a87d-f1025b49e740 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Terminating instance
Nov 14 23:56:27 user nova-compute[75341]: DEBUG nova.compute.manager [None req-430935a2-1377-42be-a87d-f1025b49e740 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Start destroying the instance on the hypervisor. {{(pid=75341) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:56:28 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-7551eb70-0b84-4b26-854c-6f487515b618 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 53d7a6fe-3914-459a-9494-c75549af7b9f is timed out.
Nov 14 23:56:28 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-7551eb70-0b84-4b26-854c-6f487515b618 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Successfully detached device vdb from instance 53d7a6fe-3914-459a-9494-c75549af7b9f from the live domain config.
Nov 14 23:56:28 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7551eb70-0b84-4b26-854c-6f487515b618 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] calling os-brick to detach iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-7551eb70-0b84-4b26-854c-6f487515b618 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, {'target_iqn': 'iqn.2010-10.org.openstack:4dbb919d-8262-462e-b0a8-448ce0689412', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pObYfuoy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:56:28 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-7551eb70-0b84-4b26-854c-6f487515b618 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:56:28 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-7551eb70-0b84-4b26-854c-6f487515b618 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-7551eb70-0b84-4b26-854c-6f487515b618 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b106a3d-f749-4702-925d-4330f7e1a04b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4dbb919d-8262-462e-b0a8-448ce0689412\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-7551eb70-0b84-4b26-854c-6f487515b618 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 23:56:28 user nova-compute[75341]: No targets found.
Nov 14 23:56:28 user nova-compute[75341]: iSNS:
Nov 14 23:56:28 user nova-compute[75341]: No targets found.
Nov 14 23:56:28 user nova-compute[75341]: STATIC:
Nov 14 23:56:28 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:4dbb919d-8262-462e-b0a8-448ce0689412
Nov 14 23:56:28 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:56:28 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:56:28 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00
Nov 14 23:56:28 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:56:28 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:56:28 user nova-compute[75341]: FIRMWARE:
Nov 14 23:56:28 user nova-compute[75341]: No targets found.
Nov 14 23:56:28 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-7551eb70-0b84-4b26-854c-6f487515b618 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 23:56:28 user nova-compute[75341]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 23:56:28 user nova-compute[75341]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75341) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-7551eb70-0b84-4b26-854c-6f487515b618 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4dbb919d-8262-462e-b0a8-448ce0689412', 0)] {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bae50f7-46bc-4c39-b713-63bb938cb58a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4dbb919d-8262-462e-b0a8-448ce0689412\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[333a55c3-62c8-4d08-852b-b55f87cfd9c7]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dbb919d-8262-462e-b0a8-448ce0689412 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-7551eb70-0b84-4b26-854c-6f487515b618 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)
Nov 14 23:56:28 user nova-compute[75341]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dbb919d-8262-462e-b0a8-448ce0689412 (non-flash)
Nov 14 23:56:28 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-7551eb70-0b84-4b26-854c-6f487515b618 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)
Nov 14 23:56:28 user nova-compute[75341]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dbb919d-8262-462e-b0a8-448ce0689412 (non-flash)
Nov 14 23:56:28 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-7551eb70-0b84-4b26-854c-6f487515b618 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f185072d480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4dbb919d-8262-462e-b0a8-448ce0689412'): ({'sdb'}, set())}) {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-7551eb70-0b84-4b26-854c-6f487515b618 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Removing single pathed devices sdb {{(pid=75341) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[f180c13b-1435-4df0-8b9d-d61cd70c2d17]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df5260f-a2ea-423b-8d64-e083fa40c8ca]: (4, ('ok\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-7551eb70-0b84-4b26-854c-6f487515b618 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Flushing IO for device /dev/sdb {{(pid=75341) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[472ea237-596d-438d-aad9-f71c15db148e]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-7551eb70-0b84-4b26-854c-6f487515b618 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75341) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG nova.compute.manager [req-06224fce-0e51-4e43-8bce-967e68e7cb45 req-ff6766cc-fdf0-4bab-bcc1-4b64f3798961 service nova] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Received event network-vif-unplugged-1def089a-31ed-4ac4-be68-4050fa9c9fe6 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-06224fce-0e51-4e43-8bce-967e68e7cb45 req-ff6766cc-fdf0-4bab-bcc1-4b64f3798961 service nova] Acquiring lock "12c9a7d6-03a5-4fd2-9082-c68758f1542f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-06224fce-0e51-4e43-8bce-967e68e7cb45 req-ff6766cc-fdf0-4bab-bcc1-4b64f3798961 service nova] Lock "12c9a7d6-03a5-4fd2-9082-c68758f1542f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-06224fce-0e51-4e43-8bce-967e68e7cb45 req-ff6766cc-fdf0-4bab-bcc1-4b64f3798961 service nova] Lock "12c9a7d6-03a5-4fd2-9082-c68758f1542f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG nova.compute.manager [req-06224fce-0e51-4e43-8bce-967e68e7cb45 req-ff6766cc-fdf0-4bab-bcc1-4b64f3798961 service nova] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] No waiting events found dispatching network-vif-unplugged-1def089a-31ed-4ac4-be68-4050fa9c9fe6 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG nova.compute.manager [req-06224fce-0e51-4e43-8bce-967e68e7cb45 req-ff6766cc-fdf0-4bab-bcc1-4b64f3798961 service nova] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Received event network-vif-unplugged-1def089a-31ed-4ac4-be68-4050fa9c9fe6 for instance with task_state deleting. {{(pid=75341) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eef338a-0cf9-4b01-b0ba-6ae7a4e17b1e]: (4, ('1', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-7551eb70-0b84-4b26-854c-6f487515b618 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-7551eb70-0b84-4b26-854c-6f487515b618 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] SCSI volumes sdb have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-7551eb70-0b84-4b26-854c-6f487515b618 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4dbb919d-8262-462e-b0a8-448ce0689412')] {{(pid=75341) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dbb919d-8262-462e-b0a8-448ce0689412 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dbb919d-8262-462e-b0a8-448ce0689412 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67f5d0d-8e71-4c5c-ac2f-4f18b907922f]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-7551eb70-0b84-4b26-854c-6f487515b618 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dbb919d-8262-462e-b0a8-448ce0689412 -p 172.16.0.220:3260 --logout {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dbb919d-8262-462e-b0a8-448ce0689412 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f78e51a-bd30-4278-9f48-a647447ff39c]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:4dbb919d-8262-462e-b0a8-448ce0689412, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:4dbb919d-8262-462e-b0a8-448ce0689412, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-7551eb70-0b84-4b26-854c-6f487515b618 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:4dbb919d-8262-462e-b0a8-448ce0689412, portal: 172.16.0.220,3260]
Nov 14 23:56:28 user nova-compute[75341]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:4dbb919d-8262-462e-b0a8-448ce0689412, portal: 172.16.0.220,3260] successful.
Nov 14 23:56:28 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dbb919d-8262-462e-b0a8-448ce0689412 -p 172.16.0.220:3260 --op delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dbb919d-8262-462e-b0a8-448ce0689412 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a7b509a-a735-47c9-a585-e2eeea2cff8a]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-7551eb70-0b84-4b26-854c-6f487515b618 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-7551eb70-0b84-4b26-854c-6f487515b618 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-7551eb70-0b84-4b26-854c-6f487515b618 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] <== disconnect_volume: return (313ms) None {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7551eb70-0b84-4b26-854c-6f487515b618 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Disconnected iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 23:56:28 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Instance destroyed successfully.
Nov 14 23:56:28 user nova-compute[75341]: DEBUG nova.objects.instance [None req-430935a2-1377-42be-a87d-f1025b49e740 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lazy-loading 'resources' on Instance uuid 12c9a7d6-03a5-4fd2-9082-c68758f1542f {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-430935a2-1377-42be-a87d-f1025b49e740 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T23:50:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-354068924',display_name='tempest-ServerActionsTestOtherA-server-270852724',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-354068924',id=34,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5He922s8rk+PmMGVsYQr5cOK2M7RyE6pRHPukFN7KTwHIYhqpey5pP25XxRxS64/nnTZtZU0s7MKkpDVnG7pj8Bq4MwPLqGCEvlosZZWTgxDQbmYxiYN/iVtJlhcHp1A==',key_name='tempest-keypair-1680109364',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:52:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f4c69a942b4f4b97a1a3152dea86c7fb',ramdisk_id='',reservation_id='r-hde50h2m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1796396043',owner_user_name='tempest-ServerActionsTestOtherA-1796396043-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:53:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='442aae0161f347d0a79b168a1b60286a',uuid=12c9a7d6-03a5-4fd2-9082-c68758f1542f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1def089a-31ed-4ac4-be68-4050fa9c9fe6", "address": "fa:16:3e:3c:51:b6", "network": {"id": "d86a8e7f-6658-4994-9a13-eb3163bd3865", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-635863702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c69a942b4f4b97a1a3152dea86c7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1def089a-31", "ovs_interfaceid": "1def089a-31ed-4ac4-be68-4050fa9c9fe6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-430935a2-1377-42be-a87d-f1025b49e740 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Converting VIF {"id": "1def089a-31ed-4ac4-be68-4050fa9c9fe6", "address": "fa:16:3e:3c:51:b6", "network": {"id": "d86a8e7f-6658-4994-9a13-eb3163bd3865", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-635863702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c69a942b4f4b97a1a3152dea86c7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1def089a-31", "ovs_interfaceid": "1def089a-31ed-4ac4-be68-4050fa9c9fe6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-430935a2-1377-42be-a87d-f1025b49e740 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3c:51:b6,bridge_name='br-int',has_traffic_filtering=True,id=1def089a-31ed-4ac4-be68-4050fa9c9fe6,network=Network(d86a8e7f-6658-4994-9a13-eb3163bd3865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1def089a-31') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG os_vif [None req-430935a2-1377-42be-a87d-f1025b49e740 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:51:b6,bridge_name='br-int',has_traffic_filtering=True,id=1def089a-31ed-4ac4-be68-4050fa9c9fe6,network=Network(d86a8e7f-6658-4994-9a13-eb3163bd3865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1def089a-31') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1def089a-31, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7065acaa-c7e0-471c-8712-c5269ca15a6a) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:56:28 user nova-compute[75341]: INFO os_vif [None req-430935a2-1377-42be-a87d-f1025b49e740 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:51:b6,bridge_name='br-int',has_traffic_filtering=True,id=1def089a-31ed-4ac4-be68-4050fa9c9fe6,network=Network(d86a8e7f-6658-4994-9a13-eb3163bd3865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1def089a-31')
Nov 14 23:56:28 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-430935a2-1377-42be-a87d-f1025b49e740 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Deleting instance files /opt/stack/data/nova/instances/12c9a7d6-03a5-4fd2-9082-c68758f1542f_del
Nov 14 23:56:28 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-430935a2-1377-42be-a87d-f1025b49e740 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Deletion of /opt/stack/data/nova/instances/12c9a7d6-03a5-4fd2-9082-c68758f1542f_del complete
Nov 14 23:56:28 user nova-compute[75341]: INFO nova.compute.manager [None req-430935a2-1377-42be-a87d-f1025b49e740 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 14 23:56:28 user nova-compute[75341]: DEBUG oslo.service.loopingcall [None req-430935a2-1377-42be-a87d-f1025b49e740 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75341) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG nova.compute.manager [-] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Deallocating network for instance {{(pid=75341) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 23:56:28 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] deallocate_for_instance() {{(pid=75341) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 23:56:29 user nova-compute[75341]: DEBUG nova.objects.instance [None req-7551eb70-0b84-4b26-854c-6f487515b618 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lazy-loading 'flavor' on Instance uuid 53d7a6fe-3914-459a-9494-c75549af7b9f {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:56:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-7551eb70-0b84-4b26-854c-6f487515b618 tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lock "53d7a6fe-3914-459a-9494-c75549af7b9f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.630s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:56:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "53d7a6fe-3914-459a-9494-c75549af7b9f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 11.136s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:56:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "53d7a6fe-3914-459a-9494-c75549af7b9f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:56:29 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:56:29 user nova-compute[75341]: INFO nova.compute.manager [-] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Took 0.84 seconds to deallocate network for instance.
Nov 14 23:56:29 user nova-compute[75341]: DEBUG nova.compute.manager [req-7917d519-9c87-40f3-9fd6-0a08570086e5 req-7c05c6ec-2029-4387-af88-8a4c17073eef service nova] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Received event network-vif-deleted-1def089a-31ed-4ac4-be68-4050fa9c9fe6 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:56:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-430935a2-1377-42be-a87d-f1025b49e740 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:56:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-430935a2-1377-42be-a87d-f1025b49e740 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:56:29 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-430935a2-1377-42be-a87d-f1025b49e740 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:56:29 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-430935a2-1377-42be-a87d-f1025b49e740 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:56:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-430935a2-1377-42be-a87d-f1025b49e740 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.261s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:56:29 user nova-compute[75341]: INFO nova.scheduler.client.report [None req-430935a2-1377-42be-a87d-f1025b49e740 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Deleted allocations for instance 12c9a7d6-03a5-4fd2-9082-c68758f1542f
Nov 14 23:56:30 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-430935a2-1377-42be-a87d-f1025b49e740 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "12c9a7d6-03a5-4fd2-9082-c68758f1542f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.151s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:56:30 user nova-compute[75341]: DEBUG nova.compute.manager [req-f4e95125-9aed-4b7c-a6e8-3d40046fef39 req-10dc3f57-b693-49eb-8c74-29612cc191c2 service nova] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Received event network-vif-plugged-1def089a-31ed-4ac4-be68-4050fa9c9fe6 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:56:30 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-f4e95125-9aed-4b7c-a6e8-3d40046fef39 req-10dc3f57-b693-49eb-8c74-29612cc191c2 service nova] Acquiring lock "12c9a7d6-03a5-4fd2-9082-c68758f1542f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:56:30 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-f4e95125-9aed-4b7c-a6e8-3d40046fef39 req-10dc3f57-b693-49eb-8c74-29612cc191c2 service nova] Lock "12c9a7d6-03a5-4fd2-9082-c68758f1542f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:56:30 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-f4e95125-9aed-4b7c-a6e8-3d40046fef39 req-10dc3f57-b693-49eb-8c74-29612cc191c2 service nova] Lock "12c9a7d6-03a5-4fd2-9082-c68758f1542f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:56:30 user nova-compute[75341]: DEBUG nova.compute.manager [req-f4e95125-9aed-4b7c-a6e8-3d40046fef39 req-10dc3f57-b693-49eb-8c74-29612cc191c2 service nova] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] No waiting events found dispatching network-vif-plugged-1def089a-31ed-4ac4-be68-4050fa9c9fe6 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:56:30 user nova-compute[75341]: WARNING nova.compute.manager [req-f4e95125-9aed-4b7c-a6e8-3d40046fef39 req-10dc3f57-b693-49eb-8c74-29612cc191c2 service nova] [instance: 12c9a7d6-03a5-4fd2-9082-c68758f1542f] Received unexpected event network-vif-plugged-1def089a-31ed-4ac4-be68-4050fa9c9fe6 for instance with vm_state deleted and task_state None.
Nov 14 23:56:33 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:56:38 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:56:41 user nova-compute[75341]: INFO nova.compute.manager [None req-d9df9d3c-4412-47ef-9fbe-e0a9d2231ae0 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Unrescuing
Nov 14 23:56:41 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d9df9d3c-4412-47ef-9fbe-e0a9d2231ae0 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Acquiring lock "refresh_cache-c62455e6-61af-45b1-899f-bad37dc57b22" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:56:41 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d9df9d3c-4412-47ef-9fbe-e0a9d2231ae0 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Acquired lock "refresh_cache-c62455e6-61af-45b1-899f-bad37dc57b22" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:56:41 user nova-compute[75341]: DEBUG nova.network.neutron [None req-d9df9d3c-4412-47ef-9fbe-e0a9d2231ae0 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 23:56:41 user nova-compute[75341]: DEBUG nova.network.neutron [None req-d9df9d3c-4412-47ef-9fbe-e0a9d2231ae0 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Updating instance_info_cache with network_info: [{"id": "8989d87f-615c-4cfe-9d3d-6c012e3fdf48", "address": "fa:16:3e:2d:04:44", "network": {"id": "fcd22da6-016e-4872-a84c-4d82601c48d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-550677181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44bb8b1415c14bb59c4c35cc2b830875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8989d87f-61", "ovs_interfaceid": "8989d87f-615c-4cfe-9d3d-6c012e3fdf48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:56:41 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d9df9d3c-4412-47ef-9fbe-e0a9d2231ae0 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Releasing lock "refresh_cache-c62455e6-61af-45b1-899f-bad37dc57b22" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:56:41 user nova-compute[75341]: DEBUG nova.objects.instance [None req-d9df9d3c-4412-47ef-9fbe-e0a9d2231ae0 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lazy-loading 'flavor' on Instance uuid c62455e6-61af-45b1-899f-bad37dc57b22 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:56:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:56:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:56:42 user nova-compute[75341]: DEBUG nova.compute.manager [req-e822ab9a-a729-4116-9fd9-7350467a3147 req-7b89a993-1905-431c-9449-a7d96aeb81a5 service nova] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Received event network-vif-unplugged-8989d87f-615c-4cfe-9d3d-6c012e3fdf48 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:56:42 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-e822ab9a-a729-4116-9fd9-7350467a3147 req-7b89a993-1905-431c-9449-a7d96aeb81a5 service nova] Acquiring lock "c62455e6-61af-45b1-899f-bad37dc57b22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:56:42 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-e822ab9a-a729-4116-9fd9-7350467a3147 req-7b89a993-1905-431c-9449-a7d96aeb81a5 service nova] Lock "c62455e6-61af-45b1-899f-bad37dc57b22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:56:42 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-e822ab9a-a729-4116-9fd9-7350467a3147 req-7b89a993-1905-431c-9449-a7d96aeb81a5 service nova] Lock "c62455e6-61af-45b1-899f-bad37dc57b22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:56:42 user nova-compute[75341]: DEBUG nova.compute.manager [req-e822ab9a-a729-4116-9fd9-7350467a3147 req-7b89a993-1905-431c-9449-a7d96aeb81a5 service nova] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] No waiting events found dispatching network-vif-unplugged-8989d87f-615c-4cfe-9d3d-6c012e3fdf48 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:56:42 user nova-compute[75341]: WARNING nova.compute.manager [req-e822ab9a-a729-4116-9fd9-7350467a3147 req-7b89a993-1905-431c-9449-a7d96aeb81a5 service nova] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Received unexpected event network-vif-unplugged-8989d87f-615c-4cfe-9d3d-6c012e3fdf48 for instance with vm_state rescued and task_state unrescuing.
Nov 14 23:56:42 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:56:42 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:56:42 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Instance destroyed successfully.
Nov 14 23:56:43 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:56:43 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:56:43 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:56:43 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:56:43 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:56:43 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:56:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:56:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:56:44 user nova-compute[75341]: DEBUG nova.compute.manager [req-d66bd5d8-f268-428c-82af-6a59b19a0be8 req-172e5092-7958-4086-8f18-7a041b6cbdf5 service nova] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Received event network-vif-plugged-8989d87f-615c-4cfe-9d3d-6c012e3fdf48 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:56:44 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-d66bd5d8-f268-428c-82af-6a59b19a0be8 req-172e5092-7958-4086-8f18-7a041b6cbdf5 service nova] Acquiring lock "c62455e6-61af-45b1-899f-bad37dc57b22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:56:44 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-d66bd5d8-f268-428c-82af-6a59b19a0be8 req-172e5092-7958-4086-8f18-7a041b6cbdf5 service nova] Lock "c62455e6-61af-45b1-899f-bad37dc57b22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:56:44 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-d66bd5d8-f268-428c-82af-6a59b19a0be8 req-172e5092-7958-4086-8f18-7a041b6cbdf5 service nova] Lock "c62455e6-61af-45b1-899f-bad37dc57b22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:56:44 user nova-compute[75341]: DEBUG nova.compute.manager [req-d66bd5d8-f268-428c-82af-6a59b19a0be8 req-172e5092-7958-4086-8f18-7a041b6cbdf5 service nova] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] No waiting events found dispatching network-vif-plugged-8989d87f-615c-4cfe-9d3d-6c012e3fdf48 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:56:44 user nova-compute[75341]: WARNING nova.compute.manager [req-d66bd5d8-f268-428c-82af-6a59b19a0be8 req-172e5092-7958-4086-8f18-7a041b6cbdf5 service nova] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Received unexpected event network-vif-plugged-8989d87f-615c-4cfe-9d3d-6c012e3fdf48 for instance with vm_state rescued and task_state unrescuing.
Nov 14 23:56:44 user nova-compute[75341]: DEBUG nova.compute.manager [req-d66bd5d8-f268-428c-82af-6a59b19a0be8 req-172e5092-7958-4086-8f18-7a041b6cbdf5 service nova] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Received event network-vif-plugged-8989d87f-615c-4cfe-9d3d-6c012e3fdf48 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:56:44 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-d66bd5d8-f268-428c-82af-6a59b19a0be8 req-172e5092-7958-4086-8f18-7a041b6cbdf5 service nova] Acquiring lock "c62455e6-61af-45b1-899f-bad37dc57b22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:56:44 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-d66bd5d8-f268-428c-82af-6a59b19a0be8 req-172e5092-7958-4086-8f18-7a041b6cbdf5 service nova] Lock "c62455e6-61af-45b1-899f-bad37dc57b22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:56:44 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-d66bd5d8-f268-428c-82af-6a59b19a0be8 req-172e5092-7958-4086-8f18-7a041b6cbdf5 service nova] Lock "c62455e6-61af-45b1-899f-bad37dc57b22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:56:44 user nova-compute[75341]: DEBUG nova.compute.manager [req-d66bd5d8-f268-428c-82af-6a59b19a0be8 req-172e5092-7958-4086-8f18-7a041b6cbdf5 service nova] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] No waiting events found dispatching network-vif-plugged-8989d87f-615c-4cfe-9d3d-6c012e3fdf48 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:56:44 user nova-compute[75341]: WARNING nova.compute.manager [req-d66bd5d8-f268-428c-82af-6a59b19a0be8 req-172e5092-7958-4086-8f18-7a041b6cbdf5 service nova] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Received unexpected event network-vif-plugged-8989d87f-615c-4cfe-9d3d-6c012e3fdf48 for instance with vm_state rescued and task_state unrescuing.
Nov 14 23:56:45 user nova-compute[75341]: DEBUG nova.compute.manager [None req-d9df9d3c-4412-47ef-9fbe-e0a9d2231ae0 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 23:56:46 user nova-compute[75341]: DEBUG nova.compute.manager [req-6a46ad72-00f0-438a-a01b-ce31ed109136 req-719c3b83-b8d1-451b-8b64-4ca4b9f66a47 service nova] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Received event network-vif-plugged-8989d87f-615c-4cfe-9d3d-6c012e3fdf48 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:56:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6a46ad72-00f0-438a-a01b-ce31ed109136 req-719c3b83-b8d1-451b-8b64-4ca4b9f66a47 service nova] Acquiring lock "c62455e6-61af-45b1-899f-bad37dc57b22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:56:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6a46ad72-00f0-438a-a01b-ce31ed109136 req-719c3b83-b8d1-451b-8b64-4ca4b9f66a47 service nova] Lock "c62455e6-61af-45b1-899f-bad37dc57b22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:56:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6a46ad72-00f0-438a-a01b-ce31ed109136 req-719c3b83-b8d1-451b-8b64-4ca4b9f66a47 service nova] Lock "c62455e6-61af-45b1-899f-bad37dc57b22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:56:46 user nova-compute[75341]: DEBUG nova.compute.manager [req-6a46ad72-00f0-438a-a01b-ce31ed109136 req-719c3b83-b8d1-451b-8b64-4ca4b9f66a47 service nova] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] No waiting events found dispatching network-vif-plugged-8989d87f-615c-4cfe-9d3d-6c012e3fdf48 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:56:46 user nova-compute[75341]: WARNING nova.compute.manager [req-6a46ad72-00f0-438a-a01b-ce31ed109136 req-719c3b83-b8d1-451b-8b64-4ca4b9f66a47 service nova] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Received unexpected event network-vif-plugged-8989d87f-615c-4cfe-9d3d-6c012e3fdf48 for instance with vm_state active and task_state None.
Nov 14 23:56:47 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:56:48 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:56:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Acquiring lock "a80008bd-c61c-4a36-ae67-e556a5ecee08" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:56:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "a80008bd-c61c-4a36-ae67-e556a5ecee08" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:56:49 user nova-compute[75341]: DEBUG nova.compute.manager [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Starting instance... {{(pid=75341) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 23:56:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:56:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:56:49 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75341) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 23:56:49 user nova-compute[75341]: INFO nova.compute.claims [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Claim successful on node user
Nov 14 23:56:49 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:56:49 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:56:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.396s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:56:49 user nova-compute[75341]: DEBUG nova.compute.manager [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Start building networks asynchronously for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 23:56:49 user nova-compute[75341]: DEBUG nova.compute.manager [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Allocating IP information in the background. {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 23:56:49 user nova-compute[75341]: DEBUG nova.network.neutron [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] allocate_for_instance() {{(pid=75341) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 23:56:49 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 23:56:49 user nova-compute[75341]: DEBUG nova.compute.manager [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Start building block device mappings for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 23:56:49 user nova-compute[75341]: DEBUG nova.policy [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b08f7ddf6c2f4fd596e214d6ca56c234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96674073965642f1af11221b4add8a6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75341) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 23:56:49 user nova-compute[75341]: INFO nova.virt.block_device [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Booting with volume a5f672e8-ffa6-4986-99a8-819fe39ccf36 at /dev/vda
Nov 14 23:56:49 user nova-compute[75341]: DEBUG os_brick.utils [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:56:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:56:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:56:49 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[26906d5e-02ca-42c3-9894-fcd324a8b89f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6d1cfca09c9\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:56:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:56:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:56:49 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[8adbc924-667d-4ea0-bdc9-4ca22c3c7cea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:56:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:56:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:56:49 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb401f2e-83f1-4a98-a262-a25b6317fd79]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:56:49 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c2f78ec-b930-4f9e-aa33-ebaa0fc0422d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:56:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Running cmd (subprocess): nvme version {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:56:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] 'nvme version' failed. Not Retrying. {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:56:50 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] nvme not present on system {{(pid=75341) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 23:56:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:56:50 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:56:50 user nova-compute[75341]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 23:56:50 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[50243106-e4de-4d83-b2f4-ee0b3100331c]: (4, '') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:56:50 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75341) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 23:56:50 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 23:56:50 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] LIGHTOS: no hostnqn found. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 23:56:50 user nova-compute[75341]: DEBUG os_brick.utils [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6d1cfca09c9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:56:50 user nova-compute[75341]: DEBUG nova.virt.block_device [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Updating existing volume attachment record: a9a55a14-e2f8-4b12-a0fb-63478d439084 {{(pid=75341) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 23:56:50 user nova-compute[75341]: DEBUG nova.network.neutron [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Successfully created port: 140e7083-e454-413d-892e-a4784b4cea66 {{(pid=75341) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 23:56:51 user nova-compute[75341]: DEBUG nova.network.neutron [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Successfully updated port: 140e7083-e454-413d-892e-a4784b4cea66 {{(pid=75341) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 23:56:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Acquiring lock "refresh_cache-a80008bd-c61c-4a36-ae67-e556a5ecee08" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:56:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Acquired lock "refresh_cache-a80008bd-c61c-4a36-ae67-e556a5ecee08" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:56:51 user nova-compute[75341]: DEBUG nova.network.neutron [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 23:56:51 user nova-compute[75341]: DEBUG nova.compute.manager [req-0d09f180-32d0-41cf-bcc5-424403cb2283 req-e76c6d44-3020-40ea-b9fe-28f6200cc0cb service nova] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Received event network-changed-140e7083-e454-413d-892e-a4784b4cea66 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:56:51 user nova-compute[75341]: DEBUG nova.compute.manager [req-0d09f180-32d0-41cf-bcc5-424403cb2283 req-e76c6d44-3020-40ea-b9fe-28f6200cc0cb service nova] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Refreshing instance network info cache due to event network-changed-140e7083-e454-413d-892e-a4784b4cea66. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:56:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-0d09f180-32d0-41cf-bcc5-424403cb2283 req-e76c6d44-3020-40ea-b9fe-28f6200cc0cb service nova] Acquiring lock "refresh_cache-a80008bd-c61c-4a36-ae67-e556a5ecee08" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:56:51 user nova-compute[75341]: DEBUG nova.network.neutron [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Instance cache missing network info. {{(pid=75341) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 23:56:51 user nova-compute[75341]: DEBUG nova.network.neutron [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Updating instance_info_cache with network_info: [{"id": "140e7083-e454-413d-892e-a4784b4cea66", "address": "fa:16:3e:69:fb:24", "network": {"id": "227eb779-a064-477d-8447-45862017ae7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-3827253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96674073965642f1af11221b4add8a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap140e7083-e4", "ovs_interfaceid": "140e7083-e454-413d-892e-a4784b4cea66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:56:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Releasing lock "refresh_cache-a80008bd-c61c-4a36-ae67-e556a5ecee08" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:56:51 user nova-compute[75341]: DEBUG nova.compute.manager [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Instance network_info: |[{"id": "140e7083-e454-413d-892e-a4784b4cea66", "address": "fa:16:3e:69:fb:24", "network": {"id": "227eb779-a064-477d-8447-45862017ae7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-3827253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96674073965642f1af11221b4add8a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap140e7083-e4", "ovs_interfaceid": "140e7083-e454-413d-892e-a4784b4cea66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 23:56:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-0d09f180-32d0-41cf-bcc5-424403cb2283 req-e76c6d44-3020-40ea-b9fe-28f6200cc0cb service nova] Acquired lock "refresh_cache-a80008bd-c61c-4a36-ae67-e556a5ecee08" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:56:51 user nova-compute[75341]: DEBUG nova.network.neutron [req-0d09f180-32d0-41cf-bcc5-424403cb2283 req-e76c6d44-3020-40ea-b9fe-28f6200cc0cb service nova] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Refreshing network info cache for port 140e7083-e454-413d-892e-a4784b4cea66 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:56:51 user nova-compute[75341]: DEBUG nova.network.neutron [req-0d09f180-32d0-41cf-bcc5-424403cb2283 req-e76c6d44-3020-40ea-b9fe-28f6200cc0cb service nova] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Updated VIF entry in instance network info cache for port 140e7083-e454-413d-892e-a4784b4cea66. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:56:51 user nova-compute[75341]: DEBUG nova.network.neutron [req-0d09f180-32d0-41cf-bcc5-424403cb2283 req-e76c6d44-3020-40ea-b9fe-28f6200cc0cb service nova] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Updating instance_info_cache with network_info: [{"id": "140e7083-e454-413d-892e-a4784b4cea66", "address": "fa:16:3e:69:fb:24", "network": {"id": "227eb779-a064-477d-8447-45862017ae7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-3827253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96674073965642f1af11221b4add8a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap140e7083-e4", "ovs_interfaceid": "140e7083-e454-413d-892e-a4784b4cea66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:56:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-0d09f180-32d0-41cf-bcc5-424403cb2283 req-e76c6d44-3020-40ea-b9fe-28f6200cc0cb service nova] Releasing lock "refresh_cache-a80008bd-c61c-4a36-ae67-e556a5ecee08" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:56:53 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:56:54 user nova-compute[75341]: DEBUG nova.compute.manager [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Start spawning the instance on the hypervisor. {{(pid=75341) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 23:56:54 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Creating instance directory {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 23:56:54 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Creating image(s)
Nov 14 23:56:54 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Did not create local disks {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 23:56:54 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Ensure instance console log exists: /opt/stack/data/nova/instances/a80008bd-c61c-4a36-ae67-e556a5ecee08/console.log {{(pid=75341) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 23:56:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:56:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:56:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:56:54 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Start _get_guest_xml network_info=[{"id": "140e7083-e454-413d-892e-a4784b4cea66", "address": "fa:16:3e:69:fb:24", "network": {"id": "227eb779-a064-477d-8447-45862017ae7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-3827253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96674073965642f1af11221b4add8a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap140e7083-e4", "ovs_interfaceid": "140e7083-e454-413d-892e-a4784b4cea66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'a9a55a14-e2f8-4b12-a0fb-63478d439084', 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qFHBPzGf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a80008bd-c61c-4a36-ae67-e556a5ecee08', 'attached_at': '', 'detached_at': '', 'volume_id': 'a5f672e8-ffa6-4986-99a8-819fe39ccf36', 'serial': 'a5f672e8-ffa6-4986-99a8-819fe39ccf36'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 23:56:54 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:56:54 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:56:54 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 23:56:54 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 23:56:54 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 23:56:54 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 23:56:54 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 23:56:54 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 23:56:54 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 23:56:54 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 23:56:54 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 23:56:54 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 23:56:54 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 23:56:54 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 23:56:54 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 23:56:54 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 23:56:54 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 23:56:54 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 23:56:54 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Calling os-brick to attach iSCSI Volume {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 23:56:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qFHBPzGf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:56:54 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:56:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:56:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:56:54 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:56:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:56:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:56:54 user nova-compute[75341]: INFO os_brick.initiator.connectors.iscsi [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 23:56:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 -p 172.16.0.220:3260 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:56:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:56:54 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1fa1b25-0e4d-47a7-8291-d1fec754d74b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:56:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 23:56:54 user nova-compute[75341]:  {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:56:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 -p 172.16.0.220:3260 --interface default --op new {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:56:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:56:54 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[380105a7-acda-4c72-b140-32749d69cbe4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36] added\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:56:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36] added
Nov 14 23:56:54 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:56:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:56:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:56:54 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe432c4-7c14-461b-b625-728c130fc7ba]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:56:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:56:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:56:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:56:54 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[eebcebad-aadf-4c65-a566-6910e255490c]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:56:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:56:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qFHBPzGf {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:56:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qFHBPzGf" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:56:54 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[69efb483-31b0-48e9-b1e0-c81c249be606]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:56:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qFHBPzGf'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:56:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:56:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:56:54 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07d1622-69e7-40cf-a553-271303e0fd22]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:56:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:56:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:56:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:56:54 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[213a8ed3-c025-459b-9a4a-cec9ff9f82eb]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:56:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)
Nov 14 23:56:54 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:56:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)
Nov 14 23:56:54 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:56:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 -p 172.16.0.220:3260 --login {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:56:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:56:55 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[851914f6-f013-4720-8a08-b6f028553e55]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:56:55 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36, portal: 172.16.0.220,3260]
Nov 14 23:56:55 user nova-compute[75341]: Login to [iface: default, target: iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36, portal: 172.16.0.220,3260] successful.
Nov 14 23:56:55 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:56:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:56:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:56:55 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[51327055-f970-4df0-89ac-ecc3ace9f821]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:56:55 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:56:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:56:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:56:55 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e50d3b-38d4-4345-be29-79fa9f7d80a5]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:56:55 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)
Nov 14 23:56:55 user nova-compute[75341]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)
Nov 14 23:56:55 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:56:55 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)
Nov 14 23:56:55 user nova-compute[75341]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)
Nov 14 23:56:55 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:56:55 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.247s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:56:55 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Connected to 172.16.0.220:3260 {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 23:56:55 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=75341) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 23:56:55 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75341) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 23:56:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:56:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:56:55 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[60000a5e-3a71-4411-ab12-cc999926cc85]: (4, ('- - 0', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:56:55 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 23:56:55 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qFHBPzGf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 23:56:55 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:56:56 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:56:56 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '26536393737656136', 'path': '/dev/sdb'} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:56:56 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26536393737656136', 'path': '/dev/sdb'} {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 23:56:56 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:56:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1126440302',display_name='tempest-TestVolumeBootPattern-server-1126440302',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1126440302',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN7m+PTR/lRAnqFJ5INzHZER+6KEezVf2NqND5YLAUMiY/B8DjdO2ameMcKY7PyF3FV92+jHAoJaiByyFu7+plRebNNPsSYlc8sL/IhL0WhnAYWxdc2ydVL4yfconkjd2A==',key_name='tempest-TestVolumeBootPattern-1320135145',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96674073965642f1af11221b4add8a6d',ramdisk_id='',reservation_id='r-tpv6g1h0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-320933673',owner_user_name='tempest-TestVolumeBootPattern-320933673-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:56:50Z,user_data=None,user_id='b08f7ddf6c2f4fd596e214d6ca56c234',uuid=a80008bd-c61c-4a36-ae67-e556a5ecee08,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "140e7083-e454-413d-892e-a4784b4cea66", "address": "fa:16:3e:69:fb:24", "network": {"id": "227eb779-a064-477d-8447-45862017ae7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-3827253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96674073965642f1af11221b4add8a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap140e7083-e4", "ovs_interfaceid": "140e7083-e454-413d-892e-a4784b4cea66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:56:56 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Converting VIF {"id": "140e7083-e454-413d-892e-a4784b4cea66", "address": "fa:16:3e:69:fb:24", "network": {"id": "227eb779-a064-477d-8447-45862017ae7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-3827253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96674073965642f1af11221b4add8a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap140e7083-e4", "ovs_interfaceid": "140e7083-e454-413d-892e-a4784b4cea66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:56:56 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:fb:24,bridge_name='br-int',has_traffic_filtering=True,id=140e7083-e454-413d-892e-a4784b4cea66,network=Network(227eb779-a064-477d-8447-45862017ae7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap140e7083-e4') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:56:56 user nova-compute[75341]: DEBUG nova.objects.instance [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lazy-loading 'pci_devices' on Instance uuid a80008bd-c61c-4a36-ae67-e556a5ecee08 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:56:56 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] End _get_guest_xml xml=<domain type="kvm">
Nov 14 23:56:56 user nova-compute[75341]:   <uuid>a80008bd-c61c-4a36-ae67-e556a5ecee08</uuid>
Nov 14 23:56:56 user nova-compute[75341]:   <name>instance-00000029</name>
Nov 14 23:56:56 user nova-compute[75341]:   <memory>524288</memory>
Nov 14 23:56:56 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 14 23:56:56 user nova-compute[75341]:   <metadata>
Nov 14 23:56:56 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 23:56:56 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 14 23:56:56 user nova-compute[75341]:       <nova:name>tempest-TestVolumeBootPattern-server-1126440302</nova:name>
Nov 14 23:56:56 user nova-compute[75341]:       <nova:creationTime>2023-11-14 23:56:54</nova:creationTime>
Nov 14 23:56:56 user nova-compute[75341]:       <nova:flavor name="m1.tiny">
Nov 14 23:56:56 user nova-compute[75341]:         <nova:memory>512</nova:memory>
Nov 14 23:56:56 user nova-compute[75341]:         <nova:disk>1</nova:disk>
Nov 14 23:56:56 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 14 23:56:56 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 23:56:56 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 14 23:56:56 user nova-compute[75341]:       </nova:flavor>
Nov 14 23:56:56 user nova-compute[75341]:       <nova:owner>
Nov 14 23:56:56 user nova-compute[75341]:         <nova:user uuid="b08f7ddf6c2f4fd596e214d6ca56c234">tempest-TestVolumeBootPattern-320933673-project-member</nova:user>
Nov 14 23:56:56 user nova-compute[75341]:         <nova:project uuid="96674073965642f1af11221b4add8a6d">tempest-TestVolumeBootPattern-320933673</nova:project>
Nov 14 23:56:56 user nova-compute[75341]:       </nova:owner>
Nov 14 23:56:56 user nova-compute[75341]:       <nova:ports>
Nov 14 23:56:56 user nova-compute[75341]:         <nova:port uuid="140e7083-e454-413d-892e-a4784b4cea66">
Nov 14 23:56:56 user nova-compute[75341]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 23:56:56 user nova-compute[75341]:         </nova:port>
Nov 14 23:56:56 user nova-compute[75341]:       </nova:ports>
Nov 14 23:56:56 user nova-compute[75341]:     </nova:instance>
Nov 14 23:56:56 user nova-compute[75341]:   </metadata>
Nov 14 23:56:56 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 14 23:56:56 user nova-compute[75341]:     <system>
Nov 14 23:56:56 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 23:56:56 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 14 23:56:56 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 14 23:56:56 user nova-compute[75341]:       <entry name="serial">a80008bd-c61c-4a36-ae67-e556a5ecee08</entry>
Nov 14 23:56:56 user nova-compute[75341]:       <entry name="uuid">a80008bd-c61c-4a36-ae67-e556a5ecee08</entry>
Nov 14 23:56:56 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 14 23:56:56 user nova-compute[75341]:     </system>
Nov 14 23:56:56 user nova-compute[75341]:   </sysinfo>
Nov 14 23:56:56 user nova-compute[75341]:   <os>
Nov 14 23:56:56 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 23:56:56 user nova-compute[75341]:     <boot dev="hd"/>
Nov 14 23:56:56 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 14 23:56:56 user nova-compute[75341]:   </os>
Nov 14 23:56:56 user nova-compute[75341]:   <features>
Nov 14 23:56:56 user nova-compute[75341]:     <acpi/>
Nov 14 23:56:56 user nova-compute[75341]:     <apic/>
Nov 14 23:56:56 user nova-compute[75341]:     <vmcoreinfo/>
Nov 14 23:56:56 user nova-compute[75341]:   </features>
Nov 14 23:56:56 user nova-compute[75341]:   <clock offset="utc">
Nov 14 23:56:56 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 23:56:56 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 23:56:56 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 14 23:56:56 user nova-compute[75341]:   </clock>
Nov 14 23:56:56 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 14 23:56:56 user nova-compute[75341]:     <model>Nehalem</model>
Nov 14 23:56:56 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 23:56:56 user nova-compute[75341]:   </cpu>
Nov 14 23:56:56 user nova-compute[75341]:   <devices>
Nov 14 23:56:56 user nova-compute[75341]:     <disk type="block" device="disk">
Nov 14 23:56:56 user nova-compute[75341]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:56:56 user nova-compute[75341]:       <source dev="/dev/sdb"/>
Nov 14 23:56:56 user nova-compute[75341]:       <target dev="vda" bus="virtio"/>
Nov 14 23:56:56 user nova-compute[75341]:       <serial>a5f672e8-ffa6-4986-99a8-819fe39ccf36</serial>
Nov 14 23:56:56 user nova-compute[75341]:     </disk>
Nov 14 23:56:56 user nova-compute[75341]:     <interface type="ethernet">
Nov 14 23:56:56 user nova-compute[75341]:       <mac address="fa:16:3e:69:fb:24"/>
Nov 14 23:56:56 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:56:56 user nova-compute[75341]:       <mtu size="1442"/>
Nov 14 23:56:56 user nova-compute[75341]:       <target dev="tap140e7083-e4"/>
Nov 14 23:56:56 user nova-compute[75341]:     </interface>
Nov 14 23:56:56 user nova-compute[75341]:     <serial type="pty">
Nov 14 23:56:56 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/a80008bd-c61c-4a36-ae67-e556a5ecee08/console.log" append="off"/>
Nov 14 23:56:56 user nova-compute[75341]:     </serial>
Nov 14 23:56:56 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 23:56:56 user nova-compute[75341]:     <video>
Nov 14 23:56:56 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:56:56 user nova-compute[75341]:     </video>
Nov 14 23:56:56 user nova-compute[75341]:     <rng model="virtio">
Nov 14 23:56:56 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 14 23:56:56 user nova-compute[75341]:     </rng>
Nov 14 23:56:56 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 14 23:56:56 user nova-compute[75341]:     <memballoon model="virtio">
Nov 14 23:56:56 user nova-compute[75341]:       <stats period="10"/>
Nov 14 23:56:56 user nova-compute[75341]:     </memballoon>
Nov 14 23:56:56 user nova-compute[75341]:   </devices>
Nov 14 23:56:56 user nova-compute[75341]: </domain>
Nov 14 23:56:56 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 23:56:56 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:56:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1126440302',display_name='tempest-TestVolumeBootPattern-server-1126440302',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1126440302',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN7m+PTR/lRAnqFJ5INzHZER+6KEezVf2NqND5YLAUMiY/B8DjdO2ameMcKY7PyF3FV92+jHAoJaiByyFu7+plRebNNPsSYlc8sL/IhL0WhnAYWxdc2ydVL4yfconkjd2A==',key_name='tempest-TestVolumeBootPattern-1320135145',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96674073965642f1af11221b4add8a6d',ramdisk_id='',reservation_id='r-tpv6g1h0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-320933673',owner_user_name='tempest-TestVolumeBootPattern-320933673-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:56:50Z,user_data=None,user_id='b08f7ddf6c2f4fd596e214d6ca56c234',uuid=a80008bd-c61c-4a36-ae67-e556a5ecee08,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "140e7083-e454-413d-892e-a4784b4cea66", "address": "fa:16:3e:69:fb:24", "network": {"id": "227eb779-a064-477d-8447-45862017ae7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-3827253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96674073965642f1af11221b4add8a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap140e7083-e4", "ovs_interfaceid": "140e7083-e454-413d-892e-a4784b4cea66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 23:56:56 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Converting VIF {"id": "140e7083-e454-413d-892e-a4784b4cea66", "address": "fa:16:3e:69:fb:24", "network": {"id": "227eb779-a064-477d-8447-45862017ae7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-3827253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96674073965642f1af11221b4add8a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap140e7083-e4", "ovs_interfaceid": "140e7083-e454-413d-892e-a4784b4cea66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:56:56 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:fb:24,bridge_name='br-int',has_traffic_filtering=True,id=140e7083-e454-413d-892e-a4784b4cea66,network=Network(227eb779-a064-477d-8447-45862017ae7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap140e7083-e4') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:56:56 user nova-compute[75341]: DEBUG os_vif [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:fb:24,bridge_name='br-int',has_traffic_filtering=True,id=140e7083-e454-413d-892e-a4784b4cea66,network=Network(227eb779-a064-477d-8447-45862017ae7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap140e7083-e4') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 23:56:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:56:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:56:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 23:56:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:56:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1b492aea-c061-5874-a2a3-366e3c63238f', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:56:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:56:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:56:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:56:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:56:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap140e7083-e4, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:56:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap140e7083-e4, col_values=(('qos', UUID('4e6b5b3b-21ad-4307-a1ff-28830637ac04')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:56:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap140e7083-e4, col_values=(('external_ids', {'iface-id': '140e7083-e454-413d-892e-a4784b4cea66', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:fb:24', 'vm-uuid': 'a80008bd-c61c-4a36-ae67-e556a5ecee08'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:56:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:56:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:56:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:56:56 user nova-compute[75341]: INFO os_vif [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:fb:24,bridge_name='br-int',has_traffic_filtering=True,id=140e7083-e454-413d-892e-a4784b4cea66,network=Network(227eb779-a064-477d-8447-45862017ae7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap140e7083-e4')
Nov 14 23:56:56 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:56:56 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] No VIF found with MAC fa:16:3e:69:fb:24, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:56:56 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:56:56 user nova-compute[75341]: DEBUG nova.compute.manager [req-561e01bb-3695-41e9-a371-24627f4ce022 req-bb13bb72-8f4f-40e7-8bf3-446ea469f80f service nova] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] Received event network-changed-a3595789-ed45-4588-a234-ac1682f304a1 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:56:56 user nova-compute[75341]: DEBUG nova.compute.manager [req-561e01bb-3695-41e9-a371-24627f4ce022 req-bb13bb72-8f4f-40e7-8bf3-446ea469f80f service nova] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] Refreshing instance network info cache due to event network-changed-a3595789-ed45-4588-a234-ac1682f304a1. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:56:56 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-561e01bb-3695-41e9-a371-24627f4ce022 req-bb13bb72-8f4f-40e7-8bf3-446ea469f80f service nova] Acquiring lock "refresh_cache-cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:56:56 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-561e01bb-3695-41e9-a371-24627f4ce022 req-bb13bb72-8f4f-40e7-8bf3-446ea469f80f service nova] Acquired lock "refresh_cache-cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:56:56 user nova-compute[75341]: DEBUG nova.network.neutron [req-561e01bb-3695-41e9-a371-24627f4ce022 req-bb13bb72-8f4f-40e7-8bf3-446ea469f80f service nova] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] Refreshing network info cache for port a3595789-ed45-4588-a234-ac1682f304a1 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:56:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:56:57 user nova-compute[75341]: DEBUG nova.network.neutron [req-561e01bb-3695-41e9-a371-24627f4ce022 req-bb13bb72-8f4f-40e7-8bf3-446ea469f80f service nova] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] Updated VIF entry in instance network info cache for port a3595789-ed45-4588-a234-ac1682f304a1. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:56:57 user nova-compute[75341]: DEBUG nova.network.neutron [req-561e01bb-3695-41e9-a371-24627f4ce022 req-bb13bb72-8f4f-40e7-8bf3-446ea469f80f service nova] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] Updating instance_info_cache with network_info: [{"id": "a3595789-ed45-4588-a234-ac1682f304a1", "address": "fa:16:3e:b0:df:79", "network": {"id": "9ad7204e-07f5-4676-b2de-09e036a92e61", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-718201239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542a85b3a6d14c77872f1957120ba655", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3595789-ed", "ovs_interfaceid": "a3595789-ed45-4588-a234-ac1682f304a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:56:57 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-561e01bb-3695-41e9-a371-24627f4ce022 req-bb13bb72-8f4f-40e7-8bf3-446ea469f80f service nova] Releasing lock "refresh_cache-cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:56:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:56:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:56:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:56:57 user nova-compute[75341]: DEBUG nova.compute.manager [req-e2d501f2-18ec-4d4f-9f95-91a19aaa9c92 req-fc5f5d15-81eb-4176-a638-93517eb5cc34 service nova] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Received event network-vif-plugged-140e7083-e454-413d-892e-a4784b4cea66 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:56:57 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-e2d501f2-18ec-4d4f-9f95-91a19aaa9c92 req-fc5f5d15-81eb-4176-a638-93517eb5cc34 service nova] Acquiring lock "a80008bd-c61c-4a36-ae67-e556a5ecee08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:56:57 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-e2d501f2-18ec-4d4f-9f95-91a19aaa9c92 req-fc5f5d15-81eb-4176-a638-93517eb5cc34 service nova] Lock "a80008bd-c61c-4a36-ae67-e556a5ecee08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:56:57 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-e2d501f2-18ec-4d4f-9f95-91a19aaa9c92 req-fc5f5d15-81eb-4176-a638-93517eb5cc34 service nova] Lock "a80008bd-c61c-4a36-ae67-e556a5ecee08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:56:57 user nova-compute[75341]: DEBUG nova.compute.manager [req-e2d501f2-18ec-4d4f-9f95-91a19aaa9c92 req-fc5f5d15-81eb-4176-a638-93517eb5cc34 service nova] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] No waiting events found dispatching network-vif-plugged-140e7083-e454-413d-892e-a4784b4cea66 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:56:57 user nova-compute[75341]: WARNING nova.compute.manager [req-e2d501f2-18ec-4d4f-9f95-91a19aaa9c92 req-fc5f5d15-81eb-4176-a638-93517eb5cc34 service nova] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Received unexpected event network-vif-plugged-140e7083-e454-413d-892e-a4784b4cea66 for instance with vm_state building and task_state spawning.
Nov 14 23:56:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:56:58 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:56:58 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:56:58 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:56:58 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:56:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c6c61df9-86f2-4331-8c7e-2e0a865930e4 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Acquiring lock "cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:56:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c6c61df9-86f2-4331-8c7e-2e0a865930e4 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:56:58 user nova-compute[75341]: DEBUG nova.objects.instance [None req-c6c61df9-86f2-4331-8c7e-2e0a865930e4 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lazy-loading 'flavor' on Instance uuid cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:56:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c6c61df9-86f2-4331-8c7e-2e0a865930e4 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:56:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c6c61df9-86f2-4331-8c7e-2e0a865930e4 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Acquiring lock "cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:56:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c6c61df9-86f2-4331-8c7e-2e0a865930e4 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:56:58 user nova-compute[75341]: INFO nova.compute.manager [None req-c6c61df9-86f2-4331-8c7e-2e0a865930e4 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] Attaching volume 840153f3-4df1-48c2-b014-d536a282de51 to /dev/vdb
Nov 14 23:56:58 user nova-compute[75341]: DEBUG os_brick.utils [None req-c6c61df9-86f2-4331-8c7e-2e0a865930e4 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:56:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:56:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:56:58 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[4acdff88-07db-4f9d-a70f-9dbf6c0913a4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6d1cfca09c9\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:56:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:56:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:56:58 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f569fe-ad43-43a1-84f9-54eed10d4253]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:56:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:56:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:56:58 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[04942a22-5994-4b10-91e0-39076dbf5fa3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:56:58 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e01bd6-1ceb-439e-8649-64e2688984ee]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:56:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-c6c61df9-86f2-4331-8c7e-2e0a865930e4 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Running cmd (subprocess): nvme version {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:56:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-c6c61df9-86f2-4331-8c7e-2e0a865930e4 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] 'nvme version' failed. Not Retrying. {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:56:58 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c6c61df9-86f2-4331-8c7e-2e0a865930e4 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] nvme not present on system {{(pid=75341) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 23:56:58 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:56:58 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75341) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 23:56:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:56:58 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:56:58 user nova-compute[75341]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 23:56:58 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcede388-79b2-48f2-b80d-377c83d6f555]: (4, '') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:56:58 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-c6c61df9-86f2-4331-8c7e-2e0a865930e4 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75341) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 23:56:58 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-c6c61df9-86f2-4331-8c7e-2e0a865930e4 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 23:56:58 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-c6c61df9-86f2-4331-8c7e-2e0a865930e4 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] LIGHTOS: no hostnqn found. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 23:56:58 user nova-compute[75341]: DEBUG os_brick.utils [None req-c6c61df9-86f2-4331-8c7e-2e0a865930e4 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6d1cfca09c9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:56:58 user nova-compute[75341]: DEBUG nova.virt.block_device [None req-c6c61df9-86f2-4331-8c7e-2e0a865930e4 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] Updating existing volume attachment record: 278a4fc8-d8ec-468b-b24b-f15fab16fdc4 {{(pid=75341) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 23:56:59 user nova-compute[75341]: DEBUG nova.compute.manager [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Instance event wait completed in 0 seconds for  {{(pid=75341) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 23:56:59 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Guest created on hypervisor {{(pid=75341) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 23:56:59 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Instance spawned successfully.
Nov 14 23:56:59 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 23:56:59 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Found default for hw_cdrom_bus of ide {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:56:59 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Found default for hw_disk_bus of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:56:59 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Found default for hw_input_bus of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:56:59 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Found default for hw_pointer_model of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:56:59 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Found default for hw_video_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:56:59 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Found default for hw_vif_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:56:59 user nova-compute[75341]: DEBUG nova.compute.manager [req-d1a151bc-2b4e-41fb-95a0-0976cb9a9322 req-2f186606-074c-492c-ab5f-6ecc117afa38 service nova] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Received event network-vif-plugged-140e7083-e454-413d-892e-a4784b4cea66 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:56:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-d1a151bc-2b4e-41fb-95a0-0976cb9a9322 req-2f186606-074c-492c-ab5f-6ecc117afa38 service nova] Acquiring lock "a80008bd-c61c-4a36-ae67-e556a5ecee08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:56:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-d1a151bc-2b4e-41fb-95a0-0976cb9a9322 req-2f186606-074c-492c-ab5f-6ecc117afa38 service nova] Lock "a80008bd-c61c-4a36-ae67-e556a5ecee08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:56:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-d1a151bc-2b4e-41fb-95a0-0976cb9a9322 req-2f186606-074c-492c-ab5f-6ecc117afa38 service nova] Lock "a80008bd-c61c-4a36-ae67-e556a5ecee08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:56:59 user nova-compute[75341]: DEBUG nova.compute.manager [req-d1a151bc-2b4e-41fb-95a0-0976cb9a9322 req-2f186606-074c-492c-ab5f-6ecc117afa38 service nova] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] No waiting events found dispatching network-vif-plugged-140e7083-e454-413d-892e-a4784b4cea66 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:56:59 user nova-compute[75341]: WARNING nova.compute.manager [req-d1a151bc-2b4e-41fb-95a0-0976cb9a9322 req-2f186606-074c-492c-ab5f-6ecc117afa38 service nova] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Received unexpected event network-vif-plugged-140e7083-e454-413d-892e-a4784b4cea66 for instance with vm_state building and task_state spawning.
Nov 14 23:56:59 user nova-compute[75341]: INFO nova.compute.manager [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Took 5.11 seconds to spawn the instance on the hypervisor.
Nov 14 23:56:59 user nova-compute[75341]: DEBUG nova.compute.manager [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 23:56:59 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:56:59 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:57:00 user nova-compute[75341]: INFO nova.compute.manager [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Took 10.76 seconds to build instance.
Nov 14 23:57:00 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e2980f02-de10-418f-9379-85717bb12f84 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "a80008bd-c61c-4a36-ae67-e556a5ecee08" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.849s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:57:00 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-559b6d67-e72a-4bdb-a445-c3f085e0ccec tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Acquiring lock "53d7a6fe-3914-459a-9494-c75549af7b9f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:57:00 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-559b6d67-e72a-4bdb-a445-c3f085e0ccec tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lock "53d7a6fe-3914-459a-9494-c75549af7b9f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:57:00 user nova-compute[75341]: DEBUG nova.objects.instance [None req-559b6d67-e72a-4bdb-a445-c3f085e0ccec tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lazy-loading 'flavor' on Instance uuid 53d7a6fe-3914-459a-9494-c75549af7b9f {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:57:00 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-559b6d67-e72a-4bdb-a445-c3f085e0ccec tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lock "53d7a6fe-3914-459a-9494-c75549af7b9f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:57:00 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:57:00 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Starting heal instance info cache {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 23:57:00 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Rebuilding the list of instances to heal {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 23:57:00 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-559b6d67-e72a-4bdb-a445-c3f085e0ccec tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Acquiring lock "53d7a6fe-3914-459a-9494-c75549af7b9f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:57:00 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-559b6d67-e72a-4bdb-a445-c3f085e0ccec tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lock "53d7a6fe-3914-459a-9494-c75549af7b9f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:57:00 user nova-compute[75341]: INFO nova.compute.manager [None req-559b6d67-e72a-4bdb-a445-c3f085e0ccec tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Attaching volume 4a230abf-f727-4b44-b0b9-6a5ae84cb343 to /dev/vdb
Nov 14 23:57:01 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "refresh_cache-51045050-c7c6-49c5-acd4-2a76be0f466f" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:57:01 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquired lock "refresh_cache-51045050-c7c6-49c5-acd4-2a76be0f466f" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:57:01 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Forcefully refreshing network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 23:57:01 user nova-compute[75341]: DEBUG nova.objects.instance [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lazy-loading 'info_cache' on Instance uuid 51045050-c7c6-49c5-acd4-2a76be0f466f {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:57:01 user nova-compute[75341]: DEBUG os_brick.utils [None req-559b6d67-e72a-4bdb-a445-c3f085e0ccec tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:57:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:57:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:57:01 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19c5cbc-de43-457b-8e01-4f6c6623685f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6d1cfca09c9\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:57:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:57:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:57:01 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[38db0728-81e0-446b-8808-2d7a318499da]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:57:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:57:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:57:01 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc96b2a-54dc-47b1-b392-7aa17255fdf3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:57:01 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f46ccc-46b3-4e27-8b21-ab7a5ca727e8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:57:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-559b6d67-e72a-4bdb-a445-c3f085e0ccec tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Running cmd (subprocess): nvme version {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:57:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-559b6d67-e72a-4bdb-a445-c3f085e0ccec tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] 'nvme version' failed. Not Retrying. {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:57:01 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.nvmeof [None req-559b6d67-e72a-4bdb-a445-c3f085e0ccec tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] nvme not present on system {{(pid=75341) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 23:57:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:57:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:57:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:57:01 user nova-compute[75341]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 23:57:01 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bbc8e91-941d-428e-81b0-39d79c252b24]: (4, '') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:57:01 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-559b6d67-e72a-4bdb-a445-c3f085e0ccec tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75341) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 23:57:01 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-559b6d67-e72a-4bdb-a445-c3f085e0ccec tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 23:57:01 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-559b6d67-e72a-4bdb-a445-c3f085e0ccec tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] LIGHTOS: no hostnqn found. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 23:57:01 user nova-compute[75341]: DEBUG os_brick.utils [None req-559b6d67-e72a-4bdb-a445-c3f085e0ccec tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6d1cfca09c9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:57:01 user nova-compute[75341]: DEBUG nova.virt.block_device [None req-559b6d67-e72a-4bdb-a445-c3f085e0ccec tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Updating existing volume attachment record: 69b114d4-78a9-4846-8126-08e9c5b6d3e9 {{(pid=75341) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 23:57:01 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Updating instance_info_cache with network_info: [{"id": "64ebe5e6-0c81-41fd-b49e-75bed11e40df", "address": "fa:16:3e:44:63:f2", "network": {"id": "fcd22da6-016e-4872-a84c-4d82601c48d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-550677181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44bb8b1415c14bb59c4c35cc2b830875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ebe5e6-0c", "ovs_interfaceid": "64ebe5e6-0c81-41fd-b49e-75bed11e40df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:57:01 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Releasing lock "refresh_cache-51045050-c7c6-49c5-acd4-2a76be0f466f" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:57:01 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Updated the network info_cache for instance {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 23:57:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:57:02 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:57:02 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:57:02 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:57:02 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:57:02 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:57:02 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:57:02 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75341) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 23:57:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:57:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:57:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:57:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:57:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c62455e6-61af-45b1-899f-bad37dc57b22/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:57:03 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6c61df9-86f2-4331-8c7e-2e0a865930e4 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] Calling os-brick to attach iSCSI Volume {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 23:57:03 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c61df9-86f2-4331-8c7e-2e0a865930e4 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:840153f3-4df1-48c2-b014-d536a282de51', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lJFZVycO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:57:03 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-c6c61df9-86f2-4331-8c7e-2e0a865930e4 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:57:03 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-c6c61df9-86f2-4331-8c7e-2e0a865930e4 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:57:03 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-c6c61df9-86f2-4331-8c7e-2e0a865930e4 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:57:03 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-c6c61df9-86f2-4331-8c7e-2e0a865930e4 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:57:03 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-c6c61df9-86f2-4331-8c7e-2e0a865930e4 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:840153f3-4df1-48c2-b014-d536a282de51" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:57:03 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-c6c61df9-86f2-4331-8c7e-2e0a865930e4 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:840153f3-4df1-48c2-b014-d536a282de51" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:57:03 user nova-compute[75341]: INFO os_brick.initiator.connectors.iscsi [None req-c6c61df9-86f2-4331-8c7e-2e0a865930e4 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 23:57:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c62455e6-61af-45b1-899f-bad37dc57b22/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:57:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c62455e6-61af-45b1-899f-bad37dc57b22/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:57:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:840153f3-4df1-48c2-b014-d536a282de51 -p 172.16.0.220:3260 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:57:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:840153f3-4df1-48c2-b014-d536a282de51 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:57:03 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[a559d72b-2688-4de3-9458-b11f47e6935e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:57:03 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c61df9-86f2-4331-8c7e-2e0a865930e4 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 23:57:03 user nova-compute[75341]:  {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:57:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:840153f3-4df1-48c2-b014-d536a282de51 -p 172.16.0.220:3260 --interface default --op new {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:57:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:840153f3-4df1-48c2-b014-d536a282de51 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:57:03 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f98a35-2878-4adf-883f-c8b61f6d6f31]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:840153f3-4df1-48c2-b014-d536a282de51] added\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:57:03 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c61df9-86f2-4331-8c7e-2e0a865930e4 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:840153f3-4df1-48c2-b014-d536a282de51] added
Nov 14 23:57:03 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:57:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:840153f3-4df1-48c2-b014-d536a282de51 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:57:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:840153f3-4df1-48c2-b014-d536a282de51 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:57:03 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a564456-33e4-4455-90be-e954d9f27072]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:57:03 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c61df9-86f2-4331-8c7e-2e0a865930e4 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:57:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:840153f3-4df1-48c2-b014-d536a282de51 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:57:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:840153f3-4df1-48c2-b014-d536a282de51 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:57:03 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fbc88fc-0e65-42d7-995c-99748ef59763]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:57:03 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c61df9-86f2-4331-8c7e-2e0a865930e4 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:57:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:840153f3-4df1-48c2-b014-d536a282de51 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lJFZVycO {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:57:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:840153f3-4df1-48c2-b014-d536a282de51 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lJFZVycO" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:57:03 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d500a8-024c-4696-816d-99ae75bf4c14]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:57:03 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c61df9-86f2-4331-8c7e-2e0a865930e4 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lJFZVycO'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:57:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:840153f3-4df1-48c2-b014-d536a282de51 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:57:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:840153f3-4df1-48c2-b014-d536a282de51 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:57:03 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5f9e3e-60ce-4ad8-b87f-b91924822b5a]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:57:03 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c61df9-86f2-4331-8c7e-2e0a865930e4 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:57:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:57:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:57:03 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[0646057a-74f6-4972-ac23-7469511e6633]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:57:03 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c61df9-86f2-4331-8c7e-2e0a865930e4 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)
Nov 14 23:57:03 user nova-compute[75341]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)
Nov 14 23:57:03 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:57:03 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c61df9-86f2-4331-8c7e-2e0a865930e4 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)
Nov 14 23:57:03 user nova-compute[75341]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)
Nov 14 23:57:03 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:57:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:840153f3-4df1-48c2-b014-d536a282de51 -p 172.16.0.220:3260 --login {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:57:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c62455e6-61af-45b1-899f-bad37dc57b22/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:57:03 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 23:57:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk.rescue --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:57:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:840153f3-4df1-48c2-b014-d536a282de51 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:57:03 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d391d6-ce8c-402d-8a7d-36e0b33e9548]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:840153f3-4df1-48c2-b014-d536a282de51, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:840153f3-4df1-48c2-b014-d536a282de51, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:57:03 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c61df9-86f2-4331-8c7e-2e0a865930e4 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:840153f3-4df1-48c2-b014-d536a282de51, portal: 172.16.0.220,3260]
Nov 14 23:57:03 user nova-compute[75341]: Login to [iface: default, target: iqn.2010-10.org.openstack:840153f3-4df1-48c2-b014-d536a282de51, portal: 172.16.0.220,3260] successful.
Nov 14 23:57:03 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:57:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:840153f3-4df1-48c2-b014-d536a282de51 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:57:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:840153f3-4df1-48c2-b014-d536a282de51 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:57:04 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e4cef4-8bbf-42b7-9233-31a8f07a6b51]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:57:04 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c61df9-86f2-4331-8c7e-2e0a865930e4 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:57:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:57:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:57:04 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[2522d06f-6cb0-45fd-8df7-053e2267597d]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840153f3-4df1-48c2-b014-d536a282de51 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:57:04 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c61df9-86f2-4331-8c7e-2e0a865930e4 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)
Nov 14 23:57:04 user nova-compute[75341]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)
Nov 14 23:57:04 user nova-compute[75341]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840153f3-4df1-48c2-b014-d536a282de51 (non-flash)
Nov 14 23:57:04 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:57:04 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c61df9-86f2-4331-8c7e-2e0a865930e4 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)
Nov 14 23:57:04 user nova-compute[75341]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)
Nov 14 23:57:04 user nova-compute[75341]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840153f3-4df1-48c2-b014-d536a282de51 (non-flash)
Nov 14 23:57:04 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:57:04 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-c6c61df9-86f2-4331-8c7e-2e0a865930e4 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:840153f3-4df1-48c2-b014-d536a282de51" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:57:04 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c61df9-86f2-4331-8c7e-2e0a865930e4 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Connected to 172.16.0.220:3260 {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 23:57:04 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-c6c61df9-86f2-4331-8c7e-2e0a865930e4 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] HCTL ('35', '-', '-', 0) found on session 48 with lun 0 {{(pid=75341) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 23:57:04 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-c6c61df9-86f2-4331-8c7e-2e0a865930e4 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75341) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 23:57:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:57:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:57:04 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[01314b76-054c-4e38-acc3-5ec2c364f869]: (4, ('- - 0', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:57:04 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-c6c61df9-86f2-4331-8c7e-2e0a865930e4 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Searching for a device in session 48 and hctl ['35', '*', '*', 0] yield: None {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 23:57:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:57:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk.rescue --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:57:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:57:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:57:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:57:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:57:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:57:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:57:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:57:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:57:05 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-c6c61df9-86f2-4331-8c7e-2e0a865930e4 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Searching for a device in session 48 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 23:57:05 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c61df9-86f2-4331-8c7e-2e0a865930e4 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:840153f3-4df1-48c2-b014-d536a282de51', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lJFZVycO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 23:57:05 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-c6c61df9-86f2-4331-8c7e-2e0a865930e4 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:57:05 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c61df9-86f2-4331-8c7e-2e0a865930e4 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '26237623132623738', 'path': '/dev/sdd'} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:57:05 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6c61df9-86f2-4331-8c7e-2e0a865930e4 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237623132623738', 'path': '/dev/sdd'} {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 23:57:05 user nova-compute[75341]: DEBUG nova.objects.instance [None req-c6c61df9-86f2-4331-8c7e-2e0a865930e4 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lazy-loading 'flavor' on Instance uuid cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:57:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:57:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53d7a6fe-3914-459a-9494-c75549af7b9f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:57:05 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-c6c61df9-86f2-4331-8c7e-2e0a865930e4 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 23:57:05 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:57:05 user nova-compute[75341]:   <source dev="/dev/sdd"/>
Nov 14 23:57:05 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:57:05 user nova-compute[75341]:   <serial>840153f3-4df1-48c2-b014-d536a282de51</serial>
Nov 14 23:57:05 user nova-compute[75341]: </disk>
Nov 14 23:57:05 user nova-compute[75341]:  {{(pid=75341) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 23:57:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53d7a6fe-3914-459a-9494-c75549af7b9f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:57:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53d7a6fe-3914-459a-9494-c75549af7b9f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:57:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53d7a6fe-3914-459a-9494-c75549af7b9f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:57:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:57:05 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c6c61df9-86f2-4331-8c7e-2e0a865930e4 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:57:05 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c6c61df9-86f2-4331-8c7e-2e0a865930e4 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:57:05 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c6c61df9-86f2-4331-8c7e-2e0a865930e4 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] No VIF found with MAC fa:16:3e:b0:df:79, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:57:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:57:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:57:05 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c6c61df9-86f2-4331-8c7e-2e0a865930e4 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.029s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:57:05 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-559b6d67-e72a-4bdb-a445-c3f085e0ccec tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Calling os-brick to attach iSCSI Volume {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 23:57:05 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-559b6d67-e72a-4bdb-a445-c3f085e0ccec tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4a230abf-f727-4b44-b0b9-6a5ae84cb343', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qVpfDbwx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:57:05 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-559b6d67-e72a-4bdb-a445-c3f085e0ccec tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:57:05 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-559b6d67-e72a-4bdb-a445-c3f085e0ccec tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:57:05 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-559b6d67-e72a-4bdb-a445-c3f085e0ccec tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:57:05 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-559b6d67-e72a-4bdb-a445-c3f085e0ccec tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:57:05 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-559b6d67-e72a-4bdb-a445-c3f085e0ccec tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a230abf-f727-4b44-b0b9-6a5ae84cb343" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:57:05 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-559b6d67-e72a-4bdb-a445-c3f085e0ccec tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a230abf-f727-4b44-b0b9-6a5ae84cb343" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:57:05 user nova-compute[75341]: INFO os_brick.initiator.connectors.iscsi [None req-559b6d67-e72a-4bdb-a445-c3f085e0ccec tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 23:57:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a230abf-f727-4b44-b0b9-6a5ae84cb343 -p 172.16.0.220:3260 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:57:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a230abf-f727-4b44-b0b9-6a5ae84cb343 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:57:05 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae44e20-7b85-4d32-b50a-9a8de03410e6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:57:05 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-559b6d67-e72a-4bdb-a445-c3f085e0ccec tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 23:57:05 user nova-compute[75341]:  {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:57:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a230abf-f727-4b44-b0b9-6a5ae84cb343 -p 172.16.0.220:3260 --interface default --op new {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:57:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a230abf-f727-4b44-b0b9-6a5ae84cb343 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:57:05 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[768c853c-6c22-46db-bc69-4bea48b53096]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a230abf-f727-4b44-b0b9-6a5ae84cb343] added\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:57:05 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-559b6d67-e72a-4bdb-a445-c3f085e0ccec tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a230abf-f727-4b44-b0b9-6a5ae84cb343] added
Nov 14 23:57:05 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:57:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a230abf-f727-4b44-b0b9-6a5ae84cb343 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:57:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a230abf-f727-4b44-b0b9-6a5ae84cb343 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:57:05 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[574e2615-464b-4d4b-a3ef-7c72a85928dc]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:57:05 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-559b6d67-e72a-4bdb-a445-c3f085e0ccec tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:57:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a230abf-f727-4b44-b0b9-6a5ae84cb343 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:57:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:57:05 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 23:57:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:57:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a230abf-f727-4b44-b0b9-6a5ae84cb343 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:57:05 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6268eda-2f22-4b57-9fba-cb6a9bd7d7ca]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:57:05 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-559b6d67-e72a-4bdb-a445-c3f085e0ccec tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:57:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a230abf-f727-4b44-b0b9-6a5ae84cb343 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qVpfDbwx {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:57:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a230abf-f727-4b44-b0b9-6a5ae84cb343 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qVpfDbwx" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:57:05 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d72d15-40ce-4988-9740-9f50ee8659fa]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:57:05 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-559b6d67-e72a-4bdb-a445-c3f085e0ccec tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qVpfDbwx'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:57:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a230abf-f727-4b44-b0b9-6a5ae84cb343 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:57:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a230abf-f727-4b44-b0b9-6a5ae84cb343 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:57:05 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7fa42f-1459-4656-963b-bae18de8bb5e]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:57:05 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-559b6d67-e72a-4bdb-a445-c3f085e0ccec tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:57:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:57:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:57:06 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc014160-98aa-4716-9437-04eab591737b]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840153f3-4df1-48c2-b014-d536a282de51 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:57:06 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-559b6d67-e72a-4bdb-a445-c3f085e0ccec tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)
Nov 14 23:57:06 user nova-compute[75341]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)
Nov 14 23:57:06 user nova-compute[75341]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840153f3-4df1-48c2-b014-d536a282de51 (non-flash)
Nov 14 23:57:06 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:57:06 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-559b6d67-e72a-4bdb-a445-c3f085e0ccec tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)
Nov 14 23:57:06 user nova-compute[75341]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)
Nov 14 23:57:06 user nova-compute[75341]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840153f3-4df1-48c2-b014-d536a282de51 (non-flash)
Nov 14 23:57:06 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:57:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a230abf-f727-4b44-b0b9-6a5ae84cb343 -p 172.16.0.220:3260 --login {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:57:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a230abf-f727-4b44-b0b9-6a5ae84cb343 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:57:06 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[339d77bf-86eb-41f4-99d5-242e7e980b4a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a230abf-f727-4b44-b0b9-6a5ae84cb343, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4a230abf-f727-4b44-b0b9-6a5ae84cb343, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:57:06 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-559b6d67-e72a-4bdb-a445-c3f085e0ccec tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a230abf-f727-4b44-b0b9-6a5ae84cb343, portal: 172.16.0.220,3260]
Nov 14 23:57:06 user nova-compute[75341]: Login to [iface: default, target: iqn.2010-10.org.openstack:4a230abf-f727-4b44-b0b9-6a5ae84cb343, portal: 172.16.0.220,3260] successful.
Nov 14 23:57:06 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:57:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a230abf-f727-4b44-b0b9-6a5ae84cb343 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:57:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:57:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:57:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a230abf-f727-4b44-b0b9-6a5ae84cb343 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:57:06 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[774a15ea-5529-468c-8c86-733064438935]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:57:06 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-559b6d67-e72a-4bdb-a445-c3f085e0ccec tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:57:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:57:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:57:06 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[b648e860-c2f2-45f7-b980-18bf8de38321]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840153f3-4df1-48c2-b014-d536a282de51 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a230abf-f727-4b44-b0b9-6a5ae84cb343 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:57:06 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-559b6d67-e72a-4bdb-a445-c3f085e0ccec tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)
Nov 14 23:57:06 user nova-compute[75341]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)
Nov 14 23:57:06 user nova-compute[75341]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840153f3-4df1-48c2-b014-d536a282de51 (non-flash)
Nov 14 23:57:06 user nova-compute[75341]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a230abf-f727-4b44-b0b9-6a5ae84cb343 (non-flash)
Nov 14 23:57:06 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:57:06 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-559b6d67-e72a-4bdb-a445-c3f085e0ccec tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)
Nov 14 23:57:06 user nova-compute[75341]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)
Nov 14 23:57:06 user nova-compute[75341]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840153f3-4df1-48c2-b014-d536a282de51 (non-flash)
Nov 14 23:57:06 user nova-compute[75341]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a230abf-f727-4b44-b0b9-6a5ae84cb343 (non-flash)
Nov 14 23:57:06 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:57:06 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-559b6d67-e72a-4bdb-a445-c3f085e0ccec tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a230abf-f727-4b44-b0b9-6a5ae84cb343" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.363s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:57:06 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-559b6d67-e72a-4bdb-a445-c3f085e0ccec tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Connected to 172.16.0.220:3260 {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 23:57:06 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-559b6d67-e72a-4bdb-a445-c3f085e0ccec tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] HCTL ('36', '-', '-', 0) found on session 49 with lun 0 {{(pid=75341) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 23:57:06 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-559b6d67-e72a-4bdb-a445-c3f085e0ccec tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75341) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 23:57:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:57:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:57:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:57:06 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f8141c-ee53-461c-a6e1-90715786e1f0]: (4, ('- - 0', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:57:06 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-559b6d67-e72a-4bdb-a445-c3f085e0ccec tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Searching for a device in session 49 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 23:57:06 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-559b6d67-e72a-4bdb-a445-c3f085e0ccec tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:4a230abf-f727-4b44-b0b9-6a5ae84cb343', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qVpfDbwx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 23:57:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:57:06 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:57:06 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:57:06 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Hypervisor/Node resource view: name=user free_ram=8133MB free_disk=25.36233139038086GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75341) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 23:57:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:57:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:57:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1a0b2bd3-ecd8-4221-9a4c-bf14ec2c0694 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Acquiring lock "cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:57:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1a0b2bd3-ecd8-4221-9a4c-bf14ec2c0694 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:57:06 user nova-compute[75341]: INFO nova.compute.manager [None req-1a0b2bd3-ecd8-4221-9a4c-bf14ec2c0694 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] Detaching volume 840153f3-4df1-48c2-b014-d536a282de51
Nov 14 23:57:06 user nova-compute[75341]: INFO nova.virt.block_device [None req-1a0b2bd3-ecd8-4221-9a4c-bf14ec2c0694 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] Attempting to driver detach volume 840153f3-4df1-48c2-b014-d536a282de51 from mountpoint /dev/vdb
Nov 14 23:57:06 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-1a0b2bd3-ecd8-4221-9a4c-bf14ec2c0694 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Attempting to detach device vdb from instance cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e from the persistent domain config. {{(pid=75341) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 23:57:06 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-1a0b2bd3-ecd8-4221-9a4c-bf14ec2c0694 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 23:57:06 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:57:06 user nova-compute[75341]:   <source dev="/dev/sdd"/>
Nov 14 23:57:06 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:57:06 user nova-compute[75341]:   <serial>840153f3-4df1-48c2-b014-d536a282de51</serial>
Nov 14 23:57:06 user nova-compute[75341]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 23:57:06 user nova-compute[75341]: </disk>
Nov 14 23:57:06 user nova-compute[75341]:  {{(pid=75341) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 23:57:06 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 51045050-c7c6-49c5-acd4-2a76be0f466f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:57:06 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 6382e432-838f-4d89-a743-cbaa37f50ab5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:57:06 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance defae731-4191-4526-99cc-a301cf5b3355 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:57:06 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 2316aa9e-d4c9-43d0-9918-86265583aed1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:57:06 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 53d7a6fe-3914-459a-9494-c75549af7b9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:57:06 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance c62455e6-61af-45b1-899f-bad37dc57b22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:57:06 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:57:06 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance a80008bd-c61c-4a36-ae67-e556a5ecee08 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:57:06 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 23:57:06 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 23:57:06 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-1a0b2bd3-ecd8-4221-9a4c-bf14ec2c0694 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Successfully detached device vdb from instance cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e from the persistent domain config.
Nov 14 23:57:06 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-1a0b2bd3-ecd8-4221-9a4c-bf14ec2c0694 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e from the live domain config. {{(pid=75341) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 23:57:06 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-1a0b2bd3-ecd8-4221-9a4c-bf14ec2c0694 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 23:57:06 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:57:06 user nova-compute[75341]:   <source dev="/dev/sdd"/>
Nov 14 23:57:06 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:57:06 user nova-compute[75341]:   <serial>840153f3-4df1-48c2-b014-d536a282de51</serial>
Nov 14 23:57:06 user nova-compute[75341]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 23:57:06 user nova-compute[75341]: </disk>
Nov 14 23:57:06 user nova-compute[75341]:  {{(pid=75341) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 23:57:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:57:07 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:57:07 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:57:07 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Compute_service record updated for user:user {{(pid=75341) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 23:57:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.431s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:57:07 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-559b6d67-e72a-4bdb-a445-c3f085e0ccec tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.417s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:57:07 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-559b6d67-e72a-4bdb-a445-c3f085e0ccec tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] <== connect_volume: return (1418ms) {'type': 'block', 'scsi_wwn': '26362383834616232', 'path': '/dev/sde'} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:57:07 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-559b6d67-e72a-4bdb-a445-c3f085e0ccec tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362383834616232', 'path': '/dev/sde'} {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 23:57:07 user nova-compute[75341]: DEBUG nova.objects.instance [None req-559b6d67-e72a-4bdb-a445-c3f085e0ccec tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lazy-loading 'flavor' on Instance uuid 53d7a6fe-3914-459a-9494-c75549af7b9f {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:57:07 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-559b6d67-e72a-4bdb-a445-c3f085e0ccec tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 23:57:07 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:57:07 user nova-compute[75341]:   <source dev="/dev/sde"/>
Nov 14 23:57:07 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:57:07 user nova-compute[75341]:   <serial>4a230abf-f727-4b44-b0b9-6a5ae84cb343</serial>
Nov 14 23:57:07 user nova-compute[75341]: </disk>
Nov 14 23:57:07 user nova-compute[75341]:  {{(pid=75341) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 23:57:07 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-1a0b2bd3-ecd8-4221-9a4c-bf14ec2c0694 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e {{(pid=75341) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 23:57:07 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-559b6d67-e72a-4bdb-a445-c3f085e0ccec tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:57:07 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-559b6d67-e72a-4bdb-a445-c3f085e0ccec tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:57:07 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-559b6d67-e72a-4bdb-a445-c3f085e0ccec tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] No VIF found with MAC fa:16:3e:14:63:0c, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:57:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-559b6d67-e72a-4bdb-a445-c3f085e0ccec tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lock "53d7a6fe-3914-459a-9494-c75549af7b9f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.812s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:57:10 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d1510cf2-bbfd-47de-8d5f-a506afca0e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Acquiring lock "53d7a6fe-3914-459a-9494-c75549af7b9f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:57:10 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d1510cf2-bbfd-47de-8d5f-a506afca0e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lock "53d7a6fe-3914-459a-9494-c75549af7b9f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:57:10 user nova-compute[75341]: INFO nova.compute.manager [None req-d1510cf2-bbfd-47de-8d5f-a506afca0e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Detaching volume 4a230abf-f727-4b44-b0b9-6a5ae84cb343
Nov 14 23:57:10 user nova-compute[75341]: INFO nova.virt.block_device [None req-d1510cf2-bbfd-47de-8d5f-a506afca0e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Attempting to driver detach volume 4a230abf-f727-4b44-b0b9-6a5ae84cb343 from mountpoint /dev/vdb
Nov 14 23:57:10 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d1510cf2-bbfd-47de-8d5f-a506afca0e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Attempting to detach device vdb from instance 53d7a6fe-3914-459a-9494-c75549af7b9f from the persistent domain config. {{(pid=75341) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 23:57:10 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-d1510cf2-bbfd-47de-8d5f-a506afca0e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 23:57:10 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:57:10 user nova-compute[75341]:   <source dev="/dev/sde"/>
Nov 14 23:57:10 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:57:10 user nova-compute[75341]:   <serial>4a230abf-f727-4b44-b0b9-6a5ae84cb343</serial>
Nov 14 23:57:10 user nova-compute[75341]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 23:57:10 user nova-compute[75341]: </disk>
Nov 14 23:57:10 user nova-compute[75341]:  {{(pid=75341) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 23:57:10 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-d1510cf2-bbfd-47de-8d5f-a506afca0e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Successfully detached device vdb from instance 53d7a6fe-3914-459a-9494-c75549af7b9f from the persistent domain config.
Nov 14 23:57:10 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d1510cf2-bbfd-47de-8d5f-a506afca0e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 53d7a6fe-3914-459a-9494-c75549af7b9f from the live domain config. {{(pid=75341) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 23:57:10 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-d1510cf2-bbfd-47de-8d5f-a506afca0e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 23:57:10 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:57:10 user nova-compute[75341]:   <source dev="/dev/sde"/>
Nov 14 23:57:10 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:57:10 user nova-compute[75341]:   <serial>4a230abf-f727-4b44-b0b9-6a5ae84cb343</serial>
Nov 14 23:57:10 user nova-compute[75341]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 23:57:10 user nova-compute[75341]: </disk>
Nov 14 23:57:10 user nova-compute[75341]:  {{(pid=75341) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 23:57:10 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d1510cf2-bbfd-47de-8d5f-a506afca0e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 53d7a6fe-3914-459a-9494-c75549af7b9f {{(pid=75341) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 23:57:11 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:57:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:57:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:57:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:57:21 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:57:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:57:26 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:57:26 user nova-compute[75341]: DEBUG nova.objects.instance [None req-12ba88f5-c38a-454e-9fcd-b9e93c713de4 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lazy-loading 'flavor' on Instance uuid 2316aa9e-d4c9-43d0-9918-86265583aed1 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:57:26 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-12ba88f5-c38a-454e-9fcd-b9e93c713de4 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Acquiring lock "refresh_cache-2316aa9e-d4c9-43d0-9918-86265583aed1" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:57:26 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-12ba88f5-c38a-454e-9fcd-b9e93c713de4 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Acquired lock "refresh_cache-2316aa9e-d4c9-43d0-9918-86265583aed1" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:57:26 user nova-compute[75341]: DEBUG nova.network.neutron [None req-12ba88f5-c38a-454e-9fcd-b9e93c713de4 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 23:57:26 user nova-compute[75341]: DEBUG nova.objects.instance [None req-12ba88f5-c38a-454e-9fcd-b9e93c713de4 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lazy-loading 'info_cache' on Instance uuid 2316aa9e-d4c9-43d0-9918-86265583aed1 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:57:26 user nova-compute[75341]: DEBUG nova.objects.base [None req-12ba88f5-c38a-454e-9fcd-b9e93c713de4 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Object Instance<2316aa9e-d4c9-43d0-9918-86265583aed1> lazy-loaded attributes: flavor,info_cache {{(pid=75341) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG nova.network.neutron [None req-12ba88f5-c38a-454e-9fcd-b9e93c713de4 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Updating instance_info_cache with network_info: [{"id": "71caa935-899c-4716-9953-ae35733e691e", "address": "fa:16:3e:3d:1f:4a", "network": {"id": "167936c8-5f28-439e-9a1f-d9356b3a1ec9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374167607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e601d11e75d4ec4b7c05e615c67fe20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71caa935-89", "ovs_interfaceid": "71caa935-899c-4716-9953-ae35733e691e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-12ba88f5-c38a-454e-9fcd-b9e93c713de4 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Releasing lock "refresh_cache-2316aa9e-d4c9-43d0-9918-86265583aed1" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:57:27 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Instance destroyed successfully.
Nov 14 23:57:27 user nova-compute[75341]: DEBUG nova.objects.instance [None req-12ba88f5-c38a-454e-9fcd-b9e93c713de4 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lazy-loading 'resources' on Instance uuid 2316aa9e-d4c9-43d0-9918-86265583aed1 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG nova.objects.base [None req-12ba88f5-c38a-454e-9fcd-b9e93c713de4 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Object Instance<2316aa9e-d4c9-43d0-9918-86265583aed1> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75341) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-12ba88f5-c38a-454e-9fcd-b9e93c713de4 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:49:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-154597700',display_name='tempest-AttachVolumeTestJSON-server-154597700',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-154597700',id=32,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaFgRJa61ME1XpWOzpNtbuqeAV1SySIMy7vrqCjTh61rgrkmD4lVtobnjyZbOLvU5WmBzUQHKYD/KyyedZ/uzEQoe71Auc/XFD5jRK6KaS6v9fK21UKVH1TMup4zwPhng==',key_name='tempest-keypair-1222319400',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:49:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0e601d11e75d4ec4b7c05e615c67fe20',ramdisk_id='',reservation_id='r-2tbsxelf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1907700292',owner_user_name='tempest-AttachVolumeTestJSON-1907700292-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:55:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa84b131dff84566810c44b553b09ba8',uuid=2316aa9e-d4c9-43d0-9918-86265583aed1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "71caa935-899c-4716-9953-ae35733e691e", "address": "fa:16:3e:3d:1f:4a", "network": {"id": "167936c8-5f28-439e-9a1f-d9356b3a1ec9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374167607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e601d11e75d4ec4b7c05e615c67fe20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71caa935-89", "ovs_interfaceid": "71caa935-899c-4716-9953-ae35733e691e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-12ba88f5-c38a-454e-9fcd-b9e93c713de4 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Converting VIF {"id": "71caa935-899c-4716-9953-ae35733e691e", "address": "fa:16:3e:3d:1f:4a", "network": {"id": "167936c8-5f28-439e-9a1f-d9356b3a1ec9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374167607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e601d11e75d4ec4b7c05e615c67fe20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71caa935-89", "ovs_interfaceid": "71caa935-899c-4716-9953-ae35733e691e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-12ba88f5-c38a-454e-9fcd-b9e93c713de4 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:1f:4a,bridge_name='br-int',has_traffic_filtering=True,id=71caa935-899c-4716-9953-ae35733e691e,network=Network(167936c8-5f28-439e-9a1f-d9356b3a1ec9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71caa935-89') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG os_vif [None req-12ba88f5-c38a-454e-9fcd-b9e93c713de4 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:1f:4a,bridge_name='br-int',has_traffic_filtering=True,id=71caa935-899c-4716-9953-ae35733e691e,network=Network(167936c8-5f28-439e-9a1f-d9356b3a1ec9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71caa935-89') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap71caa935-89, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=684651ef-f885-43a6-ae10-5e7ab48ad06f) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:57:27 user nova-compute[75341]: INFO os_vif [None req-12ba88f5-c38a-454e-9fcd-b9e93c713de4 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:1f:4a,bridge_name='br-int',has_traffic_filtering=True,id=71caa935-899c-4716-9953-ae35733e691e,network=Network(167936c8-5f28-439e-9a1f-d9356b3a1ec9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71caa935-89')
Nov 14 23:57:27 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-12ba88f5-c38a-454e-9fcd-b9e93c713de4 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Start _get_guest_xml network_info=[{"id": "71caa935-899c-4716-9953-ae35733e691e", "address": "fa:16:3e:3d:1f:4a", "network": {"id": "167936c8-5f28-439e-9a1f-d9356b3a1ec9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374167607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e601d11e75d4ec4b7c05e615c67fe20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71caa935-89", "ovs_interfaceid": "71caa935-899c-4716-9953-ae35733e691e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encrypted': False, 'image_id': 'e46abb82-b810-490e-a8a1-ccdc5fa1a796'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG nova.objects.instance [None req-12ba88f5-c38a-454e-9fcd-b9e93c713de4 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lazy-loading 'numa_topology' on Instance uuid 2316aa9e-d4c9-43d0-9918-86265583aed1 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG nova.objects.base [None req-12ba88f5-c38a-454e-9fcd-b9e93c713de4 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Object Instance<2316aa9e-d4c9-43d0-9918-86265583aed1> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75341) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 23:57:27 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-12ba88f5-c38a-454e-9fcd-b9e93c713de4 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:57:27 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-12ba88f5-c38a-454e-9fcd-b9e93c713de4 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:57:27 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-12ba88f5-c38a-454e-9fcd-b9e93c713de4 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-12ba88f5-c38a-454e-9fcd-b9e93c713de4 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-12ba88f5-c38a-454e-9fcd-b9e93c713de4 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-12ba88f5-c38a-454e-9fcd-b9e93c713de4 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-12ba88f5-c38a-454e-9fcd-b9e93c713de4 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-12ba88f5-c38a-454e-9fcd-b9e93c713de4 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-12ba88f5-c38a-454e-9fcd-b9e93c713de4 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-12ba88f5-c38a-454e-9fcd-b9e93c713de4 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-12ba88f5-c38a-454e-9fcd-b9e93c713de4 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-12ba88f5-c38a-454e-9fcd-b9e93c713de4 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-12ba88f5-c38a-454e-9fcd-b9e93c713de4 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-12ba88f5-c38a-454e-9fcd-b9e93c713de4 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-12ba88f5-c38a-454e-9fcd-b9e93c713de4 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-12ba88f5-c38a-454e-9fcd-b9e93c713de4 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-12ba88f5-c38a-454e-9fcd-b9e93c713de4 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-12ba88f5-c38a-454e-9fcd-b9e93c713de4 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG nova.objects.instance [None req-12ba88f5-c38a-454e-9fcd-b9e93c713de4 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2316aa9e-d4c9-43d0-9918-86265583aed1 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:57:27 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-1a0b2bd3-ecd8-4221-9a4c-bf14ec2c0694 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e is timed out.
Nov 14 23:57:27 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-1a0b2bd3-ecd8-4221-9a4c-bf14ec2c0694 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Successfully detached device vdb from instance cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e from the live domain config.
Nov 14 23:57:27 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a0b2bd3-ecd8-4221-9a4c-bf14ec2c0694 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] calling os-brick to detach iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a0b2bd3-ecd8-4221-9a4c-bf14ec2c0694 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, {'target_iqn': 'iqn.2010-10.org.openstack:840153f3-4df1-48c2-b014-d536a282de51', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lJFZVycO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:57:27 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-1a0b2bd3-ecd8-4221-9a4c-bf14ec2c0694 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:57:27 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-1a0b2bd3-ecd8-4221-9a4c-bf14ec2c0694 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-1a0b2bd3-ecd8-4221-9a4c-bf14ec2c0694 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG nova.objects.base [None req-12ba88f5-c38a-454e-9fcd-b9e93c713de4 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Object Instance<2316aa9e-d4c9-43d0-9918-86265583aed1> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75341) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-12ba88f5-c38a-454e-9fcd-b9e93c713de4 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:49:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-154597700',display_name='tempest-AttachVolumeTestJSON-server-154597700',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-154597700',id=32,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaFgRJa61ME1XpWOzpNtbuqeAV1SySIMy7vrqCjTh61rgrkmD4lVtobnjyZbOLvU5WmBzUQHKYD/KyyedZ/uzEQoe71Auc/XFD5jRK6KaS6v9fK21UKVH1TMup4zwPhng==',key_name='tempest-keypair-1222319400',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:49:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0e601d11e75d4ec4b7c05e615c67fe20',ramdisk_id='',reservation_id='r-2tbsxelf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1907700292',owner_user_name='tempest-AttachVolumeTestJSON-1907700292-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:55:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa84b131dff84566810c44b553b09ba8',uuid=2316aa9e-d4c9-43d0-9918-86265583aed1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "71caa935-899c-4716-9953-ae35733e691e", "address": "fa:16:3e:3d:1f:4a", "network": {"id": "167936c8-5f28-439e-9a1f-d9356b3a1ec9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374167607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e601d11e75d4ec4b7c05e615c67fe20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71caa935-89", "ovs_interfaceid": "71caa935-899c-4716-9953-ae35733e691e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-12ba88f5-c38a-454e-9fcd-b9e93c713de4 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Converting VIF {"id": "71caa935-899c-4716-9953-ae35733e691e", "address": "fa:16:3e:3d:1f:4a", "network": {"id": "167936c8-5f28-439e-9a1f-d9356b3a1ec9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374167607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e601d11e75d4ec4b7c05e615c67fe20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71caa935-89", "ovs_interfaceid": "71caa935-899c-4716-9953-ae35733e691e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-12ba88f5-c38a-454e-9fcd-b9e93c713de4 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:1f:4a,bridge_name='br-int',has_traffic_filtering=True,id=71caa935-899c-4716-9953-ae35733e691e,network=Network(167936c8-5f28-439e-9a1f-d9356b3a1ec9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71caa935-89') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG nova.objects.instance [None req-12ba88f5-c38a-454e-9fcd-b9e93c713de4 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lazy-loading 'pci_devices' on Instance uuid 2316aa9e-d4c9-43d0-9918-86265583aed1 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[03fb1a76-db08-4464-94be-f1e53fc2e67c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:840153f3-4df1-48c2-b014-d536a282de51\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a230abf-f727-4b44-b0b9-6a5ae84cb343\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a0b2bd3-ecd8-4221-9a4c-bf14ec2c0694 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 23:57:27 user nova-compute[75341]: No targets found.
Nov 14 23:57:27 user nova-compute[75341]: iSNS:
Nov 14 23:57:27 user nova-compute[75341]: No targets found.
Nov 14 23:57:27 user nova-compute[75341]: STATIC:
Nov 14 23:57:27 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36
Nov 14 23:57:27 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:57:27 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:57:27 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:840153f3-4df1-48c2-b014-d536a282de51
Nov 14 23:57:27 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:57:27 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:57:27 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:4a230abf-f727-4b44-b0b9-6a5ae84cb343
Nov 14 23:57:27 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:57:27 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:57:27 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00
Nov 14 23:57:27 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:57:27 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:57:27 user nova-compute[75341]: FIRMWARE:
Nov 14 23:57:27 user nova-compute[75341]: No targets found.
Nov 14 23:57:27 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a0b2bd3-ecd8-4221-9a4c-bf14ec2c0694 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 23:57:27 user nova-compute[75341]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 23:57:27 user nova-compute[75341]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75341) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a0b2bd3-ecd8-4221-9a4c-bf14ec2c0694 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:840153f3-4df1-48c2-b014-d536a282de51', 0)] {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG nova.objects.base [None req-12ba88f5-c38a-454e-9fcd-b9e93c713de4 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Object Instance<2316aa9e-d4c9-43d0-9918-86265583aed1> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75341) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-12ba88f5-c38a-454e-9fcd-b9e93c713de4 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] End _get_guest_xml xml=<domain type="kvm">
Nov 14 23:57:27 user nova-compute[75341]:   <uuid>2316aa9e-d4c9-43d0-9918-86265583aed1</uuid>
Nov 14 23:57:27 user nova-compute[75341]:   <name>instance-00000020</name>
Nov 14 23:57:27 user nova-compute[75341]:   <memory>524288</memory>
Nov 14 23:57:27 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 14 23:57:27 user nova-compute[75341]:   <metadata>
Nov 14 23:57:27 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 23:57:27 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 14 23:57:27 user nova-compute[75341]:       <nova:name>tempest-AttachVolumeTestJSON-server-154597700</nova:name>
Nov 14 23:57:27 user nova-compute[75341]:       <nova:creationTime>2023-11-14 23:57:27</nova:creationTime>
Nov 14 23:57:27 user nova-compute[75341]:       <nova:flavor name="m1.tiny">
Nov 14 23:57:27 user nova-compute[75341]:         <nova:memory>512</nova:memory>
Nov 14 23:57:27 user nova-compute[75341]:         <nova:disk>1</nova:disk>
Nov 14 23:57:27 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 14 23:57:27 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 23:57:27 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 14 23:57:27 user nova-compute[75341]:       </nova:flavor>
Nov 14 23:57:27 user nova-compute[75341]:       <nova:owner>
Nov 14 23:57:27 user nova-compute[75341]:         <nova:user uuid="aa84b131dff84566810c44b553b09ba8">tempest-AttachVolumeTestJSON-1907700292-project-member</nova:user>
Nov 14 23:57:27 user nova-compute[75341]:         <nova:project uuid="0e601d11e75d4ec4b7c05e615c67fe20">tempest-AttachVolumeTestJSON-1907700292</nova:project>
Nov 14 23:57:27 user nova-compute[75341]:       </nova:owner>
Nov 14 23:57:27 user nova-compute[75341]:       <nova:root type="image" uuid="e46abb82-b810-490e-a8a1-ccdc5fa1a796"/>
Nov 14 23:57:27 user nova-compute[75341]:       <nova:ports>
Nov 14 23:57:27 user nova-compute[75341]:         <nova:port uuid="71caa935-899c-4716-9953-ae35733e691e">
Nov 14 23:57:27 user nova-compute[75341]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 23:57:27 user nova-compute[75341]:         </nova:port>
Nov 14 23:57:27 user nova-compute[75341]:       </nova:ports>
Nov 14 23:57:27 user nova-compute[75341]:     </nova:instance>
Nov 14 23:57:27 user nova-compute[75341]:   </metadata>
Nov 14 23:57:27 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 14 23:57:27 user nova-compute[75341]:     <system>
Nov 14 23:57:27 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 23:57:27 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 14 23:57:27 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 14 23:57:27 user nova-compute[75341]:       <entry name="serial">2316aa9e-d4c9-43d0-9918-86265583aed1</entry>
Nov 14 23:57:27 user nova-compute[75341]:       <entry name="uuid">2316aa9e-d4c9-43d0-9918-86265583aed1</entry>
Nov 14 23:57:27 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 14 23:57:27 user nova-compute[75341]:     </system>
Nov 14 23:57:27 user nova-compute[75341]:   </sysinfo>
Nov 14 23:57:27 user nova-compute[75341]:   <os>
Nov 14 23:57:27 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 23:57:27 user nova-compute[75341]:     <boot dev="hd"/>
Nov 14 23:57:27 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 14 23:57:27 user nova-compute[75341]:   </os>
Nov 14 23:57:27 user nova-compute[75341]:   <features>
Nov 14 23:57:27 user nova-compute[75341]:     <acpi/>
Nov 14 23:57:27 user nova-compute[75341]:     <apic/>
Nov 14 23:57:27 user nova-compute[75341]:     <vmcoreinfo/>
Nov 14 23:57:27 user nova-compute[75341]:   </features>
Nov 14 23:57:27 user nova-compute[75341]:   <clock offset="utc">
Nov 14 23:57:27 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 23:57:27 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 23:57:27 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 14 23:57:27 user nova-compute[75341]:   </clock>
Nov 14 23:57:27 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 14 23:57:27 user nova-compute[75341]:     <model>Nehalem</model>
Nov 14 23:57:27 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 23:57:27 user nova-compute[75341]:   </cpu>
Nov 14 23:57:27 user nova-compute[75341]:   <devices>
Nov 14 23:57:27 user nova-compute[75341]:     <disk type="file" device="disk">
Nov 14 23:57:27 user nova-compute[75341]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 23:57:27 user nova-compute[75341]:       <source file="/opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/disk"/>
Nov 14 23:57:27 user nova-compute[75341]:       <target dev="vda" bus="virtio"/>
Nov 14 23:57:27 user nova-compute[75341]:     </disk>
Nov 14 23:57:27 user nova-compute[75341]:     <interface type="ethernet">
Nov 14 23:57:27 user nova-compute[75341]:       <mac address="fa:16:3e:3d:1f:4a"/>
Nov 14 23:57:27 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:57:27 user nova-compute[75341]:       <mtu size="1442"/>
Nov 14 23:57:27 user nova-compute[75341]:       <target dev="tap71caa935-89"/>
Nov 14 23:57:27 user nova-compute[75341]:     </interface>
Nov 14 23:57:27 user nova-compute[75341]:     <serial type="pty">
Nov 14 23:57:27 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/console.log" append="off"/>
Nov 14 23:57:27 user nova-compute[75341]:     </serial>
Nov 14 23:57:27 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 23:57:27 user nova-compute[75341]:     <video>
Nov 14 23:57:27 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:57:27 user nova-compute[75341]:     </video>
Nov 14 23:57:27 user nova-compute[75341]:     <rng model="virtio">
Nov 14 23:57:27 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 14 23:57:27 user nova-compute[75341]:     </rng>
Nov 14 23:57:27 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 14 23:57:27 user nova-compute[75341]:     <memballoon model="virtio">
Nov 14 23:57:27 user nova-compute[75341]:       <stats period="10"/>
Nov 14 23:57:27 user nova-compute[75341]:     </memballoon>
Nov 14 23:57:27 user nova-compute[75341]:   </devices>
Nov 14 23:57:27 user nova-compute[75341]: </domain>
Nov 14 23:57:27 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-12ba88f5-c38a-454e-9fcd-b9e93c713de4 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3265df3-dc0c-4004-9aea-21f6f7458bdf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a230abf-f727-4b44-b0b9-6a5ae84cb343\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:840153f3-4df1-48c2-b014-d536a282de51\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[97cfd0fc-988f-4a51-98fe-bcec4316cdf6]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840153f3-4df1-48c2-b014-d536a282de51 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a230abf-f727-4b44-b0b9-6a5ae84cb343 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a0b2bd3-ecd8-4221-9a4c-bf14ec2c0694 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)
Nov 14 23:57:27 user nova-compute[75341]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)
Nov 14 23:57:27 user nova-compute[75341]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840153f3-4df1-48c2-b014-d536a282de51 (non-flash)
Nov 14 23:57:27 user nova-compute[75341]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a230abf-f727-4b44-b0b9-6a5ae84cb343 (non-flash)
Nov 14 23:57:27 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a0b2bd3-ecd8-4221-9a4c-bf14ec2c0694 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)
Nov 14 23:57:27 user nova-compute[75341]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)
Nov 14 23:57:27 user nova-compute[75341]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840153f3-4df1-48c2-b014-d536a282de51 (non-flash)
Nov 14 23:57:27 user nova-compute[75341]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a230abf-f727-4b44-b0b9-6a5ae84cb343 (non-flash)
Nov 14 23:57:27 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a0b2bd3-ecd8-4221-9a4c-bf14ec2c0694 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18506d3490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:840153f3-4df1-48c2-b014-d536a282de51'): ({'sdd'}, set())}) {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-1a0b2bd3-ecd8-4221-9a4c-bf14ec2c0694 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Removing single pathed devices sdd {{(pid=75341) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[f167d380-d198-4120-8b56-89abdd5042ee]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe26415-0e26-45ef-a142-56f96bbd61e5]: (4, ('ok\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-1a0b2bd3-ecd8-4221-9a4c-bf14ec2c0694 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Flushing IO for device /dev/sdd {{(pid=75341) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73938ea-cffa-49ce-ad51-77e506e9f5a6]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-1a0b2bd3-ecd8-4221-9a4c-bf14ec2c0694 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75341) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.030s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b91745-1221-43dc-9c63-12e34468f3be]: (4, ('1', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-1a0b2bd3-ecd8-4221-9a4c-bf14ec2c0694 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-1a0b2bd3-ecd8-4221-9a4c-bf14ec2c0694 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] SCSI volumes sdd have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a0b2bd3-ecd8-4221-9a4c-bf14ec2c0694 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:840153f3-4df1-48c2-b014-d536a282de51')] {{(pid=75341) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:840153f3-4df1-48c2-b014-d536a282de51 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-12ba88f5-c38a-454e-9fcd-b9e93c713de4 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-12ba88f5-c38a-454e-9fcd-b9e93c713de4 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:840153f3-4df1-48c2-b014-d536a282de51 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9743a47-9612-48d0-aa60-4d0534898f7c]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a0b2bd3-ecd8-4221-9a4c-bf14ec2c0694 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:840153f3-4df1-48c2-b014-d536a282de51 -p 172.16.0.220:3260 --logout {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:840153f3-4df1-48c2-b014-d536a282de51 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0148b97-6c38-4ae6-8ff6-ce79ccf3d95e]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:840153f3-4df1-48c2-b014-d536a282de51, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:840153f3-4df1-48c2-b014-d536a282de51, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a0b2bd3-ecd8-4221-9a4c-bf14ec2c0694 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:840153f3-4df1-48c2-b014-d536a282de51, portal: 172.16.0.220,3260]
Nov 14 23:57:27 user nova-compute[75341]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:840153f3-4df1-48c2-b014-d536a282de51, portal: 172.16.0.220,3260] successful.
Nov 14 23:57:27 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:840153f3-4df1-48c2-b014-d536a282de51 -p 172.16.0.220:3260 --op delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:840153f3-4df1-48c2-b014-d536a282de51 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[69cdf600-cb97-4d9f-be91-47ca5e4759fa]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a0b2bd3-ecd8-4221-9a4c-bf14ec2c0694 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-1a0b2bd3-ecd8-4221-9a4c-bf14ec2c0694 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a0b2bd3-ecd8-4221-9a4c-bf14ec2c0694 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] <== disconnect_volume: return (363ms) None {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a0b2bd3-ecd8-4221-9a4c-bf14ec2c0694 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] Disconnected iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-12ba88f5-c38a-454e-9fcd-b9e93c713de4 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG nova.objects.instance [None req-12ba88f5-c38a-454e-9fcd-b9e93c713de4 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2316aa9e-d4c9-43d0-9918-86265583aed1 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG nova.objects.base [None req-12ba88f5-c38a-454e-9fcd-b9e93c713de4 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Object Instance<2316aa9e-d4c9-43d0-9918-86265583aed1> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75341) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-12ba88f5-c38a-454e-9fcd-b9e93c713de4 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-12ba88f5-c38a-454e-9fcd-b9e93c713de4 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.181s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-12ba88f5-c38a-454e-9fcd-b9e93c713de4 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/disk. size=1073741824 {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 23:57:27 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-12ba88f5-c38a-454e-9fcd-b9e93c713de4 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:57:28 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-12ba88f5-c38a-454e-9fcd-b9e93c713de4 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:57:28 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-12ba88f5-c38a-454e-9fcd-b9e93c713de4 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Cannot resize image /opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/disk to a smaller size. {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 23:57:28 user nova-compute[75341]: DEBUG nova.objects.instance [None req-12ba88f5-c38a-454e-9fcd-b9e93c713de4 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lazy-loading 'migration_context' on Instance uuid 2316aa9e-d4c9-43d0-9918-86265583aed1 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:57:28 user nova-compute[75341]: DEBUG nova.objects.base [None req-12ba88f5-c38a-454e-9fcd-b9e93c713de4 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Object Instance<2316aa9e-d4c9-43d0-9918-86265583aed1> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75341) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 23:57:28 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-12ba88f5-c38a-454e-9fcd-b9e93c713de4 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:49:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-154597700',display_name='tempest-AttachVolumeTestJSON-server-154597700',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-154597700',id=32,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaFgRJa61ME1XpWOzpNtbuqeAV1SySIMy7vrqCjTh61rgrkmD4lVtobnjyZbOLvU5WmBzUQHKYD/KyyedZ/uzEQoe71Auc/XFD5jRK6KaS6v9fK21UKVH1TMup4zwPhng==',key_name='tempest-keypair-1222319400',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:49:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='0e601d11e75d4ec4b7c05e615c67fe20',ramdisk_id='',reservation_id='r-2tbsxelf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1907700292',owner_user_name='tempest-AttachVolumeTestJSON-1907700292-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:55:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa84b131dff84566810c44b553b09ba8',uuid=2316aa9e-d4c9-43d0-9918-86265583aed1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "71caa935-899c-4716-9953-ae35733e691e", "address": "fa:16:3e:3d:1f:4a", "network": {"id": "167936c8-5f28-439e-9a1f-d9356b3a1ec9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374167607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e601d11e75d4ec4b7c05e615c67fe20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71caa935-89", "ovs_interfaceid": "71caa935-899c-4716-9953-ae35733e691e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 23:57:28 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-12ba88f5-c38a-454e-9fcd-b9e93c713de4 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Converting VIF {"id": "71caa935-899c-4716-9953-ae35733e691e", "address": "fa:16:3e:3d:1f:4a", "network": {"id": "167936c8-5f28-439e-9a1f-d9356b3a1ec9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374167607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e601d11e75d4ec4b7c05e615c67fe20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71caa935-89", "ovs_interfaceid": "71caa935-899c-4716-9953-ae35733e691e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:57:28 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-12ba88f5-c38a-454e-9fcd-b9e93c713de4 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:1f:4a,bridge_name='br-int',has_traffic_filtering=True,id=71caa935-899c-4716-9953-ae35733e691e,network=Network(167936c8-5f28-439e-9a1f-d9356b3a1ec9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71caa935-89') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:57:28 user nova-compute[75341]: DEBUG os_vif [None req-12ba88f5-c38a-454e-9fcd-b9e93c713de4 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:1f:4a,bridge_name='br-int',has_traffic_filtering=True,id=71caa935-899c-4716-9953-ae35733e691e,network=Network(167936c8-5f28-439e-9a1f-d9356b3a1ec9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71caa935-89') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 23:57:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:57:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:57:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 23:57:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:57:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bacad1c4-5f95-5d0b-b16d-03bac3402380', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:57:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:57:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:57:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:57:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap71caa935-89, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:57:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap71caa935-89, col_values=(('qos', UUID('ea6b7e77-8de3-4b19-b70b-d9ca5750b882')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:57:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap71caa935-89, col_values=(('external_ids', {'iface-id': '71caa935-899c-4716-9953-ae35733e691e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:1f:4a', 'vm-uuid': '2316aa9e-d4c9-43d0-9918-86265583aed1'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:57:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:57:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:57:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:57:28 user nova-compute[75341]: INFO os_vif [None req-12ba88f5-c38a-454e-9fcd-b9e93c713de4 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:1f:4a,bridge_name='br-int',has_traffic_filtering=True,id=71caa935-899c-4716-9953-ae35733e691e,network=Network(167936c8-5f28-439e-9a1f-d9356b3a1ec9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71caa935-89')
Nov 14 23:57:28 user nova-compute[75341]: DEBUG nova.objects.instance [None req-1a0b2bd3-ecd8-4221-9a4c-bf14ec2c0694 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lazy-loading 'flavor' on Instance uuid cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:57:28 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1a0b2bd3-ecd8-4221-9a4c-bf14ec2c0694 tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.678s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:57:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:57:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:57:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:57:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:57:29 user nova-compute[75341]: DEBUG nova.compute.manager [req-3615eaa9-405a-46b6-9672-532f53aac9a7 req-c4f7d417-3579-4204-b195-d1b00912174c service nova] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Received event network-vif-plugged-71caa935-899c-4716-9953-ae35733e691e {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:57:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-3615eaa9-405a-46b6-9672-532f53aac9a7 req-c4f7d417-3579-4204-b195-d1b00912174c service nova] Acquiring lock "2316aa9e-d4c9-43d0-9918-86265583aed1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:57:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-3615eaa9-405a-46b6-9672-532f53aac9a7 req-c4f7d417-3579-4204-b195-d1b00912174c service nova] Lock "2316aa9e-d4c9-43d0-9918-86265583aed1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:57:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-3615eaa9-405a-46b6-9672-532f53aac9a7 req-c4f7d417-3579-4204-b195-d1b00912174c service nova] Lock "2316aa9e-d4c9-43d0-9918-86265583aed1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:57:29 user nova-compute[75341]: DEBUG nova.compute.manager [req-3615eaa9-405a-46b6-9672-532f53aac9a7 req-c4f7d417-3579-4204-b195-d1b00912174c service nova] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] No waiting events found dispatching network-vif-plugged-71caa935-899c-4716-9953-ae35733e691e {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:57:29 user nova-compute[75341]: WARNING nova.compute.manager [req-3615eaa9-405a-46b6-9672-532f53aac9a7 req-c4f7d417-3579-4204-b195-d1b00912174c service nova] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Received unexpected event network-vif-plugged-71caa935-899c-4716-9953-ae35733e691e for instance with vm_state stopped and task_state powering-on.
Nov 14 23:57:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:57:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:57:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:57:30 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-d1510cf2-bbfd-47de-8d5f-a506afca0e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 53d7a6fe-3914-459a-9494-c75549af7b9f is timed out.
Nov 14 23:57:30 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-d1510cf2-bbfd-47de-8d5f-a506afca0e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Successfully detached device vdb from instance 53d7a6fe-3914-459a-9494-c75549af7b9f from the live domain config.
Nov 14 23:57:30 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1510cf2-bbfd-47de-8d5f-a506afca0e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] calling os-brick to detach iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 23:57:30 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1510cf2-bbfd-47de-8d5f-a506afca0e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, {'target_iqn': 'iqn.2010-10.org.openstack:4a230abf-f727-4b44-b0b9-6a5ae84cb343', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qVpfDbwx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:57:30 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-d1510cf2-bbfd-47de-8d5f-a506afca0e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:57:30 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-d1510cf2-bbfd-47de-8d5f-a506afca0e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:57:30 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-d1510cf2-bbfd-47de-8d5f-a506afca0e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:57:30 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:57:30 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:57:30 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6279a99-cbc3-44ba-ba65-c2a78be670f7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a230abf-f727-4b44-b0b9-6a5ae84cb343\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:57:30 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1510cf2-bbfd-47de-8d5f-a506afca0e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 23:57:30 user nova-compute[75341]: No targets found.
Nov 14 23:57:30 user nova-compute[75341]: iSNS:
Nov 14 23:57:30 user nova-compute[75341]: No targets found.
Nov 14 23:57:30 user nova-compute[75341]: STATIC:
Nov 14 23:57:30 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36
Nov 14 23:57:30 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:57:30 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:57:30 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:4a230abf-f727-4b44-b0b9-6a5ae84cb343
Nov 14 23:57:30 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:57:30 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:57:30 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00
Nov 14 23:57:30 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:57:30 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:57:30 user nova-compute[75341]: FIRMWARE:
Nov 14 23:57:30 user nova-compute[75341]: No targets found.
Nov 14 23:57:30 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:57:30 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1510cf2-bbfd-47de-8d5f-a506afca0e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 23:57:30 user nova-compute[75341]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 23:57:30 user nova-compute[75341]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75341) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 23:57:30 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1510cf2-bbfd-47de-8d5f-a506afca0e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a230abf-f727-4b44-b0b9-6a5ae84cb343', 0)] {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 23:57:30 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:57:30 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:57:30 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[3366f089-bf08-432d-a70e-067581602862]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a230abf-f727-4b44-b0b9-6a5ae84cb343\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:57:30 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:57:30 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:57:30 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[40beb2b3-3141-4cc2-8387-ebf9e7405ea0]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a230abf-f727-4b44-b0b9-6a5ae84cb343 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:57:30 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1510cf2-bbfd-47de-8d5f-a506afca0e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)
Nov 14 23:57:30 user nova-compute[75341]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)
Nov 14 23:57:30 user nova-compute[75341]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a230abf-f727-4b44-b0b9-6a5ae84cb343 (non-flash)
Nov 14 23:57:30 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:57:30 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1510cf2-bbfd-47de-8d5f-a506afca0e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)
Nov 14 23:57:30 user nova-compute[75341]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)
Nov 14 23:57:30 user nova-compute[75341]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a230abf-f727-4b44-b0b9-6a5ae84cb343 (non-flash)
Nov 14 23:57:30 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:57:30 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1510cf2-bbfd-47de-8d5f-a506afca0e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1870455870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a230abf-f727-4b44-b0b9-6a5ae84cb343'): ({'sde'}, set())}) {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 23:57:30 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-d1510cf2-bbfd-47de-8d5f-a506afca0e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Removing single pathed devices sde {{(pid=75341) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 23:57:30 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:57:30 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:57:30 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[7426764f-2760-4a54-8d84-ceea311ec894]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:57:30 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:57:30 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:57:30 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5799d0d-ca64-4776-b352-2fca92565f21]: (4, ('ok\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:57:30 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-d1510cf2-bbfd-47de-8d5f-a506afca0e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Flushing IO for device /dev/sde {{(pid=75341) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 23:57:30 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:57:30 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:57:30 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b7f83b-9150-41bf-87f2-36dd15610be8]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:57:30 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-d1510cf2-bbfd-47de-8d5f-a506afca0e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75341) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 23:57:30 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:57:30 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:57:30 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ab190b-3c14-4a2c-bc5b-c1b210951994]: (4, ('1', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:57:30 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-d1510cf2-bbfd-47de-8d5f-a506afca0e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 23:57:30 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-d1510cf2-bbfd-47de-8d5f-a506afca0e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] SCSI volumes sde have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 23:57:30 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1510cf2-bbfd-47de-8d5f-a506afca0e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a230abf-f727-4b44-b0b9-6a5ae84cb343')] {{(pid=75341) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 23:57:30 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a230abf-f727-4b44-b0b9-6a5ae84cb343 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:57:30 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a230abf-f727-4b44-b0b9-6a5ae84cb343 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:57:30 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc180f49-28e5-496a-8a67-18eea012cbb4]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:57:30 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1510cf2-bbfd-47de-8d5f-a506afca0e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:57:30 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a230abf-f727-4b44-b0b9-6a5ae84cb343 -p 172.16.0.220:3260 --logout {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:57:30 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a230abf-f727-4b44-b0b9-6a5ae84cb343 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:57:30 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c5debb0-534f-4fc6-b00a-0d2624bf5a9d]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:4a230abf-f727-4b44-b0b9-6a5ae84cb343, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:4a230abf-f727-4b44-b0b9-6a5ae84cb343, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:57:30 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1510cf2-bbfd-47de-8d5f-a506afca0e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:4a230abf-f727-4b44-b0b9-6a5ae84cb343, portal: 172.16.0.220,3260]
Nov 14 23:57:30 user nova-compute[75341]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:4a230abf-f727-4b44-b0b9-6a5ae84cb343, portal: 172.16.0.220,3260] successful.
Nov 14 23:57:30 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:57:30 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a230abf-f727-4b44-b0b9-6a5ae84cb343 -p 172.16.0.220:3260 --op delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:57:30 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a230abf-f727-4b44-b0b9-6a5ae84cb343 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:57:30 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbeee97d-410c-4e3e-a426-006db768e9b8]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:57:30 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1510cf2-bbfd-47de-8d5f-a506afca0e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:57:30 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-d1510cf2-bbfd-47de-8d5f-a506afca0e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:57:30 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1510cf2-bbfd-47de-8d5f-a506afca0e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] <== disconnect_volume: return (283ms) None {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:57:30 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1510cf2-bbfd-47de-8d5f-a506afca0e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Disconnected iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 23:57:31 user nova-compute[75341]: DEBUG nova.compute.manager [None req-12ba88f5-c38a-454e-9fcd-b9e93c713de4 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Instance event wait completed in 0 seconds for  {{(pid=75341) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 23:57:31 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Instance rebooted successfully.
Nov 14 23:57:31 user nova-compute[75341]: DEBUG nova.compute.manager [None req-12ba88f5-c38a-454e-9fcd-b9e93c713de4 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 23:57:31 user nova-compute[75341]: DEBUG nova.objects.instance [None req-d1510cf2-bbfd-47de-8d5f-a506afca0e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lazy-loading 'flavor' on Instance uuid 53d7a6fe-3914-459a-9494-c75549af7b9f {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:57:31 user nova-compute[75341]: DEBUG nova.compute.manager [req-62cd8004-2e8d-4353-8d7a-59789318ba55 req-5887c5c3-7af8-47b0-81f2-71e7d7b9475c service nova] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Received event network-vif-plugged-71caa935-899c-4716-9953-ae35733e691e {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:57:31 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-62cd8004-2e8d-4353-8d7a-59789318ba55 req-5887c5c3-7af8-47b0-81f2-71e7d7b9475c service nova] Acquiring lock "2316aa9e-d4c9-43d0-9918-86265583aed1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:57:31 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-62cd8004-2e8d-4353-8d7a-59789318ba55 req-5887c5c3-7af8-47b0-81f2-71e7d7b9475c service nova] Lock "2316aa9e-d4c9-43d0-9918-86265583aed1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:57:31 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-62cd8004-2e8d-4353-8d7a-59789318ba55 req-5887c5c3-7af8-47b0-81f2-71e7d7b9475c service nova] Lock "2316aa9e-d4c9-43d0-9918-86265583aed1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:57:31 user nova-compute[75341]: DEBUG nova.compute.manager [req-62cd8004-2e8d-4353-8d7a-59789318ba55 req-5887c5c3-7af8-47b0-81f2-71e7d7b9475c service nova] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] No waiting events found dispatching network-vif-plugged-71caa935-899c-4716-9953-ae35733e691e {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:57:31 user nova-compute[75341]: WARNING nova.compute.manager [req-62cd8004-2e8d-4353-8d7a-59789318ba55 req-5887c5c3-7af8-47b0-81f2-71e7d7b9475c service nova] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Received unexpected event network-vif-plugged-71caa935-899c-4716-9953-ae35733e691e for instance with vm_state active and task_state None.
Nov 14 23:57:31 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d1510cf2-bbfd-47de-8d5f-a506afca0e9a tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lock "53d7a6fe-3914-459a-9494-c75549af7b9f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.600s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:57:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:57:33 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:57:38 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:57:43 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:57:47 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:57:48 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:57:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:57:53 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:57:57 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-01be5972-b135-4fad-aea7-894a58a9a82e tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Acquiring lock "cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:57:57 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-01be5972-b135-4fad-aea7-894a58a9a82e tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:57:57 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-01be5972-b135-4fad-aea7-894a58a9a82e tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Acquiring lock "cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:57:57 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-01be5972-b135-4fad-aea7-894a58a9a82e tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:57:57 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-01be5972-b135-4fad-aea7-894a58a9a82e tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:57:57 user nova-compute[75341]: INFO nova.compute.manager [None req-01be5972-b135-4fad-aea7-894a58a9a82e tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] Terminating instance
Nov 14 23:57:57 user nova-compute[75341]: DEBUG nova.compute.manager [None req-01be5972-b135-4fad-aea7-894a58a9a82e tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] Start destroying the instance on the hypervisor. {{(pid=75341) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 23:57:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:57:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:57:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:57:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:57:57 user nova-compute[75341]: DEBUG nova.compute.manager [req-a5bd3e69-9c57-41f1-b7e4-cf3b629d3fca req-1043b645-5713-4664-a8f9-813576ecbf4c service nova] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] Received event network-vif-unplugged-a3595789-ed45-4588-a234-ac1682f304a1 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:57:57 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a5bd3e69-9c57-41f1-b7e4-cf3b629d3fca req-1043b645-5713-4664-a8f9-813576ecbf4c service nova] Acquiring lock "cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:57:57 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a5bd3e69-9c57-41f1-b7e4-cf3b629d3fca req-1043b645-5713-4664-a8f9-813576ecbf4c service nova] Lock "cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:57:57 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a5bd3e69-9c57-41f1-b7e4-cf3b629d3fca req-1043b645-5713-4664-a8f9-813576ecbf4c service nova] Lock "cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:57:57 user nova-compute[75341]: DEBUG nova.compute.manager [req-a5bd3e69-9c57-41f1-b7e4-cf3b629d3fca req-1043b645-5713-4664-a8f9-813576ecbf4c service nova] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] No waiting events found dispatching network-vif-unplugged-a3595789-ed45-4588-a234-ac1682f304a1 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:57:57 user nova-compute[75341]: DEBUG nova.compute.manager [req-a5bd3e69-9c57-41f1-b7e4-cf3b629d3fca req-1043b645-5713-4664-a8f9-813576ecbf4c service nova] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] Received event network-vif-unplugged-a3595789-ed45-4588-a234-ac1682f304a1 for instance with task_state deleting. {{(pid=75341) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 23:57:57 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] Instance destroyed successfully.
Nov 14 23:57:57 user nova-compute[75341]: DEBUG nova.objects.instance [None req-01be5972-b135-4fad-aea7-894a58a9a82e tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lazy-loading 'resources' on Instance uuid cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:57:57 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-01be5972-b135-4fad-aea7-894a58a9a82e tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:55:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-814064283',display_name='tempest-AttachVolumeNegativeTest-server-814064283',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-814064283',id=40,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAmK/AcbGyY7tn9Md9lo2LQ82r4mszW75NBOK6fzOspuqWHpRwk6vEJ42oV460fvfzuY67PwbF1tQd+nllEzYRyG5RiKAHkWOSpvirFrlzJ2Xe3CJyAcaUG36kneAGfSOw==',key_name='tempest-keypair-1191600092',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:55:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='542a85b3a6d14c77872f1957120ba655',ramdisk_id='',reservation_id='r-odqe6on6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-802469934',owner_user_name='tempest-AttachVolumeNegativeTest-802469934-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:55:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d0b6eae0d3124f70982781555ccc7ec0',uuid=cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a3595789-ed45-4588-a234-ac1682f304a1", "address": "fa:16:3e:b0:df:79", "network": {"id": "9ad7204e-07f5-4676-b2de-09e036a92e61", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-718201239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542a85b3a6d14c77872f1957120ba655", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3595789-ed", "ovs_interfaceid": "a3595789-ed45-4588-a234-ac1682f304a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 23:57:57 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-01be5972-b135-4fad-aea7-894a58a9a82e tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Converting VIF {"id": "a3595789-ed45-4588-a234-ac1682f304a1", "address": "fa:16:3e:b0:df:79", "network": {"id": "9ad7204e-07f5-4676-b2de-09e036a92e61", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-718201239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "542a85b3a6d14c77872f1957120ba655", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3595789-ed", "ovs_interfaceid": "a3595789-ed45-4588-a234-ac1682f304a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:57:57 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-01be5972-b135-4fad-aea7-894a58a9a82e tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:df:79,bridge_name='br-int',has_traffic_filtering=True,id=a3595789-ed45-4588-a234-ac1682f304a1,network=Network(9ad7204e-07f5-4676-b2de-09e036a92e61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3595789-ed') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:57:57 user nova-compute[75341]: DEBUG os_vif [None req-01be5972-b135-4fad-aea7-894a58a9a82e tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:df:79,bridge_name='br-int',has_traffic_filtering=True,id=a3595789-ed45-4588-a234-ac1682f304a1,network=Network(9ad7204e-07f5-4676-b2de-09e036a92e61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3595789-ed') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 23:57:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:57:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa3595789-ed, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:57:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:57:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:57:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=731dbd2a-0b42-4e4e-964b-28d949ae2fad) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:57:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:57:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:57:57 user nova-compute[75341]: INFO os_vif [None req-01be5972-b135-4fad-aea7-894a58a9a82e tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:df:79,bridge_name='br-int',has_traffic_filtering=True,id=a3595789-ed45-4588-a234-ac1682f304a1,network=Network(9ad7204e-07f5-4676-b2de-09e036a92e61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3595789-ed')
Nov 14 23:57:57 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-01be5972-b135-4fad-aea7-894a58a9a82e tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] Deleting instance files /opt/stack/data/nova/instances/cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e_del
Nov 14 23:57:57 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-01be5972-b135-4fad-aea7-894a58a9a82e tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] Deletion of /opt/stack/data/nova/instances/cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e_del complete
Nov 14 23:57:57 user nova-compute[75341]: INFO nova.compute.manager [None req-01be5972-b135-4fad-aea7-894a58a9a82e tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 14 23:57:57 user nova-compute[75341]: DEBUG oslo.service.loopingcall [None req-01be5972-b135-4fad-aea7-894a58a9a82e tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75341) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 23:57:57 user nova-compute[75341]: DEBUG nova.compute.manager [-] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] Deallocating network for instance {{(pid=75341) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 23:57:57 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] deallocate_for_instance() {{(pid=75341) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 23:57:58 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:57:58 user nova-compute[75341]: INFO nova.compute.manager [-] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] Took 0.76 seconds to deallocate network for instance.
Nov 14 23:57:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-01be5972-b135-4fad-aea7-894a58a9a82e tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:57:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-01be5972-b135-4fad-aea7-894a58a9a82e tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:57:58 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-01be5972-b135-4fad-aea7-894a58a9a82e tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:57:58 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-01be5972-b135-4fad-aea7-894a58a9a82e tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:57:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-01be5972-b135-4fad-aea7-894a58a9a82e tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.267s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:57:59 user nova-compute[75341]: INFO nova.scheduler.client.report [None req-01be5972-b135-4fad-aea7-894a58a9a82e tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Deleted allocations for instance cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e
Nov 14 23:57:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-01be5972-b135-4fad-aea7-894a58a9a82e tempest-AttachVolumeNegativeTest-802469934 tempest-AttachVolumeNegativeTest-802469934-project-member] Lock "cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.068s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:57:59 user nova-compute[75341]: DEBUG nova.compute.manager [req-8fdd37b3-40b2-4ac9-8f35-a4280970a23b req-715a79f1-6f97-4ce4-815c-bbb1dee1561c service nova] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] Received event network-vif-plugged-a3595789-ed45-4588-a234-ac1682f304a1 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:57:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-8fdd37b3-40b2-4ac9-8f35-a4280970a23b req-715a79f1-6f97-4ce4-815c-bbb1dee1561c service nova] Acquiring lock "cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:57:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-8fdd37b3-40b2-4ac9-8f35-a4280970a23b req-715a79f1-6f97-4ce4-815c-bbb1dee1561c service nova] Lock "cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:57:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-8fdd37b3-40b2-4ac9-8f35-a4280970a23b req-715a79f1-6f97-4ce4-815c-bbb1dee1561c service nova] Lock "cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:57:59 user nova-compute[75341]: DEBUG nova.compute.manager [req-8fdd37b3-40b2-4ac9-8f35-a4280970a23b req-715a79f1-6f97-4ce4-815c-bbb1dee1561c service nova] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] No waiting events found dispatching network-vif-plugged-a3595789-ed45-4588-a234-ac1682f304a1 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:57:59 user nova-compute[75341]: WARNING nova.compute.manager [req-8fdd37b3-40b2-4ac9-8f35-a4280970a23b req-715a79f1-6f97-4ce4-815c-bbb1dee1561c service nova] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] Received unexpected event network-vif-plugged-a3595789-ed45-4588-a234-ac1682f304a1 for instance with vm_state deleted and task_state None.
Nov 14 23:57:59 user nova-compute[75341]: DEBUG nova.compute.manager [req-8fdd37b3-40b2-4ac9-8f35-a4280970a23b req-715a79f1-6f97-4ce4-815c-bbb1dee1561c service nova] [instance: cc75b5bd-6edc-4bfd-a81c-4d86b7c50c1e] Received event network-vif-deleted-a3595789-ed45-4588-a234-ac1682f304a1 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:58:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:58:02 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:58:02 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:58:02 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:58:02 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:58:02 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:58:02 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75341) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 23:58:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:58:02 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:58:02 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Starting heal instance info cache {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 23:58:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "refresh_cache-6382e432-838f-4d89-a743-cbaa37f50ab5" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:58:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquired lock "refresh_cache-6382e432-838f-4d89-a743-cbaa37f50ab5" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:58:03 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Forcefully refreshing network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 23:58:03 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Updating instance_info_cache with network_info: [{"id": "61a9a4a7-170b-4ed9-8d52-8cb4defd1cae", "address": "fa:16:3e:0c:42:07", "network": {"id": "fcd22da6-016e-4872-a84c-4d82601c48d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-550677181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44bb8b1415c14bb59c4c35cc2b830875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61a9a4a7-17", "ovs_interfaceid": "61a9a4a7-170b-4ed9-8d52-8cb4defd1cae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:58:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Releasing lock "refresh_cache-6382e432-838f-4d89-a743-cbaa37f50ab5" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:58:03 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Updated the network info_cache for instance {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 23:58:03 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:58:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:58:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:58:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:58:03 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75341) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 23:58:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:58:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:58:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:58:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:58:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c62455e6-61af-45b1-899f-bad37dc57b22/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:58:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c62455e6-61af-45b1-899f-bad37dc57b22/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:58:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c62455e6-61af-45b1-899f-bad37dc57b22/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:58:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c62455e6-61af-45b1-899f-bad37dc57b22/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:58:04 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 23:58:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk.rescue --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:58:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:58:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk.rescue --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:58:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:58:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:58:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:58:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:58:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:58:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:58:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:58:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:58:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:58:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53d7a6fe-3914-459a-9494-c75549af7b9f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:58:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53d7a6fe-3914-459a-9494-c75549af7b9f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:58:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53d7a6fe-3914-459a-9494-c75549af7b9f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:58:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53d7a6fe-3914-459a-9494-c75549af7b9f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:58:06 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 23:58:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:58:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:58:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:58:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:58:06 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:58:06 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:58:06 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Hypervisor/Node resource view: name=user free_ram=8028MB free_disk=25.387569427490234GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75341) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 23:58:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:58:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:58:06 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 51045050-c7c6-49c5-acd4-2a76be0f466f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:58:06 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 6382e432-838f-4d89-a743-cbaa37f50ab5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:58:06 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance defae731-4191-4526-99cc-a301cf5b3355 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:58:06 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 2316aa9e-d4c9-43d0-9918-86265583aed1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:58:06 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 53d7a6fe-3914-459a-9494-c75549af7b9f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:58:06 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance c62455e6-61af-45b1-899f-bad37dc57b22 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:58:06 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance a80008bd-c61c-4a36-ae67-e556a5ecee08 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:58:06 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 23:58:06 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 23:58:07 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:58:07 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:58:07 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Compute_service record updated for user:user {{(pid=75341) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 23:58:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.399s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:58:07 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:58:07 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:58:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:58:07 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:58:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:58:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ad16ad51-8ba3-491f-b40e-2facc04e9b0e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Acquiring lock "53d7a6fe-3914-459a-9494-c75549af7b9f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:58:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ad16ad51-8ba3-491f-b40e-2facc04e9b0e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lock "53d7a6fe-3914-459a-9494-c75549af7b9f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:58:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ad16ad51-8ba3-491f-b40e-2facc04e9b0e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Acquiring lock "53d7a6fe-3914-459a-9494-c75549af7b9f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:58:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ad16ad51-8ba3-491f-b40e-2facc04e9b0e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lock "53d7a6fe-3914-459a-9494-c75549af7b9f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:58:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ad16ad51-8ba3-491f-b40e-2facc04e9b0e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lock "53d7a6fe-3914-459a-9494-c75549af7b9f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:58:16 user nova-compute[75341]: INFO nova.compute.manager [None req-ad16ad51-8ba3-491f-b40e-2facc04e9b0e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Terminating instance
Nov 14 23:58:16 user nova-compute[75341]: DEBUG nova.compute.manager [None req-ad16ad51-8ba3-491f-b40e-2facc04e9b0e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Start destroying the instance on the hypervisor. {{(pid=75341) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 23:58:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:58:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:58:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:58:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:58:16 user nova-compute[75341]: DEBUG nova.compute.manager [req-da5c1c07-6469-493b-813b-86b629bd9ef1 req-8b8354f0-6464-4d47-babc-ddc105073a95 service nova] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Received event network-vif-unplugged-d5f6d779-3733-459c-8144-771980cd9ec2 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:58:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-da5c1c07-6469-493b-813b-86b629bd9ef1 req-8b8354f0-6464-4d47-babc-ddc105073a95 service nova] Acquiring lock "53d7a6fe-3914-459a-9494-c75549af7b9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:58:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-da5c1c07-6469-493b-813b-86b629bd9ef1 req-8b8354f0-6464-4d47-babc-ddc105073a95 service nova] Lock "53d7a6fe-3914-459a-9494-c75549af7b9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:58:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-da5c1c07-6469-493b-813b-86b629bd9ef1 req-8b8354f0-6464-4d47-babc-ddc105073a95 service nova] Lock "53d7a6fe-3914-459a-9494-c75549af7b9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:58:16 user nova-compute[75341]: DEBUG nova.compute.manager [req-da5c1c07-6469-493b-813b-86b629bd9ef1 req-8b8354f0-6464-4d47-babc-ddc105073a95 service nova] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] No waiting events found dispatching network-vif-unplugged-d5f6d779-3733-459c-8144-771980cd9ec2 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:58:16 user nova-compute[75341]: DEBUG nova.compute.manager [req-da5c1c07-6469-493b-813b-86b629bd9ef1 req-8b8354f0-6464-4d47-babc-ddc105073a95 service nova] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Received event network-vif-unplugged-d5f6d779-3733-459c-8144-771980cd9ec2 for instance with task_state deleting. {{(pid=75341) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 23:58:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:58:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:58:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:58:16 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Instance destroyed successfully.
Nov 14 23:58:16 user nova-compute[75341]: DEBUG nova.objects.instance [None req-ad16ad51-8ba3-491f-b40e-2facc04e9b0e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lazy-loading 'resources' on Instance uuid 53d7a6fe-3914-459a-9494-c75549af7b9f {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:58:16 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-ad16ad51-8ba3-491f-b40e-2facc04e9b0e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:51:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-681502116',display_name='tempest-SnapshotDataIntegrityTests-server-681502116',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-681502116',id=37,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLQpn856CRdRcHXF04ZBaDcpmMr8f9QJqKbZvn67yvJ2et4428e2uD9evkuO8HpedKAkRPE5N41GsL4QOss0ZuQ2znxLa9tHwdKPsAK19iNK8UK439eMi+ccRS1bivR2ww==',key_name='tempest-keypair-1848879181',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:51:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='080d7a9c1501453d94616cf03ea12473',ramdisk_id='',reservation_id='r-ijvbsome',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1937652206',owner_user_name='tempest-SnapshotDataIntegrityTests-1937652206-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:51:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9a816d73a424b448157264f42acfaf4',uuid=53d7a6fe-3914-459a-9494-c75549af7b9f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d5f6d779-3733-459c-8144-771980cd9ec2", "address": "fa:16:3e:14:63:0c", "network": {"id": "e4c01dfd-427e-4d61-92e0-170e541b1fb9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2053751717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "080d7a9c1501453d94616cf03ea12473", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f6d779-37", "ovs_interfaceid": "d5f6d779-3733-459c-8144-771980cd9ec2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 23:58:16 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-ad16ad51-8ba3-491f-b40e-2facc04e9b0e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Converting VIF {"id": "d5f6d779-3733-459c-8144-771980cd9ec2", "address": "fa:16:3e:14:63:0c", "network": {"id": "e4c01dfd-427e-4d61-92e0-170e541b1fb9", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2053751717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "080d7a9c1501453d94616cf03ea12473", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f6d779-37", "ovs_interfaceid": "d5f6d779-3733-459c-8144-771980cd9ec2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:58:16 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-ad16ad51-8ba3-491f-b40e-2facc04e9b0e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:63:0c,bridge_name='br-int',has_traffic_filtering=True,id=d5f6d779-3733-459c-8144-771980cd9ec2,network=Network(e4c01dfd-427e-4d61-92e0-170e541b1fb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5f6d779-37') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:58:16 user nova-compute[75341]: DEBUG os_vif [None req-ad16ad51-8ba3-491f-b40e-2facc04e9b0e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:63:0c,bridge_name='br-int',has_traffic_filtering=True,id=d5f6d779-3733-459c-8144-771980cd9ec2,network=Network(e4c01dfd-427e-4d61-92e0-170e541b1fb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5f6d779-37') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 23:58:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:58:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd5f6d779-37, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:58:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:58:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:58:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:58:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cd32a4cd-e85c-4d56-b3e7-a7245075f8a2) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:58:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:58:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:58:16 user nova-compute[75341]: INFO os_vif [None req-ad16ad51-8ba3-491f-b40e-2facc04e9b0e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:63:0c,bridge_name='br-int',has_traffic_filtering=True,id=d5f6d779-3733-459c-8144-771980cd9ec2,network=Network(e4c01dfd-427e-4d61-92e0-170e541b1fb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5f6d779-37')
Nov 14 23:58:16 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-ad16ad51-8ba3-491f-b40e-2facc04e9b0e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Deleting instance files /opt/stack/data/nova/instances/53d7a6fe-3914-459a-9494-c75549af7b9f_del
Nov 14 23:58:16 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-ad16ad51-8ba3-491f-b40e-2facc04e9b0e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Deletion of /opt/stack/data/nova/instances/53d7a6fe-3914-459a-9494-c75549af7b9f_del complete
Nov 14 23:58:16 user nova-compute[75341]: INFO nova.compute.manager [None req-ad16ad51-8ba3-491f-b40e-2facc04e9b0e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 14 23:58:16 user nova-compute[75341]: DEBUG oslo.service.loopingcall [None req-ad16ad51-8ba3-491f-b40e-2facc04e9b0e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75341) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 23:58:16 user nova-compute[75341]: DEBUG nova.compute.manager [-] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Deallocating network for instance {{(pid=75341) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 23:58:16 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] deallocate_for_instance() {{(pid=75341) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 23:58:18 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:58:18 user nova-compute[75341]: INFO nova.compute.manager [-] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Took 1.16 seconds to deallocate network for instance.
Nov 14 23:58:18 user nova-compute[75341]: DEBUG nova.compute.manager [req-f0362c32-e25a-4e09-adc1-36820af30192 req-37d58456-e038-467a-afe3-112b4fdf1364 service nova] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Received event network-vif-deleted-d5f6d779-3733-459c-8144-771980cd9ec2 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:58:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ad16ad51-8ba3-491f-b40e-2facc04e9b0e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:58:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ad16ad51-8ba3-491f-b40e-2facc04e9b0e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:58:18 user nova-compute[75341]: DEBUG nova.compute.manager [req-2288fa43-95cf-4447-88ae-62999c0a8800 req-dc28b30b-64ff-4e57-938a-da85ec8bf640 service nova] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Received event network-vif-plugged-d5f6d779-3733-459c-8144-771980cd9ec2 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:58:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-2288fa43-95cf-4447-88ae-62999c0a8800 req-dc28b30b-64ff-4e57-938a-da85ec8bf640 service nova] Acquiring lock "53d7a6fe-3914-459a-9494-c75549af7b9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:58:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-2288fa43-95cf-4447-88ae-62999c0a8800 req-dc28b30b-64ff-4e57-938a-da85ec8bf640 service nova] Lock "53d7a6fe-3914-459a-9494-c75549af7b9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:58:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-2288fa43-95cf-4447-88ae-62999c0a8800 req-dc28b30b-64ff-4e57-938a-da85ec8bf640 service nova] Lock "53d7a6fe-3914-459a-9494-c75549af7b9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:58:18 user nova-compute[75341]: DEBUG nova.compute.manager [req-2288fa43-95cf-4447-88ae-62999c0a8800 req-dc28b30b-64ff-4e57-938a-da85ec8bf640 service nova] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] No waiting events found dispatching network-vif-plugged-d5f6d779-3733-459c-8144-771980cd9ec2 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:58:18 user nova-compute[75341]: WARNING nova.compute.manager [req-2288fa43-95cf-4447-88ae-62999c0a8800 req-dc28b30b-64ff-4e57-938a-da85ec8bf640 service nova] [instance: 53d7a6fe-3914-459a-9494-c75549af7b9f] Received unexpected event network-vif-plugged-d5f6d779-3733-459c-8144-771980cd9ec2 for instance with vm_state deleted and task_state None.
Nov 14 23:58:18 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-ad16ad51-8ba3-491f-b40e-2facc04e9b0e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:58:18 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-ad16ad51-8ba3-491f-b40e-2facc04e9b0e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:58:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ad16ad51-8ba3-491f-b40e-2facc04e9b0e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.287s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:58:18 user nova-compute[75341]: INFO nova.scheduler.client.report [None req-ad16ad51-8ba3-491f-b40e-2facc04e9b0e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Deleted allocations for instance 53d7a6fe-3914-459a-9494-c75549af7b9f
Nov 14 23:58:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ad16ad51-8ba3-491f-b40e-2facc04e9b0e tempest-SnapshotDataIntegrityTests-1937652206 tempest-SnapshotDataIntegrityTests-1937652206-project-member] Lock "53d7a6fe-3914-459a-9494-c75549af7b9f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.490s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:58:21 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:58:23 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Acquiring lock "c3524e47-34b3-4b33-a1ff-25a8e4f35d86" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:58:23 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "c3524e47-34b3-4b33-a1ff-25a8e4f35d86" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:58:23 user nova-compute[75341]: DEBUG nova.compute.manager [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Starting instance... {{(pid=75341) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 23:58:23 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:58:23 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:58:23 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75341) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 23:58:23 user nova-compute[75341]: INFO nova.compute.claims [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Claim successful on node user
Nov 14 23:58:24 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:58:24 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:58:24 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.343s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:58:24 user nova-compute[75341]: DEBUG nova.compute.manager [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Start building networks asynchronously for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 23:58:24 user nova-compute[75341]: DEBUG nova.compute.manager [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Allocating IP information in the background. {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 23:58:24 user nova-compute[75341]: DEBUG nova.network.neutron [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] allocate_for_instance() {{(pid=75341) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 23:58:24 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 23:58:24 user nova-compute[75341]: DEBUG nova.compute.manager [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Start building block device mappings for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 23:58:24 user nova-compute[75341]: INFO nova.virt.block_device [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Booting with volume 47542c09-3d82-4329-8a27-3650d4e00123 at /dev/vda
Nov 14 23:58:24 user nova-compute[75341]: DEBUG nova.policy [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '442aae0161f347d0a79b168a1b60286a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c69a942b4f4b97a1a3152dea86c7fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75341) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 23:58:24 user nova-compute[75341]: DEBUG os_brick.utils [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:58:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:58:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:58:24 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a4b025-9c84-4bd9-880a-8c81c280acdb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6d1cfca09c9\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:58:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:58:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:58:24 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[3354f718-fd2e-4606-8c0c-9d53da54fed8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:58:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:58:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:58:24 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce4be98-eaa2-4b35-988b-658712dafbe6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:58:24 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[87289038-c45f-47c7-a4b6-58cbffc6ae00]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:58:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Running cmd (subprocess): nvme version {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:58:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] 'nvme version' failed. Not Retrying. {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:58:24 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.nvmeof [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] nvme not present on system {{(pid=75341) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 23:58:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:58:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:58:24 user nova-compute[75341]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 23:58:24 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[8606dc24-a7fd-48f0-b28d-c3aa90a4c9fe]: (4, '') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:58:24 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75341) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 23:58:24 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 23:58:24 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] LIGHTOS: no hostnqn found. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 23:58:24 user nova-compute[75341]: DEBUG os_brick.utils [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6d1cfca09c9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:58:24 user nova-compute[75341]: DEBUG nova.virt.block_device [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Updating existing volume attachment record: 9fea8ac8-6efb-4534-bd1f-1379ffbc949d {{(pid=75341) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 23:58:25 user nova-compute[75341]: DEBUG nova.network.neutron [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Successfully created port: 50f461fb-27ee-438f-880c-cde1e7441cfe {{(pid=75341) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 23:58:25 user nova-compute[75341]: DEBUG nova.network.neutron [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Successfully updated port: 50f461fb-27ee-438f-880c-cde1e7441cfe {{(pid=75341) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 23:58:25 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Acquiring lock "refresh_cache-c3524e47-34b3-4b33-a1ff-25a8e4f35d86" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:58:25 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Acquired lock "refresh_cache-c3524e47-34b3-4b33-a1ff-25a8e4f35d86" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:58:25 user nova-compute[75341]: DEBUG nova.network.neutron [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 23:58:25 user nova-compute[75341]: DEBUG nova.compute.manager [req-8b8b6a0b-ec08-4e2f-888e-d30747eae3a2 req-02a61d6d-2563-4246-8e2a-6a8a3febfb4c service nova] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Received event network-changed-50f461fb-27ee-438f-880c-cde1e7441cfe {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:58:25 user nova-compute[75341]: DEBUG nova.compute.manager [req-8b8b6a0b-ec08-4e2f-888e-d30747eae3a2 req-02a61d6d-2563-4246-8e2a-6a8a3febfb4c service nova] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Refreshing instance network info cache due to event network-changed-50f461fb-27ee-438f-880c-cde1e7441cfe. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:58:25 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-8b8b6a0b-ec08-4e2f-888e-d30747eae3a2 req-02a61d6d-2563-4246-8e2a-6a8a3febfb4c service nova] Acquiring lock "refresh_cache-c3524e47-34b3-4b33-a1ff-25a8e4f35d86" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:58:26 user nova-compute[75341]: DEBUG nova.network.neutron [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Instance cache missing network info. {{(pid=75341) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 23:58:26 user nova-compute[75341]: DEBUG nova.network.neutron [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Updating instance_info_cache with network_info: [{"id": "50f461fb-27ee-438f-880c-cde1e7441cfe", "address": "fa:16:3e:26:50:43", "network": {"id": "d86a8e7f-6658-4994-9a13-eb3163bd3865", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-635863702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c69a942b4f4b97a1a3152dea86c7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f461fb-27", "ovs_interfaceid": "50f461fb-27ee-438f-880c-cde1e7441cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:58:26 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Releasing lock "refresh_cache-c3524e47-34b3-4b33-a1ff-25a8e4f35d86" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:58:26 user nova-compute[75341]: DEBUG nova.compute.manager [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Instance network_info: |[{"id": "50f461fb-27ee-438f-880c-cde1e7441cfe", "address": "fa:16:3e:26:50:43", "network": {"id": "d86a8e7f-6658-4994-9a13-eb3163bd3865", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-635863702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c69a942b4f4b97a1a3152dea86c7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f461fb-27", "ovs_interfaceid": "50f461fb-27ee-438f-880c-cde1e7441cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 23:58:26 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-8b8b6a0b-ec08-4e2f-888e-d30747eae3a2 req-02a61d6d-2563-4246-8e2a-6a8a3febfb4c service nova] Acquired lock "refresh_cache-c3524e47-34b3-4b33-a1ff-25a8e4f35d86" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:58:26 user nova-compute[75341]: DEBUG nova.network.neutron [req-8b8b6a0b-ec08-4e2f-888e-d30747eae3a2 req-02a61d6d-2563-4246-8e2a-6a8a3febfb4c service nova] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Refreshing network info cache for port 50f461fb-27ee-438f-880c-cde1e7441cfe {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:58:26 user nova-compute[75341]: DEBUG nova.network.neutron [req-8b8b6a0b-ec08-4e2f-888e-d30747eae3a2 req-02a61d6d-2563-4246-8e2a-6a8a3febfb4c service nova] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Updated VIF entry in instance network info cache for port 50f461fb-27ee-438f-880c-cde1e7441cfe. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:58:26 user nova-compute[75341]: DEBUG nova.network.neutron [req-8b8b6a0b-ec08-4e2f-888e-d30747eae3a2 req-02a61d6d-2563-4246-8e2a-6a8a3febfb4c service nova] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Updating instance_info_cache with network_info: [{"id": "50f461fb-27ee-438f-880c-cde1e7441cfe", "address": "fa:16:3e:26:50:43", "network": {"id": "d86a8e7f-6658-4994-9a13-eb3163bd3865", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-635863702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c69a942b4f4b97a1a3152dea86c7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f461fb-27", "ovs_interfaceid": "50f461fb-27ee-438f-880c-cde1e7441cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:58:26 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-8b8b6a0b-ec08-4e2f-888e-d30747eae3a2 req-02a61d6d-2563-4246-8e2a-6a8a3febfb4c service nova] Releasing lock "refresh_cache-c3524e47-34b3-4b33-a1ff-25a8e4f35d86" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:58:26 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:58:26 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:58:26 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 23:58:26 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 23:58:26 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 23:58:26 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG nova.compute.manager [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Start spawning the instance on the hypervisor. {{(pid=75341) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Creating instance directory {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 23:58:29 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Creating image(s)
Nov 14 23:58:29 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Did not create local disks {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Ensure instance console log exists: /opt/stack/data/nova/instances/c3524e47-34b3-4b33-a1ff-25a8e4f35d86/console.log {{(pid=75341) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Start _get_guest_xml network_info=[{"id": "50f461fb-27ee-438f-880c-cde1e7441cfe", "address": "fa:16:3e:26:50:43", "network": {"id": "d86a8e7f-6658-4994-9a13-eb3163bd3865", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-635863702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c69a942b4f4b97a1a3152dea86c7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f461fb-27", "ovs_interfaceid": "50f461fb-27ee-438f-880c-cde1e7441cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '9fea8ac8-6efb-4534-bd1f-1379ffbc949d', 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NaWvjfqe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c3524e47-34b3-4b33-a1ff-25a8e4f35d86', 'attached_at': '', 'detached_at': '', 'volume_id': '47542c09-3d82-4329-8a27-3650d4e00123', 'serial': '47542c09-3d82-4329-8a27-3650d4e00123'}, 'delete_on_termination': True, 'volume_type': None} {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 23:58:29 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:58:29 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:58:29 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Calling os-brick to attach iSCSI Volume {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NaWvjfqe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:58:29 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:58:29 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:58:29 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:58:29 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:58:29 user nova-compute[75341]: INFO os_brick.initiator.connectors.iscsi [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 23:58:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 -p 172.16.0.220:3260 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd338ca-5c4b-41f4-b06f-c0f4839212e9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 23:58:29 user nova-compute[75341]:  {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 -p 172.16.0.220:3260 --interface default --op new {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9c05a7-8374-4608-927a-10bfab5ee787]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123] added\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123] added
Nov 14 23:58:29 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d7ec13-f759-43a1-8e15-c3ba608849bb]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e45e31-19d4-4907-bb2a-90f4db481537]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NaWvjfqe {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NaWvjfqe" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[e12f4647-f270-4728-b95f-1a1ec2380358]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NaWvjfqe'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35a90a4-acff-49a1-8b34-7a859832d3b0]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c53b76-02b2-49d2-8941-bde0f4c013b8]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)
Nov 14 23:58:29 user nova-compute[75341]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)
Nov 14 23:58:29 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)
Nov 14 23:58:29 user nova-compute[75341]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)
Nov 14 23:58:29 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 -p 172.16.0.220:3260 --login {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe7c54b-a89c-43a5-a3d8-087637c70efa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123, portal: 172.16.0.220,3260]
Nov 14 23:58:29 user nova-compute[75341]: Login to [iface: default, target: iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123, portal: 172.16.0.220,3260] successful.
Nov 14 23:58:29 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.114s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd38777a-13a7-49ff-a5e8-319d6cce9d55]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[959de436-455f-4d45-a1a3-7b7b476db53b]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)
Nov 14 23:58:29 user nova-compute[75341]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)
Nov 14 23:58:29 user nova-compute[75341]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 (non-flash)
Nov 14 23:58:29 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)
Nov 14 23:58:29 user nova-compute[75341]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)
Nov 14 23:58:29 user nova-compute[75341]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 (non-flash)
Nov 14 23:58:29 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.356s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Connected to 172.16.0.220:3260 {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] HCTL ('35', '-', '-', 0) found on session 50 with lun 0 {{(pid=75341) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75341) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[00dbff8b-eee5-4c95-8dc0-87ea2bf565ec]: (4, ('- - 0', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Searching for a device in session 50 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 23:58:29 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NaWvjfqe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 23:58:30 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.389s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:58:30 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] <== connect_volume: return (1391ms) {'type': 'block', 'scsi_wwn': '26361306538376533', 'path': '/dev/sdd'} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:58:30 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361306538376533', 'path': '/dev/sdd'} {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 23:58:30 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:58:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1599301259',display_name='tempest-ServerActionsTestOtherA-server-1599301259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1599301259',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTmBE+Takjbl0ZrUdtoD/FDS2CHZC4n75Y/1LCLwXLZHE8J0GqhfVD/envyBMKYWUkAGQH/bKcOVnVKa4qF07KOQ/PvMrk+gG45OxOvZ8A6PGkmy0qPqzF8MOOmxhYzVQ==',key_name='tempest-keypair-1744456340',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4c69a942b4f4b97a1a3152dea86c7fb',ramdisk_id='',reservation_id='r-dgx5dk1c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1796396043',owner_user_name='tempest-ServerActionsTestOtherA-1796396043-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:58:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='442aae0161f347d0a79b168a1b60286a',uuid=c3524e47-34b3-4b33-a1ff-25a8e4f35d86,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50f461fb-27ee-438f-880c-cde1e7441cfe", "address": "fa:16:3e:26:50:43", "network": {"id": "d86a8e7f-6658-4994-9a13-eb3163bd3865", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-635863702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c69a942b4f4b97a1a3152dea86c7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f461fb-27", "ovs_interfaceid": "50f461fb-27ee-438f-880c-cde1e7441cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:58:30 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Converting VIF {"id": "50f461fb-27ee-438f-880c-cde1e7441cfe", "address": "fa:16:3e:26:50:43", "network": {"id": "d86a8e7f-6658-4994-9a13-eb3163bd3865", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-635863702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c69a942b4f4b97a1a3152dea86c7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f461fb-27", "ovs_interfaceid": "50f461fb-27ee-438f-880c-cde1e7441cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:58:30 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:50:43,bridge_name='br-int',has_traffic_filtering=True,id=50f461fb-27ee-438f-880c-cde1e7441cfe,network=Network(d86a8e7f-6658-4994-9a13-eb3163bd3865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50f461fb-27') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:58:30 user nova-compute[75341]: DEBUG nova.objects.instance [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lazy-loading 'pci_devices' on Instance uuid c3524e47-34b3-4b33-a1ff-25a8e4f35d86 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:58:30 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] End _get_guest_xml xml=<domain type="kvm">
Nov 14 23:58:30 user nova-compute[75341]:   <uuid>c3524e47-34b3-4b33-a1ff-25a8e4f35d86</uuid>
Nov 14 23:58:30 user nova-compute[75341]:   <name>instance-0000002a</name>
Nov 14 23:58:30 user nova-compute[75341]:   <memory>524288</memory>
Nov 14 23:58:30 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 14 23:58:30 user nova-compute[75341]:   <metadata>
Nov 14 23:58:30 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 23:58:30 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 14 23:58:30 user nova-compute[75341]:       <nova:name>tempest-ServerActionsTestOtherA-server-1599301259</nova:name>
Nov 14 23:58:30 user nova-compute[75341]:       <nova:creationTime>2023-11-14 23:58:29</nova:creationTime>
Nov 14 23:58:30 user nova-compute[75341]:       <nova:flavor name="m1.tiny">
Nov 14 23:58:30 user nova-compute[75341]:         <nova:memory>512</nova:memory>
Nov 14 23:58:30 user nova-compute[75341]:         <nova:disk>1</nova:disk>
Nov 14 23:58:30 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 14 23:58:30 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 23:58:30 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 14 23:58:30 user nova-compute[75341]:       </nova:flavor>
Nov 14 23:58:30 user nova-compute[75341]:       <nova:owner>
Nov 14 23:58:30 user nova-compute[75341]:         <nova:user uuid="442aae0161f347d0a79b168a1b60286a">tempest-ServerActionsTestOtherA-1796396043-project-member</nova:user>
Nov 14 23:58:30 user nova-compute[75341]:         <nova:project uuid="f4c69a942b4f4b97a1a3152dea86c7fb">tempest-ServerActionsTestOtherA-1796396043</nova:project>
Nov 14 23:58:30 user nova-compute[75341]:       </nova:owner>
Nov 14 23:58:30 user nova-compute[75341]:       <nova:ports>
Nov 14 23:58:30 user nova-compute[75341]:         <nova:port uuid="50f461fb-27ee-438f-880c-cde1e7441cfe">
Nov 14 23:58:30 user nova-compute[75341]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 23:58:30 user nova-compute[75341]:         </nova:port>
Nov 14 23:58:30 user nova-compute[75341]:       </nova:ports>
Nov 14 23:58:30 user nova-compute[75341]:     </nova:instance>
Nov 14 23:58:30 user nova-compute[75341]:   </metadata>
Nov 14 23:58:30 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 14 23:58:30 user nova-compute[75341]:     <system>
Nov 14 23:58:30 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 23:58:30 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 14 23:58:30 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 14 23:58:30 user nova-compute[75341]:       <entry name="serial">c3524e47-34b3-4b33-a1ff-25a8e4f35d86</entry>
Nov 14 23:58:30 user nova-compute[75341]:       <entry name="uuid">c3524e47-34b3-4b33-a1ff-25a8e4f35d86</entry>
Nov 14 23:58:30 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 14 23:58:30 user nova-compute[75341]:     </system>
Nov 14 23:58:30 user nova-compute[75341]:   </sysinfo>
Nov 14 23:58:30 user nova-compute[75341]:   <os>
Nov 14 23:58:30 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 23:58:30 user nova-compute[75341]:     <boot dev="hd"/>
Nov 14 23:58:30 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 14 23:58:30 user nova-compute[75341]:   </os>
Nov 14 23:58:30 user nova-compute[75341]:   <features>
Nov 14 23:58:30 user nova-compute[75341]:     <acpi/>
Nov 14 23:58:30 user nova-compute[75341]:     <apic/>
Nov 14 23:58:30 user nova-compute[75341]:     <vmcoreinfo/>
Nov 14 23:58:30 user nova-compute[75341]:   </features>
Nov 14 23:58:30 user nova-compute[75341]:   <clock offset="utc">
Nov 14 23:58:30 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 23:58:30 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 23:58:30 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 14 23:58:30 user nova-compute[75341]:   </clock>
Nov 14 23:58:30 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 14 23:58:30 user nova-compute[75341]:     <model>Nehalem</model>
Nov 14 23:58:30 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 23:58:30 user nova-compute[75341]:   </cpu>
Nov 14 23:58:30 user nova-compute[75341]:   <devices>
Nov 14 23:58:30 user nova-compute[75341]:     <disk type="block" device="disk">
Nov 14 23:58:30 user nova-compute[75341]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:58:30 user nova-compute[75341]:       <source dev="/dev/sdd"/>
Nov 14 23:58:30 user nova-compute[75341]:       <target dev="vda" bus="virtio"/>
Nov 14 23:58:30 user nova-compute[75341]:       <serial>47542c09-3d82-4329-8a27-3650d4e00123</serial>
Nov 14 23:58:30 user nova-compute[75341]:     </disk>
Nov 14 23:58:30 user nova-compute[75341]:     <interface type="ethernet">
Nov 14 23:58:30 user nova-compute[75341]:       <mac address="fa:16:3e:26:50:43"/>
Nov 14 23:58:30 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:58:30 user nova-compute[75341]:       <mtu size="1442"/>
Nov 14 23:58:30 user nova-compute[75341]:       <target dev="tap50f461fb-27"/>
Nov 14 23:58:30 user nova-compute[75341]:     </interface>
Nov 14 23:58:30 user nova-compute[75341]:     <serial type="pty">
Nov 14 23:58:30 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/c3524e47-34b3-4b33-a1ff-25a8e4f35d86/console.log" append="off"/>
Nov 14 23:58:30 user nova-compute[75341]:     </serial>
Nov 14 23:58:30 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 23:58:30 user nova-compute[75341]:     <video>
Nov 14 23:58:30 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:58:30 user nova-compute[75341]:     </video>
Nov 14 23:58:30 user nova-compute[75341]:     <rng model="virtio">
Nov 14 23:58:30 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 14 23:58:30 user nova-compute[75341]:     </rng>
Nov 14 23:58:30 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 14 23:58:30 user nova-compute[75341]:     <memballoon model="virtio">
Nov 14 23:58:30 user nova-compute[75341]:       <stats period="10"/>
Nov 14 23:58:30 user nova-compute[75341]:     </memballoon>
Nov 14 23:58:30 user nova-compute[75341]:   </devices>
Nov 14 23:58:30 user nova-compute[75341]: </domain>
Nov 14 23:58:30 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 23:58:30 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:58:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1599301259',display_name='tempest-ServerActionsTestOtherA-server-1599301259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1599301259',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTmBE+Takjbl0ZrUdtoD/FDS2CHZC4n75Y/1LCLwXLZHE8J0GqhfVD/envyBMKYWUkAGQH/bKcOVnVKa4qF07KOQ/PvMrk+gG45OxOvZ8A6PGkmy0qPqzF8MOOmxhYzVQ==',key_name='tempest-keypair-1744456340',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4c69a942b4f4b97a1a3152dea86c7fb',ramdisk_id='',reservation_id='r-dgx5dk1c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1796396043',owner_user_name='tempest-ServerActionsTestOtherA-1796396043-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:58:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='442aae0161f347d0a79b168a1b60286a',uuid=c3524e47-34b3-4b33-a1ff-25a8e4f35d86,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50f461fb-27ee-438f-880c-cde1e7441cfe", "address": "fa:16:3e:26:50:43", "network": {"id": "d86a8e7f-6658-4994-9a13-eb3163bd3865", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-635863702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c69a942b4f4b97a1a3152dea86c7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f461fb-27", "ovs_interfaceid": "50f461fb-27ee-438f-880c-cde1e7441cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 23:58:30 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Converting VIF {"id": "50f461fb-27ee-438f-880c-cde1e7441cfe", "address": "fa:16:3e:26:50:43", "network": {"id": "d86a8e7f-6658-4994-9a13-eb3163bd3865", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-635863702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c69a942b4f4b97a1a3152dea86c7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f461fb-27", "ovs_interfaceid": "50f461fb-27ee-438f-880c-cde1e7441cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:58:30 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:50:43,bridge_name='br-int',has_traffic_filtering=True,id=50f461fb-27ee-438f-880c-cde1e7441cfe,network=Network(d86a8e7f-6658-4994-9a13-eb3163bd3865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50f461fb-27') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:58:30 user nova-compute[75341]: DEBUG os_vif [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:50:43,bridge_name='br-int',has_traffic_filtering=True,id=50f461fb-27ee-438f-880c-cde1e7441cfe,network=Network(d86a8e7f-6658-4994-9a13-eb3163bd3865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50f461fb-27') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 23:58:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:58:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:58:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 23:58:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:58:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7a7f26c6-10e7-53a2-887e-f5ea6faedaa2', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:58:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:58:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:58:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:58:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap50f461fb-27, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:58:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap50f461fb-27, col_values=(('qos', UUID('e9c98564-40f1-49da-92b8-8e0fd42a5ef7')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:58:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap50f461fb-27, col_values=(('external_ids', {'iface-id': '50f461fb-27ee-438f-880c-cde1e7441cfe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:50:43', 'vm-uuid': 'c3524e47-34b3-4b33-a1ff-25a8e4f35d86'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:58:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:58:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:58:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:58:30 user nova-compute[75341]: INFO os_vif [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:50:43,bridge_name='br-int',has_traffic_filtering=True,id=50f461fb-27ee-438f-880c-cde1e7441cfe,network=Network(d86a8e7f-6658-4994-9a13-eb3163bd3865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50f461fb-27')
Nov 14 23:58:30 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:58:30 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] No VIF found with MAC fa:16:3e:26:50:43, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:58:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:58:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:58:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:58:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:58:32 user nova-compute[75341]: DEBUG nova.compute.manager [req-c9b27f3d-f93e-4bba-98e2-424bca1dcea4 req-2cf2b6ee-651e-4fde-b8ff-b575bd6c3cc2 service nova] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Received event network-vif-plugged-50f461fb-27ee-438f-880c-cde1e7441cfe {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:58:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-c9b27f3d-f93e-4bba-98e2-424bca1dcea4 req-2cf2b6ee-651e-4fde-b8ff-b575bd6c3cc2 service nova] Acquiring lock "c3524e47-34b3-4b33-a1ff-25a8e4f35d86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:58:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-c9b27f3d-f93e-4bba-98e2-424bca1dcea4 req-2cf2b6ee-651e-4fde-b8ff-b575bd6c3cc2 service nova] Lock "c3524e47-34b3-4b33-a1ff-25a8e4f35d86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:58:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-c9b27f3d-f93e-4bba-98e2-424bca1dcea4 req-2cf2b6ee-651e-4fde-b8ff-b575bd6c3cc2 service nova] Lock "c3524e47-34b3-4b33-a1ff-25a8e4f35d86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:58:32 user nova-compute[75341]: DEBUG nova.compute.manager [req-c9b27f3d-f93e-4bba-98e2-424bca1dcea4 req-2cf2b6ee-651e-4fde-b8ff-b575bd6c3cc2 service nova] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] No waiting events found dispatching network-vif-plugged-50f461fb-27ee-438f-880c-cde1e7441cfe {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:58:32 user nova-compute[75341]: WARNING nova.compute.manager [req-c9b27f3d-f93e-4bba-98e2-424bca1dcea4 req-2cf2b6ee-651e-4fde-b8ff-b575bd6c3cc2 service nova] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Received unexpected event network-vif-plugged-50f461fb-27ee-438f-880c-cde1e7441cfe for instance with vm_state building and task_state spawning.
Nov 14 23:58:33 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a118f019-0f38-4f3c-9948-d0b3b06e76c6 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Acquiring lock "c62455e6-61af-45b1-899f-bad37dc57b22" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:58:33 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a118f019-0f38-4f3c-9948-d0b3b06e76c6 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "c62455e6-61af-45b1-899f-bad37dc57b22" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:58:33 user nova-compute[75341]: INFO nova.compute.manager [None req-a118f019-0f38-4f3c-9948-d0b3b06e76c6 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Detaching volume fc6f285e-df58-4f26-b0d1-9b3344d9fc00
Nov 14 23:58:33 user nova-compute[75341]: INFO nova.virt.block_device [None req-a118f019-0f38-4f3c-9948-d0b3b06e76c6 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Attempting to driver detach volume fc6f285e-df58-4f26-b0d1-9b3344d9fc00 from mountpoint /dev/vdb
Nov 14 23:58:33 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a118f019-0f38-4f3c-9948-d0b3b06e76c6 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Attempting to detach device vdb from instance c62455e6-61af-45b1-899f-bad37dc57b22 from the persistent domain config. {{(pid=75341) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 23:58:33 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-a118f019-0f38-4f3c-9948-d0b3b06e76c6 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 23:58:33 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:58:33 user nova-compute[75341]:   <source dev="/dev/sdc"/>
Nov 14 23:58:33 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:58:33 user nova-compute[75341]:   <serial>fc6f285e-df58-4f26-b0d1-9b3344d9fc00</serial>
Nov 14 23:58:33 user nova-compute[75341]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 23:58:33 user nova-compute[75341]: </disk>
Nov 14 23:58:33 user nova-compute[75341]:  {{(pid=75341) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 23:58:33 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-a118f019-0f38-4f3c-9948-d0b3b06e76c6 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Successfully detached device vdb from instance c62455e6-61af-45b1-899f-bad37dc57b22 from the persistent domain config.
Nov 14 23:58:33 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a118f019-0f38-4f3c-9948-d0b3b06e76c6 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c62455e6-61af-45b1-899f-bad37dc57b22 from the live domain config. {{(pid=75341) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 23:58:33 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-a118f019-0f38-4f3c-9948-d0b3b06e76c6 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 23:58:33 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:58:33 user nova-compute[75341]:   <source dev="/dev/sdc"/>
Nov 14 23:58:33 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:58:33 user nova-compute[75341]:   <serial>fc6f285e-df58-4f26-b0d1-9b3344d9fc00</serial>
Nov 14 23:58:33 user nova-compute[75341]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 23:58:33 user nova-compute[75341]: </disk>
Nov 14 23:58:33 user nova-compute[75341]:  {{(pid=75341) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 23:58:34 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a118f019-0f38-4f3c-9948-d0b3b06e76c6 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c62455e6-61af-45b1-899f-bad37dc57b22 {{(pid=75341) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 23:58:34 user nova-compute[75341]: DEBUG nova.compute.manager [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Instance event wait completed in 0 seconds for  {{(pid=75341) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 23:58:34 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Guest created on hypervisor {{(pid=75341) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 23:58:34 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Instance spawned successfully.
Nov 14 23:58:34 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 23:58:34 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Found default for hw_cdrom_bus of ide {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:58:34 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Found default for hw_disk_bus of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:58:34 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Found default for hw_input_bus of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:58:34 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Found default for hw_pointer_model of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:58:34 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Found default for hw_video_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:58:34 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Found default for hw_vif_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:58:34 user nova-compute[75341]: INFO nova.compute.manager [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Took 5.01 seconds to spawn the instance on the hypervisor.
Nov 14 23:58:34 user nova-compute[75341]: DEBUG nova.compute.manager [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 23:58:34 user nova-compute[75341]: INFO nova.compute.manager [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Took 10.43 seconds to build instance.
Nov 14 23:58:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-48378d21-8710-4ee7-a6e8-b7f87a4944ad tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "c3524e47-34b3-4b33-a1ff-25a8e4f35d86" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.531s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:58:34 user nova-compute[75341]: DEBUG nova.compute.manager [req-c7e71691-b0a5-49de-a1d6-5ace34583c78 req-9fe57575-a025-494e-a1fc-e730554da6d4 service nova] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Received event network-vif-plugged-50f461fb-27ee-438f-880c-cde1e7441cfe {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:58:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-c7e71691-b0a5-49de-a1d6-5ace34583c78 req-9fe57575-a025-494e-a1fc-e730554da6d4 service nova] Acquiring lock "c3524e47-34b3-4b33-a1ff-25a8e4f35d86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:58:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-c7e71691-b0a5-49de-a1d6-5ace34583c78 req-9fe57575-a025-494e-a1fc-e730554da6d4 service nova] Lock "c3524e47-34b3-4b33-a1ff-25a8e4f35d86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:58:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-c7e71691-b0a5-49de-a1d6-5ace34583c78 req-9fe57575-a025-494e-a1fc-e730554da6d4 service nova] Lock "c3524e47-34b3-4b33-a1ff-25a8e4f35d86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:58:34 user nova-compute[75341]: DEBUG nova.compute.manager [req-c7e71691-b0a5-49de-a1d6-5ace34583c78 req-9fe57575-a025-494e-a1fc-e730554da6d4 service nova] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] No waiting events found dispatching network-vif-plugged-50f461fb-27ee-438f-880c-cde1e7441cfe {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:58:34 user nova-compute[75341]: WARNING nova.compute.manager [req-c7e71691-b0a5-49de-a1d6-5ace34583c78 req-9fe57575-a025-494e-a1fc-e730554da6d4 service nova] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Received unexpected event network-vif-plugged-50f461fb-27ee-438f-880c-cde1e7441cfe for instance with vm_state active and task_state None.
Nov 14 23:58:34 user nova-compute[75341]: DEBUG nova.compute.manager [req-c7e71691-b0a5-49de-a1d6-5ace34583c78 req-9fe57575-a025-494e-a1fc-e730554da6d4 service nova] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Received event network-changed-8989d87f-615c-4cfe-9d3d-6c012e3fdf48 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:58:34 user nova-compute[75341]: DEBUG nova.compute.manager [req-c7e71691-b0a5-49de-a1d6-5ace34583c78 req-9fe57575-a025-494e-a1fc-e730554da6d4 service nova] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Refreshing instance network info cache due to event network-changed-8989d87f-615c-4cfe-9d3d-6c012e3fdf48. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:58:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-c7e71691-b0a5-49de-a1d6-5ace34583c78 req-9fe57575-a025-494e-a1fc-e730554da6d4 service nova] Acquiring lock "refresh_cache-c62455e6-61af-45b1-899f-bad37dc57b22" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:58:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-c7e71691-b0a5-49de-a1d6-5ace34583c78 req-9fe57575-a025-494e-a1fc-e730554da6d4 service nova] Acquired lock "refresh_cache-c62455e6-61af-45b1-899f-bad37dc57b22" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:58:34 user nova-compute[75341]: DEBUG nova.network.neutron [req-c7e71691-b0a5-49de-a1d6-5ace34583c78 req-9fe57575-a025-494e-a1fc-e730554da6d4 service nova] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Refreshing network info cache for port 8989d87f-615c-4cfe-9d3d-6c012e3fdf48 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:58:35 user nova-compute[75341]: DEBUG nova.network.neutron [req-c7e71691-b0a5-49de-a1d6-5ace34583c78 req-9fe57575-a025-494e-a1fc-e730554da6d4 service nova] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Updated VIF entry in instance network info cache for port 8989d87f-615c-4cfe-9d3d-6c012e3fdf48. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:58:35 user nova-compute[75341]: DEBUG nova.network.neutron [req-c7e71691-b0a5-49de-a1d6-5ace34583c78 req-9fe57575-a025-494e-a1fc-e730554da6d4 service nova] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Updating instance_info_cache with network_info: [{"id": "8989d87f-615c-4cfe-9d3d-6c012e3fdf48", "address": "fa:16:3e:2d:04:44", "network": {"id": "fcd22da6-016e-4872-a84c-4d82601c48d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-550677181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44bb8b1415c14bb59c4c35cc2b830875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8989d87f-61", "ovs_interfaceid": "8989d87f-615c-4cfe-9d3d-6c012e3fdf48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:58:35 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-c7e71691-b0a5-49de-a1d6-5ace34583c78 req-9fe57575-a025-494e-a1fc-e730554da6d4 service nova] Releasing lock "refresh_cache-c62455e6-61af-45b1-899f-bad37dc57b22" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:58:35 user nova-compute[75341]: DEBUG nova.compute.manager [req-c7e71691-b0a5-49de-a1d6-5ace34583c78 req-9fe57575-a025-494e-a1fc-e730554da6d4 service nova] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Received event network-changed-8989d87f-615c-4cfe-9d3d-6c012e3fdf48 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:58:35 user nova-compute[75341]: DEBUG nova.compute.manager [req-c7e71691-b0a5-49de-a1d6-5ace34583c78 req-9fe57575-a025-494e-a1fc-e730554da6d4 service nova] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Refreshing instance network info cache due to event network-changed-8989d87f-615c-4cfe-9d3d-6c012e3fdf48. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:58:35 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-c7e71691-b0a5-49de-a1d6-5ace34583c78 req-9fe57575-a025-494e-a1fc-e730554da6d4 service nova] Acquiring lock "refresh_cache-c62455e6-61af-45b1-899f-bad37dc57b22" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:58:35 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-c7e71691-b0a5-49de-a1d6-5ace34583c78 req-9fe57575-a025-494e-a1fc-e730554da6d4 service nova] Acquired lock "refresh_cache-c62455e6-61af-45b1-899f-bad37dc57b22" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:58:35 user nova-compute[75341]: DEBUG nova.network.neutron [req-c7e71691-b0a5-49de-a1d6-5ace34583c78 req-9fe57575-a025-494e-a1fc-e730554da6d4 service nova] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Refreshing network info cache for port 8989d87f-615c-4cfe-9d3d-6c012e3fdf48 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:58:35 user nova-compute[75341]: DEBUG nova.network.neutron [req-c7e71691-b0a5-49de-a1d6-5ace34583c78 req-9fe57575-a025-494e-a1fc-e730554da6d4 service nova] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Updated VIF entry in instance network info cache for port 8989d87f-615c-4cfe-9d3d-6c012e3fdf48. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:58:35 user nova-compute[75341]: DEBUG nova.network.neutron [req-c7e71691-b0a5-49de-a1d6-5ace34583c78 req-9fe57575-a025-494e-a1fc-e730554da6d4 service nova] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Updating instance_info_cache with network_info: [{"id": "8989d87f-615c-4cfe-9d3d-6c012e3fdf48", "address": "fa:16:3e:2d:04:44", "network": {"id": "fcd22da6-016e-4872-a84c-4d82601c48d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-550677181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44bb8b1415c14bb59c4c35cc2b830875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8989d87f-61", "ovs_interfaceid": "8989d87f-615c-4cfe-9d3d-6c012e3fdf48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:58:35 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-c7e71691-b0a5-49de-a1d6-5ace34583c78 req-9fe57575-a025-494e-a1fc-e730554da6d4 service nova] Releasing lock "refresh_cache-c62455e6-61af-45b1-899f-bad37dc57b22" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:58:35 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:58:37 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:58:40 user nova-compute[75341]: DEBUG nova.compute.manager [req-e7827f71-a860-4890-aced-10b99c759e50 req-541c3f1a-ef8b-4af8-8a90-a8aa4e069a4d service nova] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Received event network-changed-140e7083-e454-413d-892e-a4784b4cea66 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:58:40 user nova-compute[75341]: DEBUG nova.compute.manager [req-e7827f71-a860-4890-aced-10b99c759e50 req-541c3f1a-ef8b-4af8-8a90-a8aa4e069a4d service nova] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Refreshing instance network info cache due to event network-changed-140e7083-e454-413d-892e-a4784b4cea66. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:58:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-e7827f71-a860-4890-aced-10b99c759e50 req-541c3f1a-ef8b-4af8-8a90-a8aa4e069a4d service nova] Acquiring lock "refresh_cache-a80008bd-c61c-4a36-ae67-e556a5ecee08" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:58:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-e7827f71-a860-4890-aced-10b99c759e50 req-541c3f1a-ef8b-4af8-8a90-a8aa4e069a4d service nova] Acquired lock "refresh_cache-a80008bd-c61c-4a36-ae67-e556a5ecee08" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:58:40 user nova-compute[75341]: DEBUG nova.network.neutron [req-e7827f71-a860-4890-aced-10b99c759e50 req-541c3f1a-ef8b-4af8-8a90-a8aa4e069a4d service nova] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Refreshing network info cache for port 140e7083-e454-413d-892e-a4784b4cea66 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:58:40 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:58:41 user nova-compute[75341]: DEBUG nova.network.neutron [req-e7827f71-a860-4890-aced-10b99c759e50 req-541c3f1a-ef8b-4af8-8a90-a8aa4e069a4d service nova] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Updated VIF entry in instance network info cache for port 140e7083-e454-413d-892e-a4784b4cea66. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:58:41 user nova-compute[75341]: DEBUG nova.network.neutron [req-e7827f71-a860-4890-aced-10b99c759e50 req-541c3f1a-ef8b-4af8-8a90-a8aa4e069a4d service nova] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Updating instance_info_cache with network_info: [{"id": "140e7083-e454-413d-892e-a4784b4cea66", "address": "fa:16:3e:69:fb:24", "network": {"id": "227eb779-a064-477d-8447-45862017ae7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-3827253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96674073965642f1af11221b4add8a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap140e7083-e4", "ovs_interfaceid": "140e7083-e454-413d-892e-a4784b4cea66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:58:41 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-e7827f71-a860-4890-aced-10b99c759e50 req-541c3f1a-ef8b-4af8-8a90-a8aa4e069a4d service nova] Releasing lock "refresh_cache-a80008bd-c61c-4a36-ae67-e556a5ecee08" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:58:42 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:58:45 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:58:47 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:58:48 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Acquiring lock "6eee60d5-4088-40ff-b816-4080da234894" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:58:48 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "6eee60d5-4088-40ff-b816-4080da234894" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:58:48 user nova-compute[75341]: DEBUG nova.compute.manager [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Starting instance... {{(pid=75341) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 23:58:48 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:58:48 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:58:48 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75341) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 23:58:48 user nova-compute[75341]: INFO nova.compute.claims [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Claim successful on node user
Nov 14 23:58:48 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:58:48 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:58:48 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.346s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:58:48 user nova-compute[75341]: DEBUG nova.compute.manager [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Start building networks asynchronously for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 23:58:48 user nova-compute[75341]: DEBUG nova.compute.manager [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Allocating IP information in the background. {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 23:58:48 user nova-compute[75341]: DEBUG nova.network.neutron [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 6eee60d5-4088-40ff-b816-4080da234894] allocate_for_instance() {{(pid=75341) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 23:58:48 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 23:58:48 user nova-compute[75341]: DEBUG nova.compute.manager [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Start building block device mappings for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 23:58:48 user nova-compute[75341]: DEBUG nova.policy [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b08f7ddf6c2f4fd596e214d6ca56c234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96674073965642f1af11221b4add8a6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75341) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 23:58:48 user nova-compute[75341]: INFO nova.virt.block_device [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Booting with volume 0c7d8ab7-14d0-4084-8e4a-3cd7e843934f at /dev/vda
Nov 14 23:58:48 user nova-compute[75341]: DEBUG os_brick.utils [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:58:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:58:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:58:48 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd076e4-f866-45bf-b432-06fb4782243a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6d1cfca09c9\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:58:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:58:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:58:48 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[046c9f9d-390c-442f-b906-9b4415f9ef8e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:58:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:58:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:58:48 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7208d2f-f0d5-440a-a74e-654cb347230a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:58:48 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c03ba4-b878-42d6-8afa-d359def34d25]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:58:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Running cmd (subprocess): nvme version {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:58:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] 'nvme version' failed. Not Retrying. {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:58:48 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] nvme not present on system {{(pid=75341) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 23:58:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:58:48 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:58:48 user nova-compute[75341]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 23:58:48 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccdf3c1a-347d-4640-a927-d26bc165f27c]: (4, '') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:58:48 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75341) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 23:58:48 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 23:58:48 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] LIGHTOS: no hostnqn found. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 23:58:48 user nova-compute[75341]: DEBUG os_brick.utils [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6d1cfca09c9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:58:48 user nova-compute[75341]: DEBUG nova.virt.block_device [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Updating existing volume attachment record: 3ae1bfa6-7696-45db-ad7a-98f32994998c {{(pid=75341) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 23:58:49 user nova-compute[75341]: DEBUG nova.network.neutron [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Successfully created port: 6f73d56f-c40e-4e8d-a793-3ff9ae5bc35c {{(pid=75341) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 23:58:50 user nova-compute[75341]: DEBUG nova.network.neutron [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Successfully updated port: 6f73d56f-c40e-4e8d-a793-3ff9ae5bc35c {{(pid=75341) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 23:58:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Acquiring lock "refresh_cache-6eee60d5-4088-40ff-b816-4080da234894" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:58:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Acquired lock "refresh_cache-6eee60d5-4088-40ff-b816-4080da234894" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:58:50 user nova-compute[75341]: DEBUG nova.network.neutron [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 23:58:50 user nova-compute[75341]: DEBUG nova.compute.manager [req-8ab037f4-f839-4c54-af55-ae367a338603 req-04bf5bbe-4175-45c4-992a-43807a529cd5 service nova] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Received event network-changed-6f73d56f-c40e-4e8d-a793-3ff9ae5bc35c {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:58:50 user nova-compute[75341]: DEBUG nova.compute.manager [req-8ab037f4-f839-4c54-af55-ae367a338603 req-04bf5bbe-4175-45c4-992a-43807a529cd5 service nova] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Refreshing instance network info cache due to event network-changed-6f73d56f-c40e-4e8d-a793-3ff9ae5bc35c. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:58:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-8ab037f4-f839-4c54-af55-ae367a338603 req-04bf5bbe-4175-45c4-992a-43807a529cd5 service nova] Acquiring lock "refresh_cache-6eee60d5-4088-40ff-b816-4080da234894" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:58:50 user nova-compute[75341]: DEBUG nova.network.neutron [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Instance cache missing network info. {{(pid=75341) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 23:58:50 user nova-compute[75341]: DEBUG nova.network.neutron [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Updating instance_info_cache with network_info: [{"id": "6f73d56f-c40e-4e8d-a793-3ff9ae5bc35c", "address": "fa:16:3e:08:9f:79", "network": {"id": "227eb779-a064-477d-8447-45862017ae7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-3827253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96674073965642f1af11221b4add8a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f73d56f-c4", "ovs_interfaceid": "6f73d56f-c40e-4e8d-a793-3ff9ae5bc35c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:58:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Releasing lock "refresh_cache-6eee60d5-4088-40ff-b816-4080da234894" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:58:50 user nova-compute[75341]: DEBUG nova.compute.manager [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Instance network_info: |[{"id": "6f73d56f-c40e-4e8d-a793-3ff9ae5bc35c", "address": "fa:16:3e:08:9f:79", "network": {"id": "227eb779-a064-477d-8447-45862017ae7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-3827253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96674073965642f1af11221b4add8a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f73d56f-c4", "ovs_interfaceid": "6f73d56f-c40e-4e8d-a793-3ff9ae5bc35c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 23:58:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-8ab037f4-f839-4c54-af55-ae367a338603 req-04bf5bbe-4175-45c4-992a-43807a529cd5 service nova] Acquired lock "refresh_cache-6eee60d5-4088-40ff-b816-4080da234894" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:58:50 user nova-compute[75341]: DEBUG nova.network.neutron [req-8ab037f4-f839-4c54-af55-ae367a338603 req-04bf5bbe-4175-45c4-992a-43807a529cd5 service nova] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Refreshing network info cache for port 6f73d56f-c40e-4e8d-a793-3ff9ae5bc35c {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:58:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:58:51 user nova-compute[75341]: DEBUG nova.network.neutron [req-8ab037f4-f839-4c54-af55-ae367a338603 req-04bf5bbe-4175-45c4-992a-43807a529cd5 service nova] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Updated VIF entry in instance network info cache for port 6f73d56f-c40e-4e8d-a793-3ff9ae5bc35c. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:58:51 user nova-compute[75341]: DEBUG nova.network.neutron [req-8ab037f4-f839-4c54-af55-ae367a338603 req-04bf5bbe-4175-45c4-992a-43807a529cd5 service nova] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Updating instance_info_cache with network_info: [{"id": "6f73d56f-c40e-4e8d-a793-3ff9ae5bc35c", "address": "fa:16:3e:08:9f:79", "network": {"id": "227eb779-a064-477d-8447-45862017ae7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-3827253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96674073965642f1af11221b4add8a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f73d56f-c4", "ovs_interfaceid": "6f73d56f-c40e-4e8d-a793-3ff9ae5bc35c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:58:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-8ab037f4-f839-4c54-af55-ae367a338603 req-04bf5bbe-4175-45c4-992a-43807a529cd5 service nova] Releasing lock "refresh_cache-6eee60d5-4088-40ff-b816-4080da234894" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:58:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:58:53 user nova-compute[75341]: DEBUG nova.compute.manager [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Start spawning the instance on the hypervisor. {{(pid=75341) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 23:58:53 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Creating instance directory {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 23:58:53 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Creating image(s)
Nov 14 23:58:53 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Did not create local disks {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 23:58:53 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Ensure instance console log exists: /opt/stack/data/nova/instances/6eee60d5-4088-40ff-b816-4080da234894/console.log {{(pid=75341) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 23:58:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:58:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:58:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:58:53 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Start _get_guest_xml network_info=[{"id": "6f73d56f-c40e-4e8d-a793-3ff9ae5bc35c", "address": "fa:16:3e:08:9f:79", "network": {"id": "227eb779-a064-477d-8447-45862017ae7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-3827253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96674073965642f1af11221b4add8a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f73d56f-c4", "ovs_interfaceid": "6f73d56f-c40e-4e8d-a793-3ff9ae5bc35c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '3ae1bfa6-7696-45db-ad7a-98f32994998c', 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ewaoHPsj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6eee60d5-4088-40ff-b816-4080da234894', 'attached_at': '', 'detached_at': '', 'volume_id': '0c7d8ab7-14d0-4084-8e4a-3cd7e843934f', 'serial': '0c7d8ab7-14d0-4084-8e4a-3cd7e843934f'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 23:58:53 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:58:53 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:58:53 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 23:58:53 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 23:58:53 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 23:58:53 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 23:58:53 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 23:58:53 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 23:58:53 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 23:58:53 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 23:58:53 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 23:58:53 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 23:58:53 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 23:58:53 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 23:58:53 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 23:58:53 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 23:58:53 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 23:58:53 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 23:58:53 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Calling os-brick to attach iSCSI Volume {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 23:58:53 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ewaoHPsj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:58:53 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:58:53 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:58:53 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:58:53 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:58:53 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:58:53 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:58:53 user nova-compute[75341]: INFO os_brick.initiator.connectors.iscsi [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 23:58:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f -p 172.16.0.220:3260 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:58:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:58:53 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc7b9b9-5857-456a-ba73-542182a9862a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:58:53 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 23:58:53 user nova-compute[75341]:  {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:58:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f -p 172.16.0.220:3260 --interface default --op new {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:58:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:58:53 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4794b57-996b-432b-aa67-7ddf376a4afa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f] added\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:58:53 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f] added
Nov 14 23:58:53 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:58:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:58:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:58:53 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[0065cf07-0e89-47d9-886d-e187bf93100f]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:58:53 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:58:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:58:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:58:53 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c64ed6c-c929-4130-a0e9-173cbfa9fd8b]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:58:53 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:58:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ewaoHPsj {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:58:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ewaoHPsj" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:58:53 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3d6c1d-aee1-407b-8959-3edf3beb0b4b]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:58:53 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ewaoHPsj'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:58:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:58:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:58:53 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d694764-abff-4724-af71-502acdea97d3]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:58:53 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:58:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:58:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:58:53 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[76fa24ea-2cba-4afd-aa96-23e0c98815c2]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:58:53 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)
Nov 14 23:58:53 user nova-compute[75341]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)
Nov 14 23:58:53 user nova-compute[75341]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 (non-flash)
Nov 14 23:58:53 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:58:53 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)
Nov 14 23:58:53 user nova-compute[75341]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)
Nov 14 23:58:53 user nova-compute[75341]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 (non-flash)
Nov 14 23:58:53 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:58:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f -p 172.16.0.220:3260 --login {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:58:54 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a118f019-0f38-4f3c-9948-d0b3b06e76c6 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c62455e6-61af-45b1-899f-bad37dc57b22 is timed out.
Nov 14 23:58:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:58:54 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf01601e-017a-47e2-96bb-6604aa7736a4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:58:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f, portal: 172.16.0.220,3260]
Nov 14 23:58:54 user nova-compute[75341]: Login to [iface: default, target: iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f, portal: 172.16.0.220,3260] successful.
Nov 14 23:58:54 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:58:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:58:54 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-a118f019-0f38-4f3c-9948-d0b3b06e76c6 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Successfully detached device vdb from instance c62455e6-61af-45b1-899f-bad37dc57b22 from the live domain config.
Nov 14 23:58:54 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a118f019-0f38-4f3c-9948-d0b3b06e76c6 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] calling os-brick to detach iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 23:58:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-a118f019-0f38-4f3c-9948-d0b3b06e76c6 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, {'target_iqn': 'iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JwYsOTFV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:58:54 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-a118f019-0f38-4f3c-9948-d0b3b06e76c6 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:58:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-a118f019-0f38-4f3c-9948-d0b3b06e76c6 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:58:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:58:54 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[0862a235-50e4-4a1f-a9fc-1a17cf1369b9]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:58:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:58:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:58:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:58:54 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19a991a-36f2-408b-afe0-740c56463085]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:58:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)
Nov 14 23:58:54 user nova-compute[75341]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)
Nov 14 23:58:54 user nova-compute[75341]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 (non-flash)
Nov 14 23:58:54 user nova-compute[75341]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f (non-flash)
Nov 14 23:58:54 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:58:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)
Nov 14 23:58:54 user nova-compute[75341]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)
Nov 14 23:58:54 user nova-compute[75341]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 (non-flash)
Nov 14 23:58:54 user nova-compute[75341]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f (non-flash)
Nov 14 23:58:54 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:58:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.468s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:58:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Connected to 172.16.0.220:3260 {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 23:58:54 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] HCTL ('36', '-', '-', 0) found on session 51 with lun 0 {{(pid=75341) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 23:58:54 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75341) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 23:58:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:58:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:58:54 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3fb47f0-02f1-4012-8550-082e0557a645]: (4, ('- - 0', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:58:54 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Searching for a device in session 51 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 23:58:54 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ewaoHPsj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.503s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] <== connect_volume: return (1505ms) {'type': 'block', 'scsi_wwn': '23537353134616534', 'path': '/dev/sde'} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537353134616534', 'path': '/dev/sde'} {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-a118f019-0f38-4f3c-9948-d0b3b06e76c6 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.230s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a1d1d0-3f5d-4eae-a713-01eb36a20a7a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-a118f019-0f38-4f3c-9948-d0b3b06e76c6 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 23:58:55 user nova-compute[75341]: No targets found.
Nov 14 23:58:55 user nova-compute[75341]: iSNS:
Nov 14 23:58:55 user nova-compute[75341]: No targets found.
Nov 14 23:58:55 user nova-compute[75341]: STATIC:
Nov 14 23:58:55 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36
Nov 14 23:58:55 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:58:55 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:58:55 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123
Nov 14 23:58:55 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:58:55 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:58:55 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00
Nov 14 23:58:55 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:58:55 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:58:55 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f
Nov 14 23:58:55 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:58:55 user nova-compute[75341]:                 Iface Name: default
Nov 14 23:58:55 user nova-compute[75341]: FIRMWARE:
Nov 14 23:58:55 user nova-compute[75341]: No targets found.
Nov 14 23:58:55 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-a118f019-0f38-4f3c-9948-d0b3b06e76c6 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 23:58:55 user nova-compute[75341]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 23:58:55 user nova-compute[75341]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75341) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-a118f019-0f38-4f3c-9948-d0b3b06e76c6 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00', 0)] {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:58:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-678016763',display_name='tempest-TestVolumeBootPattern-server-678016763',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-678016763',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN7m+PTR/lRAnqFJ5INzHZER+6KEezVf2NqND5YLAUMiY/B8DjdO2ameMcKY7PyF3FV92+jHAoJaiByyFu7+plRebNNPsSYlc8sL/IhL0WhnAYWxdc2ydVL4yfconkjd2A==',key_name='tempest-TestVolumeBootPattern-1320135145',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96674073965642f1af11221b4add8a6d',ramdisk_id='',reservation_id='r-0z0005zx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-320933673',owner_user_name='tempest-TestVolumeBootPattern-320933673-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:58:49Z,user_data=None,user_id='b08f7ddf6c2f4fd596e214d6ca56c234',uuid=6eee60d5-4088-40ff-b816-4080da234894,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f73d56f-c40e-4e8d-a793-3ff9ae5bc35c", "address": "fa:16:3e:08:9f:79", "network": {"id": "227eb779-a064-477d-8447-45862017ae7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-3827253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96674073965642f1af11221b4add8a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f73d56f-c4", "ovs_interfaceid": "6f73d56f-c40e-4e8d-a793-3ff9ae5bc35c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Converting VIF {"id": "6f73d56f-c40e-4e8d-a793-3ff9ae5bc35c", "address": "fa:16:3e:08:9f:79", "network": {"id": "227eb779-a064-477d-8447-45862017ae7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-3827253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96674073965642f1af11221b4add8a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f73d56f-c4", "ovs_interfaceid": "6f73d56f-c40e-4e8d-a793-3ff9ae5bc35c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:9f:79,bridge_name='br-int',has_traffic_filtering=True,id=6f73d56f-c40e-4e8d-a793-3ff9ae5bc35c,network=Network(227eb779-a064-477d-8447-45862017ae7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f73d56f-c4') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG nova.objects.instance [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lazy-loading 'pci_devices' on Instance uuid 6eee60d5-4088-40ff-b816-4080da234894 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d9aa50-eff3-47b7-b633-9fc4995ad185]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 6eee60d5-4088-40ff-b816-4080da234894] End _get_guest_xml xml=<domain type="kvm">
Nov 14 23:58:55 user nova-compute[75341]:   <uuid>6eee60d5-4088-40ff-b816-4080da234894</uuid>
Nov 14 23:58:55 user nova-compute[75341]:   <name>instance-0000002b</name>
Nov 14 23:58:55 user nova-compute[75341]:   <memory>524288</memory>
Nov 14 23:58:55 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 14 23:58:55 user nova-compute[75341]:   <metadata>
Nov 14 23:58:55 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 23:58:55 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 14 23:58:55 user nova-compute[75341]:       <nova:name>tempest-TestVolumeBootPattern-server-678016763</nova:name>
Nov 14 23:58:55 user nova-compute[75341]:       <nova:creationTime>2023-11-14 23:58:53</nova:creationTime>
Nov 14 23:58:55 user nova-compute[75341]:       <nova:flavor name="m1.tiny">
Nov 14 23:58:55 user nova-compute[75341]:         <nova:memory>512</nova:memory>
Nov 14 23:58:55 user nova-compute[75341]:         <nova:disk>1</nova:disk>
Nov 14 23:58:55 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 14 23:58:55 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 23:58:55 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 14 23:58:55 user nova-compute[75341]:       </nova:flavor>
Nov 14 23:58:55 user nova-compute[75341]:       <nova:owner>
Nov 14 23:58:55 user nova-compute[75341]:         <nova:user uuid="b08f7ddf6c2f4fd596e214d6ca56c234">tempest-TestVolumeBootPattern-320933673-project-member</nova:user>
Nov 14 23:58:55 user nova-compute[75341]:         <nova:project uuid="96674073965642f1af11221b4add8a6d">tempest-TestVolumeBootPattern-320933673</nova:project>
Nov 14 23:58:55 user nova-compute[75341]:       </nova:owner>
Nov 14 23:58:55 user nova-compute[75341]:       <nova:ports>
Nov 14 23:58:55 user nova-compute[75341]:         <nova:port uuid="6f73d56f-c40e-4e8d-a793-3ff9ae5bc35c">
Nov 14 23:58:55 user nova-compute[75341]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 23:58:55 user nova-compute[75341]:         </nova:port>
Nov 14 23:58:55 user nova-compute[75341]:       </nova:ports>
Nov 14 23:58:55 user nova-compute[75341]:     </nova:instance>
Nov 14 23:58:55 user nova-compute[75341]:   </metadata>
Nov 14 23:58:55 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 14 23:58:55 user nova-compute[75341]:     <system>
Nov 14 23:58:55 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 23:58:55 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 14 23:58:55 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 14 23:58:55 user nova-compute[75341]:       <entry name="serial">6eee60d5-4088-40ff-b816-4080da234894</entry>
Nov 14 23:58:55 user nova-compute[75341]:       <entry name="uuid">6eee60d5-4088-40ff-b816-4080da234894</entry>
Nov 14 23:58:55 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 14 23:58:55 user nova-compute[75341]:     </system>
Nov 14 23:58:55 user nova-compute[75341]:   </sysinfo>
Nov 14 23:58:55 user nova-compute[75341]:   <os>
Nov 14 23:58:55 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 23:58:55 user nova-compute[75341]:     <boot dev="hd"/>
Nov 14 23:58:55 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 14 23:58:55 user nova-compute[75341]:   </os>
Nov 14 23:58:55 user nova-compute[75341]:   <features>
Nov 14 23:58:55 user nova-compute[75341]:     <acpi/>
Nov 14 23:58:55 user nova-compute[75341]:     <apic/>
Nov 14 23:58:55 user nova-compute[75341]:     <vmcoreinfo/>
Nov 14 23:58:55 user nova-compute[75341]:   </features>
Nov 14 23:58:55 user nova-compute[75341]:   <clock offset="utc">
Nov 14 23:58:55 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 23:58:55 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 23:58:55 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 14 23:58:55 user nova-compute[75341]:   </clock>
Nov 14 23:58:55 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 14 23:58:55 user nova-compute[75341]:     <model>Nehalem</model>
Nov 14 23:58:55 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 23:58:55 user nova-compute[75341]:   </cpu>
Nov 14 23:58:55 user nova-compute[75341]:   <devices>
Nov 14 23:58:55 user nova-compute[75341]:     <disk type="block" device="disk">
Nov 14 23:58:55 user nova-compute[75341]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:58:55 user nova-compute[75341]:       <source dev="/dev/sde"/>
Nov 14 23:58:55 user nova-compute[75341]:       <target dev="vda" bus="virtio"/>
Nov 14 23:58:55 user nova-compute[75341]:       <serial>0c7d8ab7-14d0-4084-8e4a-3cd7e843934f</serial>
Nov 14 23:58:55 user nova-compute[75341]:     </disk>
Nov 14 23:58:55 user nova-compute[75341]:     <interface type="ethernet">
Nov 14 23:58:55 user nova-compute[75341]:       <mac address="fa:16:3e:08:9f:79"/>
Nov 14 23:58:55 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:58:55 user nova-compute[75341]:       <mtu size="1442"/>
Nov 14 23:58:55 user nova-compute[75341]:       <target dev="tap6f73d56f-c4"/>
Nov 14 23:58:55 user nova-compute[75341]:     </interface>
Nov 14 23:58:55 user nova-compute[75341]:     <serial type="pty">
Nov 14 23:58:55 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/6eee60d5-4088-40ff-b816-4080da234894/console.log" append="off"/>
Nov 14 23:58:55 user nova-compute[75341]:     </serial>
Nov 14 23:58:55 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 23:58:55 user nova-compute[75341]:     <video>
Nov 14 23:58:55 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:58:55 user nova-compute[75341]:     </video>
Nov 14 23:58:55 user nova-compute[75341]:     <rng model="virtio">
Nov 14 23:58:55 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 14 23:58:55 user nova-compute[75341]:     </rng>
Nov 14 23:58:55 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 14 23:58:55 user nova-compute[75341]:     <memballoon model="virtio">
Nov 14 23:58:55 user nova-compute[75341]:       <stats period="10"/>
Nov 14 23:58:55 user nova-compute[75341]:     </memballoon>
Nov 14 23:58:55 user nova-compute[75341]:   </devices>
Nov 14 23:58:55 user nova-compute[75341]: </domain>
Nov 14 23:58:55 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:58:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-678016763',display_name='tempest-TestVolumeBootPattern-server-678016763',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-678016763',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN7m+PTR/lRAnqFJ5INzHZER+6KEezVf2NqND5YLAUMiY/B8DjdO2ameMcKY7PyF3FV92+jHAoJaiByyFu7+plRebNNPsSYlc8sL/IhL0WhnAYWxdc2ydVL4yfconkjd2A==',key_name='tempest-TestVolumeBootPattern-1320135145',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96674073965642f1af11221b4add8a6d',ramdisk_id='',reservation_id='r-0z0005zx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-320933673',owner_user_name='tempest-TestVolumeBootPattern-320933673-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:58:49Z,user_data=None,user_id='b08f7ddf6c2f4fd596e214d6ca56c234',uuid=6eee60d5-4088-40ff-b816-4080da234894,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f73d56f-c40e-4e8d-a793-3ff9ae5bc35c", "address": "fa:16:3e:08:9f:79", "network": {"id": "227eb779-a064-477d-8447-45862017ae7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-3827253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96674073965642f1af11221b4add8a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f73d56f-c4", "ovs_interfaceid": "6f73d56f-c40e-4e8d-a793-3ff9ae5bc35c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Converting VIF {"id": "6f73d56f-c40e-4e8d-a793-3ff9ae5bc35c", "address": "fa:16:3e:08:9f:79", "network": {"id": "227eb779-a064-477d-8447-45862017ae7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-3827253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96674073965642f1af11221b4add8a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f73d56f-c4", "ovs_interfaceid": "6f73d56f-c40e-4e8d-a793-3ff9ae5bc35c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:9f:79,bridge_name='br-int',has_traffic_filtering=True,id=6f73d56f-c40e-4e8d-a793-3ff9ae5bc35c,network=Network(227eb779-a064-477d-8447-45862017ae7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f73d56f-c4') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG os_vif [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:9f:79,bridge_name='br-int',has_traffic_filtering=True,id=6f73d56f-c40e-4e8d-a793-3ff9ae5bc35c,network=Network(227eb779-a064-477d-8447-45862017ae7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f73d56f-c4') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '06368893-5375-5ae0-bf19-f53d9d3107d2', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba2b6c4-1eaa-4039-9c4c-a0397c23ffa1]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-a118f019-0f38-4f3c-9948-d0b3b06e76c6 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)
Nov 14 23:58:55 user nova-compute[75341]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)
Nov 14 23:58:55 user nova-compute[75341]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 (non-flash)
Nov 14 23:58:55 user nova-compute[75341]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f (non-flash)
Nov 14 23:58:55 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-a118f019-0f38-4f3c-9948-d0b3b06e76c6 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 (non-flash)
Nov 14 23:58:55 user nova-compute[75341]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)
Nov 14 23:58:55 user nova-compute[75341]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 (non-flash)
Nov 14 23:58:55 user nova-compute[75341]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f (non-flash)
Nov 14 23:58:55 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-a118f019-0f38-4f3c-9948-d0b3b06e76c6 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1870775000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00'): ({'sdc'}, set())}) {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-a118f019-0f38-4f3c-9948-d0b3b06e76c6 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Removing single pathed devices sdc {{(pid=75341) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6f73d56f-c4, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6f73d56f-c4, col_values=(('qos', UUID('1adba605-c70f-4db0-9504-9e5ce16b4ba2')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6f73d56f-c4, col_values=(('external_ids', {'iface-id': '6f73d56f-c40e-4e8d-a793-3ff9ae5bc35c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:9f:79', 'vm-uuid': '6eee60d5-4088-40ff-b816-4080da234894'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:58:55 user nova-compute[75341]: INFO os_vif [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:9f:79,bridge_name='br-int',has_traffic_filtering=True,id=6f73d56f-c40e-4e8d-a793-3ff9ae5bc35c,network=Network(227eb779-a064-477d-8447-45862017ae7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f73d56f-c4')
Nov 14 23:58:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98f2fe2-a01d-423f-a62a-6e1ef6ac656e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[97936a2b-0c4b-44da-a5bb-36d45aac4395]: (4, ('ok\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-a118f019-0f38-4f3c-9948-d0b3b06e76c6 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Flushing IO for device /dev/sdc {{(pid=75341) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5024aae-c2d8-48ce-84df-1f2baf91e165]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-a118f019-0f38-4f3c-9948-d0b3b06e76c6 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75341) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] No VIF found with MAC fa:16:3e:08:9f:79, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f7abba-ec3e-43fb-9c1e-5abe889adb4a]: (4, ('1', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-a118f019-0f38-4f3c-9948-d0b3b06e76c6 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-a118f019-0f38-4f3c-9948-d0b3b06e76c6 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] SCSI volumes sdc have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-a118f019-0f38-4f3c-9948-d0b3b06e76c6 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00')] {{(pid=75341) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8c72f0-8d39-4164-a6fa-2c16c3952993]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-a118f019-0f38-4f3c-9948-d0b3b06e76c6 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 -p 172.16.0.220:3260 --logout {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2ec095-7bea-4d6b-8935-0f424f5bc883]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-a118f019-0f38-4f3c-9948-d0b3b06e76c6 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00, portal: 172.16.0.220,3260]
Nov 14 23:58:55 user nova-compute[75341]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00, portal: 172.16.0.220,3260] successful.
Nov 14 23:58:55 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 -p 172.16.0.220:3260 --op delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc6f285e-df58-4f26-b0d1-9b3344d9fc00 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a11b2e-8b9a-40a7-80d8-34c13495f474]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-a118f019-0f38-4f3c-9948-d0b3b06e76c6 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-a118f019-0f38-4f3c-9948-d0b3b06e76c6 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-a118f019-0f38-4f3c-9948-d0b3b06e76c6 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] <== disconnect_volume: return (1558ms) None {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:58:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a118f019-0f38-4f3c-9948-d0b3b06e76c6 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Disconnected iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 23:58:56 user nova-compute[75341]: DEBUG nova.objects.instance [None req-a118f019-0f38-4f3c-9948-d0b3b06e76c6 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lazy-loading 'flavor' on Instance uuid c62455e6-61af-45b1-899f-bad37dc57b22 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:58:56 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a118f019-0f38-4f3c-9948-d0b3b06e76c6 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "c62455e6-61af-45b1-899f-bad37dc57b22" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.896s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:58:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:58:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:58:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:58:56 user nova-compute[75341]: DEBUG nova.compute.manager [req-0a6fe3fc-a5ab-44e8-868a-86cdcc78b20c req-6643bf59-3ba1-4c26-89cc-222ed278ec0b service nova] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Received event network-vif-plugged-6f73d56f-c40e-4e8d-a793-3ff9ae5bc35c {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:58:56 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-0a6fe3fc-a5ab-44e8-868a-86cdcc78b20c req-6643bf59-3ba1-4c26-89cc-222ed278ec0b service nova] Acquiring lock "6eee60d5-4088-40ff-b816-4080da234894-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:58:56 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-0a6fe3fc-a5ab-44e8-868a-86cdcc78b20c req-6643bf59-3ba1-4c26-89cc-222ed278ec0b service nova] Lock "6eee60d5-4088-40ff-b816-4080da234894-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:58:56 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-0a6fe3fc-a5ab-44e8-868a-86cdcc78b20c req-6643bf59-3ba1-4c26-89cc-222ed278ec0b service nova] Lock "6eee60d5-4088-40ff-b816-4080da234894-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:58:56 user nova-compute[75341]: DEBUG nova.compute.manager [req-0a6fe3fc-a5ab-44e8-868a-86cdcc78b20c req-6643bf59-3ba1-4c26-89cc-222ed278ec0b service nova] [instance: 6eee60d5-4088-40ff-b816-4080da234894] No waiting events found dispatching network-vif-plugged-6f73d56f-c40e-4e8d-a793-3ff9ae5bc35c {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:58:56 user nova-compute[75341]: WARNING nova.compute.manager [req-0a6fe3fc-a5ab-44e8-868a-86cdcc78b20c req-6643bf59-3ba1-4c26-89cc-222ed278ec0b service nova] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Received unexpected event network-vif-plugged-6f73d56f-c40e-4e8d-a793-3ff9ae5bc35c for instance with vm_state building and task_state spawning.
Nov 14 23:58:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:58:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:58:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:58:57 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:58:58 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:58:58 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:58:58 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75341) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 23:58:58 user nova-compute[75341]: DEBUG nova.compute.manager [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Instance event wait completed in 0 seconds for  {{(pid=75341) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 23:58:58 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Guest created on hypervisor {{(pid=75341) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 23:58:58 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Instance spawned successfully.
Nov 14 23:58:58 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 23:58:59 user nova-compute[75341]: DEBUG nova.compute.manager [req-2ff4a83f-7d6e-43b7-bb0c-5575f1fbd451 req-d7413e16-ee27-4278-8fd3-5cd6a698dc7f service nova] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Received event network-vif-plugged-6f73d56f-c40e-4e8d-a793-3ff9ae5bc35c {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:58:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-2ff4a83f-7d6e-43b7-bb0c-5575f1fbd451 req-d7413e16-ee27-4278-8fd3-5cd6a698dc7f service nova] Acquiring lock "6eee60d5-4088-40ff-b816-4080da234894-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:58:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-2ff4a83f-7d6e-43b7-bb0c-5575f1fbd451 req-d7413e16-ee27-4278-8fd3-5cd6a698dc7f service nova] Lock "6eee60d5-4088-40ff-b816-4080da234894-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:58:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-2ff4a83f-7d6e-43b7-bb0c-5575f1fbd451 req-d7413e16-ee27-4278-8fd3-5cd6a698dc7f service nova] Lock "6eee60d5-4088-40ff-b816-4080da234894-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:58:59 user nova-compute[75341]: DEBUG nova.compute.manager [req-2ff4a83f-7d6e-43b7-bb0c-5575f1fbd451 req-d7413e16-ee27-4278-8fd3-5cd6a698dc7f service nova] [instance: 6eee60d5-4088-40ff-b816-4080da234894] No waiting events found dispatching network-vif-plugged-6f73d56f-c40e-4e8d-a793-3ff9ae5bc35c {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:58:59 user nova-compute[75341]: WARNING nova.compute.manager [req-2ff4a83f-7d6e-43b7-bb0c-5575f1fbd451 req-d7413e16-ee27-4278-8fd3-5cd6a698dc7f service nova] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Received unexpected event network-vif-plugged-6f73d56f-c40e-4e8d-a793-3ff9ae5bc35c for instance with vm_state building and task_state spawning.
Nov 14 23:58:59 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Found default for hw_cdrom_bus of ide {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:58:59 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Found default for hw_disk_bus of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:58:59 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Found default for hw_input_bus of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:58:59 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Found default for hw_pointer_model of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:58:59 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Found default for hw_video_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:58:59 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Found default for hw_vif_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:58:59 user nova-compute[75341]: INFO nova.compute.manager [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Took 5.40 seconds to spawn the instance on the hypervisor.
Nov 14 23:58:59 user nova-compute[75341]: DEBUG nova.compute.manager [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 23:58:59 user nova-compute[75341]: INFO nova.compute.manager [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Took 11.07 seconds to build instance.
Nov 14 23:58:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f6a528eb-7eba-4cc7-a689-33fbde667e87 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "6eee60d5-4088-40ff-b816-4080da234894" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.160s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:58:59 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:59:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:59:01 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:59:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:59:02 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:59:02 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Starting heal instance info cache {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 23:59:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "refresh_cache-defae731-4191-4526-99cc-a301cf5b3355" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:59:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquired lock "refresh_cache-defae731-4191-4526-99cc-a301cf5b3355" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:59:03 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: defae731-4191-4526-99cc-a301cf5b3355] Forcefully refreshing network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 23:59:03 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: defae731-4191-4526-99cc-a301cf5b3355] Updating instance_info_cache with network_info: [{"id": "10b83231-0b39-4dee-95db-bb6a03d70fc0", "address": "fa:16:3e:b7:3a:83", "network": {"id": "d86a8e7f-6658-4994-9a13-eb3163bd3865", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-635863702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c69a942b4f4b97a1a3152dea86c7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10b83231-0b", "ovs_interfaceid": "10b83231-0b39-4dee-95db-bb6a03d70fc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:59:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Releasing lock "refresh_cache-defae731-4191-4526-99cc-a301cf5b3355" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:59:03 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: defae731-4191-4526-99cc-a301cf5b3355] Updated the network info_cache for instance {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 23:59:03 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:59:03 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:59:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:59:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:59:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:59:03 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75341) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 23:59:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:59:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:59:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:59:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:59:04 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 23:59:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c62455e6-61af-45b1-899f-bad37dc57b22/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:59:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c62455e6-61af-45b1-899f-bad37dc57b22/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:59:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c62455e6-61af-45b1-899f-bad37dc57b22/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:59:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c62455e6-61af-45b1-899f-bad37dc57b22/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:59:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk.rescue --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:59:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:59:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk.rescue --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:59:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:59:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:59:05 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:59:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:59:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:59:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:59:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:59:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:59:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:59:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:59:06 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 23:59:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:59:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:59:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:59:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:59:06 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 23:59:07 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:59:07 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:59:07 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Hypervisor/Node resource view: name=user free_ram=8021MB free_disk=25.403594970703125GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75341) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 23:59:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:59:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:59:07 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 51045050-c7c6-49c5-acd4-2a76be0f466f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:59:07 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 6382e432-838f-4d89-a743-cbaa37f50ab5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:59:07 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance defae731-4191-4526-99cc-a301cf5b3355 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:59:07 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 2316aa9e-d4c9-43d0-9918-86265583aed1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:59:07 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance c62455e6-61af-45b1-899f-bad37dc57b22 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:59:07 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance a80008bd-c61c-4a36-ae67-e556a5ecee08 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:59:07 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance c3524e47-34b3-4b33-a1ff-25a8e4f35d86 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:59:07 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 6eee60d5-4088-40ff-b816-4080da234894 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:59:07 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 23:59:07 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 23:59:07 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:59:07 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:59:07 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Compute_service record updated for user:user {{(pid=75341) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 23:59:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.459s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:59:09 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:59:09 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:59:10 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:59:10 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:59:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:59:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:59:15 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:59:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:59:17 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-4ef521b6-5764-42ab-8b85-46bdc9ef077a tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Acquiring lock "2316aa9e-d4c9-43d0-9918-86265583aed1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:59:17 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-4ef521b6-5764-42ab-8b85-46bdc9ef077a tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "2316aa9e-d4c9-43d0-9918-86265583aed1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:59:17 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-4ef521b6-5764-42ab-8b85-46bdc9ef077a tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Acquiring lock "2316aa9e-d4c9-43d0-9918-86265583aed1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:59:17 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-4ef521b6-5764-42ab-8b85-46bdc9ef077a tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "2316aa9e-d4c9-43d0-9918-86265583aed1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:59:17 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-4ef521b6-5764-42ab-8b85-46bdc9ef077a tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "2316aa9e-d4c9-43d0-9918-86265583aed1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:59:17 user nova-compute[75341]: INFO nova.compute.manager [None req-4ef521b6-5764-42ab-8b85-46bdc9ef077a tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Terminating instance
Nov 14 23:59:17 user nova-compute[75341]: DEBUG nova.compute.manager [None req-4ef521b6-5764-42ab-8b85-46bdc9ef077a tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Start destroying the instance on the hypervisor. {{(pid=75341) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 23:59:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:59:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:59:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:59:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:59:18 user nova-compute[75341]: DEBUG nova.compute.manager [req-f030708e-0894-4bed-a702-3aebee1284a3 req-e0c3461f-3a8d-4763-9563-8bef25396243 service nova] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Received event network-vif-unplugged-71caa935-899c-4716-9953-ae35733e691e {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:59:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-f030708e-0894-4bed-a702-3aebee1284a3 req-e0c3461f-3a8d-4763-9563-8bef25396243 service nova] Acquiring lock "2316aa9e-d4c9-43d0-9918-86265583aed1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:59:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-f030708e-0894-4bed-a702-3aebee1284a3 req-e0c3461f-3a8d-4763-9563-8bef25396243 service nova] Lock "2316aa9e-d4c9-43d0-9918-86265583aed1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:59:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-f030708e-0894-4bed-a702-3aebee1284a3 req-e0c3461f-3a8d-4763-9563-8bef25396243 service nova] Lock "2316aa9e-d4c9-43d0-9918-86265583aed1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:59:18 user nova-compute[75341]: DEBUG nova.compute.manager [req-f030708e-0894-4bed-a702-3aebee1284a3 req-e0c3461f-3a8d-4763-9563-8bef25396243 service nova] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] No waiting events found dispatching network-vif-unplugged-71caa935-899c-4716-9953-ae35733e691e {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:59:18 user nova-compute[75341]: DEBUG nova.compute.manager [req-f030708e-0894-4bed-a702-3aebee1284a3 req-e0c3461f-3a8d-4763-9563-8bef25396243 service nova] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Received event network-vif-unplugged-71caa935-899c-4716-9953-ae35733e691e for instance with task_state deleting. {{(pid=75341) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 23:59:18 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Instance destroyed successfully.
Nov 14 23:59:18 user nova-compute[75341]: DEBUG nova.objects.instance [None req-4ef521b6-5764-42ab-8b85-46bdc9ef077a tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lazy-loading 'resources' on Instance uuid 2316aa9e-d4c9-43d0-9918-86265583aed1 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:59:18 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-4ef521b6-5764-42ab-8b85-46bdc9ef077a tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:49:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-154597700',display_name='tempest-AttachVolumeTestJSON-server-154597700',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-154597700',id=32,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaFgRJa61ME1XpWOzpNtbuqeAV1SySIMy7vrqCjTh61rgrkmD4lVtobnjyZbOLvU5WmBzUQHKYD/KyyedZ/uzEQoe71Auc/XFD5jRK6KaS6v9fK21UKVH1TMup4zwPhng==',key_name='tempest-keypair-1222319400',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:49:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e601d11e75d4ec4b7c05e615c67fe20',ramdisk_id='',reservation_id='r-2tbsxelf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1907700292',owner_user_name='tempest-AttachVolumeTestJSON-1907700292-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:57:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa84b131dff84566810c44b553b09ba8',uuid=2316aa9e-d4c9-43d0-9918-86265583aed1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "71caa935-899c-4716-9953-ae35733e691e", "address": "fa:16:3e:3d:1f:4a", "network": {"id": "167936c8-5f28-439e-9a1f-d9356b3a1ec9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374167607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e601d11e75d4ec4b7c05e615c67fe20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71caa935-89", "ovs_interfaceid": "71caa935-899c-4716-9953-ae35733e691e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 23:59:18 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-4ef521b6-5764-42ab-8b85-46bdc9ef077a tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Converting VIF {"id": "71caa935-899c-4716-9953-ae35733e691e", "address": "fa:16:3e:3d:1f:4a", "network": {"id": "167936c8-5f28-439e-9a1f-d9356b3a1ec9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374167607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e601d11e75d4ec4b7c05e615c67fe20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71caa935-89", "ovs_interfaceid": "71caa935-899c-4716-9953-ae35733e691e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:59:18 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-4ef521b6-5764-42ab-8b85-46bdc9ef077a tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:1f:4a,bridge_name='br-int',has_traffic_filtering=True,id=71caa935-899c-4716-9953-ae35733e691e,network=Network(167936c8-5f28-439e-9a1f-d9356b3a1ec9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71caa935-89') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:59:18 user nova-compute[75341]: DEBUG os_vif [None req-4ef521b6-5764-42ab-8b85-46bdc9ef077a tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:1f:4a,bridge_name='br-int',has_traffic_filtering=True,id=71caa935-899c-4716-9953-ae35733e691e,network=Network(167936c8-5f28-439e-9a1f-d9356b3a1ec9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71caa935-89') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 23:59:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:59:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap71caa935-89, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:59:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:59:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:59:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:59:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:59:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ea6b7e77-8de3-4b19-b70b-d9ca5750b882) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:59:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:59:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:59:18 user nova-compute[75341]: INFO os_vif [None req-4ef521b6-5764-42ab-8b85-46bdc9ef077a tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:1f:4a,bridge_name='br-int',has_traffic_filtering=True,id=71caa935-899c-4716-9953-ae35733e691e,network=Network(167936c8-5f28-439e-9a1f-d9356b3a1ec9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71caa935-89')
Nov 14 23:59:18 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-4ef521b6-5764-42ab-8b85-46bdc9ef077a tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Deleting instance files /opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1_del
Nov 14 23:59:18 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-4ef521b6-5764-42ab-8b85-46bdc9ef077a tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Deletion of /opt/stack/data/nova/instances/2316aa9e-d4c9-43d0-9918-86265583aed1_del complete
Nov 14 23:59:18 user nova-compute[75341]: INFO nova.compute.manager [None req-4ef521b6-5764-42ab-8b85-46bdc9ef077a tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 14 23:59:18 user nova-compute[75341]: DEBUG oslo.service.loopingcall [None req-4ef521b6-5764-42ab-8b85-46bdc9ef077a tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75341) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 23:59:18 user nova-compute[75341]: DEBUG nova.compute.manager [-] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Deallocating network for instance {{(pid=75341) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 23:59:18 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] deallocate_for_instance() {{(pid=75341) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 23:59:19 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:59:19 user nova-compute[75341]: INFO nova.compute.manager [-] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Took 0.85 seconds to deallocate network for instance.
Nov 14 23:59:19 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-4ef521b6-5764-42ab-8b85-46bdc9ef077a tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:59:19 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-4ef521b6-5764-42ab-8b85-46bdc9ef077a tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:59:19 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-4ef521b6-5764-42ab-8b85-46bdc9ef077a tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:59:19 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-4ef521b6-5764-42ab-8b85-46bdc9ef077a tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:59:19 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-4ef521b6-5764-42ab-8b85-46bdc9ef077a tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.277s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:59:19 user nova-compute[75341]: INFO nova.scheduler.client.report [None req-4ef521b6-5764-42ab-8b85-46bdc9ef077a tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Deleted allocations for instance 2316aa9e-d4c9-43d0-9918-86265583aed1
Nov 14 23:59:20 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-4ef521b6-5764-42ab-8b85-46bdc9ef077a tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "2316aa9e-d4c9-43d0-9918-86265583aed1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.213s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:59:20 user nova-compute[75341]: DEBUG nova.compute.manager [req-f73dbc4f-46fe-42d0-940f-e0401b2d3fe3 req-7d505822-6bba-480a-8eb0-bff9daf19798 service nova] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Received event network-vif-plugged-71caa935-899c-4716-9953-ae35733e691e {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:59:20 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-f73dbc4f-46fe-42d0-940f-e0401b2d3fe3 req-7d505822-6bba-480a-8eb0-bff9daf19798 service nova] Acquiring lock "2316aa9e-d4c9-43d0-9918-86265583aed1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:59:20 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-f73dbc4f-46fe-42d0-940f-e0401b2d3fe3 req-7d505822-6bba-480a-8eb0-bff9daf19798 service nova] Lock "2316aa9e-d4c9-43d0-9918-86265583aed1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:59:20 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-f73dbc4f-46fe-42d0-940f-e0401b2d3fe3 req-7d505822-6bba-480a-8eb0-bff9daf19798 service nova] Lock "2316aa9e-d4c9-43d0-9918-86265583aed1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:59:20 user nova-compute[75341]: DEBUG nova.compute.manager [req-f73dbc4f-46fe-42d0-940f-e0401b2d3fe3 req-7d505822-6bba-480a-8eb0-bff9daf19798 service nova] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] No waiting events found dispatching network-vif-plugged-71caa935-899c-4716-9953-ae35733e691e {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:59:20 user nova-compute[75341]: WARNING nova.compute.manager [req-f73dbc4f-46fe-42d0-940f-e0401b2d3fe3 req-7d505822-6bba-480a-8eb0-bff9daf19798 service nova] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Received unexpected event network-vif-plugged-71caa935-899c-4716-9953-ae35733e691e for instance with vm_state deleted and task_state None.
Nov 14 23:59:20 user nova-compute[75341]: DEBUG nova.compute.manager [req-f73dbc4f-46fe-42d0-940f-e0401b2d3fe3 req-7d505822-6bba-480a-8eb0-bff9daf19798 service nova] [instance: 2316aa9e-d4c9-43d0-9918-86265583aed1] Received event network-vif-deleted-71caa935-899c-4716-9953-ae35733e691e {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:59:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:59:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:59:23 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:59:23 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-45f4d805-bf68-4bae-8a3f-106c9ede7559 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Acquiring lock "c62455e6-61af-45b1-899f-bad37dc57b22" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:59:23 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-45f4d805-bf68-4bae-8a3f-106c9ede7559 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "c62455e6-61af-45b1-899f-bad37dc57b22" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:59:23 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-45f4d805-bf68-4bae-8a3f-106c9ede7559 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Acquiring lock "c62455e6-61af-45b1-899f-bad37dc57b22-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:59:23 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-45f4d805-bf68-4bae-8a3f-106c9ede7559 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "c62455e6-61af-45b1-899f-bad37dc57b22-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:59:23 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-45f4d805-bf68-4bae-8a3f-106c9ede7559 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "c62455e6-61af-45b1-899f-bad37dc57b22-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:59:23 user nova-compute[75341]: INFO nova.compute.manager [None req-45f4d805-bf68-4bae-8a3f-106c9ede7559 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Terminating instance
Nov 14 23:59:23 user nova-compute[75341]: DEBUG nova.compute.manager [None req-45f4d805-bf68-4bae-8a3f-106c9ede7559 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Start destroying the instance on the hypervisor. {{(pid=75341) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 23:59:23 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:59:23 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:59:24 user nova-compute[75341]: DEBUG nova.compute.manager [req-7274215f-a09e-45ac-b8a8-9891e0aca283 req-526bbc19-700e-4ad1-baac-5753cc34ef72 service nova] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Received event network-vif-unplugged-8989d87f-615c-4cfe-9d3d-6c012e3fdf48 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:59:24 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-7274215f-a09e-45ac-b8a8-9891e0aca283 req-526bbc19-700e-4ad1-baac-5753cc34ef72 service nova] Acquiring lock "c62455e6-61af-45b1-899f-bad37dc57b22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:59:24 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-7274215f-a09e-45ac-b8a8-9891e0aca283 req-526bbc19-700e-4ad1-baac-5753cc34ef72 service nova] Lock "c62455e6-61af-45b1-899f-bad37dc57b22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:59:24 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-7274215f-a09e-45ac-b8a8-9891e0aca283 req-526bbc19-700e-4ad1-baac-5753cc34ef72 service nova] Lock "c62455e6-61af-45b1-899f-bad37dc57b22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:59:24 user nova-compute[75341]: DEBUG nova.compute.manager [req-7274215f-a09e-45ac-b8a8-9891e0aca283 req-526bbc19-700e-4ad1-baac-5753cc34ef72 service nova] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] No waiting events found dispatching network-vif-unplugged-8989d87f-615c-4cfe-9d3d-6c012e3fdf48 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:59:24 user nova-compute[75341]: DEBUG nova.compute.manager [req-7274215f-a09e-45ac-b8a8-9891e0aca283 req-526bbc19-700e-4ad1-baac-5753cc34ef72 service nova] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Received event network-vif-unplugged-8989d87f-615c-4cfe-9d3d-6c012e3fdf48 for instance with task_state deleting. {{(pid=75341) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 23:59:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:59:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:59:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:59:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:59:24 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Instance destroyed successfully.
Nov 14 23:59:24 user nova-compute[75341]: DEBUG nova.objects.instance [None req-45f4d805-bf68-4bae-8a3f-106c9ede7559 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lazy-loading 'resources' on Instance uuid c62455e6-61af-45b1-899f-bad37dc57b22 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:59:24 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-45f4d805-bf68-4bae-8a3f-106c9ede7559 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:52:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1462035552',display_name='tempest-ServerRescueNegativeTestJSON-server-1462035552',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1462035552',id=38,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNs4W2OktPVBOZWeaKzDzmXrUWs93ClVQv27cek+6cQRNCqjAwvdx6Y93/zXFXRb3ClOs1rK9E9IRD2QFgmNu1bmmVuar6AjgojHBaCfi643v9btLecoeDIfapdQ5VGE1g==',key_name='tempest-keypair-1814364720',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:54:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='44bb8b1415c14bb59c4c35cc2b830875',ramdisk_id='',reservation_id='r-zjkidlzv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1956631656',owner_user_name='tempest-ServerRescueNegativeTestJSON-1956631656-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:56:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c49a358e2f942f3a9777910ee755575',uuid=c62455e6-61af-45b1-899f-bad37dc57b22,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8989d87f-615c-4cfe-9d3d-6c012e3fdf48", "address": "fa:16:3e:2d:04:44", "network": {"id": "fcd22da6-016e-4872-a84c-4d82601c48d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-550677181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44bb8b1415c14bb59c4c35cc2b830875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8989d87f-61", "ovs_interfaceid": "8989d87f-615c-4cfe-9d3d-6c012e3fdf48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 23:59:24 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-45f4d805-bf68-4bae-8a3f-106c9ede7559 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Converting VIF {"id": "8989d87f-615c-4cfe-9d3d-6c012e3fdf48", "address": "fa:16:3e:2d:04:44", "network": {"id": "fcd22da6-016e-4872-a84c-4d82601c48d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-550677181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44bb8b1415c14bb59c4c35cc2b830875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8989d87f-61", "ovs_interfaceid": "8989d87f-615c-4cfe-9d3d-6c012e3fdf48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:59:24 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-45f4d805-bf68-4bae-8a3f-106c9ede7559 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2d:04:44,bridge_name='br-int',has_traffic_filtering=True,id=8989d87f-615c-4cfe-9d3d-6c012e3fdf48,network=Network(fcd22da6-016e-4872-a84c-4d82601c48d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8989d87f-61') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:59:24 user nova-compute[75341]: DEBUG os_vif [None req-45f4d805-bf68-4bae-8a3f-106c9ede7559 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:04:44,bridge_name='br-int',has_traffic_filtering=True,id=8989d87f-615c-4cfe-9d3d-6c012e3fdf48,network=Network(fcd22da6-016e-4872-a84c-4d82601c48d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8989d87f-61') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 23:59:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:59:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8989d87f-61, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:59:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:59:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:59:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:59:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=37bf4bf4-23e4-4a05-9425-768ba4c13030) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:59:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:59:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:59:24 user nova-compute[75341]: INFO os_vif [None req-45f4d805-bf68-4bae-8a3f-106c9ede7559 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:04:44,bridge_name='br-int',has_traffic_filtering=True,id=8989d87f-615c-4cfe-9d3d-6c012e3fdf48,network=Network(fcd22da6-016e-4872-a84c-4d82601c48d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8989d87f-61')
Nov 14 23:59:24 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-45f4d805-bf68-4bae-8a3f-106c9ede7559 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Deleting instance files /opt/stack/data/nova/instances/c62455e6-61af-45b1-899f-bad37dc57b22_del
Nov 14 23:59:24 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-45f4d805-bf68-4bae-8a3f-106c9ede7559 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Deletion of /opt/stack/data/nova/instances/c62455e6-61af-45b1-899f-bad37dc57b22_del complete
Nov 14 23:59:24 user nova-compute[75341]: INFO nova.compute.manager [None req-45f4d805-bf68-4bae-8a3f-106c9ede7559 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 14 23:59:24 user nova-compute[75341]: DEBUG oslo.service.loopingcall [None req-45f4d805-bf68-4bae-8a3f-106c9ede7559 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75341) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 23:59:24 user nova-compute[75341]: DEBUG nova.compute.manager [-] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Deallocating network for instance {{(pid=75341) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 23:59:24 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] deallocate_for_instance() {{(pid=75341) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 23:59:25 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:59:25 user nova-compute[75341]: INFO nova.compute.manager [-] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Took 0.90 seconds to deallocate network for instance.
Nov 14 23:59:25 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-45f4d805-bf68-4bae-8a3f-106c9ede7559 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:59:25 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-45f4d805-bf68-4bae-8a3f-106c9ede7559 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:59:26 user nova-compute[75341]: DEBUG nova.compute.manager [req-6aff09d1-ac08-4b6c-bc4b-b543333ae117 req-6b445756-3f8d-4442-8368-60258978df2e service nova] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Received event network-vif-plugged-8989d87f-615c-4cfe-9d3d-6c012e3fdf48 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:59:26 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6aff09d1-ac08-4b6c-bc4b-b543333ae117 req-6b445756-3f8d-4442-8368-60258978df2e service nova] Acquiring lock "c62455e6-61af-45b1-899f-bad37dc57b22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:59:26 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6aff09d1-ac08-4b6c-bc4b-b543333ae117 req-6b445756-3f8d-4442-8368-60258978df2e service nova] Lock "c62455e6-61af-45b1-899f-bad37dc57b22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:59:26 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6aff09d1-ac08-4b6c-bc4b-b543333ae117 req-6b445756-3f8d-4442-8368-60258978df2e service nova] Lock "c62455e6-61af-45b1-899f-bad37dc57b22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:59:26 user nova-compute[75341]: DEBUG nova.compute.manager [req-6aff09d1-ac08-4b6c-bc4b-b543333ae117 req-6b445756-3f8d-4442-8368-60258978df2e service nova] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] No waiting events found dispatching network-vif-plugged-8989d87f-615c-4cfe-9d3d-6c012e3fdf48 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:59:26 user nova-compute[75341]: WARNING nova.compute.manager [req-6aff09d1-ac08-4b6c-bc4b-b543333ae117 req-6b445756-3f8d-4442-8368-60258978df2e service nova] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Received unexpected event network-vif-plugged-8989d87f-615c-4cfe-9d3d-6c012e3fdf48 for instance with vm_state deleted and task_state None.
Nov 14 23:59:26 user nova-compute[75341]: DEBUG nova.compute.manager [req-6aff09d1-ac08-4b6c-bc4b-b543333ae117 req-6b445756-3f8d-4442-8368-60258978df2e service nova] [instance: c62455e6-61af-45b1-899f-bad37dc57b22] Received event network-vif-deleted-8989d87f-615c-4cfe-9d3d-6c012e3fdf48 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:59:26 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-45f4d805-bf68-4bae-8a3f-106c9ede7559 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:59:26 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-45f4d805-bf68-4bae-8a3f-106c9ede7559 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:59:26 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-45f4d805-bf68-4bae-8a3f-106c9ede7559 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.389s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:59:26 user nova-compute[75341]: INFO nova.scheduler.client.report [None req-45f4d805-bf68-4bae-8a3f-106c9ede7559 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Deleted allocations for instance c62455e6-61af-45b1-899f-bad37dc57b22
Nov 14 23:59:26 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-45f4d805-bf68-4bae-8a3f-106c9ede7559 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "c62455e6-61af-45b1-899f-bad37dc57b22" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.559s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:59:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:59:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:59:34 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:59:34 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:59:34 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 23:59:34 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 23:59:34 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 23:59:34 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:59:39 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:59:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:59:43 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:59:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:59:46 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:59:47 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:59:48 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:59:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:59:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:59:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Acquiring lock "f48db53c-618c-42fc-a688-974cc75f3598" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:59:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "f48db53c-618c-42fc-a688-974cc75f3598" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:59:52 user nova-compute[75341]: DEBUG nova.compute.manager [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Starting instance... {{(pid=75341) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 23:59:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:59:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:59:52 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75341) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 23:59:52 user nova-compute[75341]: INFO nova.compute.claims [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Claim successful on node user
Nov 14 23:59:52 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:59:52 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:59:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.382s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:59:52 user nova-compute[75341]: DEBUG nova.compute.manager [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Start building networks asynchronously for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 23:59:52 user nova-compute[75341]: DEBUG nova.compute.manager [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Allocating IP information in the background. {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 23:59:52 user nova-compute[75341]: DEBUG nova.network.neutron [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: f48db53c-618c-42fc-a688-974cc75f3598] allocate_for_instance() {{(pid=75341) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 23:59:52 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 23:59:52 user nova-compute[75341]: DEBUG nova.compute.manager [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Start building block device mappings for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 23:59:53 user nova-compute[75341]: DEBUG nova.compute.manager [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Start spawning the instance on the hypervisor. {{(pid=75341) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 23:59:53 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Creating instance directory {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 23:59:53 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Creating image(s)
Nov 14 23:59:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Acquiring lock "/opt/stack/data/nova/instances/f48db53c-618c-42fc-a688-974cc75f3598/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:59:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "/opt/stack/data/nova/instances/f48db53c-618c-42fc-a688-974cc75f3598/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:59:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "/opt/stack/data/nova/instances/f48db53c-618c-42fc-a688-974cc75f3598/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:59:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Acquiring lock "cb60ccba765983a5b3e0e36eba011aaa71328a3b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:59:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "cb60ccba765983a5b3e0e36eba011aaa71328a3b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:59:53 user nova-compute[75341]: DEBUG nova.policy [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1b1c77e1e34b46319dcd52a38996542c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8c1eeb4c3c4f27b774aba29ceb7997', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75341) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 23:59:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb60ccba765983a5b3e0e36eba011aaa71328a3b.part --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:59:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb60ccba765983a5b3e0e36eba011aaa71328a3b.part --force-share --output=json" returned: 0 in 0.176s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:59:53 user nova-compute[75341]: DEBUG nova.virt.images [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] a514ccdd-c667-4101-b446-774c8244dedb was qcow2, converting to raw {{(pid=75341) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 23:59:53 user nova-compute[75341]: DEBUG nova.privsep.utils [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75341) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 23:59:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cb60ccba765983a5b3e0e36eba011aaa71328a3b.part /opt/stack/data/nova/instances/_base/cb60ccba765983a5b3e0e36eba011aaa71328a3b.converted {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:59:53 user nova-compute[75341]: DEBUG nova.network.neutron [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Successfully created port: b9bfab22-02f7-4620-9bd5-f65817bc199a {{(pid=75341) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 23:59:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cb60ccba765983a5b3e0e36eba011aaa71328a3b.part /opt/stack/data/nova/instances/_base/cb60ccba765983a5b3e0e36eba011aaa71328a3b.converted" returned: 0 in 0.346s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:59:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb60ccba765983a5b3e0e36eba011aaa71328a3b.converted --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:59:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb60ccba765983a5b3e0e36eba011aaa71328a3b.converted --force-share --output=json" returned: 0 in 0.174s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:59:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "cb60ccba765983a5b3e0e36eba011aaa71328a3b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.200s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:59:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb60ccba765983a5b3e0e36eba011aaa71328a3b --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:59:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb60ccba765983a5b3e0e36eba011aaa71328a3b --force-share --output=json" returned: 0 in 0.172s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:59:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Acquiring lock "cb60ccba765983a5b3e0e36eba011aaa71328a3b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:59:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "cb60ccba765983a5b3e0e36eba011aaa71328a3b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:59:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb60ccba765983a5b3e0e36eba011aaa71328a3b --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:59:54 user nova-compute[75341]: DEBUG nova.network.neutron [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Successfully updated port: b9bfab22-02f7-4620-9bd5-f65817bc199a {{(pid=75341) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 23:59:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Acquiring lock "refresh_cache-f48db53c-618c-42fc-a688-974cc75f3598" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:59:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Acquired lock "refresh_cache-f48db53c-618c-42fc-a688-974cc75f3598" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:59:54 user nova-compute[75341]: DEBUG nova.network.neutron [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 23:59:54 user nova-compute[75341]: DEBUG nova.compute.manager [req-d7108496-8f9b-467f-bab2-f446a91b3923 req-bcda67c8-866b-44a2-a0ca-ba8c62d48122 service nova] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Received event network-changed-b9bfab22-02f7-4620-9bd5-f65817bc199a {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:59:54 user nova-compute[75341]: DEBUG nova.compute.manager [req-d7108496-8f9b-467f-bab2-f446a91b3923 req-bcda67c8-866b-44a2-a0ca-ba8c62d48122 service nova] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Refreshing instance network info cache due to event network-changed-b9bfab22-02f7-4620-9bd5-f65817bc199a. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:59:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-d7108496-8f9b-467f-bab2-f446a91b3923 req-bcda67c8-866b-44a2-a0ca-ba8c62d48122 service nova] Acquiring lock "refresh_cache-f48db53c-618c-42fc-a688-974cc75f3598" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:59:54 user nova-compute[75341]: DEBUG nova.network.neutron [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Instance cache missing network info. {{(pid=75341) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 23:59:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb60ccba765983a5b3e0e36eba011aaa71328a3b --force-share --output=json" returned: 0 in 0.177s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:59:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cb60ccba765983a5b3e0e36eba011aaa71328a3b,backing_fmt=raw /opt/stack/data/nova/instances/f48db53c-618c-42fc-a688-974cc75f3598/disk 1073741824 {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:59:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cb60ccba765983a5b3e0e36eba011aaa71328a3b,backing_fmt=raw /opt/stack/data/nova/instances/f48db53c-618c-42fc-a688-974cc75f3598/disk 1073741824" returned: 0 in 0.051s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:59:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "cb60ccba765983a5b3e0e36eba011aaa71328a3b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:59:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb60ccba765983a5b3e0e36eba011aaa71328a3b --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:59:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:59:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb60ccba765983a5b3e0e36eba011aaa71328a3b --force-share --output=json" returned: 0 in 0.170s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:59:54 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f48db53c-618c-42fc-a688-974cc75f3598/disk. size=1073741824 {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 23:59:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48db53c-618c-42fc-a688-974cc75f3598/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:59:54 user nova-compute[75341]: DEBUG nova.network.neutron [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Updating instance_info_cache with network_info: [{"id": "b9bfab22-02f7-4620-9bd5-f65817bc199a", "address": "fa:16:3e:10:f1:8e", "network": {"id": "e8f13b75-3423-43ce-b6dc-843c837e46d2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-617247022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8c1eeb4c3c4f27b774aba29ceb7997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9bfab22-02", "ovs_interfaceid": "b9bfab22-02f7-4620-9bd5-f65817bc199a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:59:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Releasing lock "refresh_cache-f48db53c-618c-42fc-a688-974cc75f3598" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:59:54 user nova-compute[75341]: DEBUG nova.compute.manager [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Instance network_info: |[{"id": "b9bfab22-02f7-4620-9bd5-f65817bc199a", "address": "fa:16:3e:10:f1:8e", "network": {"id": "e8f13b75-3423-43ce-b6dc-843c837e46d2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-617247022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8c1eeb4c3c4f27b774aba29ceb7997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9bfab22-02", "ovs_interfaceid": "b9bfab22-02f7-4620-9bd5-f65817bc199a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 23:59:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-d7108496-8f9b-467f-bab2-f446a91b3923 req-bcda67c8-866b-44a2-a0ca-ba8c62d48122 service nova] Acquired lock "refresh_cache-f48db53c-618c-42fc-a688-974cc75f3598" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:59:54 user nova-compute[75341]: DEBUG nova.network.neutron [req-d7108496-8f9b-467f-bab2-f446a91b3923 req-bcda67c8-866b-44a2-a0ca-ba8c62d48122 service nova] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Refreshing network info cache for port b9bfab22-02f7-4620-9bd5-f65817bc199a {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:59:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48db53c-618c-42fc-a688-974cc75f3598/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:59:54 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Cannot resize image /opt/stack/data/nova/instances/f48db53c-618c-42fc-a688-974cc75f3598/disk to a smaller size. {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 23:59:54 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Created local disks {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 23:59:54 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Ensure instance console log exists: /opt/stack/data/nova/instances/f48db53c-618c-42fc-a688-974cc75f3598/console.log {{(pid=75341) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 23:59:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:59:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:59:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:59:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Start _get_guest_xml network_info=[{"id": "b9bfab22-02f7-4620-9bd5-f65817bc199a", "address": "fa:16:3e:10:f1:8e", "network": {"id": "e8f13b75-3423-43ce-b6dc-843c837e46d2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-617247022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8c1eeb4c3c4f27b774aba29ceb7997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9bfab22-02", "ovs_interfaceid": "b9bfab22-02f7-4620-9bd5-f65817bc199a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:59:50Z,direct_url=<?>,disk_format='qcow2',id=a514ccdd-c667-4101-b446-774c8244dedb,min_disk=0,min_ram=0,name='tempest-scenario-img--1244423963',owner='9f8c1eeb4c3c4f27b774aba29ceb7997',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:59:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encrypted': False, 'image_id': 'a514ccdd-c667-4101-b446-774c8244dedb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 23:59:55 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:59:55 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:59:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 23:59:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 23:59:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 23:59:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 23:59:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 23:59:55 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:59:50Z,direct_url=<?>,disk_format='qcow2',id=a514ccdd-c667-4101-b446-774c8244dedb,min_disk=0,min_ram=0,name='tempest-scenario-img--1244423963',owner='9f8c1eeb4c3c4f27b774aba29ceb7997',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:59:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 23:59:55 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 23:59:55 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 23:59:55 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 23:59:55 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 23:59:55 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 23:59:55 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 23:59:55 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 23:59:55 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 23:59:55 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 23:59:55 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 23:59:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:59:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-89893269',display_name='tempest-TestMinimumBasicScenario-server-89893269',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-89893269',id=44,image_ref='a514ccdd-c667-4101-b446-774c8244dedb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD0eZ5MsnBvG5pKKJBm4DlYZrp8vwl0KUIoqF3rAYo2HUDLyr+TZxLNlaqGyAUDWA2dfkwjc9L12nHbBmdHRBsmT0iiatxTfrEomOcKH/IzhH6JOzKHsaGB/tcMn536jXg==',key_name='tempest-TestMinimumBasicScenario-1806050912',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f8c1eeb4c3c4f27b774aba29ceb7997',ramdisk_id='',reservation_id='r-t0gzgsz8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a514ccdd-c667-4101-b446-774c8244dedb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-157558920',owner_user_name='tempest-TestMinimumBasicScenario-157558920-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:59:53Z,user_data=None,user_id='1b1c77e1e34b46319dcd52a38996542c',uuid=f48db53c-618c-42fc-a688-974cc75f3598,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9bfab22-02f7-4620-9bd5-f65817bc199a", "address": "fa:16:3e:10:f1:8e", "network": {"id": "e8f13b75-3423-43ce-b6dc-843c837e46d2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-617247022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8c1eeb4c3c4f27b774aba29ceb7997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9bfab22-02", "ovs_interfaceid": "b9bfab22-02f7-4620-9bd5-f65817bc199a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 23:59:55 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Converting VIF {"id": "b9bfab22-02f7-4620-9bd5-f65817bc199a", "address": "fa:16:3e:10:f1:8e", "network": {"id": "e8f13b75-3423-43ce-b6dc-843c837e46d2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-617247022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8c1eeb4c3c4f27b774aba29ceb7997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9bfab22-02", "ovs_interfaceid": "b9bfab22-02f7-4620-9bd5-f65817bc199a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:59:55 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:f1:8e,bridge_name='br-int',has_traffic_filtering=True,id=b9bfab22-02f7-4620-9bd5-f65817bc199a,network=Network(e8f13b75-3423-43ce-b6dc-843c837e46d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9bfab22-02') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:59:55 user nova-compute[75341]: DEBUG nova.objects.instance [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lazy-loading 'pci_devices' on Instance uuid f48db53c-618c-42fc-a688-974cc75f3598 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:59:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: f48db53c-618c-42fc-a688-974cc75f3598] End _get_guest_xml xml=<domain type="kvm">
Nov 14 23:59:55 user nova-compute[75341]:   <uuid>f48db53c-618c-42fc-a688-974cc75f3598</uuid>
Nov 14 23:59:55 user nova-compute[75341]:   <name>instance-0000002c</name>
Nov 14 23:59:55 user nova-compute[75341]:   <memory>524288</memory>
Nov 14 23:59:55 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 14 23:59:55 user nova-compute[75341]:   <metadata>
Nov 14 23:59:55 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 23:59:55 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 14 23:59:55 user nova-compute[75341]:       <nova:name>tempest-TestMinimumBasicScenario-server-89893269</nova:name>
Nov 14 23:59:55 user nova-compute[75341]:       <nova:creationTime>2023-11-14 23:59:55</nova:creationTime>
Nov 14 23:59:55 user nova-compute[75341]:       <nova:flavor name="m1.tiny">
Nov 14 23:59:55 user nova-compute[75341]:         <nova:memory>512</nova:memory>
Nov 14 23:59:55 user nova-compute[75341]:         <nova:disk>1</nova:disk>
Nov 14 23:59:55 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 14 23:59:55 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 23:59:55 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 14 23:59:55 user nova-compute[75341]:       </nova:flavor>
Nov 14 23:59:55 user nova-compute[75341]:       <nova:owner>
Nov 14 23:59:55 user nova-compute[75341]:         <nova:user uuid="1b1c77e1e34b46319dcd52a38996542c">tempest-TestMinimumBasicScenario-157558920-project-member</nova:user>
Nov 14 23:59:55 user nova-compute[75341]:         <nova:project uuid="9f8c1eeb4c3c4f27b774aba29ceb7997">tempest-TestMinimumBasicScenario-157558920</nova:project>
Nov 14 23:59:55 user nova-compute[75341]:       </nova:owner>
Nov 14 23:59:55 user nova-compute[75341]:       <nova:root type="image" uuid="a514ccdd-c667-4101-b446-774c8244dedb"/>
Nov 14 23:59:55 user nova-compute[75341]:       <nova:ports>
Nov 14 23:59:55 user nova-compute[75341]:         <nova:port uuid="b9bfab22-02f7-4620-9bd5-f65817bc199a">
Nov 14 23:59:55 user nova-compute[75341]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 23:59:55 user nova-compute[75341]:         </nova:port>
Nov 14 23:59:55 user nova-compute[75341]:       </nova:ports>
Nov 14 23:59:55 user nova-compute[75341]:     </nova:instance>
Nov 14 23:59:55 user nova-compute[75341]:   </metadata>
Nov 14 23:59:55 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 14 23:59:55 user nova-compute[75341]:     <system>
Nov 14 23:59:55 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 23:59:55 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 14 23:59:55 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 14 23:59:55 user nova-compute[75341]:       <entry name="serial">f48db53c-618c-42fc-a688-974cc75f3598</entry>
Nov 14 23:59:55 user nova-compute[75341]:       <entry name="uuid">f48db53c-618c-42fc-a688-974cc75f3598</entry>
Nov 14 23:59:55 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 14 23:59:55 user nova-compute[75341]:     </system>
Nov 14 23:59:55 user nova-compute[75341]:   </sysinfo>
Nov 14 23:59:55 user nova-compute[75341]:   <os>
Nov 14 23:59:55 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 23:59:55 user nova-compute[75341]:     <boot dev="hd"/>
Nov 14 23:59:55 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 14 23:59:55 user nova-compute[75341]:   </os>
Nov 14 23:59:55 user nova-compute[75341]:   <features>
Nov 14 23:59:55 user nova-compute[75341]:     <acpi/>
Nov 14 23:59:55 user nova-compute[75341]:     <apic/>
Nov 14 23:59:55 user nova-compute[75341]:     <vmcoreinfo/>
Nov 14 23:59:55 user nova-compute[75341]:   </features>
Nov 14 23:59:55 user nova-compute[75341]:   <clock offset="utc">
Nov 14 23:59:55 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 23:59:55 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 23:59:55 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 14 23:59:55 user nova-compute[75341]:   </clock>
Nov 14 23:59:55 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 14 23:59:55 user nova-compute[75341]:     <model>Nehalem</model>
Nov 14 23:59:55 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 23:59:55 user nova-compute[75341]:   </cpu>
Nov 14 23:59:55 user nova-compute[75341]:   <devices>
Nov 14 23:59:55 user nova-compute[75341]:     <disk type="file" device="disk">
Nov 14 23:59:55 user nova-compute[75341]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 23:59:55 user nova-compute[75341]:       <source file="/opt/stack/data/nova/instances/f48db53c-618c-42fc-a688-974cc75f3598/disk"/>
Nov 14 23:59:55 user nova-compute[75341]:       <target dev="vda" bus="virtio"/>
Nov 14 23:59:55 user nova-compute[75341]:     </disk>
Nov 14 23:59:55 user nova-compute[75341]:     <interface type="ethernet">
Nov 14 23:59:55 user nova-compute[75341]:       <mac address="fa:16:3e:10:f1:8e"/>
Nov 14 23:59:55 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:59:55 user nova-compute[75341]:       <mtu size="1442"/>
Nov 14 23:59:55 user nova-compute[75341]:       <target dev="tapb9bfab22-02"/>
Nov 14 23:59:55 user nova-compute[75341]:     </interface>
Nov 14 23:59:55 user nova-compute[75341]:     <serial type="pty">
Nov 14 23:59:55 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/f48db53c-618c-42fc-a688-974cc75f3598/console.log" append="off"/>
Nov 14 23:59:55 user nova-compute[75341]:     </serial>
Nov 14 23:59:55 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 23:59:55 user nova-compute[75341]:     <video>
Nov 14 23:59:55 user nova-compute[75341]:       <model type="virtio"/>
Nov 14 23:59:55 user nova-compute[75341]:     </video>
Nov 14 23:59:55 user nova-compute[75341]:     <rng model="virtio">
Nov 14 23:59:55 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 14 23:59:55 user nova-compute[75341]:     </rng>
Nov 14 23:59:55 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 14 23:59:55 user nova-compute[75341]:     <memballoon model="virtio">
Nov 14 23:59:55 user nova-compute[75341]:       <stats period="10"/>
Nov 14 23:59:55 user nova-compute[75341]:     </memballoon>
Nov 14 23:59:55 user nova-compute[75341]:   </devices>
Nov 14 23:59:55 user nova-compute[75341]: </domain>
Nov 14 23:59:55 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 23:59:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:59:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-89893269',display_name='tempest-TestMinimumBasicScenario-server-89893269',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-89893269',id=44,image_ref='a514ccdd-c667-4101-b446-774c8244dedb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD0eZ5MsnBvG5pKKJBm4DlYZrp8vwl0KUIoqF3rAYo2HUDLyr+TZxLNlaqGyAUDWA2dfkwjc9L12nHbBmdHRBsmT0iiatxTfrEomOcKH/IzhH6JOzKHsaGB/tcMn536jXg==',key_name='tempest-TestMinimumBasicScenario-1806050912',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f8c1eeb4c3c4f27b774aba29ceb7997',ramdisk_id='',reservation_id='r-t0gzgsz8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a514ccdd-c667-4101-b446-774c8244dedb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-157558920',owner_user_name='tempest-TestMinimumBasicScenario-157558920-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T23:59:53Z,user_data=None,user_id='1b1c77e1e34b46319dcd52a38996542c',uuid=f48db53c-618c-42fc-a688-974cc75f3598,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9bfab22-02f7-4620-9bd5-f65817bc199a", "address": "fa:16:3e:10:f1:8e", "network": {"id": "e8f13b75-3423-43ce-b6dc-843c837e46d2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-617247022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8c1eeb4c3c4f27b774aba29ceb7997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9bfab22-02", "ovs_interfaceid": "b9bfab22-02f7-4620-9bd5-f65817bc199a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 23:59:55 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Converting VIF {"id": "b9bfab22-02f7-4620-9bd5-f65817bc199a", "address": "fa:16:3e:10:f1:8e", "network": {"id": "e8f13b75-3423-43ce-b6dc-843c837e46d2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-617247022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8c1eeb4c3c4f27b774aba29ceb7997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9bfab22-02", "ovs_interfaceid": "b9bfab22-02f7-4620-9bd5-f65817bc199a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:59:55 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:f1:8e,bridge_name='br-int',has_traffic_filtering=True,id=b9bfab22-02f7-4620-9bd5-f65817bc199a,network=Network(e8f13b75-3423-43ce-b6dc-843c837e46d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9bfab22-02') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:59:55 user nova-compute[75341]: DEBUG os_vif [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:f1:8e,bridge_name='br-int',has_traffic_filtering=True,id=b9bfab22-02f7-4620-9bd5-f65817bc199a,network=Network(e8f13b75-3423-43ce-b6dc-843c837e46d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9bfab22-02') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 23:59:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:59:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:59:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 23:59:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:59:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bc893fa2-7036-56b4-a1a9-f2cd3589bca4', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:59:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:59:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:59:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:59:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb9bfab22-02, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:59:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb9bfab22-02, col_values=(('qos', UUID('de5c58bf-d51a-4933-a428-da390148d4bb')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:59:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb9bfab22-02, col_values=(('external_ids', {'iface-id': 'b9bfab22-02f7-4620-9bd5-f65817bc199a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:f1:8e', 'vm-uuid': 'f48db53c-618c-42fc-a688-974cc75f3598'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:59:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:59:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:59:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:59:55 user nova-compute[75341]: INFO os_vif [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:f1:8e,bridge_name='br-int',has_traffic_filtering=True,id=b9bfab22-02f7-4620-9bd5-f65817bc199a,network=Network(e8f13b75-3423-43ce-b6dc-843c837e46d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9bfab22-02')
Nov 14 23:59:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:59:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] No VIF found with MAC fa:16:3e:10:f1:8e, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:59:55 user nova-compute[75341]: DEBUG nova.network.neutron [req-d7108496-8f9b-467f-bab2-f446a91b3923 req-bcda67c8-866b-44a2-a0ca-ba8c62d48122 service nova] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Updated VIF entry in instance network info cache for port b9bfab22-02f7-4620-9bd5-f65817bc199a. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:59:55 user nova-compute[75341]: DEBUG nova.network.neutron [req-d7108496-8f9b-467f-bab2-f446a91b3923 req-bcda67c8-866b-44a2-a0ca-ba8c62d48122 service nova] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Updating instance_info_cache with network_info: [{"id": "b9bfab22-02f7-4620-9bd5-f65817bc199a", "address": "fa:16:3e:10:f1:8e", "network": {"id": "e8f13b75-3423-43ce-b6dc-843c837e46d2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-617247022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8c1eeb4c3c4f27b774aba29ceb7997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9bfab22-02", "ovs_interfaceid": "b9bfab22-02f7-4620-9bd5-f65817bc199a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:59:55 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-d7108496-8f9b-467f-bab2-f446a91b3923 req-bcda67c8-866b-44a2-a0ca-ba8c62d48122 service nova] Releasing lock "refresh_cache-f48db53c-618c-42fc-a688-974cc75f3598" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:59:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:59:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:59:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:59:56 user nova-compute[75341]: DEBUG nova.compute.manager [req-7fc04ef7-95be-45ba-87cf-cb9948fd0dfd req-1fd2778b-ac48-46ae-9f5a-5b695cda8578 service nova] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Received event network-vif-plugged-b9bfab22-02f7-4620-9bd5-f65817bc199a {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:59:56 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-7fc04ef7-95be-45ba-87cf-cb9948fd0dfd req-1fd2778b-ac48-46ae-9f5a-5b695cda8578 service nova] Acquiring lock "f48db53c-618c-42fc-a688-974cc75f3598-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:59:56 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-7fc04ef7-95be-45ba-87cf-cb9948fd0dfd req-1fd2778b-ac48-46ae-9f5a-5b695cda8578 service nova] Lock "f48db53c-618c-42fc-a688-974cc75f3598-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:59:56 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-7fc04ef7-95be-45ba-87cf-cb9948fd0dfd req-1fd2778b-ac48-46ae-9f5a-5b695cda8578 service nova] Lock "f48db53c-618c-42fc-a688-974cc75f3598-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:59:56 user nova-compute[75341]: DEBUG nova.compute.manager [req-7fc04ef7-95be-45ba-87cf-cb9948fd0dfd req-1fd2778b-ac48-46ae-9f5a-5b695cda8578 service nova] [instance: f48db53c-618c-42fc-a688-974cc75f3598] No waiting events found dispatching network-vif-plugged-b9bfab22-02f7-4620-9bd5-f65817bc199a {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:59:56 user nova-compute[75341]: WARNING nova.compute.manager [req-7fc04ef7-95be-45ba-87cf-cb9948fd0dfd req-1fd2778b-ac48-46ae-9f5a-5b695cda8578 service nova] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Received unexpected event network-vif-plugged-b9bfab22-02f7-4620-9bd5-f65817bc199a for instance with vm_state building and task_state spawning.
Nov 14 23:59:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:59:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:59:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:59:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:59:58 user nova-compute[75341]: DEBUG nova.compute.manager [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Instance event wait completed in 0 seconds for  {{(pid=75341) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 23:59:58 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Guest created on hypervisor {{(pid=75341) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 23:59:58 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Instance spawned successfully.
Nov 14 23:59:58 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 23:59:58 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Found default for hw_cdrom_bus of ide {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:59:58 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Found default for hw_disk_bus of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:59:58 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Found default for hw_input_bus of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:59:58 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Found default for hw_pointer_model of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:59:58 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Found default for hw_video_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:59:58 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Found default for hw_vif_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 23:59:58 user nova-compute[75341]: INFO nova.compute.manager [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Took 5.64 seconds to spawn the instance on the hypervisor.
Nov 14 23:59:58 user nova-compute[75341]: DEBUG nova.compute.manager [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 23:59:58 user nova-compute[75341]: DEBUG nova.compute.manager [req-69be542c-5cd8-47f7-8d35-c734802889bb req-3c4e5a6e-2425-437a-a705-a3bcda854c5e service nova] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Received event network-vif-plugged-b9bfab22-02f7-4620-9bd5-f65817bc199a {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:59:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-69be542c-5cd8-47f7-8d35-c734802889bb req-3c4e5a6e-2425-437a-a705-a3bcda854c5e service nova] Acquiring lock "f48db53c-618c-42fc-a688-974cc75f3598-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:59:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-69be542c-5cd8-47f7-8d35-c734802889bb req-3c4e5a6e-2425-437a-a705-a3bcda854c5e service nova] Lock "f48db53c-618c-42fc-a688-974cc75f3598-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:59:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-69be542c-5cd8-47f7-8d35-c734802889bb req-3c4e5a6e-2425-437a-a705-a3bcda854c5e service nova] Lock "f48db53c-618c-42fc-a688-974cc75f3598-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:59:58 user nova-compute[75341]: DEBUG nova.compute.manager [req-69be542c-5cd8-47f7-8d35-c734802889bb req-3c4e5a6e-2425-437a-a705-a3bcda854c5e service nova] [instance: f48db53c-618c-42fc-a688-974cc75f3598] No waiting events found dispatching network-vif-plugged-b9bfab22-02f7-4620-9bd5-f65817bc199a {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:59:58 user nova-compute[75341]: WARNING nova.compute.manager [req-69be542c-5cd8-47f7-8d35-c734802889bb req-3c4e5a6e-2425-437a-a705-a3bcda854c5e service nova] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Received unexpected event network-vif-plugged-b9bfab22-02f7-4620-9bd5-f65817bc199a for instance with vm_state building and task_state spawning.
Nov 14 23:59:58 user nova-compute[75341]: INFO nova.compute.manager [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Took 6.32 seconds to build instance.
Nov 14 23:59:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-441afda0-0da2-43eb-8143-8c2ba1049391 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "f48db53c-618c-42fc-a688-974cc75f3598" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.448s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:59:58 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:59:59 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:59:59 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75341) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 00:00:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:01 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:00:01 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:00:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:02 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:00:02 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Starting heal instance info cache {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 00:00:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "refresh_cache-a80008bd-c61c-4a36-ae67-e556a5ecee08" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:00:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquired lock "refresh_cache-a80008bd-c61c-4a36-ae67-e556a5ecee08" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:00:03 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Forcefully refreshing network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 00:00:03 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Updating instance_info_cache with network_info: [{"id": "140e7083-e454-413d-892e-a4784b4cea66", "address": "fa:16:3e:69:fb:24", "network": {"id": "227eb779-a064-477d-8447-45862017ae7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-3827253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96674073965642f1af11221b4add8a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap140e7083-e4", "ovs_interfaceid": "140e7083-e454-413d-892e-a4784b4cea66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:00:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Releasing lock "refresh_cache-a80008bd-c61c-4a36-ae67-e556a5ecee08" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:00:03 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Updated the network info_cache for instance {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 00:00:03 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:00:03 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:00:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:00:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:00:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:00:03 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75341) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 00:00:04 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 00:00:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk.rescue --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:00:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:00:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk.rescue --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:00:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:00:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:00:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:00:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:00:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:00:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:00:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:00:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:00:05 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:00:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48db53c-618c-42fc-a688-974cc75f3598/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:00:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48db53c-618c-42fc-a688-974cc75f3598/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:00:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48db53c-618c-42fc-a688-974cc75f3598/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:00:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48db53c-618c-42fc-a688-974cc75f3598/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:00:05 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 00:00:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:00:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:00:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:00:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:00:05 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 00:00:06 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:00:06 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:00:06 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Hypervisor/Node resource view: name=user free_ram=8251MB free_disk=25.393611907958984GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75341) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 00:00:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:00:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:00:06 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 51045050-c7c6-49c5-acd4-2a76be0f466f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:00:06 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 6382e432-838f-4d89-a743-cbaa37f50ab5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:00:06 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance defae731-4191-4526-99cc-a301cf5b3355 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:00:06 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance a80008bd-c61c-4a36-ae67-e556a5ecee08 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:00:06 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance c3524e47-34b3-4b33-a1ff-25a8e4f35d86 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:00:06 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 6eee60d5-4088-40ff-b816-4080da234894 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:00:06 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance f48db53c-618c-42fc-a688-974cc75f3598 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:00:06 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 00:00:06 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 00:00:06 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 00:00:06 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 00:00:06 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Compute_service record updated for user:user {{(pid=75341) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 00:00:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.419s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:00:08 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:00:08 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:00:08 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:00:10 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Acquiring lock "3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:00:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:00:11 user nova-compute[75341]: DEBUG nova.compute.manager [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Starting instance... {{(pid=75341) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 00:00:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:00:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:00:11 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75341) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 00:00:11 user nova-compute[75341]: INFO nova.compute.claims [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Claim successful on node user
Nov 15 00:00:11 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 00:00:11 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 00:00:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.492s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:00:11 user nova-compute[75341]: DEBUG nova.compute.manager [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Start building networks asynchronously for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 00:00:12 user nova-compute[75341]: DEBUG nova.compute.manager [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Allocating IP information in the background. {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 00:00:12 user nova-compute[75341]: DEBUG nova.network.neutron [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] allocate_for_instance() {{(pid=75341) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 00:00:12 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 00:00:12 user nova-compute[75341]: DEBUG nova.compute.manager [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Start building block device mappings for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 00:00:12 user nova-compute[75341]: DEBUG nova.policy [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aa84b131dff84566810c44b553b09ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e601d11e75d4ec4b7c05e615c67fe20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75341) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 00:00:12 user nova-compute[75341]: DEBUG nova.compute.manager [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Start spawning the instance on the hypervisor. {{(pid=75341) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 00:00:12 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Creating instance directory {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 00:00:12 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Creating image(s)
Nov 15 00:00:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Acquiring lock "/opt/stack/data/nova/instances/3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:00:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "/opt/stack/data/nova/instances/3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:00:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "/opt/stack/data/nova/instances/3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:00:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:00:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.177s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:00:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Acquiring lock "4754efee9a6d73d3647f2add2cfe86c291949740" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:00:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:00:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:00:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.167s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:00:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0/disk 1073741824 {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:00:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0/disk 1073741824" returned: 0 in 0.046s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:00:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:00:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:00:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.164s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:00:12 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0/disk. size=1073741824 {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 00:00:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:00:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:00:12 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Cannot resize image /opt/stack/data/nova/instances/3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0/disk to a smaller size. {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 00:00:12 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Created local disks {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 00:00:12 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Ensure instance console log exists: /opt/stack/data/nova/instances/3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0/console.log {{(pid=75341) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 00:00:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:00:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:00:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:00:13 user nova-compute[75341]: DEBUG nova.network.neutron [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Successfully created port: f337ac0b-ba3c-4517-a743-5c489e2798cd {{(pid=75341) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 00:00:13 user nova-compute[75341]: DEBUG nova.network.neutron [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Successfully updated port: f337ac0b-ba3c-4517-a743-5c489e2798cd {{(pid=75341) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 00:00:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Acquiring lock "refresh_cache-3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:00:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Acquired lock "refresh_cache-3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:00:13 user nova-compute[75341]: DEBUG nova.network.neutron [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 00:00:13 user nova-compute[75341]: DEBUG nova.compute.manager [req-2b8272fb-ca78-421f-bc7e-35da44f201d2 req-c01fc385-ca62-4f99-a5b7-438782db1f51 service nova] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Received event network-changed-f337ac0b-ba3c-4517-a743-5c489e2798cd {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:00:13 user nova-compute[75341]: DEBUG nova.compute.manager [req-2b8272fb-ca78-421f-bc7e-35da44f201d2 req-c01fc385-ca62-4f99-a5b7-438782db1f51 service nova] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Refreshing instance network info cache due to event network-changed-f337ac0b-ba3c-4517-a743-5c489e2798cd. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 00:00:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-2b8272fb-ca78-421f-bc7e-35da44f201d2 req-c01fc385-ca62-4f99-a5b7-438782db1f51 service nova] Acquiring lock "refresh_cache-3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:00:13 user nova-compute[75341]: DEBUG nova.network.neutron [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Instance cache missing network info. {{(pid=75341) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 00:00:14 user nova-compute[75341]: DEBUG nova.network.neutron [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Updating instance_info_cache with network_info: [{"id": "f337ac0b-ba3c-4517-a743-5c489e2798cd", "address": "fa:16:3e:0c:1d:ea", "network": {"id": "167936c8-5f28-439e-9a1f-d9356b3a1ec9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374167607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e601d11e75d4ec4b7c05e615c67fe20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf337ac0b-ba", "ovs_interfaceid": "f337ac0b-ba3c-4517-a743-5c489e2798cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:00:14 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Releasing lock "refresh_cache-3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:00:14 user nova-compute[75341]: DEBUG nova.compute.manager [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Instance network_info: |[{"id": "f337ac0b-ba3c-4517-a743-5c489e2798cd", "address": "fa:16:3e:0c:1d:ea", "network": {"id": "167936c8-5f28-439e-9a1f-d9356b3a1ec9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374167607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e601d11e75d4ec4b7c05e615c67fe20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf337ac0b-ba", "ovs_interfaceid": "f337ac0b-ba3c-4517-a743-5c489e2798cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 00:00:14 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-2b8272fb-ca78-421f-bc7e-35da44f201d2 req-c01fc385-ca62-4f99-a5b7-438782db1f51 service nova] Acquired lock "refresh_cache-3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:00:14 user nova-compute[75341]: DEBUG nova.network.neutron [req-2b8272fb-ca78-421f-bc7e-35da44f201d2 req-c01fc385-ca62-4f99-a5b7-438782db1f51 service nova] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Refreshing network info cache for port f337ac0b-ba3c-4517-a743-5c489e2798cd {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 00:00:14 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Start _get_guest_xml network_info=[{"id": "f337ac0b-ba3c-4517-a743-5c489e2798cd", "address": "fa:16:3e:0c:1d:ea", "network": {"id": "167936c8-5f28-439e-9a1f-d9356b3a1ec9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374167607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e601d11e75d4ec4b7c05e615c67fe20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf337ac0b-ba", "ovs_interfaceid": "f337ac0b-ba3c-4517-a743-5c489e2798cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encrypted': False, 'image_id': 'e46abb82-b810-490e-a8a1-ccdc5fa1a796'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 00:00:14 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:00:14 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:00:14 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 00:00:14 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 00:00:14 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 00:00:14 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 00:00:14 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 00:00:14 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 00:00:14 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 00:00:14 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 00:00:14 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 00:00:14 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 00:00:14 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 00:00:14 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 00:00:14 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 00:00:14 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 00:00:14 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 00:00:14 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 00:00:14 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T00:00:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1552565157',display_name='tempest-AttachVolumeTestJSON-server-1552565157',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1552565157',id=45,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhDSxY9KzPbmhPSdGFWzNYWivUaBWG8Oljx9bDqaplVFDvcJEMPhhreaJU0l8mW14ZFDOlJlDNeWD7anCj3Ok/wMMyLkxXyBk+yled6c7EJZTZMAqU6wyCjLOWwSjY7kA==',key_name='tempest-keypair-1417763904',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e601d11e75d4ec4b7c05e615c67fe20',ramdisk_id='',reservation_id='r-7w79su9i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1907700292',owner_user_name='tempest-AttachVolumeTestJSON-1907700292-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T00:00:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa84b131dff84566810c44b553b09ba8',uuid=3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f337ac0b-ba3c-4517-a743-5c489e2798cd", "address": "fa:16:3e:0c:1d:ea", "network": {"id": "167936c8-5f28-439e-9a1f-d9356b3a1ec9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374167607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e601d11e75d4ec4b7c05e615c67fe20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf337ac0b-ba", "ovs_interfaceid": "f337ac0b-ba3c-4517-a743-5c489e2798cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 00:00:14 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Converting VIF {"id": "f337ac0b-ba3c-4517-a743-5c489e2798cd", "address": "fa:16:3e:0c:1d:ea", "network": {"id": "167936c8-5f28-439e-9a1f-d9356b3a1ec9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374167607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e601d11e75d4ec4b7c05e615c67fe20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf337ac0b-ba", "ovs_interfaceid": "f337ac0b-ba3c-4517-a743-5c489e2798cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 00:00:14 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:1d:ea,bridge_name='br-int',has_traffic_filtering=True,id=f337ac0b-ba3c-4517-a743-5c489e2798cd,network=Network(167936c8-5f28-439e-9a1f-d9356b3a1ec9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf337ac0b-ba') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 00:00:14 user nova-compute[75341]: DEBUG nova.objects.instance [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lazy-loading 'pci_devices' on Instance uuid 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:00:14 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] End _get_guest_xml xml=<domain type="kvm">
Nov 15 00:00:14 user nova-compute[75341]:   <uuid>3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0</uuid>
Nov 15 00:00:14 user nova-compute[75341]:   <name>instance-0000002d</name>
Nov 15 00:00:14 user nova-compute[75341]:   <memory>524288</memory>
Nov 15 00:00:14 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 15 00:00:14 user nova-compute[75341]:   <metadata>
Nov 15 00:00:14 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 00:00:14 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 15 00:00:14 user nova-compute[75341]:       <nova:name>tempest-AttachVolumeTestJSON-server-1552565157</nova:name>
Nov 15 00:00:14 user nova-compute[75341]:       <nova:creationTime>2023-11-15 00:00:14</nova:creationTime>
Nov 15 00:00:14 user nova-compute[75341]:       <nova:flavor name="m1.tiny">
Nov 15 00:00:14 user nova-compute[75341]:         <nova:memory>512</nova:memory>
Nov 15 00:00:14 user nova-compute[75341]:         <nova:disk>1</nova:disk>
Nov 15 00:00:14 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 15 00:00:14 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 00:00:14 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 15 00:00:14 user nova-compute[75341]:       </nova:flavor>
Nov 15 00:00:14 user nova-compute[75341]:       <nova:owner>
Nov 15 00:00:14 user nova-compute[75341]:         <nova:user uuid="aa84b131dff84566810c44b553b09ba8">tempest-AttachVolumeTestJSON-1907700292-project-member</nova:user>
Nov 15 00:00:14 user nova-compute[75341]:         <nova:project uuid="0e601d11e75d4ec4b7c05e615c67fe20">tempest-AttachVolumeTestJSON-1907700292</nova:project>
Nov 15 00:00:14 user nova-compute[75341]:       </nova:owner>
Nov 15 00:00:14 user nova-compute[75341]:       <nova:root type="image" uuid="e46abb82-b810-490e-a8a1-ccdc5fa1a796"/>
Nov 15 00:00:14 user nova-compute[75341]:       <nova:ports>
Nov 15 00:00:14 user nova-compute[75341]:         <nova:port uuid="f337ac0b-ba3c-4517-a743-5c489e2798cd">
Nov 15 00:00:14 user nova-compute[75341]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 00:00:14 user nova-compute[75341]:         </nova:port>
Nov 15 00:00:14 user nova-compute[75341]:       </nova:ports>
Nov 15 00:00:14 user nova-compute[75341]:     </nova:instance>
Nov 15 00:00:14 user nova-compute[75341]:   </metadata>
Nov 15 00:00:14 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 15 00:00:14 user nova-compute[75341]:     <system>
Nov 15 00:00:14 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 00:00:14 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 15 00:00:14 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 15 00:00:14 user nova-compute[75341]:       <entry name="serial">3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0</entry>
Nov 15 00:00:14 user nova-compute[75341]:       <entry name="uuid">3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0</entry>
Nov 15 00:00:14 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 15 00:00:14 user nova-compute[75341]:     </system>
Nov 15 00:00:14 user nova-compute[75341]:   </sysinfo>
Nov 15 00:00:14 user nova-compute[75341]:   <os>
Nov 15 00:00:14 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 00:00:14 user nova-compute[75341]:     <boot dev="hd"/>
Nov 15 00:00:14 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 15 00:00:14 user nova-compute[75341]:   </os>
Nov 15 00:00:14 user nova-compute[75341]:   <features>
Nov 15 00:00:14 user nova-compute[75341]:     <acpi/>
Nov 15 00:00:14 user nova-compute[75341]:     <apic/>
Nov 15 00:00:14 user nova-compute[75341]:     <vmcoreinfo/>
Nov 15 00:00:14 user nova-compute[75341]:   </features>
Nov 15 00:00:14 user nova-compute[75341]:   <clock offset="utc">
Nov 15 00:00:14 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 00:00:14 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 00:00:14 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 15 00:00:14 user nova-compute[75341]:   </clock>
Nov 15 00:00:14 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 15 00:00:14 user nova-compute[75341]:     <model>Nehalem</model>
Nov 15 00:00:14 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 00:00:14 user nova-compute[75341]:   </cpu>
Nov 15 00:00:14 user nova-compute[75341]:   <devices>
Nov 15 00:00:14 user nova-compute[75341]:     <disk type="file" device="disk">
Nov 15 00:00:14 user nova-compute[75341]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 00:00:14 user nova-compute[75341]:       <source file="/opt/stack/data/nova/instances/3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0/disk"/>
Nov 15 00:00:14 user nova-compute[75341]:       <target dev="vda" bus="virtio"/>
Nov 15 00:00:14 user nova-compute[75341]:     </disk>
Nov 15 00:00:14 user nova-compute[75341]:     <interface type="ethernet">
Nov 15 00:00:14 user nova-compute[75341]:       <mac address="fa:16:3e:0c:1d:ea"/>
Nov 15 00:00:14 user nova-compute[75341]:       <model type="virtio"/>
Nov 15 00:00:14 user nova-compute[75341]:       <mtu size="1442"/>
Nov 15 00:00:14 user nova-compute[75341]:       <target dev="tapf337ac0b-ba"/>
Nov 15 00:00:14 user nova-compute[75341]:     </interface>
Nov 15 00:00:14 user nova-compute[75341]:     <serial type="pty">
Nov 15 00:00:14 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0/console.log" append="off"/>
Nov 15 00:00:14 user nova-compute[75341]:     </serial>
Nov 15 00:00:14 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 00:00:14 user nova-compute[75341]:     <video>
Nov 15 00:00:14 user nova-compute[75341]:       <model type="virtio"/>
Nov 15 00:00:14 user nova-compute[75341]:     </video>
Nov 15 00:00:14 user nova-compute[75341]:     <rng model="virtio">
Nov 15 00:00:14 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 15 00:00:14 user nova-compute[75341]:     </rng>
Nov 15 00:00:14 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 15 00:00:14 user nova-compute[75341]:     <memballoon model="virtio">
Nov 15 00:00:14 user nova-compute[75341]:       <stats period="10"/>
Nov 15 00:00:14 user nova-compute[75341]:     </memballoon>
Nov 15 00:00:14 user nova-compute[75341]:   </devices>
Nov 15 00:00:14 user nova-compute[75341]: </domain>
Nov 15 00:00:14 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 00:00:14 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T00:00:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1552565157',display_name='tempest-AttachVolumeTestJSON-server-1552565157',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1552565157',id=45,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhDSxY9KzPbmhPSdGFWzNYWivUaBWG8Oljx9bDqaplVFDvcJEMPhhreaJU0l8mW14ZFDOlJlDNeWD7anCj3Ok/wMMyLkxXyBk+yled6c7EJZTZMAqU6wyCjLOWwSjY7kA==',key_name='tempest-keypair-1417763904',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e601d11e75d4ec4b7c05e615c67fe20',ramdisk_id='',reservation_id='r-7w79su9i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1907700292',owner_user_name='tempest-AttachVolumeTestJSON-1907700292-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T00:00:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa84b131dff84566810c44b553b09ba8',uuid=3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f337ac0b-ba3c-4517-a743-5c489e2798cd", "address": "fa:16:3e:0c:1d:ea", "network": {"id": "167936c8-5f28-439e-9a1f-d9356b3a1ec9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374167607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e601d11e75d4ec4b7c05e615c67fe20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf337ac0b-ba", "ovs_interfaceid": "f337ac0b-ba3c-4517-a743-5c489e2798cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 00:00:14 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Converting VIF {"id": "f337ac0b-ba3c-4517-a743-5c489e2798cd", "address": "fa:16:3e:0c:1d:ea", "network": {"id": "167936c8-5f28-439e-9a1f-d9356b3a1ec9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374167607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e601d11e75d4ec4b7c05e615c67fe20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf337ac0b-ba", "ovs_interfaceid": "f337ac0b-ba3c-4517-a743-5c489e2798cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 00:00:14 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:1d:ea,bridge_name='br-int',has_traffic_filtering=True,id=f337ac0b-ba3c-4517-a743-5c489e2798cd,network=Network(167936c8-5f28-439e-9a1f-d9356b3a1ec9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf337ac0b-ba') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 00:00:14 user nova-compute[75341]: DEBUG os_vif [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:1d:ea,bridge_name='br-int',has_traffic_filtering=True,id=f337ac0b-ba3c-4517-a743-5c489e2798cd,network=Network(167936c8-5f28-439e-9a1f-d9356b3a1ec9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf337ac0b-ba') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 00:00:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:00:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 00:00:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b2e0ea26-c5b1-568d-b712-3b8fdfdef04e', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:00:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:00:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf337ac0b-ba, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:00:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf337ac0b-ba, col_values=(('qos', UUID('25b6ffb2-07a7-4188-a290-d235a9467578')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:00:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf337ac0b-ba, col_values=(('external_ids', {'iface-id': 'f337ac0b-ba3c-4517-a743-5c489e2798cd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:1d:ea', 'vm-uuid': '3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:00:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:00:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:14 user nova-compute[75341]: INFO os_vif [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:1d:ea,bridge_name='br-int',has_traffic_filtering=True,id=f337ac0b-ba3c-4517-a743-5c489e2798cd,network=Network(167936c8-5f28-439e-9a1f-d9356b3a1ec9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf337ac0b-ba')
Nov 15 00:00:14 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 00:00:14 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] No VIF found with MAC fa:16:3e:0c:1d:ea, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 00:00:14 user nova-compute[75341]: DEBUG nova.network.neutron [req-2b8272fb-ca78-421f-bc7e-35da44f201d2 req-c01fc385-ca62-4f99-a5b7-438782db1f51 service nova] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Updated VIF entry in instance network info cache for port f337ac0b-ba3c-4517-a743-5c489e2798cd. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 00:00:14 user nova-compute[75341]: DEBUG nova.network.neutron [req-2b8272fb-ca78-421f-bc7e-35da44f201d2 req-c01fc385-ca62-4f99-a5b7-438782db1f51 service nova] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Updating instance_info_cache with network_info: [{"id": "f337ac0b-ba3c-4517-a743-5c489e2798cd", "address": "fa:16:3e:0c:1d:ea", "network": {"id": "167936c8-5f28-439e-9a1f-d9356b3a1ec9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374167607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e601d11e75d4ec4b7c05e615c67fe20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf337ac0b-ba", "ovs_interfaceid": "f337ac0b-ba3c-4517-a743-5c489e2798cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:00:14 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-2b8272fb-ca78-421f-bc7e-35da44f201d2 req-c01fc385-ca62-4f99-a5b7-438782db1f51 service nova] Releasing lock "refresh_cache-3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:00:14 user nova-compute[75341]: DEBUG nova.compute.manager [req-80c2faf1-9f56-4d4a-a7d5-2d377e3e5ebf req-b7941ff6-e6a6-4166-9816-4f65486fc622 service nova] [instance: defae731-4191-4526-99cc-a301cf5b3355] Received event network-changed-10b83231-0b39-4dee-95db-bb6a03d70fc0 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:00:14 user nova-compute[75341]: DEBUG nova.compute.manager [req-80c2faf1-9f56-4d4a-a7d5-2d377e3e5ebf req-b7941ff6-e6a6-4166-9816-4f65486fc622 service nova] [instance: defae731-4191-4526-99cc-a301cf5b3355] Refreshing instance network info cache due to event network-changed-10b83231-0b39-4dee-95db-bb6a03d70fc0. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 00:00:14 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-80c2faf1-9f56-4d4a-a7d5-2d377e3e5ebf req-b7941ff6-e6a6-4166-9816-4f65486fc622 service nova] Acquiring lock "refresh_cache-defae731-4191-4526-99cc-a301cf5b3355" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:00:14 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-80c2faf1-9f56-4d4a-a7d5-2d377e3e5ebf req-b7941ff6-e6a6-4166-9816-4f65486fc622 service nova] Acquired lock "refresh_cache-defae731-4191-4526-99cc-a301cf5b3355" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:00:14 user nova-compute[75341]: DEBUG nova.network.neutron [req-80c2faf1-9f56-4d4a-a7d5-2d377e3e5ebf req-b7941ff6-e6a6-4166-9816-4f65486fc622 service nova] [instance: defae731-4191-4526-99cc-a301cf5b3355] Refreshing network info cache for port 10b83231-0b39-4dee-95db-bb6a03d70fc0 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 00:00:15 user nova-compute[75341]: DEBUG nova.network.neutron [req-80c2faf1-9f56-4d4a-a7d5-2d377e3e5ebf req-b7941ff6-e6a6-4166-9816-4f65486fc622 service nova] [instance: defae731-4191-4526-99cc-a301cf5b3355] Updated VIF entry in instance network info cache for port 10b83231-0b39-4dee-95db-bb6a03d70fc0. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 00:00:15 user nova-compute[75341]: DEBUG nova.network.neutron [req-80c2faf1-9f56-4d4a-a7d5-2d377e3e5ebf req-b7941ff6-e6a6-4166-9816-4f65486fc622 service nova] [instance: defae731-4191-4526-99cc-a301cf5b3355] Updating instance_info_cache with network_info: [{"id": "10b83231-0b39-4dee-95db-bb6a03d70fc0", "address": "fa:16:3e:b7:3a:83", "network": {"id": "d86a8e7f-6658-4994-9a13-eb3163bd3865", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-635863702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c69a942b4f4b97a1a3152dea86c7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10b83231-0b", "ovs_interfaceid": "10b83231-0b39-4dee-95db-bb6a03d70fc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:00:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-80c2faf1-9f56-4d4a-a7d5-2d377e3e5ebf req-b7941ff6-e6a6-4166-9816-4f65486fc622 service nova] Releasing lock "refresh_cache-defae731-4191-4526-99cc-a301cf5b3355" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:00:15 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:15 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:15 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:15 user nova-compute[75341]: DEBUG nova.compute.manager [req-2e18622c-f325-41e4-8f5c-15c7933fe7fc req-841da370-d0a9-46f2-b38d-95da269f9c03 service nova] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Received event network-vif-plugged-f337ac0b-ba3c-4517-a743-5c489e2798cd {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:00:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-2e18622c-f325-41e4-8f5c-15c7933fe7fc req-841da370-d0a9-46f2-b38d-95da269f9c03 service nova] Acquiring lock "3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:00:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-2e18622c-f325-41e4-8f5c-15c7933fe7fc req-841da370-d0a9-46f2-b38d-95da269f9c03 service nova] Lock "3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:00:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-2e18622c-f325-41e4-8f5c-15c7933fe7fc req-841da370-d0a9-46f2-b38d-95da269f9c03 service nova] Lock "3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:00:15 user nova-compute[75341]: DEBUG nova.compute.manager [req-2e18622c-f325-41e4-8f5c-15c7933fe7fc req-841da370-d0a9-46f2-b38d-95da269f9c03 service nova] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] No waiting events found dispatching network-vif-plugged-f337ac0b-ba3c-4517-a743-5c489e2798cd {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:00:15 user nova-compute[75341]: WARNING nova.compute.manager [req-2e18622c-f325-41e4-8f5c-15c7933fe7fc req-841da370-d0a9-46f2-b38d-95da269f9c03 service nova] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Received unexpected event network-vif-plugged-f337ac0b-ba3c-4517-a743-5c489e2798cd for instance with vm_state building and task_state spawning.
Nov 15 00:00:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:16 user nova-compute[75341]: DEBUG nova.compute.manager [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Stashing vm_state: active {{(pid=75341) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 15 00:00:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:00:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:00:16 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75341) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 00:00:16 user nova-compute[75341]: INFO nova.compute.claims [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Claim successful on node user
Nov 15 00:00:16 user nova-compute[75341]: INFO nova.compute.resource_tracker [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Updating resource usage from migration 63f12b75-a115-43b0-adac-06779a8259e1
Nov 15 00:00:16 user nova-compute[75341]: DEBUG nova.compute.manager [req-cf95bad5-dc3e-4957-b9d0-ccbd48d8c14e req-223f5003-acce-4fc4-a6c3-6bb668864fe3 service nova] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Received event network-changed-50f461fb-27ee-438f-880c-cde1e7441cfe {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:00:16 user nova-compute[75341]: DEBUG nova.compute.manager [req-cf95bad5-dc3e-4957-b9d0-ccbd48d8c14e req-223f5003-acce-4fc4-a6c3-6bb668864fe3 service nova] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Refreshing instance network info cache due to event network-changed-50f461fb-27ee-438f-880c-cde1e7441cfe. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 00:00:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-cf95bad5-dc3e-4957-b9d0-ccbd48d8c14e req-223f5003-acce-4fc4-a6c3-6bb668864fe3 service nova] Acquiring lock "refresh_cache-c3524e47-34b3-4b33-a1ff-25a8e4f35d86" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:00:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-cf95bad5-dc3e-4957-b9d0-ccbd48d8c14e req-223f5003-acce-4fc4-a6c3-6bb668864fe3 service nova] Acquired lock "refresh_cache-c3524e47-34b3-4b33-a1ff-25a8e4f35d86" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:00:16 user nova-compute[75341]: DEBUG nova.network.neutron [req-cf95bad5-dc3e-4957-b9d0-ccbd48d8c14e req-223f5003-acce-4fc4-a6c3-6bb668864fe3 service nova] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Refreshing network info cache for port 50f461fb-27ee-438f-880c-cde1e7441cfe {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 00:00:17 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 00:00:17 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 00:00:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:17 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.430s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:00:17 user nova-compute[75341]: INFO nova.compute.manager [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Migrating
Nov 15 00:00:17 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Acquiring lock "refresh_cache-c3524e47-34b3-4b33-a1ff-25a8e4f35d86" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:00:17 user nova-compute[75341]: DEBUG nova.network.neutron [req-cf95bad5-dc3e-4957-b9d0-ccbd48d8c14e req-223f5003-acce-4fc4-a6c3-6bb668864fe3 service nova] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Updated VIF entry in instance network info cache for port 50f461fb-27ee-438f-880c-cde1e7441cfe. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 00:00:17 user nova-compute[75341]: DEBUG nova.network.neutron [req-cf95bad5-dc3e-4957-b9d0-ccbd48d8c14e req-223f5003-acce-4fc4-a6c3-6bb668864fe3 service nova] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Updating instance_info_cache with network_info: [{"id": "50f461fb-27ee-438f-880c-cde1e7441cfe", "address": "fa:16:3e:26:50:43", "network": {"id": "d86a8e7f-6658-4994-9a13-eb3163bd3865", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-635863702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c69a942b4f4b97a1a3152dea86c7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f461fb-27", "ovs_interfaceid": "50f461fb-27ee-438f-880c-cde1e7441cfe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:00:17 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-cf95bad5-dc3e-4957-b9d0-ccbd48d8c14e req-223f5003-acce-4fc4-a6c3-6bb668864fe3 service nova] Releasing lock "refresh_cache-c3524e47-34b3-4b33-a1ff-25a8e4f35d86" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:00:17 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Acquired lock "refresh_cache-c3524e47-34b3-4b33-a1ff-25a8e4f35d86" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:00:17 user nova-compute[75341]: DEBUG nova.network.neutron [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 00:00:17 user nova-compute[75341]: DEBUG nova.compute.manager [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Instance event wait completed in 0 seconds for  {{(pid=75341) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 00:00:17 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Guest created on hypervisor {{(pid=75341) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 00:00:17 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Instance spawned successfully.
Nov 15 00:00:17 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 00:00:17 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Found default for hw_cdrom_bus of ide {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 00:00:17 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Found default for hw_disk_bus of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 00:00:17 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Found default for hw_input_bus of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 00:00:17 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Found default for hw_pointer_model of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 00:00:17 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Found default for hw_video_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 00:00:17 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Found default for hw_vif_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 00:00:17 user nova-compute[75341]: INFO nova.compute.manager [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Took 5.70 seconds to spawn the instance on the hypervisor.
Nov 15 00:00:17 user nova-compute[75341]: DEBUG nova.compute.manager [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 00:00:17 user nova-compute[75341]: DEBUG nova.network.neutron [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Updating instance_info_cache with network_info: [{"id": "50f461fb-27ee-438f-880c-cde1e7441cfe", "address": "fa:16:3e:26:50:43", "network": {"id": "d86a8e7f-6658-4994-9a13-eb3163bd3865", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-635863702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c69a942b4f4b97a1a3152dea86c7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f461fb-27", "ovs_interfaceid": "50f461fb-27ee-438f-880c-cde1e7441cfe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:00:17 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Releasing lock "refresh_cache-c3524e47-34b3-4b33-a1ff-25a8e4f35d86" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:00:17 user nova-compute[75341]: DEBUG nova.compute.manager [req-91b79496-7f43-427a-be89-64abe4410dda req-2bdd6749-0e15-4e40-9f88-1feebe7100b8 service nova] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Received event network-vif-plugged-f337ac0b-ba3c-4517-a743-5c489e2798cd {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:00:17 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-91b79496-7f43-427a-be89-64abe4410dda req-2bdd6749-0e15-4e40-9f88-1feebe7100b8 service nova] Acquiring lock "3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:00:17 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-91b79496-7f43-427a-be89-64abe4410dda req-2bdd6749-0e15-4e40-9f88-1feebe7100b8 service nova] Lock "3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:00:17 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-91b79496-7f43-427a-be89-64abe4410dda req-2bdd6749-0e15-4e40-9f88-1feebe7100b8 service nova] Lock "3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:00:17 user nova-compute[75341]: DEBUG nova.compute.manager [req-91b79496-7f43-427a-be89-64abe4410dda req-2bdd6749-0e15-4e40-9f88-1feebe7100b8 service nova] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] No waiting events found dispatching network-vif-plugged-f337ac0b-ba3c-4517-a743-5c489e2798cd {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:00:17 user nova-compute[75341]: WARNING nova.compute.manager [req-91b79496-7f43-427a-be89-64abe4410dda req-2bdd6749-0e15-4e40-9f88-1feebe7100b8 service nova] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Received unexpected event network-vif-plugged-f337ac0b-ba3c-4517-a743-5c489e2798cd for instance with vm_state building and task_state spawning.
Nov 15 00:00:18 user nova-compute[75341]: INFO nova.compute.manager [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Took 6.58 seconds to build instance.
Nov 15 00:00:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-62ad1f33-9808-4ec3-bbde-22e1bdb6e0a6 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.668s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:00:18 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Starting migrate_disk_and_power_off {{(pid=75341) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 15 00:00:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:19 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Instance destroyed successfully.
Nov 15 00:00:19 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:58:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1599301259',display_name='tempest-ServerActionsTestOtherA-server-1599301259',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1599301259',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTmBE+Takjbl0ZrUdtoD/FDS2CHZC4n75Y/1LCLwXLZHE8J0GqhfVD/envyBMKYWUkAGQH/bKcOVnVKa4qF07KOQ/PvMrk+gG45OxOvZ8A6PGkmy0qPqzF8MOOmxhYzVQ==',key_name='tempest-keypair-1744456340',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:58:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f4c69a942b4f4b97a1a3152dea86c7fb',ramdisk_id='',reservation_id='r-dgx5dk1c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1796396043',owner_user_name='tempest-ServerActionsTestOtherA-1796396043-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T00:00:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='442aae0161f347d0a79b168a1b60286a',uuid=c3524e47-34b3-4b33-a1ff-25a8e4f35d86,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "50f461fb-27ee-438f-880c-cde1e7441cfe", "address": "fa:16:3e:26:50:43", "network": {"id": "d86a8e7f-6658-4994-9a13-eb3163bd3865", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-635863702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-635863702-network", "vif_mac": "fa:16:3e:26:50:43"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c69a942b4f4b97a1a3152dea86c7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f461fb-27", "ovs_interfaceid": "50f461fb-27ee-438f-880c-cde1e7441cfe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Converting VIF {"id": "50f461fb-27ee-438f-880c-cde1e7441cfe", "address": "fa:16:3e:26:50:43", "network": {"id": "d86a8e7f-6658-4994-9a13-eb3163bd3865", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-635863702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-635863702-network", "vif_mac": "fa:16:3e:26:50:43"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c69a942b4f4b97a1a3152dea86c7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f461fb-27", "ovs_interfaceid": "50f461fb-27ee-438f-880c-cde1e7441cfe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:50:43,bridge_name='br-int',has_traffic_filtering=True,id=50f461fb-27ee-438f-880c-cde1e7441cfe,network=Network(d86a8e7f-6658-4994-9a13-eb3163bd3865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50f461fb-27') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG os_vif [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:50:43,bridge_name='br-int',has_traffic_filtering=True,id=50f461fb-27ee-438f-880c-cde1e7441cfe,network=Network(d86a8e7f-6658-4994-9a13-eb3163bd3865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50f461fb-27') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap50f461fb-27, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG nova.compute.manager [req-26323897-2c52-440f-a4bc-759baf1c5db0 req-d159d7ff-8d0a-42bc-abcf-9751afb513e4 service nova] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Received event network-vif-unplugged-50f461fb-27ee-438f-880c-cde1e7441cfe {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-26323897-2c52-440f-a4bc-759baf1c5db0 req-d159d7ff-8d0a-42bc-abcf-9751afb513e4 service nova] Acquiring lock "c3524e47-34b3-4b33-a1ff-25a8e4f35d86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-26323897-2c52-440f-a4bc-759baf1c5db0 req-d159d7ff-8d0a-42bc-abcf-9751afb513e4 service nova] Lock "c3524e47-34b3-4b33-a1ff-25a8e4f35d86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-26323897-2c52-440f-a4bc-759baf1c5db0 req-d159d7ff-8d0a-42bc-abcf-9751afb513e4 service nova] Lock "c3524e47-34b3-4b33-a1ff-25a8e4f35d86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG nova.compute.manager [req-26323897-2c52-440f-a4bc-759baf1c5db0 req-d159d7ff-8d0a-42bc-abcf-9751afb513e4 service nova] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] No waiting events found dispatching network-vif-unplugged-50f461fb-27ee-438f-880c-cde1e7441cfe {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:00:19 user nova-compute[75341]: WARNING nova.compute.manager [req-26323897-2c52-440f-a4bc-759baf1c5db0 req-d159d7ff-8d0a-42bc-abcf-9751afb513e4 service nova] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Received unexpected event network-vif-unplugged-50f461fb-27ee-438f-880c-cde1e7441cfe for instance with vm_state active and task_state resize_migrating.
Nov 15 00:00:19 user nova-compute[75341]: DEBUG nova.compute.manager [req-26323897-2c52-440f-a4bc-759baf1c5db0 req-d159d7ff-8d0a-42bc-abcf-9751afb513e4 service nova] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Received event network-vif-plugged-50f461fb-27ee-438f-880c-cde1e7441cfe {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-26323897-2c52-440f-a4bc-759baf1c5db0 req-d159d7ff-8d0a-42bc-abcf-9751afb513e4 service nova] Acquiring lock "c3524e47-34b3-4b33-a1ff-25a8e4f35d86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-26323897-2c52-440f-a4bc-759baf1c5db0 req-d159d7ff-8d0a-42bc-abcf-9751afb513e4 service nova] Lock "c3524e47-34b3-4b33-a1ff-25a8e4f35d86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-26323897-2c52-440f-a4bc-759baf1c5db0 req-d159d7ff-8d0a-42bc-abcf-9751afb513e4 service nova] Lock "c3524e47-34b3-4b33-a1ff-25a8e4f35d86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG nova.compute.manager [req-26323897-2c52-440f-a4bc-759baf1c5db0 req-d159d7ff-8d0a-42bc-abcf-9751afb513e4 service nova] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] No waiting events found dispatching network-vif-plugged-50f461fb-27ee-438f-880c-cde1e7441cfe {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:00:19 user nova-compute[75341]: WARNING nova.compute.manager [req-26323897-2c52-440f-a4bc-759baf1c5db0 req-d159d7ff-8d0a-42bc-abcf-9751afb513e4 service nova] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Received unexpected event network-vif-plugged-50f461fb-27ee-438f-880c-cde1e7441cfe for instance with vm_state active and task_state resize_migrating.
Nov 15 00:00:19 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e9c98564-40f1-49da-92b8-8e0fd42a5ef7) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:19 user nova-compute[75341]: INFO os_vif [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:50:43,bridge_name='br-int',has_traffic_filtering=True,id=50f461fb-27ee-438f-880c-cde1e7441cfe,network=Network(d86a8e7f-6658-4994-9a13-eb3163bd3865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50f461fb-27')
Nov 15 00:00:19 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] calling os-brick to detach iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, {'target_iqn': 'iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NaWvjfqe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 00:00:19 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 00:00:19 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[208a3a94-6971-4f9c-8416-24ab5ecdf538]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 00:00:19 user nova-compute[75341]: No targets found.
Nov 15 00:00:19 user nova-compute[75341]: iSNS:
Nov 15 00:00:19 user nova-compute[75341]: No targets found.
Nov 15 00:00:19 user nova-compute[75341]: STATIC:
Nov 15 00:00:19 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36
Nov 15 00:00:19 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 15 00:00:19 user nova-compute[75341]:                 Iface Name: default
Nov 15 00:00:19 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123
Nov 15 00:00:19 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 15 00:00:19 user nova-compute[75341]:                 Iface Name: default
Nov 15 00:00:19 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f
Nov 15 00:00:19 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 15 00:00:19 user nova-compute[75341]:                 Iface Name: default
Nov 15 00:00:19 user nova-compute[75341]: FIRMWARE:
Nov 15 00:00:19 user nova-compute[75341]: No targets found.
Nov 15 00:00:19 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 00:00:19 user nova-compute[75341]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 00:00:19 user nova-compute[75341]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75341) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123', 0)] {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[6799a749-b97e-419c-a406-e9b60c57007a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a03cd2-c98b-472e-8df9-9d5b465748a2]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)
Nov 15 00:00:19 user nova-compute[75341]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 (non-flash)
Nov 15 00:00:19 user nova-compute[75341]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f (non-flash)
Nov 15 00:00:19 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)
Nov 15 00:00:19 user nova-compute[75341]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 (non-flash)
Nov 15 00:00:19 user nova-compute[75341]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f (non-flash)
Nov 15 00:00:19 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f185066a5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123'): ({'sdd'}, set())}) {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Removing single pathed devices sdd {{(pid=75341) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[6538e5ed-74da-4597-a26d-d19d2c629a66]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd9aa7f-eaa7-4ce2-a6e0-336eb58b3b06]: (4, ('ok\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Flushing IO for device /dev/sdd {{(pid=75341) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[81fc2bea-2f99-434c-8779-687e631826d0]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75341) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.054s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27d873b-210a-4586-a8a8-936f98345f98]: (4, ('1', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] SCSI volumes sdd have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123')] {{(pid=75341) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[841ee8fc-fea4-45fe-a23a-c19f5f20b487]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 -p 172.16.0.220:3260 --logout {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca3bf97-5230-4952-bbe5-a01906cd48e0]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123, portal: 172.16.0.220,3260]
Nov 15 00:00:19 user nova-compute[75341]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123, portal: 172.16.0.220,3260] successful.
Nov 15 00:00:19 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 -p 172.16.0.220:3260 --op delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfbfbd8a-244b-40db-90d6-4ee74e707940]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.381s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] <== disconnect_volume: return (384ms) None {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Disconnected iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-400ee3bb-2725-4382-977b-8be0b4951708 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Acquiring lock "6382e432-838f-4d89-a743-cbaa37f50ab5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-400ee3bb-2725-4382-977b-8be0b4951708 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "6382e432-838f-4d89-a743-cbaa37f50ab5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-400ee3bb-2725-4382-977b-8be0b4951708 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Acquiring lock "6382e432-838f-4d89-a743-cbaa37f50ab5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-400ee3bb-2725-4382-977b-8be0b4951708 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "6382e432-838f-4d89-a743-cbaa37f50ab5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-400ee3bb-2725-4382-977b-8be0b4951708 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "6382e432-838f-4d89-a743-cbaa37f50ab5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:00:19 user nova-compute[75341]: INFO nova.compute.manager [None req-400ee3bb-2725-4382-977b-8be0b4951708 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Terminating instance
Nov 15 00:00:19 user nova-compute[75341]: DEBUG nova.compute.manager [None req-400ee3bb-2725-4382-977b-8be0b4951708 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Start destroying the instance on the hypervisor. {{(pid=75341) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:19 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:20 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Instance destroyed successfully.
Nov 15 00:00:20 user nova-compute[75341]: DEBUG nova.objects.instance [None req-400ee3bb-2725-4382-977b-8be0b4951708 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lazy-loading 'resources' on Instance uuid 6382e432-838f-4d89-a743-cbaa37f50ab5 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:00:20 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-400ee3bb-2725-4382-977b-8be0b4951708 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:44:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-774340686',display_name='tempest-ServerRescueNegativeTestJSON-server-774340686',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-774340686',id=18,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:46:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='44bb8b1415c14bb59c4c35cc2b830875',ramdisk_id='',reservation_id='r-je794ae3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1956631656',owner_user_name='tempest-ServerRescueNegativeTestJSON-1956631656-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:46:18Z,user_data=None,user_id='3c49a358e2f942f3a9777910ee755575',uuid=6382e432-838f-4d89-a743-cbaa37f50ab5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "61a9a4a7-170b-4ed9-8d52-8cb4defd1cae", "address": "fa:16:3e:0c:42:07", "network": {"id": "fcd22da6-016e-4872-a84c-4d82601c48d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-550677181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44bb8b1415c14bb59c4c35cc2b830875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61a9a4a7-17", "ovs_interfaceid": "61a9a4a7-170b-4ed9-8d52-8cb4defd1cae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 00:00:20 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-400ee3bb-2725-4382-977b-8be0b4951708 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Converting VIF {"id": "61a9a4a7-170b-4ed9-8d52-8cb4defd1cae", "address": "fa:16:3e:0c:42:07", "network": {"id": "fcd22da6-016e-4872-a84c-4d82601c48d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-550677181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44bb8b1415c14bb59c4c35cc2b830875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61a9a4a7-17", "ovs_interfaceid": "61a9a4a7-170b-4ed9-8d52-8cb4defd1cae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 00:00:20 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-400ee3bb-2725-4382-977b-8be0b4951708 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:42:07,bridge_name='br-int',has_traffic_filtering=True,id=61a9a4a7-170b-4ed9-8d52-8cb4defd1cae,network=Network(fcd22da6-016e-4872-a84c-4d82601c48d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61a9a4a7-17') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 00:00:20 user nova-compute[75341]: DEBUG os_vif [None req-400ee3bb-2725-4382-977b-8be0b4951708 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:42:07,bridge_name='br-int',has_traffic_filtering=True,id=61a9a4a7-170b-4ed9-8d52-8cb4defd1cae,network=Network(fcd22da6-016e-4872-a84c-4d82601c48d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61a9a4a7-17') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 00:00:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap61a9a4a7-17, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:00:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:00:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d7b13b24-e638-42b1-a14c-c141e0d05653) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:00:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:00:20 user nova-compute[75341]: INFO os_vif [None req-400ee3bb-2725-4382-977b-8be0b4951708 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:42:07,bridge_name='br-int',has_traffic_filtering=True,id=61a9a4a7-170b-4ed9-8d52-8cb4defd1cae,network=Network(fcd22da6-016e-4872-a84c-4d82601c48d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61a9a4a7-17')
Nov 15 00:00:20 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-400ee3bb-2725-4382-977b-8be0b4951708 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Deleting instance files /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5_del
Nov 15 00:00:20 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-400ee3bb-2725-4382-977b-8be0b4951708 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Deletion of /opt/stack/data/nova/instances/6382e432-838f-4d89-a743-cbaa37f50ab5_del complete
Nov 15 00:00:20 user nova-compute[75341]: INFO nova.compute.manager [None req-400ee3bb-2725-4382-977b-8be0b4951708 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Took 0.75 seconds to destroy the instance on the hypervisor.
Nov 15 00:00:20 user nova-compute[75341]: DEBUG oslo.service.loopingcall [None req-400ee3bb-2725-4382-977b-8be0b4951708 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75341) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 00:00:20 user nova-compute[75341]: DEBUG nova.compute.manager [-] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Deallocating network for instance {{(pid=75341) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 00:00:20 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] deallocate_for_instance() {{(pid=75341) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 00:00:20 user nova-compute[75341]: DEBUG nova.network.neutron [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Port 50f461fb-27ee-438f-880c-cde1e7441cfe binding to destination host user is already ACTIVE {{(pid=75341) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 15 00:00:20 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Acquiring lock "c3524e47-34b3-4b33-a1ff-25a8e4f35d86-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:00:20 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "c3524e47-34b3-4b33-a1ff-25a8e4f35d86-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:00:20 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "c3524e47-34b3-4b33-a1ff-25a8e4f35d86-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:00:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Acquiring lock "refresh_cache-c3524e47-34b3-4b33-a1ff-25a8e4f35d86" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:00:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Acquired lock "refresh_cache-c3524e47-34b3-4b33-a1ff-25a8e4f35d86" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:00:21 user nova-compute[75341]: DEBUG nova.network.neutron [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 00:00:21 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:00:21 user nova-compute[75341]: INFO nova.compute.manager [-] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Took 0.65 seconds to deallocate network for instance.
Nov 15 00:00:21 user nova-compute[75341]: DEBUG nova.compute.manager [req-89364549-68f5-4219-8507-7337bb1f6a82 req-f3669ec2-9e8f-4ce4-8244-fe8711cb46b3 service nova] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Received event network-vif-plugged-50f461fb-27ee-438f-880c-cde1e7441cfe {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:00:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-89364549-68f5-4219-8507-7337bb1f6a82 req-f3669ec2-9e8f-4ce4-8244-fe8711cb46b3 service nova] Acquiring lock "c3524e47-34b3-4b33-a1ff-25a8e4f35d86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:00:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-89364549-68f5-4219-8507-7337bb1f6a82 req-f3669ec2-9e8f-4ce4-8244-fe8711cb46b3 service nova] Lock "c3524e47-34b3-4b33-a1ff-25a8e4f35d86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:00:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-89364549-68f5-4219-8507-7337bb1f6a82 req-f3669ec2-9e8f-4ce4-8244-fe8711cb46b3 service nova] Lock "c3524e47-34b3-4b33-a1ff-25a8e4f35d86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:00:21 user nova-compute[75341]: DEBUG nova.compute.manager [req-89364549-68f5-4219-8507-7337bb1f6a82 req-f3669ec2-9e8f-4ce4-8244-fe8711cb46b3 service nova] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] No waiting events found dispatching network-vif-plugged-50f461fb-27ee-438f-880c-cde1e7441cfe {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:00:21 user nova-compute[75341]: WARNING nova.compute.manager [req-89364549-68f5-4219-8507-7337bb1f6a82 req-f3669ec2-9e8f-4ce4-8244-fe8711cb46b3 service nova] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Received unexpected event network-vif-plugged-50f461fb-27ee-438f-880c-cde1e7441cfe for instance with vm_state active and task_state resize_migrated.
Nov 15 00:00:21 user nova-compute[75341]: DEBUG nova.compute.manager [req-89364549-68f5-4219-8507-7337bb1f6a82 req-f3669ec2-9e8f-4ce4-8244-fe8711cb46b3 service nova] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Received event network-vif-plugged-50f461fb-27ee-438f-880c-cde1e7441cfe {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:00:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-89364549-68f5-4219-8507-7337bb1f6a82 req-f3669ec2-9e8f-4ce4-8244-fe8711cb46b3 service nova] Acquiring lock "c3524e47-34b3-4b33-a1ff-25a8e4f35d86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:00:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-89364549-68f5-4219-8507-7337bb1f6a82 req-f3669ec2-9e8f-4ce4-8244-fe8711cb46b3 service nova] Lock "c3524e47-34b3-4b33-a1ff-25a8e4f35d86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:00:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-89364549-68f5-4219-8507-7337bb1f6a82 req-f3669ec2-9e8f-4ce4-8244-fe8711cb46b3 service nova] Lock "c3524e47-34b3-4b33-a1ff-25a8e4f35d86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:00:21 user nova-compute[75341]: DEBUG nova.compute.manager [req-89364549-68f5-4219-8507-7337bb1f6a82 req-f3669ec2-9e8f-4ce4-8244-fe8711cb46b3 service nova] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] No waiting events found dispatching network-vif-plugged-50f461fb-27ee-438f-880c-cde1e7441cfe {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:00:21 user nova-compute[75341]: WARNING nova.compute.manager [req-89364549-68f5-4219-8507-7337bb1f6a82 req-f3669ec2-9e8f-4ce4-8244-fe8711cb46b3 service nova] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Received unexpected event network-vif-plugged-50f461fb-27ee-438f-880c-cde1e7441cfe for instance with vm_state active and task_state resize_migrated.
Nov 15 00:00:21 user nova-compute[75341]: DEBUG nova.compute.manager [req-89364549-68f5-4219-8507-7337bb1f6a82 req-f3669ec2-9e8f-4ce4-8244-fe8711cb46b3 service nova] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Received event network-vif-unplugged-50f461fb-27ee-438f-880c-cde1e7441cfe {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:00:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-89364549-68f5-4219-8507-7337bb1f6a82 req-f3669ec2-9e8f-4ce4-8244-fe8711cb46b3 service nova] Acquiring lock "c3524e47-34b3-4b33-a1ff-25a8e4f35d86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:00:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-89364549-68f5-4219-8507-7337bb1f6a82 req-f3669ec2-9e8f-4ce4-8244-fe8711cb46b3 service nova] Lock "c3524e47-34b3-4b33-a1ff-25a8e4f35d86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:00:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-89364549-68f5-4219-8507-7337bb1f6a82 req-f3669ec2-9e8f-4ce4-8244-fe8711cb46b3 service nova] Lock "c3524e47-34b3-4b33-a1ff-25a8e4f35d86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:00:21 user nova-compute[75341]: DEBUG nova.compute.manager [req-89364549-68f5-4219-8507-7337bb1f6a82 req-f3669ec2-9e8f-4ce4-8244-fe8711cb46b3 service nova] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] No waiting events found dispatching network-vif-unplugged-50f461fb-27ee-438f-880c-cde1e7441cfe {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:00:21 user nova-compute[75341]: WARNING nova.compute.manager [req-89364549-68f5-4219-8507-7337bb1f6a82 req-f3669ec2-9e8f-4ce4-8244-fe8711cb46b3 service nova] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Received unexpected event network-vif-unplugged-50f461fb-27ee-438f-880c-cde1e7441cfe for instance with vm_state active and task_state resize_migrated.
Nov 15 00:00:21 user nova-compute[75341]: DEBUG nova.compute.manager [req-89364549-68f5-4219-8507-7337bb1f6a82 req-f3669ec2-9e8f-4ce4-8244-fe8711cb46b3 service nova] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Received event network-vif-plugged-50f461fb-27ee-438f-880c-cde1e7441cfe {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:00:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-89364549-68f5-4219-8507-7337bb1f6a82 req-f3669ec2-9e8f-4ce4-8244-fe8711cb46b3 service nova] Acquiring lock "c3524e47-34b3-4b33-a1ff-25a8e4f35d86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:00:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-89364549-68f5-4219-8507-7337bb1f6a82 req-f3669ec2-9e8f-4ce4-8244-fe8711cb46b3 service nova] Lock "c3524e47-34b3-4b33-a1ff-25a8e4f35d86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:00:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-89364549-68f5-4219-8507-7337bb1f6a82 req-f3669ec2-9e8f-4ce4-8244-fe8711cb46b3 service nova] Lock "c3524e47-34b3-4b33-a1ff-25a8e4f35d86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:00:21 user nova-compute[75341]: DEBUG nova.compute.manager [req-89364549-68f5-4219-8507-7337bb1f6a82 req-f3669ec2-9e8f-4ce4-8244-fe8711cb46b3 service nova] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] No waiting events found dispatching network-vif-plugged-50f461fb-27ee-438f-880c-cde1e7441cfe {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:00:21 user nova-compute[75341]: WARNING nova.compute.manager [req-89364549-68f5-4219-8507-7337bb1f6a82 req-f3669ec2-9e8f-4ce4-8244-fe8711cb46b3 service nova] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Received unexpected event network-vif-plugged-50f461fb-27ee-438f-880c-cde1e7441cfe for instance with vm_state active and task_state resize_migrated.
Nov 15 00:00:21 user nova-compute[75341]: DEBUG nova.compute.manager [req-89364549-68f5-4219-8507-7337bb1f6a82 req-f3669ec2-9e8f-4ce4-8244-fe8711cb46b3 service nova] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Received event network-vif-unplugged-61a9a4a7-170b-4ed9-8d52-8cb4defd1cae {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:00:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-89364549-68f5-4219-8507-7337bb1f6a82 req-f3669ec2-9e8f-4ce4-8244-fe8711cb46b3 service nova] Acquiring lock "6382e432-838f-4d89-a743-cbaa37f50ab5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:00:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-89364549-68f5-4219-8507-7337bb1f6a82 req-f3669ec2-9e8f-4ce4-8244-fe8711cb46b3 service nova] Lock "6382e432-838f-4d89-a743-cbaa37f50ab5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:00:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-89364549-68f5-4219-8507-7337bb1f6a82 req-f3669ec2-9e8f-4ce4-8244-fe8711cb46b3 service nova] Lock "6382e432-838f-4d89-a743-cbaa37f50ab5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:00:21 user nova-compute[75341]: DEBUG nova.compute.manager [req-89364549-68f5-4219-8507-7337bb1f6a82 req-f3669ec2-9e8f-4ce4-8244-fe8711cb46b3 service nova] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] No waiting events found dispatching network-vif-unplugged-61a9a4a7-170b-4ed9-8d52-8cb4defd1cae {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:00:21 user nova-compute[75341]: DEBUG nova.compute.manager [req-89364549-68f5-4219-8507-7337bb1f6a82 req-f3669ec2-9e8f-4ce4-8244-fe8711cb46b3 service nova] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Received event network-vif-unplugged-61a9a4a7-170b-4ed9-8d52-8cb4defd1cae for instance with task_state deleting. {{(pid=75341) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 00:00:21 user nova-compute[75341]: DEBUG nova.compute.manager [req-89364549-68f5-4219-8507-7337bb1f6a82 req-f3669ec2-9e8f-4ce4-8244-fe8711cb46b3 service nova] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Received event network-vif-plugged-61a9a4a7-170b-4ed9-8d52-8cb4defd1cae {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:00:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-89364549-68f5-4219-8507-7337bb1f6a82 req-f3669ec2-9e8f-4ce4-8244-fe8711cb46b3 service nova] Acquiring lock "6382e432-838f-4d89-a743-cbaa37f50ab5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:00:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-89364549-68f5-4219-8507-7337bb1f6a82 req-f3669ec2-9e8f-4ce4-8244-fe8711cb46b3 service nova] Lock "6382e432-838f-4d89-a743-cbaa37f50ab5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:00:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-89364549-68f5-4219-8507-7337bb1f6a82 req-f3669ec2-9e8f-4ce4-8244-fe8711cb46b3 service nova] Lock "6382e432-838f-4d89-a743-cbaa37f50ab5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:00:21 user nova-compute[75341]: DEBUG nova.compute.manager [req-89364549-68f5-4219-8507-7337bb1f6a82 req-f3669ec2-9e8f-4ce4-8244-fe8711cb46b3 service nova] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] No waiting events found dispatching network-vif-plugged-61a9a4a7-170b-4ed9-8d52-8cb4defd1cae {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:00:21 user nova-compute[75341]: WARNING nova.compute.manager [req-89364549-68f5-4219-8507-7337bb1f6a82 req-f3669ec2-9e8f-4ce4-8244-fe8711cb46b3 service nova] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Received unexpected event network-vif-plugged-61a9a4a7-170b-4ed9-8d52-8cb4defd1cae for instance with vm_state rescued and task_state deleting.
Nov 15 00:00:21 user nova-compute[75341]: DEBUG nova.compute.manager [req-a394336e-ed9e-4205-934f-58eff75eaf4d req-04cc10e3-5a05-4130-96ea-cbd3e391bdee service nova] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Received event network-vif-deleted-61a9a4a7-170b-4ed9-8d52-8cb4defd1cae {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:00:21 user nova-compute[75341]: INFO nova.compute.manager [req-a394336e-ed9e-4205-934f-58eff75eaf4d req-04cc10e3-5a05-4130-96ea-cbd3e391bdee service nova] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Neutron deleted interface 61a9a4a7-170b-4ed9-8d52-8cb4defd1cae; detaching it from the instance and deleting it from the info cache
Nov 15 00:00:21 user nova-compute[75341]: DEBUG nova.network.neutron [req-a394336e-ed9e-4205-934f-58eff75eaf4d req-04cc10e3-5a05-4130-96ea-cbd3e391bdee service nova] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:00:21 user nova-compute[75341]: DEBUG nova.compute.manager [req-a394336e-ed9e-4205-934f-58eff75eaf4d req-04cc10e3-5a05-4130-96ea-cbd3e391bdee service nova] [instance: 6382e432-838f-4d89-a743-cbaa37f50ab5] Detach interface failed, port_id=61a9a4a7-170b-4ed9-8d52-8cb4defd1cae, reason: Instance 6382e432-838f-4d89-a743-cbaa37f50ab5 could not be found. {{(pid=75341) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 00:00:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-400ee3bb-2725-4382-977b-8be0b4951708 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:00:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-400ee3bb-2725-4382-977b-8be0b4951708 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:00:21 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-400ee3bb-2725-4382-977b-8be0b4951708 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 00:00:21 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-400ee3bb-2725-4382-977b-8be0b4951708 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 00:00:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-400ee3bb-2725-4382-977b-8be0b4951708 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.351s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:00:21 user nova-compute[75341]: INFO nova.scheduler.client.report [None req-400ee3bb-2725-4382-977b-8be0b4951708 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Deleted allocations for instance 6382e432-838f-4d89-a743-cbaa37f50ab5
Nov 15 00:00:21 user nova-compute[75341]: DEBUG nova.network.neutron [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Updating instance_info_cache with network_info: [{"id": "50f461fb-27ee-438f-880c-cde1e7441cfe", "address": "fa:16:3e:26:50:43", "network": {"id": "d86a8e7f-6658-4994-9a13-eb3163bd3865", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-635863702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c69a942b4f4b97a1a3152dea86c7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f461fb-27", "ovs_interfaceid": "50f461fb-27ee-438f-880c-cde1e7441cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:00:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Releasing lock "refresh_cache-c3524e47-34b3-4b33-a1ff-25a8e4f35d86" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:00:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-400ee3bb-2725-4382-977b-8be0b4951708 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "6382e432-838f-4d89-a743-cbaa37f50ab5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:00:21 user nova-compute[75341]: DEBUG os_brick.utils [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 00:00:21 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:00:21 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:00:21 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[0026bad8-da11-4ef7-99a0-6eb1ad436bbf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6d1cfca09c9\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:00:21 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:00:21 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:00:21 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[89fce427-2d5e-47ed-99e8-c567420b1b8c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:00:21 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:00:21 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:00:21 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c6e0fa-01cc-4134-9652-d8a1232be92e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:00:21 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[92af0e76-c860-46c1-b4c8-dae381a1b715]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:00:21 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Running cmd (subprocess): nvme version {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:00:21 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] 'nvme version' failed. Not Retrying. {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 00:00:21 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] nvme not present on system {{(pid=75341) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 00:00:21 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:00:21 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 00:00:21 user nova-compute[75341]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 00:00:21 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e16139f-6eae-45d6-9327-7e0bdcba2f0c]: (4, '') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:00:21 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75341) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 00:00:21 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 00:00:21 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] LIGHTOS: no hostnqn found. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 00:00:21 user nova-compute[75341]: DEBUG os_brick.utils [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6d1cfca09c9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 00:00:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:26 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Starting finish_migration {{(pid=75341) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 15 00:00:26 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Instance directory exists: not creating {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 00:00:26 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Creating image(s)
Nov 15 00:00:26 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Did not create local disks {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 00:00:26 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Ensure instance console log exists: /opt/stack/data/nova/instances/c3524e47-34b3-4b33-a1ff-25a8e4f35d86/console.log {{(pid=75341) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 00:00:26 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:00:26 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:00:26 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:00:26 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Start _get_guest_xml network_info=[{"id": "50f461fb-27ee-438f-880c-cde1e7441cfe", "address": "fa:16:3e:26:50:43", "network": {"id": "d86a8e7f-6658-4994-9a13-eb3163bd3865", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-635863702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-635863702-network", "vif_mac": "fa:16:3e:26:50:43"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c69a942b4f4b97a1a3152dea86c7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f461fb-27", "ovs_interfaceid": "50f461fb-27ee-438f-880c-cde1e7441cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '3d0c6ba6-05f5-4de8-a374-944da86fa4b3', 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NaWvjfqe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'c3524e47-34b3-4b33-a1ff-25a8e4f35d86', 'attached_at': '2023-11-15T00:00:27.000000', 'detached_at': '', 'volume_id': '47542c09-3d82-4329-8a27-3650d4e00123', 'serial': '47542c09-3d82-4329-8a27-3650d4e00123'}, 'delete_on_termination': True, 'volume_type': None} {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 00:00:26 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:00:26 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:00:26 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 00:00:26 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 00:00:26 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 00:00:26 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 00:00:26 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 00:00:26 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 00:00:26 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 00:00:26 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 00:00:26 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 00:00:26 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 00:00:26 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 00:00:26 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 00:00:26 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 00:00:26 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 00:00:26 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 00:00:26 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 00:00:26 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Calling os-brick to attach iSCSI Volume {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 00:00:26 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NaWvjfqe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 00:00:26 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 00:00:26 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 00:00:26 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 00:00:26 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 00:00:26 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 00:00:26 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 00:00:26 user nova-compute[75341]: INFO os_brick.initiator.connectors.iscsi [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 00:00:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 -p 172.16.0.220:3260 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:00:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:00:26 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[a924723c-1c0c-492c-8c23-b3e245f8c263]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:00:26 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 00:00:26 user nova-compute[75341]:  {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:00:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 -p 172.16.0.220:3260 --interface default --op new {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:00:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:00:26 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ec5c19-f6e7-4d2a-a14a-66179c702cb5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123] added\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:00:26 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123] added
Nov 15 00:00:26 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:00:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:00:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:00:26 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[89088b82-55f3-4b6c-af69-f9566a821e56]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:00:26 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:00:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:00:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:00:26 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d7d392-41a8-4443-ba43-d8d3d0cab4c3]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:00:26 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:00:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NaWvjfqe {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:00:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NaWvjfqe" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:00:26 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1a215e-3dfa-44d7-ac64-0e2c040ffdfc]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:00:26 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NaWvjfqe'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:00:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:00:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:00:26 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6fbc52-3d21-4eb5-93ef-f0cd33207677]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:00:26 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:00:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:00:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:00:26 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5dcd76-a469-4d42-b797-eeb309df0510]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:00:26 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)
Nov 15 00:00:26 user nova-compute[75341]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f (non-flash)
Nov 15 00:00:26 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 00:00:26 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)
Nov 15 00:00:26 user nova-compute[75341]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f (non-flash)
Nov 15 00:00:26 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 00:00:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 -p 172.16.0.220:3260 --login {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:00:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:00:26 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c4d68a-f35b-498d-be89-880059a7e2df]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:00:26 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123, portal: 172.16.0.220,3260]
Nov 15 00:00:26 user nova-compute[75341]: Login to [iface: default, target: iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123, portal: 172.16.0.220,3260] successful.
Nov 15 00:00:26 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:00:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:00:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:00:26 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[c667ae7e-1fe3-4f80-9ec8-30cb80af878f]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:00:26 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:00:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:00:27 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:00:27 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[3522849b-a6a0-4bb3-a2de-bfd62d311adb]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:00:27 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)
Nov 15 00:00:27 user nova-compute[75341]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f (non-flash)
Nov 15 00:00:27 user nova-compute[75341]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 (non-flash)
Nov 15 00:00:27 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 00:00:27 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)
Nov 15 00:00:27 user nova-compute[75341]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f (non-flash)
Nov 15 00:00:27 user nova-compute[75341]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 (non-flash)
Nov 15 00:00:27 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 00:00:27 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 00:00:27 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Connected to 172.16.0.220:3260 {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 00:00:27 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=75341) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 00:00:27 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75341) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 00:00:27 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:00:27 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:00:27 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a7b821-dc18-4ef3-81f8-26ab6749d5ea]: (4, ('- - 0', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:00:27 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 00:00:27 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NaWvjfqe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 00:00:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:28 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 00:00:28 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '26361306538376533', 'path': '/dev/sdc'} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 00:00:28 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361306538376533', 'path': '/dev/sdc'} {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 00:00:28 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:58:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1599301259',display_name='tempest-ServerActionsTestOtherA-server-1599301259',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1599301259',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTmBE+Takjbl0ZrUdtoD/FDS2CHZC4n75Y/1LCLwXLZHE8J0GqhfVD/envyBMKYWUkAGQH/bKcOVnVKa4qF07KOQ/PvMrk+gG45OxOvZ8A6PGkmy0qPqzF8MOOmxhYzVQ==',key_name='tempest-keypair-1744456340',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:58:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f4c69a942b4f4b97a1a3152dea86c7fb',ramdisk_id='',reservation_id='r-dgx5dk1c',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1796396043',owner_user_name='tempest-ServerActionsTestOtherA-1796396043-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T00:00:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='442aae0161f347d0a79b168a1b60286a',uuid=c3524e47-34b3-4b33-a1ff-25a8e4f35d86,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "50f461fb-27ee-438f-880c-cde1e7441cfe", "address": "fa:16:3e:26:50:43", "network": {"id": "d86a8e7f-6658-4994-9a13-eb3163bd3865", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-635863702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-635863702-network", "vif_mac": "fa:16:3e:26:50:43"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c69a942b4f4b97a1a3152dea86c7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f461fb-27", "ovs_interfaceid": "50f461fb-27ee-438f-880c-cde1e7441cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 00:00:28 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Converting VIF {"id": "50f461fb-27ee-438f-880c-cde1e7441cfe", "address": "fa:16:3e:26:50:43", "network": {"id": "d86a8e7f-6658-4994-9a13-eb3163bd3865", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-635863702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-635863702-network", "vif_mac": "fa:16:3e:26:50:43"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c69a942b4f4b97a1a3152dea86c7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f461fb-27", "ovs_interfaceid": "50f461fb-27ee-438f-880c-cde1e7441cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 00:00:28 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:50:43,bridge_name='br-int',has_traffic_filtering=True,id=50f461fb-27ee-438f-880c-cde1e7441cfe,network=Network(d86a8e7f-6658-4994-9a13-eb3163bd3865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50f461fb-27') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 00:00:28 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] End _get_guest_xml xml=<domain type="kvm">
Nov 15 00:00:28 user nova-compute[75341]:   <uuid>c3524e47-34b3-4b33-a1ff-25a8e4f35d86</uuid>
Nov 15 00:00:28 user nova-compute[75341]:   <name>instance-0000002a</name>
Nov 15 00:00:28 user nova-compute[75341]:   <memory>2097152</memory>
Nov 15 00:00:28 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 15 00:00:28 user nova-compute[75341]:   <metadata>
Nov 15 00:00:28 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 00:00:28 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 15 00:00:28 user nova-compute[75341]:       <nova:name>tempest-ServerActionsTestOtherA-server-1599301259</nova:name>
Nov 15 00:00:28 user nova-compute[75341]:       <nova:creationTime>2023-11-15 00:00:26</nova:creationTime>
Nov 15 00:00:28 user nova-compute[75341]:       <nova:flavor name="m1.small">
Nov 15 00:00:28 user nova-compute[75341]:         <nova:memory>2048</nova:memory>
Nov 15 00:00:28 user nova-compute[75341]:         <nova:disk>20</nova:disk>
Nov 15 00:00:28 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 15 00:00:28 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 00:00:28 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 15 00:00:28 user nova-compute[75341]:       </nova:flavor>
Nov 15 00:00:28 user nova-compute[75341]:       <nova:owner>
Nov 15 00:00:28 user nova-compute[75341]:         <nova:user uuid="442aae0161f347d0a79b168a1b60286a">tempest-ServerActionsTestOtherA-1796396043-project-member</nova:user>
Nov 15 00:00:28 user nova-compute[75341]:         <nova:project uuid="f4c69a942b4f4b97a1a3152dea86c7fb">tempest-ServerActionsTestOtherA-1796396043</nova:project>
Nov 15 00:00:28 user nova-compute[75341]:       </nova:owner>
Nov 15 00:00:28 user nova-compute[75341]:       <nova:ports>
Nov 15 00:00:28 user nova-compute[75341]:         <nova:port uuid="50f461fb-27ee-438f-880c-cde1e7441cfe">
Nov 15 00:00:28 user nova-compute[75341]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 00:00:28 user nova-compute[75341]:         </nova:port>
Nov 15 00:00:28 user nova-compute[75341]:       </nova:ports>
Nov 15 00:00:28 user nova-compute[75341]:     </nova:instance>
Nov 15 00:00:28 user nova-compute[75341]:   </metadata>
Nov 15 00:00:28 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 15 00:00:28 user nova-compute[75341]:     <system>
Nov 15 00:00:28 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 00:00:28 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 15 00:00:28 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 15 00:00:28 user nova-compute[75341]:       <entry name="serial">c3524e47-34b3-4b33-a1ff-25a8e4f35d86</entry>
Nov 15 00:00:28 user nova-compute[75341]:       <entry name="uuid">c3524e47-34b3-4b33-a1ff-25a8e4f35d86</entry>
Nov 15 00:00:28 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 15 00:00:28 user nova-compute[75341]:     </system>
Nov 15 00:00:28 user nova-compute[75341]:   </sysinfo>
Nov 15 00:00:28 user nova-compute[75341]:   <os>
Nov 15 00:00:28 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 00:00:28 user nova-compute[75341]:     <boot dev="hd"/>
Nov 15 00:00:28 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 15 00:00:28 user nova-compute[75341]:   </os>
Nov 15 00:00:28 user nova-compute[75341]:   <features>
Nov 15 00:00:28 user nova-compute[75341]:     <acpi/>
Nov 15 00:00:28 user nova-compute[75341]:     <apic/>
Nov 15 00:00:28 user nova-compute[75341]:     <vmcoreinfo/>
Nov 15 00:00:28 user nova-compute[75341]:   </features>
Nov 15 00:00:28 user nova-compute[75341]:   <clock offset="utc">
Nov 15 00:00:28 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 00:00:28 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 00:00:28 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 15 00:00:28 user nova-compute[75341]:   </clock>
Nov 15 00:00:28 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 15 00:00:28 user nova-compute[75341]:     <model>Nehalem</model>
Nov 15 00:00:28 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 00:00:28 user nova-compute[75341]:   </cpu>
Nov 15 00:00:28 user nova-compute[75341]:   <devices>
Nov 15 00:00:28 user nova-compute[75341]:     <disk type="block" device="disk">
Nov 15 00:00:28 user nova-compute[75341]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 00:00:28 user nova-compute[75341]:       <source dev="/dev/sdc"/>
Nov 15 00:00:28 user nova-compute[75341]:       <target dev="vda" bus="virtio"/>
Nov 15 00:00:28 user nova-compute[75341]:       <serial>47542c09-3d82-4329-8a27-3650d4e00123</serial>
Nov 15 00:00:28 user nova-compute[75341]:     </disk>
Nov 15 00:00:28 user nova-compute[75341]:     <interface type="ethernet">
Nov 15 00:00:28 user nova-compute[75341]:       <mac address="fa:16:3e:26:50:43"/>
Nov 15 00:00:28 user nova-compute[75341]:       <model type="virtio"/>
Nov 15 00:00:28 user nova-compute[75341]:       <mtu size="1442"/>
Nov 15 00:00:28 user nova-compute[75341]:       <target dev="tap50f461fb-27"/>
Nov 15 00:00:28 user nova-compute[75341]:     </interface>
Nov 15 00:00:28 user nova-compute[75341]:     <serial type="pty">
Nov 15 00:00:28 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/c3524e47-34b3-4b33-a1ff-25a8e4f35d86/console.log" append="off"/>
Nov 15 00:00:28 user nova-compute[75341]:     </serial>
Nov 15 00:00:28 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 00:00:28 user nova-compute[75341]:     <video>
Nov 15 00:00:28 user nova-compute[75341]:       <model type="virtio"/>
Nov 15 00:00:28 user nova-compute[75341]:     </video>
Nov 15 00:00:28 user nova-compute[75341]:     <rng model="virtio">
Nov 15 00:00:28 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 15 00:00:28 user nova-compute[75341]:     </rng>
Nov 15 00:00:28 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 15 00:00:28 user nova-compute[75341]:     <memballoon model="virtio">
Nov 15 00:00:28 user nova-compute[75341]:       <stats period="10"/>
Nov 15 00:00:28 user nova-compute[75341]:     </memballoon>
Nov 15 00:00:28 user nova-compute[75341]:   </devices>
Nov 15 00:00:28 user nova-compute[75341]: </domain>
Nov 15 00:00:28 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 00:00:28 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:58:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1599301259',display_name='tempest-ServerActionsTestOtherA-server-1599301259',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1599301259',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTmBE+Takjbl0ZrUdtoD/FDS2CHZC4n75Y/1LCLwXLZHE8J0GqhfVD/envyBMKYWUkAGQH/bKcOVnVKa4qF07KOQ/PvMrk+gG45OxOvZ8A6PGkmy0qPqzF8MOOmxhYzVQ==',key_name='tempest-keypair-1744456340',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:58:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f4c69a942b4f4b97a1a3152dea86c7fb',ramdisk_id='',reservation_id='r-dgx5dk1c',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1796396043',owner_user_name='tempest-ServerActionsTestOtherA-1796396043-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T00:00:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='442aae0161f347d0a79b168a1b60286a',uuid=c3524e47-34b3-4b33-a1ff-25a8e4f35d86,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "50f461fb-27ee-438f-880c-cde1e7441cfe", "address": "fa:16:3e:26:50:43", "network": {"id": "d86a8e7f-6658-4994-9a13-eb3163bd3865", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-635863702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-635863702-network", "vif_mac": "fa:16:3e:26:50:43"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c69a942b4f4b97a1a3152dea86c7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f461fb-27", "ovs_interfaceid": "50f461fb-27ee-438f-880c-cde1e7441cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 00:00:28 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Converting VIF {"id": "50f461fb-27ee-438f-880c-cde1e7441cfe", "address": "fa:16:3e:26:50:43", "network": {"id": "d86a8e7f-6658-4994-9a13-eb3163bd3865", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-635863702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-635863702-network", "vif_mac": "fa:16:3e:26:50:43"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c69a942b4f4b97a1a3152dea86c7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f461fb-27", "ovs_interfaceid": "50f461fb-27ee-438f-880c-cde1e7441cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 00:00:28 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:50:43,bridge_name='br-int',has_traffic_filtering=True,id=50f461fb-27ee-438f-880c-cde1e7441cfe,network=Network(d86a8e7f-6658-4994-9a13-eb3163bd3865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50f461fb-27') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 00:00:28 user nova-compute[75341]: DEBUG os_vif [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:50:43,bridge_name='br-int',has_traffic_filtering=True,id=50f461fb-27ee-438f-880c-cde1e7441cfe,network=Network(d86a8e7f-6658-4994-9a13-eb3163bd3865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50f461fb-27') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 00:00:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:00:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 00:00:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7a7f26c6-10e7-53a2-887e-f5ea6faedaa2', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:00:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:00:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap50f461fb-27, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:00:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap50f461fb-27, col_values=(('qos', UUID('cec6f93a-8beb-4ff6-87ff-181980b9ba8e')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:00:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap50f461fb-27, col_values=(('external_ids', {'iface-id': '50f461fb-27ee-438f-880c-cde1e7441cfe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:50:43', 'vm-uuid': 'c3524e47-34b3-4b33-a1ff-25a8e4f35d86'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:00:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:00:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:28 user nova-compute[75341]: INFO os_vif [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:50:43,bridge_name='br-int',has_traffic_filtering=True,id=50f461fb-27ee-438f-880c-cde1e7441cfe,network=Network(d86a8e7f-6658-4994-9a13-eb3163bd3865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50f461fb-27')
Nov 15 00:00:28 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 00:00:28 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] No VIF found with MAC fa:16:3e:26:50:43, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 00:00:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:29 user nova-compute[75341]: DEBUG nova.compute.manager [req-768f7554-35bf-4633-8825-25ed2344c6bf req-23f196b9-690f-4f34-bfd4-f4c9329b88f5 service nova] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Received event network-vif-plugged-50f461fb-27ee-438f-880c-cde1e7441cfe {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:00:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-768f7554-35bf-4633-8825-25ed2344c6bf req-23f196b9-690f-4f34-bfd4-f4c9329b88f5 service nova] Acquiring lock "c3524e47-34b3-4b33-a1ff-25a8e4f35d86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:00:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-768f7554-35bf-4633-8825-25ed2344c6bf req-23f196b9-690f-4f34-bfd4-f4c9329b88f5 service nova] Lock "c3524e47-34b3-4b33-a1ff-25a8e4f35d86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:00:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-768f7554-35bf-4633-8825-25ed2344c6bf req-23f196b9-690f-4f34-bfd4-f4c9329b88f5 service nova] Lock "c3524e47-34b3-4b33-a1ff-25a8e4f35d86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:00:29 user nova-compute[75341]: DEBUG nova.compute.manager [req-768f7554-35bf-4633-8825-25ed2344c6bf req-23f196b9-690f-4f34-bfd4-f4c9329b88f5 service nova] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] No waiting events found dispatching network-vif-plugged-50f461fb-27ee-438f-880c-cde1e7441cfe {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:00:29 user nova-compute[75341]: WARNING nova.compute.manager [req-768f7554-35bf-4633-8825-25ed2344c6bf req-23f196b9-690f-4f34-bfd4-f4c9329b88f5 service nova] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Received unexpected event network-vif-plugged-50f461fb-27ee-438f-880c-cde1e7441cfe for instance with vm_state active and task_state resize_finish.
Nov 15 00:00:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:31 user nova-compute[75341]: DEBUG nova.compute.manager [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Instance event wait completed in 0 seconds for  {{(pid=75341) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 00:00:31 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Instance running successfully.
Nov 15 00:00:31 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Failed to set time: agent not configured {{(pid=75341) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 15 00:00:31 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-3635a068-6317-44d0-bf87-4b2bfdb29d8d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] finish_migration finished successfully. {{(pid=75341) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 15 00:00:31 user nova-compute[75341]: DEBUG nova.compute.manager [req-c17d4f8b-4d2e-4af7-b6da-c080811c95e4 req-f3a12171-d229-43d5-889d-7b5c4f5d2255 service nova] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Received event network-vif-plugged-50f461fb-27ee-438f-880c-cde1e7441cfe {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:00:31 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-c17d4f8b-4d2e-4af7-b6da-c080811c95e4 req-f3a12171-d229-43d5-889d-7b5c4f5d2255 service nova] Acquiring lock "c3524e47-34b3-4b33-a1ff-25a8e4f35d86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:00:31 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-c17d4f8b-4d2e-4af7-b6da-c080811c95e4 req-f3a12171-d229-43d5-889d-7b5c4f5d2255 service nova] Lock "c3524e47-34b3-4b33-a1ff-25a8e4f35d86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:00:31 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-c17d4f8b-4d2e-4af7-b6da-c080811c95e4 req-f3a12171-d229-43d5-889d-7b5c4f5d2255 service nova] Lock "c3524e47-34b3-4b33-a1ff-25a8e4f35d86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:00:31 user nova-compute[75341]: DEBUG nova.compute.manager [req-c17d4f8b-4d2e-4af7-b6da-c080811c95e4 req-f3a12171-d229-43d5-889d-7b5c4f5d2255 service nova] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] No waiting events found dispatching network-vif-plugged-50f461fb-27ee-438f-880c-cde1e7441cfe {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:00:31 user nova-compute[75341]: WARNING nova.compute.manager [req-c17d4f8b-4d2e-4af7-b6da-c080811c95e4 req-f3a12171-d229-43d5-889d-7b5c4f5d2255 service nova] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Received unexpected event network-vif-plugged-50f461fb-27ee-438f-880c-cde1e7441cfe for instance with vm_state active and task_state resize_finish.
Nov 15 00:00:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:33 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:37 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:38 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:39 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:39 user nova-compute[75341]: DEBUG nova.compute.manager [req-71770e07-8a0f-4998-9ee4-3e3f10d0eef2 req-b92fe705-67c1-4dfd-8640-bbd29fc2e2da service nova] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Received event network-changed-6f73d56f-c40e-4e8d-a793-3ff9ae5bc35c {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:00:39 user nova-compute[75341]: DEBUG nova.compute.manager [req-71770e07-8a0f-4998-9ee4-3e3f10d0eef2 req-b92fe705-67c1-4dfd-8640-bbd29fc2e2da service nova] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Refreshing instance network info cache due to event network-changed-6f73d56f-c40e-4e8d-a793-3ff9ae5bc35c. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 00:00:39 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-71770e07-8a0f-4998-9ee4-3e3f10d0eef2 req-b92fe705-67c1-4dfd-8640-bbd29fc2e2da service nova] Acquiring lock "refresh_cache-6eee60d5-4088-40ff-b816-4080da234894" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:00:39 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-71770e07-8a0f-4998-9ee4-3e3f10d0eef2 req-b92fe705-67c1-4dfd-8640-bbd29fc2e2da service nova] Acquired lock "refresh_cache-6eee60d5-4088-40ff-b816-4080da234894" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:00:39 user nova-compute[75341]: DEBUG nova.network.neutron [req-71770e07-8a0f-4998-9ee4-3e3f10d0eef2 req-b92fe705-67c1-4dfd-8640-bbd29fc2e2da service nova] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Refreshing network info cache for port 6f73d56f-c40e-4e8d-a793-3ff9ae5bc35c {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 00:00:40 user nova-compute[75341]: DEBUG nova.network.neutron [req-71770e07-8a0f-4998-9ee4-3e3f10d0eef2 req-b92fe705-67c1-4dfd-8640-bbd29fc2e2da service nova] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Updated VIF entry in instance network info cache for port 6f73d56f-c40e-4e8d-a793-3ff9ae5bc35c. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 00:00:40 user nova-compute[75341]: DEBUG nova.network.neutron [req-71770e07-8a0f-4998-9ee4-3e3f10d0eef2 req-b92fe705-67c1-4dfd-8640-bbd29fc2e2da service nova] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Updating instance_info_cache with network_info: [{"id": "6f73d56f-c40e-4e8d-a793-3ff9ae5bc35c", "address": "fa:16:3e:08:9f:79", "network": {"id": "227eb779-a064-477d-8447-45862017ae7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-3827253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96674073965642f1af11221b4add8a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f73d56f-c4", "ovs_interfaceid": "6f73d56f-c40e-4e8d-a793-3ff9ae5bc35c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:00:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-71770e07-8a0f-4998-9ee4-3e3f10d0eef2 req-b92fe705-67c1-4dfd-8640-bbd29fc2e2da service nova] Releasing lock "refresh_cache-6eee60d5-4088-40ff-b816-4080da234894" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:00:40 user nova-compute[75341]: DEBUG nova.compute.manager [req-141d2adc-813d-498b-9fc3-6b4cb3335d74 req-423c0a1d-298b-4ede-91e0-7e2ddea3fd1e service nova] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Received event network-changed-6f73d56f-c40e-4e8d-a793-3ff9ae5bc35c {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:00:40 user nova-compute[75341]: DEBUG nova.compute.manager [req-141d2adc-813d-498b-9fc3-6b4cb3335d74 req-423c0a1d-298b-4ede-91e0-7e2ddea3fd1e service nova] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Refreshing instance network info cache due to event network-changed-6f73d56f-c40e-4e8d-a793-3ff9ae5bc35c. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 00:00:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-141d2adc-813d-498b-9fc3-6b4cb3335d74 req-423c0a1d-298b-4ede-91e0-7e2ddea3fd1e service nova] Acquiring lock "refresh_cache-6eee60d5-4088-40ff-b816-4080da234894" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:00:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-141d2adc-813d-498b-9fc3-6b4cb3335d74 req-423c0a1d-298b-4ede-91e0-7e2ddea3fd1e service nova] Acquired lock "refresh_cache-6eee60d5-4088-40ff-b816-4080da234894" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:00:40 user nova-compute[75341]: DEBUG nova.network.neutron [req-141d2adc-813d-498b-9fc3-6b4cb3335d74 req-423c0a1d-298b-4ede-91e0-7e2ddea3fd1e service nova] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Refreshing network info cache for port 6f73d56f-c40e-4e8d-a793-3ff9ae5bc35c {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 00:00:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d9ceda18-43d3-4b0a-b57d-1296f139f5a6 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Acquiring lock "6eee60d5-4088-40ff-b816-4080da234894" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:00:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d9ceda18-43d3-4b0a-b57d-1296f139f5a6 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "6eee60d5-4088-40ff-b816-4080da234894" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:00:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d9ceda18-43d3-4b0a-b57d-1296f139f5a6 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Acquiring lock "6eee60d5-4088-40ff-b816-4080da234894-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:00:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d9ceda18-43d3-4b0a-b57d-1296f139f5a6 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "6eee60d5-4088-40ff-b816-4080da234894-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:00:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d9ceda18-43d3-4b0a-b57d-1296f139f5a6 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "6eee60d5-4088-40ff-b816-4080da234894-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:00:40 user nova-compute[75341]: INFO nova.compute.manager [None req-d9ceda18-43d3-4b0a-b57d-1296f139f5a6 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Terminating instance
Nov 15 00:00:40 user nova-compute[75341]: DEBUG nova.compute.manager [None req-d9ceda18-43d3-4b0a-b57d-1296f139f5a6 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Start destroying the instance on the hypervisor. {{(pid=75341) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 00:00:40 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:41 user nova-compute[75341]: DEBUG nova.network.neutron [req-141d2adc-813d-498b-9fc3-6b4cb3335d74 req-423c0a1d-298b-4ede-91e0-7e2ddea3fd1e service nova] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Updated VIF entry in instance network info cache for port 6f73d56f-c40e-4e8d-a793-3ff9ae5bc35c. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 00:00:41 user nova-compute[75341]: DEBUG nova.network.neutron [req-141d2adc-813d-498b-9fc3-6b4cb3335d74 req-423c0a1d-298b-4ede-91e0-7e2ddea3fd1e service nova] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Updating instance_info_cache with network_info: [{"id": "6f73d56f-c40e-4e8d-a793-3ff9ae5bc35c", "address": "fa:16:3e:08:9f:79", "network": {"id": "227eb779-a064-477d-8447-45862017ae7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-3827253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96674073965642f1af11221b4add8a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f73d56f-c4", "ovs_interfaceid": "6f73d56f-c40e-4e8d-a793-3ff9ae5bc35c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:00:41 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-141d2adc-813d-498b-9fc3-6b4cb3335d74 req-423c0a1d-298b-4ede-91e0-7e2ddea3fd1e service nova] Releasing lock "refresh_cache-6eee60d5-4088-40ff-b816-4080da234894" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:00:41 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Instance destroyed successfully.
Nov 15 00:00:41 user nova-compute[75341]: DEBUG nova.objects.instance [None req-d9ceda18-43d3-4b0a-b57d-1296f139f5a6 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lazy-loading 'resources' on Instance uuid 6eee60d5-4088-40ff-b816-4080da234894 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:00:41 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-d9ceda18-43d3-4b0a-b57d-1296f139f5a6 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:58:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-678016763',display_name='tempest-TestVolumeBootPattern-server-678016763',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-678016763',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN7m+PTR/lRAnqFJ5INzHZER+6KEezVf2NqND5YLAUMiY/B8DjdO2ameMcKY7PyF3FV92+jHAoJaiByyFu7+plRebNNPsSYlc8sL/IhL0WhnAYWxdc2ydVL4yfconkjd2A==',key_name='tempest-TestVolumeBootPattern-1320135145',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:58:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='96674073965642f1af11221b4add8a6d',ramdisk_id='',reservation_id='r-0z0005zx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-320933673',owner_user_name='tempest-TestVolumeBootPattern-320933673-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:58:59Z,user_data=None,user_id='b08f7ddf6c2f4fd596e214d6ca56c234',uuid=6eee60d5-4088-40ff-b816-4080da234894,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f73d56f-c40e-4e8d-a793-3ff9ae5bc35c", "address": "fa:16:3e:08:9f:79", "network": {"id": "227eb779-a064-477d-8447-45862017ae7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-3827253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96674073965642f1af11221b4add8a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f73d56f-c4", "ovs_interfaceid": "6f73d56f-c40e-4e8d-a793-3ff9ae5bc35c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 00:00:41 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-d9ceda18-43d3-4b0a-b57d-1296f139f5a6 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Converting VIF {"id": "6f73d56f-c40e-4e8d-a793-3ff9ae5bc35c", "address": "fa:16:3e:08:9f:79", "network": {"id": "227eb779-a064-477d-8447-45862017ae7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-3827253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96674073965642f1af11221b4add8a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f73d56f-c4", "ovs_interfaceid": "6f73d56f-c40e-4e8d-a793-3ff9ae5bc35c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 00:00:41 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-d9ceda18-43d3-4b0a-b57d-1296f139f5a6 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:9f:79,bridge_name='br-int',has_traffic_filtering=True,id=6f73d56f-c40e-4e8d-a793-3ff9ae5bc35c,network=Network(227eb779-a064-477d-8447-45862017ae7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f73d56f-c4') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 00:00:41 user nova-compute[75341]: DEBUG os_vif [None req-d9ceda18-43d3-4b0a-b57d-1296f139f5a6 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:9f:79,bridge_name='br-int',has_traffic_filtering=True,id=6f73d56f-c40e-4e8d-a793-3ff9ae5bc35c,network=Network(227eb779-a064-477d-8447-45862017ae7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f73d56f-c4') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 00:00:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6f73d56f-c4, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:00:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:00:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1adba605-c70f-4db0-9504-9e5ce16b4ba2) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:00:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:00:41 user nova-compute[75341]: INFO os_vif [None req-d9ceda18-43d3-4b0a-b57d-1296f139f5a6 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:9f:79,bridge_name='br-int',has_traffic_filtering=True,id=6f73d56f-c40e-4e8d-a793-3ff9ae5bc35c,network=Network(227eb779-a064-477d-8447-45862017ae7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f73d56f-c4')
Nov 15 00:00:41 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9ceda18-43d3-4b0a-b57d-1296f139f5a6 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 6eee60d5-4088-40ff-b816-4080da234894] calling os-brick to detach iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 00:00:41 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ceda18-43d3-4b0a-b57d-1296f139f5a6 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, {'target_iqn': 'iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ewaoHPsj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 00:00:41 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-d9ceda18-43d3-4b0a-b57d-1296f139f5a6 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 00:00:41 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-d9ceda18-43d3-4b0a-b57d-1296f139f5a6 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 00:00:41 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-d9ceda18-43d3-4b0a-b57d-1296f139f5a6 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 00:00:41 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:00:41 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:00:41 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[57cacab1-0032-4feb-8d6c-c41c6e8b4fa4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:00:41 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ceda18-43d3-4b0a-b57d-1296f139f5a6 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 00:00:41 user nova-compute[75341]: No targets found.
Nov 15 00:00:41 user nova-compute[75341]: iSNS:
Nov 15 00:00:41 user nova-compute[75341]: No targets found.
Nov 15 00:00:41 user nova-compute[75341]: STATIC:
Nov 15 00:00:41 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36
Nov 15 00:00:41 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 15 00:00:41 user nova-compute[75341]:                 Iface Name: default
Nov 15 00:00:41 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123
Nov 15 00:00:41 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 15 00:00:41 user nova-compute[75341]:                 Iface Name: default
Nov 15 00:00:41 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f
Nov 15 00:00:41 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 15 00:00:41 user nova-compute[75341]:                 Iface Name: default
Nov 15 00:00:41 user nova-compute[75341]: FIRMWARE:
Nov 15 00:00:41 user nova-compute[75341]: No targets found.
Nov 15 00:00:41 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 00:00:41 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ceda18-43d3-4b0a-b57d-1296f139f5a6 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 00:00:41 user nova-compute[75341]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 00:00:41 user nova-compute[75341]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75341) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 00:00:41 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ceda18-43d3-4b0a-b57d-1296f139f5a6 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f', 0)] {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 00:00:41 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:00:41 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:00:41 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce79ef3d-dadf-457a-aa3a-68836961a891]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:00:41 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:00:41 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:00:41 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6668cd0-b351-4f1d-b819-fe89284278e0]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:00:41 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ceda18-43d3-4b0a-b57d-1296f139f5a6 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)
Nov 15 00:00:41 user nova-compute[75341]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f (non-flash)
Nov 15 00:00:41 user nova-compute[75341]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 (non-flash)
Nov 15 00:00:41 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 00:00:41 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ceda18-43d3-4b0a-b57d-1296f139f5a6 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)
Nov 15 00:00:41 user nova-compute[75341]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f (non-flash)
Nov 15 00:00:41 user nova-compute[75341]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 (non-flash)
Nov 15 00:00:41 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 00:00:41 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ceda18-43d3-4b0a-b57d-1296f139f5a6 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1850568af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f'): ({'sde'}, set())}) {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 00:00:41 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-d9ceda18-43d3-4b0a-b57d-1296f139f5a6 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Removing single pathed devices sde {{(pid=75341) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 00:00:41 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:00:41 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:00:41 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f9b2e4-9189-4874-9db5-3f2d8c729ebe]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:00:41 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:00:41 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:00:41 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22d1f3d-179e-4b99-9045-367440c88462]: (4, ('ok\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:00:41 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-d9ceda18-43d3-4b0a-b57d-1296f139f5a6 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Flushing IO for device /dev/sde {{(pid=75341) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 00:00:41 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:00:41 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:00:41 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b40eda4-af9b-4393-8b4d-3e6d850283fc]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:00:41 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-d9ceda18-43d3-4b0a-b57d-1296f139f5a6 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75341) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 00:00:41 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:00:41 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:00:41 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc59ee9e-30b2-4c22-a67d-bf8acde72e45]: (4, ('1', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:00:41 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-d9ceda18-43d3-4b0a-b57d-1296f139f5a6 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 00:00:41 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-d9ceda18-43d3-4b0a-b57d-1296f139f5a6 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] SCSI volumes sde have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 00:00:41 user nova-compute[75341]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23537353134616534', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_7819ef87', '/dev/disk/by-id/scsi-1SCST_BIO7819ef87-57514ae415919bd8') {{(pid=86063) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 00:00:41 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81b3150-566a-4c94-ab38-716d7cd6075d]: (4, None) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:00:41 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ceda18-43d3-4b0a-b57d-1296f139f5a6 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f')] {{(pid=75341) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 00:00:41 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:00:41 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:00:41 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7d7be8-f78f-4db0-853d-3c2b7f80b257]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:00:41 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ceda18-43d3-4b0a-b57d-1296f139f5a6 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:00:41 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f -p 172.16.0.220:3260 --logout {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:00:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:00:42 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef3a5c9-bd3c-44e1-b354-8950853b089c]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:00:42 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ceda18-43d3-4b0a-b57d-1296f139f5a6 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f, portal: 172.16.0.220,3260]
Nov 15 00:00:42 user nova-compute[75341]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f, portal: 172.16.0.220,3260] successful.
Nov 15 00:00:42 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:00:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f -p 172.16.0.220:3260 --op delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:00:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c7d8ab7-14d0-4084-8e4a-3cd7e843934f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:00:42 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[78cd5022-f11b-429d-be42-795f78bd763b]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:00:42 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ceda18-43d3-4b0a-b57d-1296f139f5a6 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:00:42 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-d9ceda18-43d3-4b0a-b57d-1296f139f5a6 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 00:00:42 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ceda18-43d3-4b0a-b57d-1296f139f5a6 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] <== disconnect_volume: return (335ms) None {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 00:00:42 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9ceda18-43d3-4b0a-b57d-1296f139f5a6 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Disconnected iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 00:00:42 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-d9ceda18-43d3-4b0a-b57d-1296f139f5a6 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Deleting instance files /opt/stack/data/nova/instances/6eee60d5-4088-40ff-b816-4080da234894_del
Nov 15 00:00:42 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-d9ceda18-43d3-4b0a-b57d-1296f139f5a6 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Deletion of /opt/stack/data/nova/instances/6eee60d5-4088-40ff-b816-4080da234894_del complete
Nov 15 00:00:42 user nova-compute[75341]: INFO nova.compute.manager [None req-d9ceda18-43d3-4b0a-b57d-1296f139f5a6 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 15 00:00:42 user nova-compute[75341]: DEBUG oslo.service.loopingcall [None req-d9ceda18-43d3-4b0a-b57d-1296f139f5a6 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75341) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 00:00:42 user nova-compute[75341]: DEBUG nova.compute.manager [-] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Deallocating network for instance {{(pid=75341) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 00:00:42 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: 6eee60d5-4088-40ff-b816-4080da234894] deallocate_for_instance() {{(pid=75341) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 00:00:42 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:42 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:00:42 user nova-compute[75341]: INFO nova.compute.manager [-] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Took 0.57 seconds to deallocate network for instance.
Nov 15 00:00:42 user nova-compute[75341]: DEBUG nova.compute.manager [req-3604b4ba-da3c-4bc2-b0a1-9b977010386a req-4679b0ce-3394-4541-971d-cd09cee8c50a service nova] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Received event network-vif-deleted-6f73d56f-c40e-4e8d-a793-3ff9ae5bc35c {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:00:42 user nova-compute[75341]: DEBUG nova.compute.manager [req-4dc425f0-3cf5-4810-a1d1-e22ec4f460c6 req-b65b2dcd-db85-4bee-a23e-945584fafcc0 service nova] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Received event network-vif-unplugged-6f73d56f-c40e-4e8d-a793-3ff9ae5bc35c {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:00:42 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4dc425f0-3cf5-4810-a1d1-e22ec4f460c6 req-b65b2dcd-db85-4bee-a23e-945584fafcc0 service nova] Acquiring lock "6eee60d5-4088-40ff-b816-4080da234894-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:00:42 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4dc425f0-3cf5-4810-a1d1-e22ec4f460c6 req-b65b2dcd-db85-4bee-a23e-945584fafcc0 service nova] Lock "6eee60d5-4088-40ff-b816-4080da234894-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:00:42 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4dc425f0-3cf5-4810-a1d1-e22ec4f460c6 req-b65b2dcd-db85-4bee-a23e-945584fafcc0 service nova] Lock "6eee60d5-4088-40ff-b816-4080da234894-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:00:42 user nova-compute[75341]: DEBUG nova.compute.manager [req-4dc425f0-3cf5-4810-a1d1-e22ec4f460c6 req-b65b2dcd-db85-4bee-a23e-945584fafcc0 service nova] [instance: 6eee60d5-4088-40ff-b816-4080da234894] No waiting events found dispatching network-vif-unplugged-6f73d56f-c40e-4e8d-a793-3ff9ae5bc35c {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:00:42 user nova-compute[75341]: DEBUG nova.compute.manager [req-4dc425f0-3cf5-4810-a1d1-e22ec4f460c6 req-b65b2dcd-db85-4bee-a23e-945584fafcc0 service nova] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Received event network-vif-unplugged-6f73d56f-c40e-4e8d-a793-3ff9ae5bc35c for instance with task_state deleting. {{(pid=75341) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 00:00:42 user nova-compute[75341]: DEBUG nova.compute.manager [req-4dc425f0-3cf5-4810-a1d1-e22ec4f460c6 req-b65b2dcd-db85-4bee-a23e-945584fafcc0 service nova] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Received event network-vif-plugged-6f73d56f-c40e-4e8d-a793-3ff9ae5bc35c {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:00:42 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4dc425f0-3cf5-4810-a1d1-e22ec4f460c6 req-b65b2dcd-db85-4bee-a23e-945584fafcc0 service nova] Acquiring lock "6eee60d5-4088-40ff-b816-4080da234894-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:00:42 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4dc425f0-3cf5-4810-a1d1-e22ec4f460c6 req-b65b2dcd-db85-4bee-a23e-945584fafcc0 service nova] Lock "6eee60d5-4088-40ff-b816-4080da234894-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:00:42 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4dc425f0-3cf5-4810-a1d1-e22ec4f460c6 req-b65b2dcd-db85-4bee-a23e-945584fafcc0 service nova] Lock "6eee60d5-4088-40ff-b816-4080da234894-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:00:42 user nova-compute[75341]: DEBUG nova.compute.manager [req-4dc425f0-3cf5-4810-a1d1-e22ec4f460c6 req-b65b2dcd-db85-4bee-a23e-945584fafcc0 service nova] [instance: 6eee60d5-4088-40ff-b816-4080da234894] No waiting events found dispatching network-vif-plugged-6f73d56f-c40e-4e8d-a793-3ff9ae5bc35c {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:00:42 user nova-compute[75341]: WARNING nova.compute.manager [req-4dc425f0-3cf5-4810-a1d1-e22ec4f460c6 req-b65b2dcd-db85-4bee-a23e-945584fafcc0 service nova] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Received unexpected event network-vif-plugged-6f73d56f-c40e-4e8d-a793-3ff9ae5bc35c for instance with vm_state active and task_state deleting.
Nov 15 00:00:43 user nova-compute[75341]: INFO nova.compute.manager [None req-d9ceda18-43d3-4b0a-b57d-1296f139f5a6 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: 6eee60d5-4088-40ff-b816-4080da234894] Took 0.81 seconds to detach 1 volumes for instance.
Nov 15 00:00:43 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d9ceda18-43d3-4b0a-b57d-1296f139f5a6 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:00:43 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d9ceda18-43d3-4b0a-b57d-1296f139f5a6 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:00:43 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-d9ceda18-43d3-4b0a-b57d-1296f139f5a6 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 00:00:43 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-d9ceda18-43d3-4b0a-b57d-1296f139f5a6 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 00:00:43 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d9ceda18-43d3-4b0a-b57d-1296f139f5a6 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.273s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:00:43 user nova-compute[75341]: INFO nova.scheduler.client.report [None req-d9ceda18-43d3-4b0a-b57d-1296f139f5a6 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Deleted allocations for instance 6eee60d5-4088-40ff-b816-4080da234894
Nov 15 00:00:43 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d9ceda18-43d3-4b0a-b57d-1296f139f5a6 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "6eee60d5-4088-40ff-b816-4080da234894" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.041s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:00:46 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:47 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:00:58 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:01:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:01:01 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:01:01 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75341) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 00:01:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:01:02 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:01:03 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:01:03 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:01:03 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Cleaning up deleted instances {{(pid=75341) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 00:01:03 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] There are 0 instances to clean {{(pid=75341) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 00:01:04 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:01:04 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Starting heal instance info cache {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 00:01:04 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Rebuilding the list of instances to heal {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 00:01:05 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "refresh_cache-51045050-c7c6-49c5-acd4-2a76be0f466f" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:01:05 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquired lock "refresh_cache-51045050-c7c6-49c5-acd4-2a76be0f466f" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:01:05 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Forcefully refreshing network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 00:01:05 user nova-compute[75341]: DEBUG nova.objects.instance [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lazy-loading 'info_cache' on Instance uuid 51045050-c7c6-49c5-acd4-2a76be0f466f {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:01:05 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Updating instance_info_cache with network_info: [{"id": "64ebe5e6-0c81-41fd-b49e-75bed11e40df", "address": "fa:16:3e:44:63:f2", "network": {"id": "fcd22da6-016e-4872-a84c-4d82601c48d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-550677181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44bb8b1415c14bb59c4c35cc2b830875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ebe5e6-0c", "ovs_interfaceid": "64ebe5e6-0c81-41fd-b49e-75bed11e40df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:01:05 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Releasing lock "refresh_cache-51045050-c7c6-49c5-acd4-2a76be0f466f" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:01:05 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Updated the network info_cache for instance {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 00:01:05 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:01:05 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:01:05 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:01:05 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:01:05 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:01:05 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75341) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 00:01:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:01:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:01:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:01:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:01:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:01:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:01:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:01:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:01:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48db53c-618c-42fc-a688-974cc75f3598/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:01:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48db53c-618c-42fc-a688-974cc75f3598/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:01:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48db53c-618c-42fc-a688-974cc75f3598/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:01:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48db53c-618c-42fc-a688-974cc75f3598/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:01:06 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 00:01:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:01:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:01:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:01:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:01:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:01:07 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 00:01:07 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:01:07 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:01:07 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Hypervisor/Node resource view: name=user free_ram=8168MB free_disk=25.3538818359375GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75341) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 00:01:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:01:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:01:07 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Applying migration context for instance c3524e47-34b3-4b33-a1ff-25a8e4f35d86 as it has an incoming, in-progress migration 63f12b75-a115-43b0-adac-06779a8259e1. Migration status is finished {{(pid=75341) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 15 00:01:07 user nova-compute[75341]: INFO nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Updating resource usage from migration 63f12b75-a115-43b0-adac-06779a8259e1
Nov 15 00:01:07 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 51045050-c7c6-49c5-acd4-2a76be0f466f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:01:07 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance defae731-4191-4526-99cc-a301cf5b3355 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:01:07 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance a80008bd-c61c-4a36-ae67-e556a5ecee08 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:01:07 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance f48db53c-618c-42fc-a688-974cc75f3598 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:01:07 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:01:07 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Migration 63f12b75-a115-43b0-adac-06779a8259e1 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 15 00:01:07 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance c3524e47-34b3-4b33-a1ff-25a8e4f35d86 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:01:07 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 00:01:07 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 00:01:07 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Refreshing inventories for resource provider 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 00:01:07 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Updating ProviderTree inventory for provider 8fa114cc-b541-418f-865c-16c44294e72d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 00:01:07 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Updating inventory in ProviderTree for provider 8fa114cc-b541-418f-865c-16c44294e72d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 00:01:07 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Refreshing aggregate associations for resource provider 8fa114cc-b541-418f-865c-16c44294e72d, aggregates: None {{(pid=75341) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 00:01:07 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Refreshing trait associations for resource provider 8fa114cc-b541-418f-865c-16c44294e72d, traits: COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_MMX,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000E {{(pid=75341) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 00:01:07 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 00:01:07 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 00:01:07 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Compute_service record updated for user:user {{(pid=75341) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 00:01:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.546s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:01:08 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:01:08 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:01:08 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:01:10 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-95a39b42-f0c8-4663-a3e5-ee29e20365a4 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Acquiring lock "51045050-c7c6-49c5-acd4-2a76be0f466f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:01:10 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-95a39b42-f0c8-4663-a3e5-ee29e20365a4 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "51045050-c7c6-49c5-acd4-2a76be0f466f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:01:10 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-95a39b42-f0c8-4663-a3e5-ee29e20365a4 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Acquiring lock "51045050-c7c6-49c5-acd4-2a76be0f466f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:01:10 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-95a39b42-f0c8-4663-a3e5-ee29e20365a4 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "51045050-c7c6-49c5-acd4-2a76be0f466f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:01:10 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-95a39b42-f0c8-4663-a3e5-ee29e20365a4 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "51045050-c7c6-49c5-acd4-2a76be0f466f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:01:10 user nova-compute[75341]: INFO nova.compute.manager [None req-95a39b42-f0c8-4663-a3e5-ee29e20365a4 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Terminating instance
Nov 15 00:01:10 user nova-compute[75341]: DEBUG nova.compute.manager [None req-95a39b42-f0c8-4663-a3e5-ee29e20365a4 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Start destroying the instance on the hypervisor. {{(pid=75341) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 00:01:10 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:01:10 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75341) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 00:01:10 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:01:10 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:01:11 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:01:11 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:01:11 user nova-compute[75341]: DEBUG nova.compute.manager [req-a66d2e5c-ef39-4760-af2f-40917f718b1f req-821a2a68-c681-436b-a6d0-c1dea7511118 service nova] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Received event network-vif-unplugged-64ebe5e6-0c81-41fd-b49e-75bed11e40df {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:01:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a66d2e5c-ef39-4760-af2f-40917f718b1f req-821a2a68-c681-436b-a6d0-c1dea7511118 service nova] Acquiring lock "51045050-c7c6-49c5-acd4-2a76be0f466f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:01:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a66d2e5c-ef39-4760-af2f-40917f718b1f req-821a2a68-c681-436b-a6d0-c1dea7511118 service nova] Lock "51045050-c7c6-49c5-acd4-2a76be0f466f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:01:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a66d2e5c-ef39-4760-af2f-40917f718b1f req-821a2a68-c681-436b-a6d0-c1dea7511118 service nova] Lock "51045050-c7c6-49c5-acd4-2a76be0f466f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:01:11 user nova-compute[75341]: DEBUG nova.compute.manager [req-a66d2e5c-ef39-4760-af2f-40917f718b1f req-821a2a68-c681-436b-a6d0-c1dea7511118 service nova] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] No waiting events found dispatching network-vif-unplugged-64ebe5e6-0c81-41fd-b49e-75bed11e40df {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:01:11 user nova-compute[75341]: DEBUG nova.compute.manager [req-a66d2e5c-ef39-4760-af2f-40917f718b1f req-821a2a68-c681-436b-a6d0-c1dea7511118 service nova] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Received event network-vif-unplugged-64ebe5e6-0c81-41fd-b49e-75bed11e40df for instance with task_state deleting. {{(pid=75341) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 00:01:11 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:01:11 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:01:11 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:01:11 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Instance destroyed successfully.
Nov 15 00:01:11 user nova-compute[75341]: DEBUG nova.objects.instance [None req-95a39b42-f0c8-4663-a3e5-ee29e20365a4 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lazy-loading 'resources' on Instance uuid 51045050-c7c6-49c5-acd4-2a76be0f466f {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:01:11 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-95a39b42-f0c8-4663-a3e5-ee29e20365a4 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:44:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-498055834',display_name='tempest-ServerRescueNegativeTestJSON-server-498055834',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-498055834',id=17,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:49:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='44bb8b1415c14bb59c4c35cc2b830875',ramdisk_id='',reservation_id='r-jta0uzo0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1956631656',owner_user_name='tempest-ServerRescueNegativeTestJSON-1956631656-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:51:01Z,user_data=None,user_id='3c49a358e2f942f3a9777910ee755575',uuid=51045050-c7c6-49c5-acd4-2a76be0f466f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "64ebe5e6-0c81-41fd-b49e-75bed11e40df", "address": "fa:16:3e:44:63:f2", "network": {"id": "fcd22da6-016e-4872-a84c-4d82601c48d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-550677181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44bb8b1415c14bb59c4c35cc2b830875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ebe5e6-0c", "ovs_interfaceid": "64ebe5e6-0c81-41fd-b49e-75bed11e40df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 00:01:11 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-95a39b42-f0c8-4663-a3e5-ee29e20365a4 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Converting VIF {"id": "64ebe5e6-0c81-41fd-b49e-75bed11e40df", "address": "fa:16:3e:44:63:f2", "network": {"id": "fcd22da6-016e-4872-a84c-4d82601c48d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-550677181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44bb8b1415c14bb59c4c35cc2b830875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ebe5e6-0c", "ovs_interfaceid": "64ebe5e6-0c81-41fd-b49e-75bed11e40df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 00:01:11 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-95a39b42-f0c8-4663-a3e5-ee29e20365a4 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:63:f2,bridge_name='br-int',has_traffic_filtering=True,id=64ebe5e6-0c81-41fd-b49e-75bed11e40df,network=Network(fcd22da6-016e-4872-a84c-4d82601c48d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64ebe5e6-0c') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 00:01:11 user nova-compute[75341]: DEBUG os_vif [None req-95a39b42-f0c8-4663-a3e5-ee29e20365a4 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:63:f2,bridge_name='br-int',has_traffic_filtering=True,id=64ebe5e6-0c81-41fd-b49e-75bed11e40df,network=Network(fcd22da6-016e-4872-a84c-4d82601c48d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64ebe5e6-0c') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 00:01:11 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:01:11 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap64ebe5e6-0c, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:01:11 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:01:11 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:01:11 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:01:11 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=01024928-4177-4085-8dd4-98c19571652c) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:01:11 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:01:11 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:01:11 user nova-compute[75341]: INFO os_vif [None req-95a39b42-f0c8-4663-a3e5-ee29e20365a4 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:63:f2,bridge_name='br-int',has_traffic_filtering=True,id=64ebe5e6-0c81-41fd-b49e-75bed11e40df,network=Network(fcd22da6-016e-4872-a84c-4d82601c48d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64ebe5e6-0c')
Nov 15 00:01:11 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-95a39b42-f0c8-4663-a3e5-ee29e20365a4 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Deleting instance files /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f_del
Nov 15 00:01:11 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-95a39b42-f0c8-4663-a3e5-ee29e20365a4 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Deletion of /opt/stack/data/nova/instances/51045050-c7c6-49c5-acd4-2a76be0f466f_del complete
Nov 15 00:01:11 user nova-compute[75341]: INFO nova.compute.manager [None req-95a39b42-f0c8-4663-a3e5-ee29e20365a4 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Took 0.67 seconds to destroy the instance on the hypervisor.
Nov 15 00:01:11 user nova-compute[75341]: DEBUG oslo.service.loopingcall [None req-95a39b42-f0c8-4663-a3e5-ee29e20365a4 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75341) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 00:01:11 user nova-compute[75341]: DEBUG nova.compute.manager [-] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Deallocating network for instance {{(pid=75341) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 00:01:11 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] deallocate_for_instance() {{(pid=75341) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 00:01:11 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:01:11 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:01:11 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:01:11 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:01:12 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:01:12 user nova-compute[75341]: INFO nova.compute.manager [-] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Took 0.46 seconds to deallocate network for instance.
Nov 15 00:01:12 user nova-compute[75341]: DEBUG nova.compute.manager [req-46eb77df-7e33-42e6-98d6-42be565a0fed req-a2d97a7a-8ac8-4624-93a5-eaf3f151ab0a service nova] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Received event network-vif-deleted-64ebe5e6-0c81-41fd-b49e-75bed11e40df {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:01:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-95a39b42-f0c8-4663-a3e5-ee29e20365a4 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:01:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-95a39b42-f0c8-4663-a3e5-ee29e20365a4 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:01:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:01:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:01:12 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-95a39b42-f0c8-4663-a3e5-ee29e20365a4 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 00:01:12 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-95a39b42-f0c8-4663-a3e5-ee29e20365a4 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 00:01:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-95a39b42-f0c8-4663-a3e5-ee29e20365a4 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.260s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:01:12 user nova-compute[75341]: INFO nova.scheduler.client.report [None req-95a39b42-f0c8-4663-a3e5-ee29e20365a4 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Deleted allocations for instance 51045050-c7c6-49c5-acd4-2a76be0f466f
Nov 15 00:01:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-95a39b42-f0c8-4663-a3e5-ee29e20365a4 tempest-ServerRescueNegativeTestJSON-1956631656 tempest-ServerRescueNegativeTestJSON-1956631656-project-member] Lock "51045050-c7c6-49c5-acd4-2a76be0f466f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.574s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:01:13 user nova-compute[75341]: DEBUG nova.compute.manager [req-6f99a7ff-1973-4f05-be09-ce31a960e74c req-cca0909f-d53b-40d2-8354-5316610e372a service nova] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Received event network-vif-plugged-64ebe5e6-0c81-41fd-b49e-75bed11e40df {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:01:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6f99a7ff-1973-4f05-be09-ce31a960e74c req-cca0909f-d53b-40d2-8354-5316610e372a service nova] Acquiring lock "51045050-c7c6-49c5-acd4-2a76be0f466f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:01:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6f99a7ff-1973-4f05-be09-ce31a960e74c req-cca0909f-d53b-40d2-8354-5316610e372a service nova] Lock "51045050-c7c6-49c5-acd4-2a76be0f466f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:01:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6f99a7ff-1973-4f05-be09-ce31a960e74c req-cca0909f-d53b-40d2-8354-5316610e372a service nova] Lock "51045050-c7c6-49c5-acd4-2a76be0f466f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:01:13 user nova-compute[75341]: DEBUG nova.compute.manager [req-6f99a7ff-1973-4f05-be09-ce31a960e74c req-cca0909f-d53b-40d2-8354-5316610e372a service nova] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] No waiting events found dispatching network-vif-plugged-64ebe5e6-0c81-41fd-b49e-75bed11e40df {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:01:13 user nova-compute[75341]: WARNING nova.compute.manager [req-6f99a7ff-1973-4f05-be09-ce31a960e74c req-cca0909f-d53b-40d2-8354-5316610e372a service nova] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Received unexpected event network-vif-plugged-64ebe5e6-0c81-41fd-b49e-75bed11e40df for instance with vm_state deleted and task_state None.
Nov 15 00:01:13 user nova-compute[75341]: DEBUG nova.compute.manager [req-6f99a7ff-1973-4f05-be09-ce31a960e74c req-cca0909f-d53b-40d2-8354-5316610e372a service nova] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Received event network-vif-plugged-64ebe5e6-0c81-41fd-b49e-75bed11e40df {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:01:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6f99a7ff-1973-4f05-be09-ce31a960e74c req-cca0909f-d53b-40d2-8354-5316610e372a service nova] Acquiring lock "51045050-c7c6-49c5-acd4-2a76be0f466f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:01:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6f99a7ff-1973-4f05-be09-ce31a960e74c req-cca0909f-d53b-40d2-8354-5316610e372a service nova] Lock "51045050-c7c6-49c5-acd4-2a76be0f466f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:01:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6f99a7ff-1973-4f05-be09-ce31a960e74c req-cca0909f-d53b-40d2-8354-5316610e372a service nova] Lock "51045050-c7c6-49c5-acd4-2a76be0f466f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:01:13 user nova-compute[75341]: DEBUG nova.compute.manager [req-6f99a7ff-1973-4f05-be09-ce31a960e74c req-cca0909f-d53b-40d2-8354-5316610e372a service nova] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] No waiting events found dispatching network-vif-plugged-64ebe5e6-0c81-41fd-b49e-75bed11e40df {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:01:13 user nova-compute[75341]: WARNING nova.compute.manager [req-6f99a7ff-1973-4f05-be09-ce31a960e74c req-cca0909f-d53b-40d2-8354-5316610e372a service nova] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Received unexpected event network-vif-plugged-64ebe5e6-0c81-41fd-b49e-75bed11e40df for instance with vm_state deleted and task_state None.
Nov 15 00:01:13 user nova-compute[75341]: DEBUG nova.compute.manager [req-6f99a7ff-1973-4f05-be09-ce31a960e74c req-cca0909f-d53b-40d2-8354-5316610e372a service nova] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Received event network-vif-plugged-64ebe5e6-0c81-41fd-b49e-75bed11e40df {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:01:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6f99a7ff-1973-4f05-be09-ce31a960e74c req-cca0909f-d53b-40d2-8354-5316610e372a service nova] Acquiring lock "51045050-c7c6-49c5-acd4-2a76be0f466f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:01:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6f99a7ff-1973-4f05-be09-ce31a960e74c req-cca0909f-d53b-40d2-8354-5316610e372a service nova] Lock "51045050-c7c6-49c5-acd4-2a76be0f466f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:01:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6f99a7ff-1973-4f05-be09-ce31a960e74c req-cca0909f-d53b-40d2-8354-5316610e372a service nova] Lock "51045050-c7c6-49c5-acd4-2a76be0f466f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:01:13 user nova-compute[75341]: DEBUG nova.compute.manager [req-6f99a7ff-1973-4f05-be09-ce31a960e74c req-cca0909f-d53b-40d2-8354-5316610e372a service nova] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] No waiting events found dispatching network-vif-plugged-64ebe5e6-0c81-41fd-b49e-75bed11e40df {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:01:13 user nova-compute[75341]: WARNING nova.compute.manager [req-6f99a7ff-1973-4f05-be09-ce31a960e74c req-cca0909f-d53b-40d2-8354-5316610e372a service nova] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Received unexpected event network-vif-plugged-64ebe5e6-0c81-41fd-b49e-75bed11e40df for instance with vm_state deleted and task_state None.
Nov 15 00:01:13 user nova-compute[75341]: DEBUG nova.compute.manager [req-6f99a7ff-1973-4f05-be09-ce31a960e74c req-cca0909f-d53b-40d2-8354-5316610e372a service nova] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Received event network-vif-unplugged-64ebe5e6-0c81-41fd-b49e-75bed11e40df {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:01:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6f99a7ff-1973-4f05-be09-ce31a960e74c req-cca0909f-d53b-40d2-8354-5316610e372a service nova] Acquiring lock "51045050-c7c6-49c5-acd4-2a76be0f466f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:01:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6f99a7ff-1973-4f05-be09-ce31a960e74c req-cca0909f-d53b-40d2-8354-5316610e372a service nova] Lock "51045050-c7c6-49c5-acd4-2a76be0f466f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:01:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6f99a7ff-1973-4f05-be09-ce31a960e74c req-cca0909f-d53b-40d2-8354-5316610e372a service nova] Lock "51045050-c7c6-49c5-acd4-2a76be0f466f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:01:13 user nova-compute[75341]: DEBUG nova.compute.manager [req-6f99a7ff-1973-4f05-be09-ce31a960e74c req-cca0909f-d53b-40d2-8354-5316610e372a service nova] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] No waiting events found dispatching network-vif-unplugged-64ebe5e6-0c81-41fd-b49e-75bed11e40df {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:01:13 user nova-compute[75341]: WARNING nova.compute.manager [req-6f99a7ff-1973-4f05-be09-ce31a960e74c req-cca0909f-d53b-40d2-8354-5316610e372a service nova] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Received unexpected event network-vif-unplugged-64ebe5e6-0c81-41fd-b49e-75bed11e40df for instance with vm_state deleted and task_state None.
Nov 15 00:01:13 user nova-compute[75341]: DEBUG nova.compute.manager [req-6f99a7ff-1973-4f05-be09-ce31a960e74c req-cca0909f-d53b-40d2-8354-5316610e372a service nova] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Received event network-vif-plugged-64ebe5e6-0c81-41fd-b49e-75bed11e40df {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:01:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6f99a7ff-1973-4f05-be09-ce31a960e74c req-cca0909f-d53b-40d2-8354-5316610e372a service nova] Acquiring lock "51045050-c7c6-49c5-acd4-2a76be0f466f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:01:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6f99a7ff-1973-4f05-be09-ce31a960e74c req-cca0909f-d53b-40d2-8354-5316610e372a service nova] Lock "51045050-c7c6-49c5-acd4-2a76be0f466f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:01:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6f99a7ff-1973-4f05-be09-ce31a960e74c req-cca0909f-d53b-40d2-8354-5316610e372a service nova] Lock "51045050-c7c6-49c5-acd4-2a76be0f466f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:01:13 user nova-compute[75341]: DEBUG nova.compute.manager [req-6f99a7ff-1973-4f05-be09-ce31a960e74c req-cca0909f-d53b-40d2-8354-5316610e372a service nova] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] No waiting events found dispatching network-vif-plugged-64ebe5e6-0c81-41fd-b49e-75bed11e40df {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:01:13 user nova-compute[75341]: WARNING nova.compute.manager [req-6f99a7ff-1973-4f05-be09-ce31a960e74c req-cca0909f-d53b-40d2-8354-5316610e372a service nova] [instance: 51045050-c7c6-49c5-acd4-2a76be0f466f] Received unexpected event network-vif-plugged-64ebe5e6-0c81-41fd-b49e-75bed11e40df for instance with vm_state deleted and task_state None.
Nov 15 00:01:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:01:21 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:01:26 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:01:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:01:36 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:01:36 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:01:36 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:01:36 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:01:36 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:01:36 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:01:36 user nova-compute[75341]: DEBUG nova.compute.manager [req-b403f9bb-d01d-45d6-925f-cad287f39285 req-32612f82-6653-41b9-95e4-fd97c823a5de service nova] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Received event network-changed-140e7083-e454-413d-892e-a4784b4cea66 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:01:36 user nova-compute[75341]: DEBUG nova.compute.manager [req-b403f9bb-d01d-45d6-925f-cad287f39285 req-32612f82-6653-41b9-95e4-fd97c823a5de service nova] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Refreshing instance network info cache due to event network-changed-140e7083-e454-413d-892e-a4784b4cea66. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 00:01:36 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-b403f9bb-d01d-45d6-925f-cad287f39285 req-32612f82-6653-41b9-95e4-fd97c823a5de service nova] Acquiring lock "refresh_cache-a80008bd-c61c-4a36-ae67-e556a5ecee08" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:01:36 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-b403f9bb-d01d-45d6-925f-cad287f39285 req-32612f82-6653-41b9-95e4-fd97c823a5de service nova] Acquired lock "refresh_cache-a80008bd-c61c-4a36-ae67-e556a5ecee08" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:01:36 user nova-compute[75341]: DEBUG nova.network.neutron [req-b403f9bb-d01d-45d6-925f-cad287f39285 req-32612f82-6653-41b9-95e4-fd97c823a5de service nova] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Refreshing network info cache for port 140e7083-e454-413d-892e-a4784b4cea66 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 00:01:36 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-99552aaf-41fe-4ec7-9a3e-de0bc26fd405 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Acquiring lock "a80008bd-c61c-4a36-ae67-e556a5ecee08" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:01:36 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-99552aaf-41fe-4ec7-9a3e-de0bc26fd405 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "a80008bd-c61c-4a36-ae67-e556a5ecee08" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:01:36 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-99552aaf-41fe-4ec7-9a3e-de0bc26fd405 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Acquiring lock "a80008bd-c61c-4a36-ae67-e556a5ecee08-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:01:36 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-99552aaf-41fe-4ec7-9a3e-de0bc26fd405 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "a80008bd-c61c-4a36-ae67-e556a5ecee08-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:01:36 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-99552aaf-41fe-4ec7-9a3e-de0bc26fd405 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "a80008bd-c61c-4a36-ae67-e556a5ecee08-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:01:36 user nova-compute[75341]: INFO nova.compute.manager [None req-99552aaf-41fe-4ec7-9a3e-de0bc26fd405 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Terminating instance
Nov 15 00:01:36 user nova-compute[75341]: DEBUG nova.compute.manager [None req-99552aaf-41fe-4ec7-9a3e-de0bc26fd405 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Start destroying the instance on the hypervisor. {{(pid=75341) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 00:01:36 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:01:36 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:01:36 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:01:36 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:01:36 user nova-compute[75341]: DEBUG nova.compute.manager [req-6d4794c9-6fb6-4b5d-a7b4-af5048ebb4e6 req-2dd77466-1b4c-49bb-8ff1-64f9fc3b632a service nova] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Received event network-vif-unplugged-140e7083-e454-413d-892e-a4784b4cea66 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:01:36 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6d4794c9-6fb6-4b5d-a7b4-af5048ebb4e6 req-2dd77466-1b4c-49bb-8ff1-64f9fc3b632a service nova] Acquiring lock "a80008bd-c61c-4a36-ae67-e556a5ecee08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:01:36 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6d4794c9-6fb6-4b5d-a7b4-af5048ebb4e6 req-2dd77466-1b4c-49bb-8ff1-64f9fc3b632a service nova] Lock "a80008bd-c61c-4a36-ae67-e556a5ecee08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:01:36 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6d4794c9-6fb6-4b5d-a7b4-af5048ebb4e6 req-2dd77466-1b4c-49bb-8ff1-64f9fc3b632a service nova] Lock "a80008bd-c61c-4a36-ae67-e556a5ecee08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.006s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:01:36 user nova-compute[75341]: DEBUG nova.compute.manager [req-6d4794c9-6fb6-4b5d-a7b4-af5048ebb4e6 req-2dd77466-1b4c-49bb-8ff1-64f9fc3b632a service nova] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] No waiting events found dispatching network-vif-unplugged-140e7083-e454-413d-892e-a4784b4cea66 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:01:36 user nova-compute[75341]: DEBUG nova.compute.manager [req-6d4794c9-6fb6-4b5d-a7b4-af5048ebb4e6 req-2dd77466-1b4c-49bb-8ff1-64f9fc3b632a service nova] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Received event network-vif-unplugged-140e7083-e454-413d-892e-a4784b4cea66 for instance with task_state deleting. {{(pid=75341) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 00:01:37 user nova-compute[75341]: DEBUG nova.network.neutron [req-b403f9bb-d01d-45d6-925f-cad287f39285 req-32612f82-6653-41b9-95e4-fd97c823a5de service nova] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Updated VIF entry in instance network info cache for port 140e7083-e454-413d-892e-a4784b4cea66. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 00:01:37 user nova-compute[75341]: DEBUG nova.network.neutron [req-b403f9bb-d01d-45d6-925f-cad287f39285 req-32612f82-6653-41b9-95e4-fd97c823a5de service nova] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Updating instance_info_cache with network_info: [{"id": "140e7083-e454-413d-892e-a4784b4cea66", "address": "fa:16:3e:69:fb:24", "network": {"id": "227eb779-a064-477d-8447-45862017ae7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-3827253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96674073965642f1af11221b4add8a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap140e7083-e4", "ovs_interfaceid": "140e7083-e454-413d-892e-a4784b4cea66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:01:37 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-b403f9bb-d01d-45d6-925f-cad287f39285 req-32612f82-6653-41b9-95e4-fd97c823a5de service nova] Releasing lock "refresh_cache-a80008bd-c61c-4a36-ae67-e556a5ecee08" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:01:37 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Instance destroyed successfully.
Nov 15 00:01:37 user nova-compute[75341]: DEBUG nova.objects.instance [None req-99552aaf-41fe-4ec7-9a3e-de0bc26fd405 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lazy-loading 'resources' on Instance uuid a80008bd-c61c-4a36-ae67-e556a5ecee08 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:01:37 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-99552aaf-41fe-4ec7-9a3e-de0bc26fd405 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:56:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1126440302',display_name='tempest-TestVolumeBootPattern-server-1126440302',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1126440302',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN7m+PTR/lRAnqFJ5INzHZER+6KEezVf2NqND5YLAUMiY/B8DjdO2ameMcKY7PyF3FV92+jHAoJaiByyFu7+plRebNNPsSYlc8sL/IhL0WhnAYWxdc2ydVL4yfconkjd2A==',key_name='tempest-TestVolumeBootPattern-1320135145',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:56:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='96674073965642f1af11221b4add8a6d',ramdisk_id='',reservation_id='r-tpv6g1h0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-320933673',owner_user_name='tempest-TestVolumeBootPattern-320933673-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:57:00Z,user_data=None,user_id='b08f7ddf6c2f4fd596e214d6ca56c234',uuid=a80008bd-c61c-4a36-ae67-e556a5ecee08,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "140e7083-e454-413d-892e-a4784b4cea66", "address": "fa:16:3e:69:fb:24", "network": {"id": "227eb779-a064-477d-8447-45862017ae7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-3827253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96674073965642f1af11221b4add8a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap140e7083-e4", "ovs_interfaceid": "140e7083-e454-413d-892e-a4784b4cea66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 00:01:37 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-99552aaf-41fe-4ec7-9a3e-de0bc26fd405 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Converting VIF {"id": "140e7083-e454-413d-892e-a4784b4cea66", "address": "fa:16:3e:69:fb:24", "network": {"id": "227eb779-a064-477d-8447-45862017ae7b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-3827253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96674073965642f1af11221b4add8a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap140e7083-e4", "ovs_interfaceid": "140e7083-e454-413d-892e-a4784b4cea66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 00:01:37 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-99552aaf-41fe-4ec7-9a3e-de0bc26fd405 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:69:fb:24,bridge_name='br-int',has_traffic_filtering=True,id=140e7083-e454-413d-892e-a4784b4cea66,network=Network(227eb779-a064-477d-8447-45862017ae7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap140e7083-e4') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 00:01:37 user nova-compute[75341]: DEBUG os_vif [None req-99552aaf-41fe-4ec7-9a3e-de0bc26fd405 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:fb:24,bridge_name='br-int',has_traffic_filtering=True,id=140e7083-e454-413d-892e-a4784b4cea66,network=Network(227eb779-a064-477d-8447-45862017ae7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap140e7083-e4') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 00:01:37 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:01:37 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap140e7083-e4, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:01:37 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:01:37 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:01:37 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:01:37 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4e6b5b3b-21ad-4307-a1ff-28830637ac04) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:01:37 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:01:37 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:01:37 user nova-compute[75341]: INFO os_vif [None req-99552aaf-41fe-4ec7-9a3e-de0bc26fd405 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:fb:24,bridge_name='br-int',has_traffic_filtering=True,id=140e7083-e454-413d-892e-a4784b4cea66,network=Network(227eb779-a064-477d-8447-45862017ae7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap140e7083-e4')
Nov 15 00:01:37 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99552aaf-41fe-4ec7-9a3e-de0bc26fd405 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] calling os-brick to detach iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 00:01:37 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-99552aaf-41fe-4ec7-9a3e-de0bc26fd405 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, {'target_iqn': 'iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qFHBPzGf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 00:01:37 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-99552aaf-41fe-4ec7-9a3e-de0bc26fd405 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 00:01:37 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-99552aaf-41fe-4ec7-9a3e-de0bc26fd405 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 00:01:37 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-99552aaf-41fe-4ec7-9a3e-de0bc26fd405 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 00:01:37 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:01:37 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:01:37 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32c9f3c-ef3a-42df-8777-de81ffe69c3d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:01:37 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-99552aaf-41fe-4ec7-9a3e-de0bc26fd405 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 00:01:37 user nova-compute[75341]: No targets found.
Nov 15 00:01:37 user nova-compute[75341]: iSNS:
Nov 15 00:01:37 user nova-compute[75341]: No targets found.
Nov 15 00:01:37 user nova-compute[75341]: STATIC:
Nov 15 00:01:37 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36
Nov 15 00:01:37 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 15 00:01:37 user nova-compute[75341]:                 Iface Name: default
Nov 15 00:01:37 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123
Nov 15 00:01:37 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 15 00:01:37 user nova-compute[75341]:                 Iface Name: default
Nov 15 00:01:37 user nova-compute[75341]: FIRMWARE:
Nov 15 00:01:37 user nova-compute[75341]: No targets found.
Nov 15 00:01:37 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 00:01:37 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-99552aaf-41fe-4ec7-9a3e-de0bc26fd405 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 00:01:37 user nova-compute[75341]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 00:01:37 user nova-compute[75341]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75341) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 00:01:37 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-99552aaf-41fe-4ec7-9a3e-de0bc26fd405 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36', 0)] {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 00:01:37 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:01:37 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:01:37 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b396cc-1a95-4024-9aa7-54be05e5a67c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:01:37 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:01:37 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:01:37 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eebc5f1-ecba-4729-be86-3ef1053578ac]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:01:37 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-99552aaf-41fe-4ec7-9a3e-de0bc26fd405 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)
Nov 15 00:01:37 user nova-compute[75341]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 (non-flash)
Nov 15 00:01:37 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 00:01:37 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-99552aaf-41fe-4ec7-9a3e-de0bc26fd405 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 (non-flash)
Nov 15 00:01:37 user nova-compute[75341]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 (non-flash)
Nov 15 00:01:37 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 00:01:37 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-99552aaf-41fe-4ec7-9a3e-de0bc26fd405 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f185056b2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36'): ({'sdb'}, set())}) {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 00:01:37 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-99552aaf-41fe-4ec7-9a3e-de0bc26fd405 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Removing single pathed devices sdb {{(pid=75341) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 00:01:37 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:01:37 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:01:37 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[e17cfefe-a6a3-4552-9f11-b9ac6994473c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:01:37 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:01:37 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:01:37 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad95539-5f88-47db-8ae8-066d13753fa3]: (4, ('ok\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:01:37 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-99552aaf-41fe-4ec7-9a3e-de0bc26fd405 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Flushing IO for device /dev/sdb {{(pid=75341) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 00:01:37 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:01:37 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:01:37 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c12530-f91e-4000-b9fb-c72862c9463f]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:01:37 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-99552aaf-41fe-4ec7-9a3e-de0bc26fd405 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75341) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 00:01:37 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:01:37 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:01:37 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[6080f271-7d7a-4241-8f42-e2c05d0a6fcb]: (4, ('1', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:01:37 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-99552aaf-41fe-4ec7-9a3e-de0bc26fd405 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 00:01:37 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-99552aaf-41fe-4ec7-9a3e-de0bc26fd405 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] SCSI volumes sdb have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 00:01:37 user nova-compute[75341]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26536393737656136', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_59da60a6', '/dev/disk/by-id/scsi-1SCST_BIO59da60a6-e6977ea61d9ef3e5') {{(pid=86063) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 00:01:37 user nova-compute[75341]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26536393737656136
Nov 15 00:01:37 user nova-compute[75341]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_59da60a6
Nov 15 00:01:37 user nova-compute[75341]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO59da60a6-e6977ea61d9ef3e5
Nov 15 00:01:37 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[684d55de-5a73-4fe5-b16c-4ef3d8c7d5bf]: (4, None) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:01:37 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-99552aaf-41fe-4ec7-9a3e-de0bc26fd405 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36')] {{(pid=75341) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 00:01:37 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:01:37 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:01:37 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea199ba-e6e8-47a1-94c0-d814f47a5e4f]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:01:37 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-99552aaf-41fe-4ec7-9a3e-de0bc26fd405 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:01:37 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 -p 172.16.0.220:3260 --logout {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:01:37 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:01:37 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[450a632a-4f4b-4a46-9d00-270e3d6d60f4]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:01:37 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-99552aaf-41fe-4ec7-9a3e-de0bc26fd405 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36, portal: 172.16.0.220,3260]
Nov 15 00:01:37 user nova-compute[75341]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36, portal: 172.16.0.220,3260] successful.
Nov 15 00:01:37 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:01:37 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 -p 172.16.0.220:3260 --op delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:01:37 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f672e8-ffa6-4986-99a8-819fe39ccf36 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:01:37 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde819cc-cc01-43fd-a1e8-88a7a857f56e]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:01:37 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-99552aaf-41fe-4ec7-9a3e-de0bc26fd405 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:01:37 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-99552aaf-41fe-4ec7-9a3e-de0bc26fd405 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 00:01:37 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-99552aaf-41fe-4ec7-9a3e-de0bc26fd405 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] <== disconnect_volume: return (291ms) None {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 00:01:37 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99552aaf-41fe-4ec7-9a3e-de0bc26fd405 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Disconnected iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 00:01:37 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-99552aaf-41fe-4ec7-9a3e-de0bc26fd405 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Deleting instance files /opt/stack/data/nova/instances/a80008bd-c61c-4a36-ae67-e556a5ecee08_del
Nov 15 00:01:37 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-99552aaf-41fe-4ec7-9a3e-de0bc26fd405 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Deletion of /opt/stack/data/nova/instances/a80008bd-c61c-4a36-ae67-e556a5ecee08_del complete
Nov 15 00:01:37 user nova-compute[75341]: INFO nova.compute.manager [None req-99552aaf-41fe-4ec7-9a3e-de0bc26fd405 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Took 1.12 seconds to destroy the instance on the hypervisor.
Nov 15 00:01:37 user nova-compute[75341]: DEBUG oslo.service.loopingcall [None req-99552aaf-41fe-4ec7-9a3e-de0bc26fd405 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75341) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 00:01:37 user nova-compute[75341]: DEBUG nova.compute.manager [-] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Deallocating network for instance {{(pid=75341) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 00:01:37 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] deallocate_for_instance() {{(pid=75341) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 00:01:38 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:01:38 user nova-compute[75341]: INFO nova.compute.manager [-] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Took 0.40 seconds to deallocate network for instance.
Nov 15 00:01:38 user nova-compute[75341]: DEBUG nova.compute.manager [req-31c4ae78-2e7c-4902-baef-aa420f30ffef req-b9c420f1-6755-416c-917b-69fc9853de38 service nova] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Received event network-vif-deleted-140e7083-e454-413d-892e-a4784b4cea66 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:01:38 user nova-compute[75341]: INFO nova.compute.manager [None req-99552aaf-41fe-4ec7-9a3e-de0bc26fd405 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Took 0.70 seconds to detach 1 volumes for instance.
Nov 15 00:01:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-99552aaf-41fe-4ec7-9a3e-de0bc26fd405 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:01:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-99552aaf-41fe-4ec7-9a3e-de0bc26fd405 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:01:39 user nova-compute[75341]: DEBUG nova.compute.manager [req-2cf5fa11-34f6-4e49-9723-625d25e7e0a3 req-8084969b-3e58-472e-bc5e-826cceb903a7 service nova] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Received event network-vif-plugged-140e7083-e454-413d-892e-a4784b4cea66 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:01:39 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-2cf5fa11-34f6-4e49-9723-625d25e7e0a3 req-8084969b-3e58-472e-bc5e-826cceb903a7 service nova] Acquiring lock "a80008bd-c61c-4a36-ae67-e556a5ecee08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:01:39 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-2cf5fa11-34f6-4e49-9723-625d25e7e0a3 req-8084969b-3e58-472e-bc5e-826cceb903a7 service nova] Lock "a80008bd-c61c-4a36-ae67-e556a5ecee08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:01:39 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-2cf5fa11-34f6-4e49-9723-625d25e7e0a3 req-8084969b-3e58-472e-bc5e-826cceb903a7 service nova] Lock "a80008bd-c61c-4a36-ae67-e556a5ecee08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:01:39 user nova-compute[75341]: DEBUG nova.compute.manager [req-2cf5fa11-34f6-4e49-9723-625d25e7e0a3 req-8084969b-3e58-472e-bc5e-826cceb903a7 service nova] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] No waiting events found dispatching network-vif-plugged-140e7083-e454-413d-892e-a4784b4cea66 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:01:39 user nova-compute[75341]: WARNING nova.compute.manager [req-2cf5fa11-34f6-4e49-9723-625d25e7e0a3 req-8084969b-3e58-472e-bc5e-826cceb903a7 service nova] [instance: a80008bd-c61c-4a36-ae67-e556a5ecee08] Received unexpected event network-vif-plugged-140e7083-e454-413d-892e-a4784b4cea66 for instance with vm_state deleted and task_state None.
Nov 15 00:01:39 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-99552aaf-41fe-4ec7-9a3e-de0bc26fd405 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 00:01:39 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-99552aaf-41fe-4ec7-9a3e-de0bc26fd405 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 00:01:39 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-99552aaf-41fe-4ec7-9a3e-de0bc26fd405 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.248s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:01:39 user nova-compute[75341]: INFO nova.scheduler.client.report [None req-99552aaf-41fe-4ec7-9a3e-de0bc26fd405 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Deleted allocations for instance a80008bd-c61c-4a36-ae67-e556a5ecee08
Nov 15 00:01:39 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-99552aaf-41fe-4ec7-9a3e-de0bc26fd405 tempest-TestVolumeBootPattern-320933673 tempest-TestVolumeBootPattern-320933673-project-member] Lock "a80008bd-c61c-4a36-ae67-e556a5ecee08" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.668s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:01:42 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:01:44 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1517c200-3118-4059-8e0e-8204f841ab93 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Acquiring lock "f48db53c-618c-42fc-a688-974cc75f3598" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:01:44 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1517c200-3118-4059-8e0e-8204f841ab93 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "f48db53c-618c-42fc-a688-974cc75f3598" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:01:44 user nova-compute[75341]: DEBUG nova.objects.instance [None req-1517c200-3118-4059-8e0e-8204f841ab93 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lazy-loading 'flavor' on Instance uuid f48db53c-618c-42fc-a688-974cc75f3598 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:01:44 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1517c200-3118-4059-8e0e-8204f841ab93 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "f48db53c-618c-42fc-a688-974cc75f3598" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:01:44 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1517c200-3118-4059-8e0e-8204f841ab93 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Acquiring lock "f48db53c-618c-42fc-a688-974cc75f3598" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:01:44 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1517c200-3118-4059-8e0e-8204f841ab93 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "f48db53c-618c-42fc-a688-974cc75f3598" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:01:44 user nova-compute[75341]: INFO nova.compute.manager [None req-1517c200-3118-4059-8e0e-8204f841ab93 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Attaching volume d0ab162a-2aa4-49a0-a6b7-21f2172db6ed to /dev/vdb
Nov 15 00:01:44 user nova-compute[75341]: DEBUG os_brick.utils [None req-1517c200-3118-4059-8e0e-8204f841ab93 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 00:01:44 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:01:44 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:01:44 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2432cb8-3c8a-40ab-b966-0fa281148148]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6d1cfca09c9\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:01:44 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:01:44 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:01:44 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[623cb128-5b43-4e0f-bee7-977c938119d8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:01:44 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:01:44 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:01:44 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3ca2d9-1afe-4887-9218-3a12c7e8216e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:01:44 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b402cc9-b74f-45ff-9454-b555298255ce]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:01:44 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-1517c200-3118-4059-8e0e-8204f841ab93 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Running cmd (subprocess): nvme version {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:01:44 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-1517c200-3118-4059-8e0e-8204f841ab93 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] 'nvme version' failed. Not Retrying. {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 00:01:44 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1517c200-3118-4059-8e0e-8204f841ab93 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] nvme not present on system {{(pid=75341) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 00:01:44 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:01:44 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 00:01:44 user nova-compute[75341]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 00:01:44 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a6c6e6-276b-42ba-bdf3-c9c96e916828]: (4, '') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:01:44 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-1517c200-3118-4059-8e0e-8204f841ab93 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75341) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 00:01:44 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-1517c200-3118-4059-8e0e-8204f841ab93 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 00:01:44 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-1517c200-3118-4059-8e0e-8204f841ab93 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] LIGHTOS: no hostnqn found. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 00:01:44 user nova-compute[75341]: DEBUG os_brick.utils [None req-1517c200-3118-4059-8e0e-8204f841ab93 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6d1cfca09c9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 00:01:44 user nova-compute[75341]: DEBUG nova.virt.block_device [None req-1517c200-3118-4059-8e0e-8204f841ab93 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Updating existing volume attachment record: 2711c73c-344d-447e-bb47-2d5c28444d42 {{(pid=75341) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 00:01:47 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:01:49 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1517c200-3118-4059-8e0e-8204f841ab93 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Calling os-brick to attach iSCSI Volume {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 00:01:49 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-1517c200-3118-4059-8e0e-8204f841ab93 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qQjFsDIz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 00:01:49 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-1517c200-3118-4059-8e0e-8204f841ab93 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 00:01:49 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-1517c200-3118-4059-8e0e-8204f841ab93 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 00:01:49 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-1517c200-3118-4059-8e0e-8204f841ab93 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 00:01:49 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-1517c200-3118-4059-8e0e-8204f841ab93 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 00:01:49 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-1517c200-3118-4059-8e0e-8204f841ab93 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 00:01:49 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-1517c200-3118-4059-8e0e-8204f841ab93 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 00:01:49 user nova-compute[75341]: INFO os_brick.initiator.connectors.iscsi [None req-1517c200-3118-4059-8e0e-8204f841ab93 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 00:01:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed -p 172.16.0.220:3260 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:01:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:01:49 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[09755649-ac27-45d9-b5f5-0d75646cafae]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:01:49 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-1517c200-3118-4059-8e0e-8204f841ab93 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 00:01:49 user nova-compute[75341]:  {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:01:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed -p 172.16.0.220:3260 --interface default --op new {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:01:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:01:49 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a3beff-4657-494f-aa1e-6af7d8f98583]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed] added\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:01:49 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-1517c200-3118-4059-8e0e-8204f841ab93 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed] added
Nov 15 00:01:49 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:01:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:01:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:01:49 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed147bf-cefa-43c1-9d0e-55f328a60af2]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:01:49 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-1517c200-3118-4059-8e0e-8204f841ab93 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:01:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:01:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:01:49 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d58aa4a-568b-436e-8c16-727b3bf78ed0]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:01:49 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-1517c200-3118-4059-8e0e-8204f841ab93 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:01:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qQjFsDIz {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:01:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qQjFsDIz" returned: 0 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:01:49 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0065226-b55e-496d-8eca-f3dedb22369f]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:01:49 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-1517c200-3118-4059-8e0e-8204f841ab93 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qQjFsDIz'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:01:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:01:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:01:49 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[722ce0e5-7dd1-4080-aa4f-a82c991004b9]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:01:49 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-1517c200-3118-4059-8e0e-8204f841ab93 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:01:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:01:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:01:49 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[673894a5-10ff-4c39-8293-73183f35563c]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:01:49 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-1517c200-3118-4059-8e0e-8204f841ab93 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 (non-flash)
Nov 15 00:01:49 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 00:01:49 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-1517c200-3118-4059-8e0e-8204f841ab93 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 (non-flash)
Nov 15 00:01:49 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 00:01:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed -p 172.16.0.220:3260 --login {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:01:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:01:49 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[c310cfe8-0e50-4443-8184-a79571a3a665]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:01:49 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-1517c200-3118-4059-8e0e-8204f841ab93 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed, portal: 172.16.0.220,3260]
Nov 15 00:01:49 user nova-compute[75341]: Login to [iface: default, target: iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed, portal: 172.16.0.220,3260] successful.
Nov 15 00:01:49 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:01:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:01:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:01:49 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[d805a03a-28e5-40f5-928d-6c23c953c2d8]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:01:49 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-1517c200-3118-4059-8e0e-8204f841ab93 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:01:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:01:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:01:49 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[f387f3e6-0ed0-46e9-8a0a-2cba42d4ce0e]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:01:49 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-1517c200-3118-4059-8e0e-8204f841ab93 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 (non-flash)
Nov 15 00:01:49 user nova-compute[75341]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed (non-flash)
Nov 15 00:01:49 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 00:01:49 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-1517c200-3118-4059-8e0e-8204f841ab93 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 (non-flash)
Nov 15 00:01:49 user nova-compute[75341]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed (non-flash)
Nov 15 00:01:49 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 00:01:49 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-1517c200-3118-4059-8e0e-8204f841ab93 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.247s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 00:01:49 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-1517c200-3118-4059-8e0e-8204f841ab93 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Connected to 172.16.0.220:3260 {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 00:01:49 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-1517c200-3118-4059-8e0e-8204f841ab93 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=75341) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 00:01:49 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-1517c200-3118-4059-8e0e-8204f841ab93 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75341) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 00:01:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:01:49 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:01:49 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a0d561-ff6b-433e-be27-b8f20730e54a]: (4, ('- - 0', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:01:49 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-1517c200-3118-4059-8e0e-8204f841ab93 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 00:01:49 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-1517c200-3118-4059-8e0e-8204f841ab93 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qQjFsDIz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 00:01:50 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-1517c200-3118-4059-8e0e-8204f841ab93 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.278s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 00:01:50 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-1517c200-3118-4059-8e0e-8204f841ab93 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] <== connect_volume: return (1280ms) {'type': 'block', 'scsi_wwn': '26363336433633836', 'path': '/dev/sdb'} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 00:01:50 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1517c200-3118-4059-8e0e-8204f841ab93 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26363336433633836', 'path': '/dev/sdb'} {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 00:01:50 user nova-compute[75341]: DEBUG nova.objects.instance [None req-1517c200-3118-4059-8e0e-8204f841ab93 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lazy-loading 'flavor' on Instance uuid f48db53c-618c-42fc-a688-974cc75f3598 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:01:50 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-1517c200-3118-4059-8e0e-8204f841ab93 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 00:01:50 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 00:01:50 user nova-compute[75341]:   <source dev="/dev/sdb"/>
Nov 15 00:01:50 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 15 00:01:50 user nova-compute[75341]:   <serial>d0ab162a-2aa4-49a0-a6b7-21f2172db6ed</serial>
Nov 15 00:01:50 user nova-compute[75341]: </disk>
Nov 15 00:01:50 user nova-compute[75341]:  {{(pid=75341) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 00:01:50 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-1517c200-3118-4059-8e0e-8204f841ab93 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 00:01:50 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-1517c200-3118-4059-8e0e-8204f841ab93 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 00:01:50 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-1517c200-3118-4059-8e0e-8204f841ab93 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] No VIF found with MAC fa:16:3e:10:f1:8e, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 00:01:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1517c200-3118-4059-8e0e-8204f841ab93 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "f48db53c-618c-42fc-a688-974cc75f3598" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.259s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:01:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:01:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:01:55 user nova-compute[75341]: DEBUG nova.compute.manager [req-036f5a9c-9490-427b-ae71-6c70b736cc2b req-49639a5f-3ffd-4456-a3b5-5a2540dfd075 service nova] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Received event network-changed-b9bfab22-02f7-4620-9bd5-f65817bc199a {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:01:55 user nova-compute[75341]: DEBUG nova.compute.manager [req-036f5a9c-9490-427b-ae71-6c70b736cc2b req-49639a5f-3ffd-4456-a3b5-5a2540dfd075 service nova] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Refreshing instance network info cache due to event network-changed-b9bfab22-02f7-4620-9bd5-f65817bc199a. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 00:01:55 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-036f5a9c-9490-427b-ae71-6c70b736cc2b req-49639a5f-3ffd-4456-a3b5-5a2540dfd075 service nova] Acquiring lock "refresh_cache-f48db53c-618c-42fc-a688-974cc75f3598" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:01:55 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-036f5a9c-9490-427b-ae71-6c70b736cc2b req-49639a5f-3ffd-4456-a3b5-5a2540dfd075 service nova] Acquired lock "refresh_cache-f48db53c-618c-42fc-a688-974cc75f3598" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:01:55 user nova-compute[75341]: DEBUG nova.network.neutron [req-036f5a9c-9490-427b-ae71-6c70b736cc2b req-49639a5f-3ffd-4456-a3b5-5a2540dfd075 service nova] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Refreshing network info cache for port b9bfab22-02f7-4620-9bd5-f65817bc199a {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 00:01:55 user nova-compute[75341]: DEBUG nova.network.neutron [req-036f5a9c-9490-427b-ae71-6c70b736cc2b req-49639a5f-3ffd-4456-a3b5-5a2540dfd075 service nova] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Updated VIF entry in instance network info cache for port b9bfab22-02f7-4620-9bd5-f65817bc199a. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 00:01:55 user nova-compute[75341]: DEBUG nova.network.neutron [req-036f5a9c-9490-427b-ae71-6c70b736cc2b req-49639a5f-3ffd-4456-a3b5-5a2540dfd075 service nova] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Updating instance_info_cache with network_info: [{"id": "b9bfab22-02f7-4620-9bd5-f65817bc199a", "address": "fa:16:3e:10:f1:8e", "network": {"id": "e8f13b75-3423-43ce-b6dc-843c837e46d2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-617247022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8c1eeb4c3c4f27b774aba29ceb7997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9bfab22-02", "ovs_interfaceid": "b9bfab22-02f7-4620-9bd5-f65817bc199a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:01:55 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-036f5a9c-9490-427b-ae71-6c70b736cc2b req-49639a5f-3ffd-4456-a3b5-5a2540dfd075 service nova] Releasing lock "refresh_cache-f48db53c-618c-42fc-a688-974cc75f3598" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:01:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:01:57 user nova-compute[75341]: DEBUG nova.compute.manager [req-abedd700-1209-4530-9ff3-296525359804 req-b1d1214a-037d-479e-b24a-79a9cbb59e07 service nova] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Received event network-changed-b9bfab22-02f7-4620-9bd5-f65817bc199a {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:01:57 user nova-compute[75341]: DEBUG nova.compute.manager [req-abedd700-1209-4530-9ff3-296525359804 req-b1d1214a-037d-479e-b24a-79a9cbb59e07 service nova] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Refreshing instance network info cache due to event network-changed-b9bfab22-02f7-4620-9bd5-f65817bc199a. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 00:01:57 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-abedd700-1209-4530-9ff3-296525359804 req-b1d1214a-037d-479e-b24a-79a9cbb59e07 service nova] Acquiring lock "refresh_cache-f48db53c-618c-42fc-a688-974cc75f3598" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:01:57 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-abedd700-1209-4530-9ff3-296525359804 req-b1d1214a-037d-479e-b24a-79a9cbb59e07 service nova] Acquired lock "refresh_cache-f48db53c-618c-42fc-a688-974cc75f3598" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:01:57 user nova-compute[75341]: DEBUG nova.network.neutron [req-abedd700-1209-4530-9ff3-296525359804 req-b1d1214a-037d-479e-b24a-79a9cbb59e07 service nova] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Refreshing network info cache for port b9bfab22-02f7-4620-9bd5-f65817bc199a {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 00:01:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:01:57 user nova-compute[75341]: DEBUG nova.network.neutron [req-abedd700-1209-4530-9ff3-296525359804 req-b1d1214a-037d-479e-b24a-79a9cbb59e07 service nova] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Updated VIF entry in instance network info cache for port b9bfab22-02f7-4620-9bd5-f65817bc199a. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 00:01:57 user nova-compute[75341]: DEBUG nova.network.neutron [req-abedd700-1209-4530-9ff3-296525359804 req-b1d1214a-037d-479e-b24a-79a9cbb59e07 service nova] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Updating instance_info_cache with network_info: [{"id": "b9bfab22-02f7-4620-9bd5-f65817bc199a", "address": "fa:16:3e:10:f1:8e", "network": {"id": "e8f13b75-3423-43ce-b6dc-843c837e46d2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-617247022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8c1eeb4c3c4f27b774aba29ceb7997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9bfab22-02", "ovs_interfaceid": "b9bfab22-02f7-4620-9bd5-f65817bc199a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:01:57 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-abedd700-1209-4530-9ff3-296525359804 req-b1d1214a-037d-479e-b24a-79a9cbb59e07 service nova] Releasing lock "refresh_cache-f48db53c-618c-42fc-a688-974cc75f3598" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:01:58 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:02:00 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Acquiring lock "f48db53c-618c-42fc-a688-974cc75f3598" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:02:00 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "f48db53c-618c-42fc-a688-974cc75f3598" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:02:00 user nova-compute[75341]: INFO nova.compute.manager [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Rebooting instance
Nov 15 00:02:00 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Acquiring lock "refresh_cache-f48db53c-618c-42fc-a688-974cc75f3598" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:02:00 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Acquired lock "refresh_cache-f48db53c-618c-42fc-a688-974cc75f3598" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:02:00 user nova-compute[75341]: DEBUG nova.network.neutron [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 00:02:00 user nova-compute[75341]: DEBUG nova.network.neutron [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Updating instance_info_cache with network_info: [{"id": "b9bfab22-02f7-4620-9bd5-f65817bc199a", "address": "fa:16:3e:10:f1:8e", "network": {"id": "e8f13b75-3423-43ce-b6dc-843c837e46d2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-617247022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8c1eeb4c3c4f27b774aba29ceb7997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9bfab22-02", "ovs_interfaceid": "b9bfab22-02f7-4620-9bd5-f65817bc199a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:02:00 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Releasing lock "refresh_cache-f48db53c-618c-42fc-a688-974cc75f3598" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:02:00 user nova-compute[75341]: DEBUG nova.compute.manager [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 00:02:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:02:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:02:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:02:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:02:01 user nova-compute[75341]: DEBUG nova.compute.manager [req-9e642586-1476-47b1-ab2a-b7a354a5db08 req-3df90003-ae79-4ce6-8a9b-0b016ebc9633 service nova] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Received event network-vif-unplugged-b9bfab22-02f7-4620-9bd5-f65817bc199a {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:02:01 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-9e642586-1476-47b1-ab2a-b7a354a5db08 req-3df90003-ae79-4ce6-8a9b-0b016ebc9633 service nova] Acquiring lock "f48db53c-618c-42fc-a688-974cc75f3598-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:02:01 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-9e642586-1476-47b1-ab2a-b7a354a5db08 req-3df90003-ae79-4ce6-8a9b-0b016ebc9633 service nova] Lock "f48db53c-618c-42fc-a688-974cc75f3598-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:02:01 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-9e642586-1476-47b1-ab2a-b7a354a5db08 req-3df90003-ae79-4ce6-8a9b-0b016ebc9633 service nova] Lock "f48db53c-618c-42fc-a688-974cc75f3598-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:02:01 user nova-compute[75341]: DEBUG nova.compute.manager [req-9e642586-1476-47b1-ab2a-b7a354a5db08 req-3df90003-ae79-4ce6-8a9b-0b016ebc9633 service nova] [instance: f48db53c-618c-42fc-a688-974cc75f3598] No waiting events found dispatching network-vif-unplugged-b9bfab22-02f7-4620-9bd5-f65817bc199a {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:02:01 user nova-compute[75341]: WARNING nova.compute.manager [req-9e642586-1476-47b1-ab2a-b7a354a5db08 req-3df90003-ae79-4ce6-8a9b-0b016ebc9633 service nova] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Received unexpected event network-vif-unplugged-b9bfab22-02f7-4620-9bd5-f65817bc199a for instance with vm_state active and task_state reboot_started_hard.
Nov 15 00:02:01 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Instance destroyed successfully.
Nov 15 00:02:01 user nova-compute[75341]: DEBUG nova.objects.instance [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lazy-loading 'resources' on Instance uuid f48db53c-618c-42fc-a688-974cc75f3598 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:02:01 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:59:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-89893269',display_name='tempest-TestMinimumBasicScenario-server-89893269',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-89893269',id=44,image_ref='a514ccdd-c667-4101-b446-774c8244dedb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD0eZ5MsnBvG5pKKJBm4DlYZrp8vwl0KUIoqF3rAYo2HUDLyr+TZxLNlaqGyAUDWA2dfkwjc9L12nHbBmdHRBsmT0iiatxTfrEomOcKH/IzhH6JOzKHsaGB/tcMn536jXg==',key_name='tempest-TestMinimumBasicScenario-1806050912',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:59:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f8c1eeb4c3c4f27b774aba29ceb7997',ramdisk_id='',reservation_id='r-t0gzgsz8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a514ccdd-c667-4101-b446-774c8244dedb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-157558920',owner_user_name='tempest-TestMinimumBasicScenario-157558920-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T00:02:01Z,user_data=None,user_id='1b1c77e1e34b46319dcd52a38996542c',uuid=f48db53c-618c-42fc-a688-974cc75f3598,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b9bfab22-02f7-4620-9bd5-f65817bc199a", "address": "fa:16:3e:10:f1:8e", "network": {"id": "e8f13b75-3423-43ce-b6dc-843c837e46d2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-617247022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8c1eeb4c3c4f27b774aba29ceb7997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9bfab22-02", "ovs_interfaceid": "b9bfab22-02f7-4620-9bd5-f65817bc199a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 00:02:01 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Converting VIF {"id": "b9bfab22-02f7-4620-9bd5-f65817bc199a", "address": "fa:16:3e:10:f1:8e", "network": {"id": "e8f13b75-3423-43ce-b6dc-843c837e46d2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-617247022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8c1eeb4c3c4f27b774aba29ceb7997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9bfab22-02", "ovs_interfaceid": "b9bfab22-02f7-4620-9bd5-f65817bc199a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 00:02:01 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:10:f1:8e,bridge_name='br-int',has_traffic_filtering=True,id=b9bfab22-02f7-4620-9bd5-f65817bc199a,network=Network(e8f13b75-3423-43ce-b6dc-843c837e46d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9bfab22-02') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 00:02:01 user nova-compute[75341]: DEBUG os_vif [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:f1:8e,bridge_name='br-int',has_traffic_filtering=True,id=b9bfab22-02f7-4620-9bd5-f65817bc199a,network=Network(e8f13b75-3423-43ce-b6dc-843c837e46d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9bfab22-02') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 00:02:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:02:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb9bfab22-02, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:02:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:02:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:02:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:02:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=de5c58bf-d51a-4933-a428-da390148d4bb) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:02:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:02:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:02:01 user nova-compute[75341]: INFO os_vif [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:f1:8e,bridge_name='br-int',has_traffic_filtering=True,id=b9bfab22-02f7-4620-9bd5-f65817bc199a,network=Network(e8f13b75-3423-43ce-b6dc-843c837e46d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9bfab22-02')
Nov 15 00:02:01 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: f48db53c-618c-42fc-a688-974cc75f3598] calling os-brick to detach iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 00:02:01 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, {'target_iqn': 'iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qQjFsDIz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 00:02:01 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 00:02:01 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 00:02:01 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 00:02:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:01 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e40937-7763-481a-975c-bafd6ed6549f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:02:01 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 00:02:01 user nova-compute[75341]: No targets found.
Nov 15 00:02:01 user nova-compute[75341]: iSNS:
Nov 15 00:02:01 user nova-compute[75341]: No targets found.
Nov 15 00:02:01 user nova-compute[75341]: STATIC:
Nov 15 00:02:01 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed
Nov 15 00:02:01 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 15 00:02:01 user nova-compute[75341]:                 Iface Name: default
Nov 15 00:02:01 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123
Nov 15 00:02:01 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 15 00:02:01 user nova-compute[75341]:                 Iface Name: default
Nov 15 00:02:01 user nova-compute[75341]: FIRMWARE:
Nov 15 00:02:01 user nova-compute[75341]: No targets found.
Nov 15 00:02:01 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 00:02:01 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 00:02:01 user nova-compute[75341]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 00:02:01 user nova-compute[75341]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75341) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 00:02:01 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed', 0)] {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 00:02:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:01 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[64bf6066-4cfb-4818-9e9f-d588591f75ca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:02:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:01 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8f324a-7def-4bb2-882f-aa591c8d14f2]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:02:01 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 (non-flash)
Nov 15 00:02:01 user nova-compute[75341]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed (non-flash)
Nov 15 00:02:01 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 00:02:01 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 (non-flash)
Nov 15 00:02:01 user nova-compute[75341]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed (non-flash)
Nov 15 00:02:01 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 00:02:01 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f189023c820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed'): ({'sdb'}, set())}) {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 00:02:01 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Removing single pathed devices sdb {{(pid=75341) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 00:02:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:01 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e37c40-7f0a-41eb-947f-c178ecb384ca]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:02:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:01 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[58fb2b37-553f-45b7-8664-6ea1a72ded70]: (4, ('ok\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:02:01 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Flushing IO for device /dev/sdb {{(pid=75341) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 00:02:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:01 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[c786b97d-6558-415c-8d9d-e30a7526b75f]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:02:01 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75341) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 00:02:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:01 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c7f2ab-a566-49a1-b555-bea626796919]: (4, ('1', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:02:01 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 00:02:01 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] SCSI volumes sdb have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 00:02:01 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed')] {{(pid=75341) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 00:02:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:01 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e77fdd0-d309-46dc-b7c3-012057d29a39]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:02:01 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:02:01 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed -p 172.16.0.220:3260 --logout {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[3445a85c-c5e5-413c-b5ec-18bda70d02a8]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed, portal: 172.16.0.220,3260]
Nov 15 00:02:02 user nova-compute[75341]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed, portal: 172.16.0.220,3260] successful.
Nov 15 00:02:02 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed -p 172.16.0.220:3260 --op delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fec3681-06d0-4912-957a-73f55495235e]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] <== disconnect_volume: return (277ms) None {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Disconnected iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Start _get_guest_xml network_info=[{"id": "b9bfab22-02f7-4620-9bd5-f65817bc199a", "address": "fa:16:3e:10:f1:8e", "network": {"id": "e8f13b75-3423-43ce-b6dc-843c837e46d2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-617247022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8c1eeb4c3c4f27b774aba29ceb7997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9bfab22-02", "ovs_interfaceid": "b9bfab22-02f7-4620-9bd5-f65817bc199a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a514ccdd-c667-4101-b446-774c8244dedb,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encrypted': False, 'image_id': 'a514ccdd-c667-4101-b446-774c8244dedb'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': None, 'attachment_id': '2711c73c-344d-447e-bb47-2d5c28444d42', 'mount_device': '/dev/vdb', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qQjFsDIz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'f48db53c-618c-42fc-a688-974cc75f3598', 'attached_at': '', 'detached_at': '', 'volume_id': 'd0ab162a-2aa4-49a0-a6b7-21f2172db6ed', 'serial': 'd0ab162a-2aa4-49a0-a6b7-21f2172db6ed'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 00:02:02 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:02:02 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:02:02 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a514ccdd-c667-4101-b446-774c8244dedb,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG nova.objects.instance [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lazy-loading 'vcpu_model' on Instance uuid f48db53c-618c-42fc-a688-974cc75f3598 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG nova.objects.base [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Object Instance<f48db53c-618c-42fc-a688-974cc75f3598> lazy-loaded attributes: resources,vcpu_model {{(pid=75341) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Calling os-brick to attach iSCSI Volume {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qQjFsDIz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 00:02:02 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 00:02:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 00:02:02 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 00:02:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 00:02:02 user nova-compute[75341]: INFO os_brick.initiator.connectors.iscsi [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 00:02:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed -p 172.16.0.220:3260 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf3dcf8-0fc4-4424-bf6a-54beaca47ab6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 00:02:02 user nova-compute[75341]:  {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed -p 172.16.0.220:3260 --interface default --op new {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[077a9d49-6b55-41c5-897b-010ffe3967be]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed] added\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed] added
Nov 15 00:02:02 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[086fc4f9-b2f8-4df1-8029-53f2f401545b]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a13331e-786f-4db4-8226-7a84665ee897]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qQjFsDIz {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qQjFsDIz" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06d3265-de36-46cf-8a70-5cb9de055890]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qQjFsDIz'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[946e4aeb-ad3b-4b4b-9b1f-e11b0a23f71b]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[497e5b7f-e685-4d61-8c7e-a7b7d9d02ff2]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 (non-flash)
Nov 15 00:02:02 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 (non-flash)
Nov 15 00:02:02 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed -p 172.16.0.220:3260 --login {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[190d61df-3f8f-4e4c-aca7-6f92f781e200]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed, portal: 172.16.0.220,3260]
Nov 15 00:02:02 user nova-compute[75341]: Login to [iface: default, target: iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed, portal: 172.16.0.220,3260] successful.
Nov 15 00:02:02 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da677ab-4156-469a-9801-003dc6e0c049]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a34300-29bd-409c-972a-5edd2ecad6fc]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 (non-flash)
Nov 15 00:02:02 user nova-compute[75341]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed (non-flash)
Nov 15 00:02:02 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 (non-flash)
Nov 15 00:02:02 user nova-compute[75341]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed (non-flash)
Nov 15 00:02:02 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.239s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Connected to 172.16.0.220:3260 {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=75341) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75341) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7ed147-d7cb-422f-9561-58c4e130d995]: (4, ('- - 0', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: None {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:02:02 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75341) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 00:02:03 user nova-compute[75341]: DEBUG nova.compute.manager [req-428bb064-8805-4f34-8f5f-82a2a5bf10b2 req-7ee8e419-357c-495d-9911-31be1e0b37ee service nova] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Received event network-vif-plugged-b9bfab22-02f7-4620-9bd5-f65817bc199a {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:02:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-428bb064-8805-4f34-8f5f-82a2a5bf10b2 req-7ee8e419-357c-495d-9911-31be1e0b37ee service nova] Acquiring lock "f48db53c-618c-42fc-a688-974cc75f3598-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:02:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-428bb064-8805-4f34-8f5f-82a2a5bf10b2 req-7ee8e419-357c-495d-9911-31be1e0b37ee service nova] Lock "f48db53c-618c-42fc-a688-974cc75f3598-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:02:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-428bb064-8805-4f34-8f5f-82a2a5bf10b2 req-7ee8e419-357c-495d-9911-31be1e0b37ee service nova] Lock "f48db53c-618c-42fc-a688-974cc75f3598-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:02:03 user nova-compute[75341]: DEBUG nova.compute.manager [req-428bb064-8805-4f34-8f5f-82a2a5bf10b2 req-7ee8e419-357c-495d-9911-31be1e0b37ee service nova] [instance: f48db53c-618c-42fc-a688-974cc75f3598] No waiting events found dispatching network-vif-plugged-b9bfab22-02f7-4620-9bd5-f65817bc199a {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:02:03 user nova-compute[75341]: WARNING nova.compute.manager [req-428bb064-8805-4f34-8f5f-82a2a5bf10b2 req-7ee8e419-357c-495d-9911-31be1e0b37ee service nova] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Received unexpected event network-vif-plugged-b9bfab22-02f7-4620-9bd5-f65817bc199a for instance with vm_state active and task_state reboot_started_hard.
Nov 15 00:02:03 user nova-compute[75341]: DEBUG nova.compute.manager [req-428bb064-8805-4f34-8f5f-82a2a5bf10b2 req-7ee8e419-357c-495d-9911-31be1e0b37ee service nova] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Received event network-changed-f337ac0b-ba3c-4517-a743-5c489e2798cd {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:02:03 user nova-compute[75341]: DEBUG nova.compute.manager [req-428bb064-8805-4f34-8f5f-82a2a5bf10b2 req-7ee8e419-357c-495d-9911-31be1e0b37ee service nova] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Refreshing instance network info cache due to event network-changed-f337ac0b-ba3c-4517-a743-5c489e2798cd. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 00:02:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-428bb064-8805-4f34-8f5f-82a2a5bf10b2 req-7ee8e419-357c-495d-9911-31be1e0b37ee service nova] Acquiring lock "refresh_cache-3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:02:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-428bb064-8805-4f34-8f5f-82a2a5bf10b2 req-7ee8e419-357c-495d-9911-31be1e0b37ee service nova] Acquired lock "refresh_cache-3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:02:03 user nova-compute[75341]: DEBUG nova.network.neutron [req-428bb064-8805-4f34-8f5f-82a2a5bf10b2 req-7ee8e419-357c-495d-9911-31be1e0b37ee service nova] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Refreshing network info cache for port f337ac0b-ba3c-4517-a743-5c489e2798cd {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 00:02:03 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 00:02:03 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qQjFsDIz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 00:02:03 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.277s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 00:02:03 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] <== connect_volume: return (1278ms) {'type': 'block', 'scsi_wwn': '26363336433633836', 'path': '/dev/sdb'} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 00:02:03 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26363336433633836', 'path': '/dev/sdb'} {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 00:02:03 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:59:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-89893269',display_name='tempest-TestMinimumBasicScenario-server-89893269',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-89893269',id=44,image_ref='a514ccdd-c667-4101-b446-774c8244dedb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD0eZ5MsnBvG5pKKJBm4DlYZrp8vwl0KUIoqF3rAYo2HUDLyr+TZxLNlaqGyAUDWA2dfkwjc9L12nHbBmdHRBsmT0iiatxTfrEomOcKH/IzhH6JOzKHsaGB/tcMn536jXg==',key_name='tempest-TestMinimumBasicScenario-1806050912',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:59:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f8c1eeb4c3c4f27b774aba29ceb7997',ramdisk_id='',reservation_id='r-t0gzgsz8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a514ccdd-c667-4101-b446-774c8244dedb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-157558920',owner_user_name='tempest-TestMinimumBasicScenario-157558920-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T00:02:01Z,user_data=None,user_id='1b1c77e1e34b46319dcd52a38996542c',uuid=f48db53c-618c-42fc-a688-974cc75f3598,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b9bfab22-02f7-4620-9bd5-f65817bc199a", "address": "fa:16:3e:10:f1:8e", "network": {"id": "e8f13b75-3423-43ce-b6dc-843c837e46d2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-617247022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8c1eeb4c3c4f27b774aba29ceb7997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9bfab22-02", "ovs_interfaceid": "b9bfab22-02f7-4620-9bd5-f65817bc199a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 00:02:03 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Converting VIF {"id": "b9bfab22-02f7-4620-9bd5-f65817bc199a", "address": "fa:16:3e:10:f1:8e", "network": {"id": "e8f13b75-3423-43ce-b6dc-843c837e46d2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-617247022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8c1eeb4c3c4f27b774aba29ceb7997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9bfab22-02", "ovs_interfaceid": "b9bfab22-02f7-4620-9bd5-f65817bc199a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 00:02:03 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:10:f1:8e,bridge_name='br-int',has_traffic_filtering=True,id=b9bfab22-02f7-4620-9bd5-f65817bc199a,network=Network(e8f13b75-3423-43ce-b6dc-843c837e46d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9bfab22-02') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 00:02:03 user nova-compute[75341]: DEBUG nova.objects.instance [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lazy-loading 'pci_devices' on Instance uuid f48db53c-618c-42fc-a688-974cc75f3598 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:02:03 user nova-compute[75341]: DEBUG nova.objects.base [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Object Instance<f48db53c-618c-42fc-a688-974cc75f3598> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75341) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 00:02:03 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: f48db53c-618c-42fc-a688-974cc75f3598] End _get_guest_xml xml=<domain type="kvm">
Nov 15 00:02:03 user nova-compute[75341]:   <uuid>f48db53c-618c-42fc-a688-974cc75f3598</uuid>
Nov 15 00:02:03 user nova-compute[75341]:   <name>instance-0000002c</name>
Nov 15 00:02:03 user nova-compute[75341]:   <memory>524288</memory>
Nov 15 00:02:03 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 15 00:02:03 user nova-compute[75341]:   <metadata>
Nov 15 00:02:03 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 00:02:03 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 15 00:02:03 user nova-compute[75341]:       <nova:name>tempest-TestMinimumBasicScenario-server-89893269</nova:name>
Nov 15 00:02:03 user nova-compute[75341]:       <nova:creationTime>2023-11-15 00:02:02</nova:creationTime>
Nov 15 00:02:03 user nova-compute[75341]:       <nova:flavor name="m1.tiny">
Nov 15 00:02:03 user nova-compute[75341]:         <nova:memory>512</nova:memory>
Nov 15 00:02:03 user nova-compute[75341]:         <nova:disk>1</nova:disk>
Nov 15 00:02:03 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 15 00:02:03 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 00:02:03 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 15 00:02:03 user nova-compute[75341]:       </nova:flavor>
Nov 15 00:02:03 user nova-compute[75341]:       <nova:owner>
Nov 15 00:02:03 user nova-compute[75341]:         <nova:user uuid="1b1c77e1e34b46319dcd52a38996542c">tempest-TestMinimumBasicScenario-157558920-project-member</nova:user>
Nov 15 00:02:03 user nova-compute[75341]:         <nova:project uuid="9f8c1eeb4c3c4f27b774aba29ceb7997">tempest-TestMinimumBasicScenario-157558920</nova:project>
Nov 15 00:02:03 user nova-compute[75341]:       </nova:owner>
Nov 15 00:02:03 user nova-compute[75341]:       <nova:root type="image" uuid="a514ccdd-c667-4101-b446-774c8244dedb"/>
Nov 15 00:02:03 user nova-compute[75341]:       <nova:ports>
Nov 15 00:02:03 user nova-compute[75341]:         <nova:port uuid="b9bfab22-02f7-4620-9bd5-f65817bc199a">
Nov 15 00:02:03 user nova-compute[75341]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 00:02:03 user nova-compute[75341]:         </nova:port>
Nov 15 00:02:03 user nova-compute[75341]:       </nova:ports>
Nov 15 00:02:03 user nova-compute[75341]:     </nova:instance>
Nov 15 00:02:03 user nova-compute[75341]:   </metadata>
Nov 15 00:02:03 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 15 00:02:03 user nova-compute[75341]:     <system>
Nov 15 00:02:03 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 00:02:03 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 15 00:02:03 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 15 00:02:03 user nova-compute[75341]:       <entry name="serial">f48db53c-618c-42fc-a688-974cc75f3598</entry>
Nov 15 00:02:03 user nova-compute[75341]:       <entry name="uuid">f48db53c-618c-42fc-a688-974cc75f3598</entry>
Nov 15 00:02:03 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 15 00:02:03 user nova-compute[75341]:     </system>
Nov 15 00:02:03 user nova-compute[75341]:   </sysinfo>
Nov 15 00:02:03 user nova-compute[75341]:   <os>
Nov 15 00:02:03 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 00:02:03 user nova-compute[75341]:     <boot dev="hd"/>
Nov 15 00:02:03 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 15 00:02:03 user nova-compute[75341]:   </os>
Nov 15 00:02:03 user nova-compute[75341]:   <features>
Nov 15 00:02:03 user nova-compute[75341]:     <acpi/>
Nov 15 00:02:03 user nova-compute[75341]:     <apic/>
Nov 15 00:02:03 user nova-compute[75341]:     <vmcoreinfo/>
Nov 15 00:02:03 user nova-compute[75341]:   </features>
Nov 15 00:02:03 user nova-compute[75341]:   <clock offset="utc">
Nov 15 00:02:03 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 00:02:03 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 00:02:03 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 15 00:02:03 user nova-compute[75341]:   </clock>
Nov 15 00:02:03 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 15 00:02:03 user nova-compute[75341]:     <model>Nehalem</model>
Nov 15 00:02:03 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 00:02:03 user nova-compute[75341]:   </cpu>
Nov 15 00:02:03 user nova-compute[75341]:   <devices>
Nov 15 00:02:03 user nova-compute[75341]:     <disk type="file" device="disk">
Nov 15 00:02:03 user nova-compute[75341]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 00:02:03 user nova-compute[75341]:       <source file="/opt/stack/data/nova/instances/f48db53c-618c-42fc-a688-974cc75f3598/disk"/>
Nov 15 00:02:03 user nova-compute[75341]:       <target dev="vda" bus="virtio"/>
Nov 15 00:02:03 user nova-compute[75341]:     </disk>
Nov 15 00:02:03 user nova-compute[75341]:     <disk type="block" device="disk">
Nov 15 00:02:03 user nova-compute[75341]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 00:02:03 user nova-compute[75341]:       <source dev="/dev/sdb"/>
Nov 15 00:02:03 user nova-compute[75341]:       <target dev="vdb" bus="virtio"/>
Nov 15 00:02:03 user nova-compute[75341]:       <serial>d0ab162a-2aa4-49a0-a6b7-21f2172db6ed</serial>
Nov 15 00:02:03 user nova-compute[75341]:     </disk>
Nov 15 00:02:03 user nova-compute[75341]:     <interface type="ethernet">
Nov 15 00:02:03 user nova-compute[75341]:       <mac address="fa:16:3e:10:f1:8e"/>
Nov 15 00:02:03 user nova-compute[75341]:       <model type="virtio"/>
Nov 15 00:02:03 user nova-compute[75341]:       <mtu size="1442"/>
Nov 15 00:02:03 user nova-compute[75341]:       <target dev="tapb9bfab22-02"/>
Nov 15 00:02:03 user nova-compute[75341]:     </interface>
Nov 15 00:02:03 user nova-compute[75341]:     <serial type="pty">
Nov 15 00:02:03 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/f48db53c-618c-42fc-a688-974cc75f3598/console.log" append="off"/>
Nov 15 00:02:03 user nova-compute[75341]:     </serial>
Nov 15 00:02:03 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 00:02:03 user nova-compute[75341]:     <video>
Nov 15 00:02:03 user nova-compute[75341]:       <model type="virtio"/>
Nov 15 00:02:03 user nova-compute[75341]:     </video>
Nov 15 00:02:03 user nova-compute[75341]:     <rng model="virtio">
Nov 15 00:02:03 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 15 00:02:03 user nova-compute[75341]:     </rng>
Nov 15 00:02:03 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 15 00:02:03 user nova-compute[75341]:     <memballoon model="virtio">
Nov 15 00:02:03 user nova-compute[75341]:       <stats period="10"/>
Nov 15 00:02:03 user nova-compute[75341]:     </memballoon>
Nov 15 00:02:03 user nova-compute[75341]:   </devices>
Nov 15 00:02:03 user nova-compute[75341]: </domain>
Nov 15 00:02:03 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 00:02:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48db53c-618c-42fc-a688-974cc75f3598/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48db53c-618c-42fc-a688-974cc75f3598/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48db53c-618c-42fc-a688-974cc75f3598/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:03 user nova-compute[75341]: DEBUG nova.network.neutron [req-428bb064-8805-4f34-8f5f-82a2a5bf10b2 req-7ee8e419-357c-495d-9911-31be1e0b37ee service nova] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Updated VIF entry in instance network info cache for port f337ac0b-ba3c-4517-a743-5c489e2798cd. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 00:02:03 user nova-compute[75341]: DEBUG nova.network.neutron [req-428bb064-8805-4f34-8f5f-82a2a5bf10b2 req-7ee8e419-357c-495d-9911-31be1e0b37ee service nova] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Updating instance_info_cache with network_info: [{"id": "f337ac0b-ba3c-4517-a743-5c489e2798cd", "address": "fa:16:3e:0c:1d:ea", "network": {"id": "167936c8-5f28-439e-9a1f-d9356b3a1ec9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374167607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e601d11e75d4ec4b7c05e615c67fe20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf337ac0b-ba", "ovs_interfaceid": "f337ac0b-ba3c-4517-a743-5c489e2798cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:02:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-428bb064-8805-4f34-8f5f-82a2a5bf10b2 req-7ee8e419-357c-495d-9911-31be1e0b37ee service nova] Releasing lock "refresh_cache-3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:02:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48db53c-618c-42fc-a688-974cc75f3598/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:03 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 00:02:03 user nova-compute[75341]: DEBUG nova.objects.instance [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lazy-loading 'trusted_certs' on Instance uuid f48db53c-618c-42fc-a688-974cc75f3598 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:02:03 user nova-compute[75341]: DEBUG nova.objects.base [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Object Instance<f48db53c-618c-42fc-a688-974cc75f3598> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75341) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 00:02:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb60ccba765983a5b3e0e36eba011aaa71328a3b --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb60ccba765983a5b3e0e36eba011aaa71328a3b --force-share --output=json" returned: 0 in 0.170s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:04 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f48db53c-618c-42fc-a688-974cc75f3598/disk. size=1073741824 {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 00:02:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48db53c-618c-42fc-a688-974cc75f3598/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48db53c-618c-42fc-a688-974cc75f3598/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:04 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Cannot resize image /opt/stack/data/nova/instances/f48db53c-618c-42fc-a688-974cc75f3598/disk to a smaller size. {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 00:02:04 user nova-compute[75341]: DEBUG nova.objects.instance [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lazy-loading 'migration_context' on Instance uuid f48db53c-618c-42fc-a688-974cc75f3598 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:02:04 user nova-compute[75341]: DEBUG nova.objects.base [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Object Instance<f48db53c-618c-42fc-a688-974cc75f3598> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75341) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 00:02:04 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:59:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-89893269',display_name='tempest-TestMinimumBasicScenario-server-89893269',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-89893269',id=44,image_ref='a514ccdd-c667-4101-b446-774c8244dedb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD0eZ5MsnBvG5pKKJBm4DlYZrp8vwl0KUIoqF3rAYo2HUDLyr+TZxLNlaqGyAUDWA2dfkwjc9L12nHbBmdHRBsmT0iiatxTfrEomOcKH/IzhH6JOzKHsaGB/tcMn536jXg==',key_name='tempest-TestMinimumBasicScenario-1806050912',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:59:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='9f8c1eeb4c3c4f27b774aba29ceb7997',ramdisk_id='',reservation_id='r-t0gzgsz8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a514ccdd-c667-4101-b446-774c8244dedb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-157558920',owner_user_name='tempest-TestMinimumBasicScenario-157558920-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T00:02:01Z,user_data=None,user_id='1b1c77e1e34b46319dcd52a38996542c',uuid=f48db53c-618c-42fc-a688-974cc75f3598,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b9bfab22-02f7-4620-9bd5-f65817bc199a", "address": "fa:16:3e:10:f1:8e", "network": {"id": "e8f13b75-3423-43ce-b6dc-843c837e46d2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-617247022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8c1eeb4c3c4f27b774aba29ceb7997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9bfab22-02", "ovs_interfaceid": "b9bfab22-02f7-4620-9bd5-f65817bc199a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 00:02:04 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Converting VIF {"id": "b9bfab22-02f7-4620-9bd5-f65817bc199a", "address": "fa:16:3e:10:f1:8e", "network": {"id": "e8f13b75-3423-43ce-b6dc-843c837e46d2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-617247022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8c1eeb4c3c4f27b774aba29ceb7997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9bfab22-02", "ovs_interfaceid": "b9bfab22-02f7-4620-9bd5-f65817bc199a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 00:02:04 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:10:f1:8e,bridge_name='br-int',has_traffic_filtering=True,id=b9bfab22-02f7-4620-9bd5-f65817bc199a,network=Network(e8f13b75-3423-43ce-b6dc-843c837e46d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9bfab22-02') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 00:02:04 user nova-compute[75341]: DEBUG os_vif [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:f1:8e,bridge_name='br-int',has_traffic_filtering=True,id=b9bfab22-02f7-4620-9bd5-f65817bc199a,network=Network(e8f13b75-3423-43ce-b6dc-843c837e46d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9bfab22-02') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 00:02:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:02:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:02:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 00:02:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:02:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bc893fa2-7036-56b4-a1a9-f2cd3589bca4', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:02:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:02:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:02:04 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1c5ff436-b747-454d-8b83-a6eb60716c19 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Acquiring lock "3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:02:04 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1c5ff436-b747-454d-8b83-a6eb60716c19 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:02:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:02:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb9bfab22-02, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:02:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb9bfab22-02, col_values=(('qos', UUID('bcafa74f-5414-46cb-85d0-6f8e24a48e83')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:02:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb9bfab22-02, col_values=(('external_ids', {'iface-id': 'b9bfab22-02f7-4620-9bd5-f65817bc199a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:f1:8e', 'vm-uuid': 'f48db53c-618c-42fc-a688-974cc75f3598'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:02:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:02:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:02:04 user nova-compute[75341]: DEBUG nova.objects.instance [None req-1c5ff436-b747-454d-8b83-a6eb60716c19 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lazy-loading 'flavor' on Instance uuid 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:02:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:02:04 user nova-compute[75341]: INFO os_vif [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:f1:8e,bridge_name='br-int',has_traffic_filtering=True,id=b9bfab22-02f7-4620-9bd5-f65817bc199a,network=Network(e8f13b75-3423-43ce-b6dc-843c837e46d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9bfab22-02')
Nov 15 00:02:04 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1c5ff436-b747-454d-8b83-a6eb60716c19 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:02:04 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1c5ff436-b747-454d-8b83-a6eb60716c19 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Acquiring lock "3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:02:04 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1c5ff436-b747-454d-8b83-a6eb60716c19 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:02:04 user nova-compute[75341]: INFO nova.compute.manager [None req-1c5ff436-b747-454d-8b83-a6eb60716c19 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Attaching volume d80b2d2c-3fd7-4dd1-8775-41112be4e74c to /dev/vdb
Nov 15 00:02:04 user nova-compute[75341]: DEBUG os_brick.utils [None req-1c5ff436-b747-454d-8b83-a6eb60716c19 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 00:02:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:04 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[db274b18-5d31-4864-9954-025cae5b41f0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6d1cfca09c9\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:02:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:04 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb2c9c8-929b-44c7-ab0c-6632133261bd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:02:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:04 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcdd02d9-0259-417f-9156-6bdcfe712193]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:02:04 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5cb3cf-6e88-4b32-953b-5f202c8d95ee]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:02:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-1c5ff436-b747-454d-8b83-a6eb60716c19 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Running cmd (subprocess): nvme version {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-1c5ff436-b747-454d-8b83-a6eb60716c19 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] 'nvme version' failed. Not Retrying. {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 00:02:04 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1c5ff436-b747-454d-8b83-a6eb60716c19 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] nvme not present on system {{(pid=75341) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 00:02:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 00:02:04 user nova-compute[75341]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 00:02:04 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[335d5d47-afdb-4d0c-8858-c3592dbdc6cd]: (4, '') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:02:04 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-1c5ff436-b747-454d-8b83-a6eb60716c19 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75341) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 00:02:04 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-1c5ff436-b747-454d-8b83-a6eb60716c19 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 00:02:04 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-1c5ff436-b747-454d-8b83-a6eb60716c19 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] LIGHTOS: no hostnqn found. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 00:02:04 user nova-compute[75341]: DEBUG os_brick.utils [None req-1c5ff436-b747-454d-8b83-a6eb60716c19 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6d1cfca09c9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 00:02:04 user nova-compute[75341]: DEBUG nova.virt.block_device [None req-1c5ff436-b747-454d-8b83-a6eb60716c19 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Updating existing volume attachment record: 510e9ed2-34fa-4ceb-b2b4-0ecffd475b64 {{(pid=75341) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 00:02:04 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:02:05 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:02:05 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:02:05 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:02:05 user nova-compute[75341]: DEBUG nova.compute.manager [req-f9c0b20e-9e30-4965-87c1-6fefc6b23cf3 req-d3f5a9e4-7ccc-4f0d-8cff-7391a199e3ab service nova] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Received event network-vif-plugged-b9bfab22-02f7-4620-9bd5-f65817bc199a {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:02:05 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-f9c0b20e-9e30-4965-87c1-6fefc6b23cf3 req-d3f5a9e4-7ccc-4f0d-8cff-7391a199e3ab service nova] Acquiring lock "f48db53c-618c-42fc-a688-974cc75f3598-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:02:05 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-f9c0b20e-9e30-4965-87c1-6fefc6b23cf3 req-d3f5a9e4-7ccc-4f0d-8cff-7391a199e3ab service nova] Lock "f48db53c-618c-42fc-a688-974cc75f3598-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:02:05 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-f9c0b20e-9e30-4965-87c1-6fefc6b23cf3 req-d3f5a9e4-7ccc-4f0d-8cff-7391a199e3ab service nova] Lock "f48db53c-618c-42fc-a688-974cc75f3598-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:02:05 user nova-compute[75341]: DEBUG nova.compute.manager [req-f9c0b20e-9e30-4965-87c1-6fefc6b23cf3 req-d3f5a9e4-7ccc-4f0d-8cff-7391a199e3ab service nova] [instance: f48db53c-618c-42fc-a688-974cc75f3598] No waiting events found dispatching network-vif-plugged-b9bfab22-02f7-4620-9bd5-f65817bc199a {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:02:05 user nova-compute[75341]: WARNING nova.compute.manager [req-f9c0b20e-9e30-4965-87c1-6fefc6b23cf3 req-d3f5a9e4-7ccc-4f0d-8cff-7391a199e3ab service nova] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Received unexpected event network-vif-plugged-b9bfab22-02f7-4620-9bd5-f65817bc199a for instance with vm_state active and task_state reboot_started_hard.
Nov 15 00:02:05 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:02:05 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:02:05 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:02:05 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:02:05 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:02:05 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75341) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 00:02:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:02:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:02:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:02:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e17f39cb-4b94-454c-893a-d9f36db9e0ee tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Acquiring lock "c3524e47-34b3-4b33-a1ff-25a8e4f35d86" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:02:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e17f39cb-4b94-454c-893a-d9f36db9e0ee tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "c3524e47-34b3-4b33-a1ff-25a8e4f35d86" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:02:06 user nova-compute[75341]: DEBUG nova.compute.manager [None req-e17f39cb-4b94-454c-893a-d9f36db9e0ee tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Going to confirm migration 2 {{(pid=75341) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 15 00:02:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e17f39cb-4b94-454c-893a-d9f36db9e0ee tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Acquiring lock "refresh_cache-c3524e47-34b3-4b33-a1ff-25a8e4f35d86" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:02:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e17f39cb-4b94-454c-893a-d9f36db9e0ee tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Acquired lock "refresh_cache-c3524e47-34b3-4b33-a1ff-25a8e4f35d86" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:02:06 user nova-compute[75341]: DEBUG nova.network.neutron [None req-e17f39cb-4b94-454c-893a-d9f36db9e0ee tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 00:02:06 user nova-compute[75341]: DEBUG nova.objects.instance [None req-e17f39cb-4b94-454c-893a-d9f36db9e0ee tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lazy-loading 'info_cache' on Instance uuid c3524e47-34b3-4b33-a1ff-25a8e4f35d86 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:02:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:06 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48db53c-618c-42fc-a688-974cc75f3598/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:07 user nova-compute[75341]: DEBUG nova.network.neutron [None req-e17f39cb-4b94-454c-893a-d9f36db9e0ee tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Updating instance_info_cache with network_info: [{"id": "50f461fb-27ee-438f-880c-cde1e7441cfe", "address": "fa:16:3e:26:50:43", "network": {"id": "d86a8e7f-6658-4994-9a13-eb3163bd3865", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-635863702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c69a942b4f4b97a1a3152dea86c7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f461fb-27", "ovs_interfaceid": "50f461fb-27ee-438f-880c-cde1e7441cfe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:02:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e17f39cb-4b94-454c-893a-d9f36db9e0ee tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Releasing lock "refresh_cache-c3524e47-34b3-4b33-a1ff-25a8e4f35d86" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:02:07 user nova-compute[75341]: DEBUG nova.objects.instance [None req-e17f39cb-4b94-454c-893a-d9f36db9e0ee tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lazy-loading 'migration_context' on Instance uuid c3524e47-34b3-4b33-a1ff-25a8e4f35d86 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:02:07 user nova-compute[75341]: DEBUG nova.objects.base [None req-e17f39cb-4b94-454c-893a-d9f36db9e0ee tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Object Instance<c3524e47-34b3-4b33-a1ff-25a8e4f35d86> lazy-loaded attributes: info_cache,migration_context {{(pid=75341) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 00:02:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e17f39cb-4b94-454c-893a-d9f36db9e0ee tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:02:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e17f39cb-4b94-454c-893a-d9f36db9e0ee tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:02:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48db53c-618c-42fc-a688-974cc75f3598/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48db53c-618c-42fc-a688-974cc75f3598/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:02:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48db53c-618c-42fc-a688-974cc75f3598/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:07 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 00:02:07 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 00:02:07 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-e17f39cb-4b94-454c-893a-d9f36db9e0ee tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 00:02:07 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-e17f39cb-4b94-454c-893a-d9f36db9e0ee tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 00:02:07 user nova-compute[75341]: DEBUG nova.compute.manager [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Instance event wait completed in 0 seconds for  {{(pid=75341) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 00:02:07 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:02:07 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:02:07 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Hypervisor/Node resource view: name=user free_ram=8526MB free_disk=25.37950897216797GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75341) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 00:02:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:02:07 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Instance rebooted successfully.
Nov 15 00:02:07 user nova-compute[75341]: DEBUG nova.compute.manager [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 00:02:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e17f39cb-4b94-454c-893a-d9f36db9e0ee tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.724s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:02:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.030s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:02:07 user nova-compute[75341]: DEBUG nova.compute.manager [req-dd4466a0-b0fe-429e-ad44-7ba3dd75c371 req-2d7c39f7-4b25-4451-b037-b5fd27751558 service nova] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Received event network-vif-plugged-b9bfab22-02f7-4620-9bd5-f65817bc199a {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:02:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-dd4466a0-b0fe-429e-ad44-7ba3dd75c371 req-2d7c39f7-4b25-4451-b037-b5fd27751558 service nova] Acquiring lock "f48db53c-618c-42fc-a688-974cc75f3598-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:02:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-dd4466a0-b0fe-429e-ad44-7ba3dd75c371 req-2d7c39f7-4b25-4451-b037-b5fd27751558 service nova] Lock "f48db53c-618c-42fc-a688-974cc75f3598-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:02:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-dd4466a0-b0fe-429e-ad44-7ba3dd75c371 req-2d7c39f7-4b25-4451-b037-b5fd27751558 service nova] Lock "f48db53c-618c-42fc-a688-974cc75f3598-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:02:07 user nova-compute[75341]: DEBUG nova.compute.manager [req-dd4466a0-b0fe-429e-ad44-7ba3dd75c371 req-2d7c39f7-4b25-4451-b037-b5fd27751558 service nova] [instance: f48db53c-618c-42fc-a688-974cc75f3598] No waiting events found dispatching network-vif-plugged-b9bfab22-02f7-4620-9bd5-f65817bc199a {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:02:07 user nova-compute[75341]: WARNING nova.compute.manager [req-dd4466a0-b0fe-429e-ad44-7ba3dd75c371 req-2d7c39f7-4b25-4451-b037-b5fd27751558 service nova] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Received unexpected event network-vif-plugged-b9bfab22-02f7-4620-9bd5-f65817bc199a for instance with vm_state active and task_state reboot_started_hard.
Nov 15 00:02:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c00d6abf-835b-4ab2-b8b5-e4e84496794e tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "f48db53c-618c-42fc-a688-974cc75f3598" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.532s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:02:07 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance defae731-4191-4526-99cc-a301cf5b3355 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:02:07 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance f48db53c-618c-42fc-a688-974cc75f3598 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:02:07 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:02:07 user nova-compute[75341]: INFO nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 63f12b75-a115-43b0-adac-06779a8259e1 has allocations against this compute host but is not found in the database.
Nov 15 00:02:07 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance c3524e47-34b3-4b33-a1ff-25a8e4f35d86 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:02:07 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 00:02:07 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 00:02:07 user nova-compute[75341]: INFO nova.scheduler.client.report [None req-e17f39cb-4b94-454c-893a-d9f36db9e0ee tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Deleted allocation for migration 63f12b75-a115-43b0-adac-06779a8259e1
Nov 15 00:02:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e17f39cb-4b94-454c-893a-d9f36db9e0ee tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "c3524e47-34b3-4b33-a1ff-25a8e4f35d86" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.898s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:02:08 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 00:02:08 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 00:02:08 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Compute_service record updated for user:user {{(pid=75341) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 00:02:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.507s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:02:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:02:09 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c5ff436-b747-454d-8b83-a6eb60716c19 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Calling os-brick to attach iSCSI Volume {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 00:02:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5ff436-b747-454d-8b83-a6eb60716c19 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d80b2d2c-3fd7-4dd1-8775-41112be4e74c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lFVyQcpE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 00:02:09 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-1c5ff436-b747-454d-8b83-a6eb60716c19 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 00:02:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-1c5ff436-b747-454d-8b83-a6eb60716c19 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 00:02:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-1c5ff436-b747-454d-8b83-a6eb60716c19 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 00:02:09 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-1c5ff436-b747-454d-8b83-a6eb60716c19 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 00:02:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-1c5ff436-b747-454d-8b83-a6eb60716c19 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d80b2d2c-3fd7-4dd1-8775-41112be4e74c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 00:02:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-1c5ff436-b747-454d-8b83-a6eb60716c19 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d80b2d2c-3fd7-4dd1-8775-41112be4e74c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 00:02:09 user nova-compute[75341]: INFO os_brick.initiator.connectors.iscsi [None req-1c5ff436-b747-454d-8b83-a6eb60716c19 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 00:02:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d80b2d2c-3fd7-4dd1-8775-41112be4e74c -p 172.16.0.220:3260 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d80b2d2c-3fd7-4dd1-8775-41112be4e74c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:09 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e02b00-c56f-4ae8-b7db-9e1e3b9e4d23]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:02:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5ff436-b747-454d-8b83-a6eb60716c19 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 00:02:09 user nova-compute[75341]:  {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:02:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d80b2d2c-3fd7-4dd1-8775-41112be4e74c -p 172.16.0.220:3260 --interface default --op new {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:09 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:02:09 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:02:09 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Starting heal instance info cache {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 00:02:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d80b2d2c-3fd7-4dd1-8775-41112be4e74c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:09 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba4cba8-e858-4c5b-9d0c-1f47ba76a2dd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d80b2d2c-3fd7-4dd1-8775-41112be4e74c] added\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:02:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5ff436-b747-454d-8b83-a6eb60716c19 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d80b2d2c-3fd7-4dd1-8775-41112be4e74c] added
Nov 15 00:02:09 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:02:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d80b2d2c-3fd7-4dd1-8775-41112be4e74c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d80b2d2c-3fd7-4dd1-8775-41112be4e74c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:09 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc9232a-78a6-4a50-8fb8-99f150ddc76e]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:02:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5ff436-b747-454d-8b83-a6eb60716c19 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:02:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d80b2d2c-3fd7-4dd1-8775-41112be4e74c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d80b2d2c-3fd7-4dd1-8775-41112be4e74c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:09 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86ee108-b27d-4b6c-84f9-0958e079dcc2]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:02:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5ff436-b747-454d-8b83-a6eb60716c19 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:02:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d80b2d2c-3fd7-4dd1-8775-41112be4e74c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lFVyQcpE {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d80b2d2c-3fd7-4dd1-8775-41112be4e74c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lFVyQcpE" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:09 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1f4f69-9caf-42c7-8d72-86e882208973]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:02:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5ff436-b747-454d-8b83-a6eb60716c19 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lFVyQcpE'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:02:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d80b2d2c-3fd7-4dd1-8775-41112be4e74c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "refresh_cache-defae731-4191-4526-99cc-a301cf5b3355" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:02:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquired lock "refresh_cache-defae731-4191-4526-99cc-a301cf5b3355" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:02:09 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: defae731-4191-4526-99cc-a301cf5b3355] Forcefully refreshing network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 00:02:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d80b2d2c-3fd7-4dd1-8775-41112be4e74c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:09 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cdd7b6b-442e-4b78-870c-275a1394e3ac]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:02:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5ff436-b747-454d-8b83-a6eb60716c19 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:02:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:09 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d2a8a8-20f8-47bb-9966-b27151932eff]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:02:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5ff436-b747-454d-8b83-a6eb60716c19 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 (non-flash)
Nov 15 00:02:09 user nova-compute[75341]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed (non-flash)
Nov 15 00:02:09 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 00:02:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5ff436-b747-454d-8b83-a6eb60716c19 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 (non-flash)
Nov 15 00:02:09 user nova-compute[75341]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed (non-flash)
Nov 15 00:02:09 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 00:02:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d80b2d2c-3fd7-4dd1-8775-41112be4e74c -p 172.16.0.220:3260 --login {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d80b2d2c-3fd7-4dd1-8775-41112be4e74c -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:09 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc14c1e9-4810-4916-90d4-97d79278f38b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d80b2d2c-3fd7-4dd1-8775-41112be4e74c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d80b2d2c-3fd7-4dd1-8775-41112be4e74c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:02:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5ff436-b747-454d-8b83-a6eb60716c19 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d80b2d2c-3fd7-4dd1-8775-41112be4e74c, portal: 172.16.0.220,3260]
Nov 15 00:02:09 user nova-compute[75341]: Login to [iface: default, target: iqn.2010-10.org.openstack:d80b2d2c-3fd7-4dd1-8775-41112be4e74c, portal: 172.16.0.220,3260] successful.
Nov 15 00:02:09 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:02:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d80b2d2c-3fd7-4dd1-8775-41112be4e74c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d80b2d2c-3fd7-4dd1-8775-41112be4e74c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:09 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4001f7b-509f-4fce-9358-410ea64c249f]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:02:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5ff436-b747-454d-8b83-a6eb60716c19 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:02:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:09 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[428c9367-0738-4ab7-bc30-3c908ef00c94]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d80b2d2c-3fd7-4dd1-8775-41112be4e74c (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:02:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5ff436-b747-454d-8b83-a6eb60716c19 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 (non-flash)
Nov 15 00:02:09 user nova-compute[75341]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed (non-flash)
Nov 15 00:02:09 user nova-compute[75341]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d80b2d2c-3fd7-4dd1-8775-41112be4e74c (non-flash)
Nov 15 00:02:09 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 00:02:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5ff436-b747-454d-8b83-a6eb60716c19 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 (non-flash)
Nov 15 00:02:09 user nova-compute[75341]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed (non-flash)
Nov 15 00:02:09 user nova-compute[75341]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d80b2d2c-3fd7-4dd1-8775-41112be4e74c (non-flash)
Nov 15 00:02:09 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 00:02:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-1c5ff436-b747-454d-8b83-a6eb60716c19 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d80b2d2c-3fd7-4dd1-8775-41112be4e74c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 00:02:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5ff436-b747-454d-8b83-a6eb60716c19 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Connected to 172.16.0.220:3260 {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 00:02:09 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-1c5ff436-b747-454d-8b83-a6eb60716c19 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] HCTL ('35', '-', '-', 0) found on session 55 with lun 0 {{(pid=75341) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 00:02:09 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-1c5ff436-b747-454d-8b83-a6eb60716c19 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75341) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 00:02:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:09 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e5bef7-a1a4-4848-8a42-60e5c7ee8ae9]: (4, ('- - 0', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:02:09 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-1c5ff436-b747-454d-8b83-a6eb60716c19 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Searching for a device in session 55 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 00:02:09 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5ff436-b747-454d-8b83-a6eb60716c19 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d80b2d2c-3fd7-4dd1-8775-41112be4e74c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lFVyQcpE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 00:02:09 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: defae731-4191-4526-99cc-a301cf5b3355] Updating instance_info_cache with network_info: [{"id": "10b83231-0b39-4dee-95db-bb6a03d70fc0", "address": "fa:16:3e:b7:3a:83", "network": {"id": "d86a8e7f-6658-4994-9a13-eb3163bd3865", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-635863702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c69a942b4f4b97a1a3152dea86c7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10b83231-0b", "ovs_interfaceid": "10b83231-0b39-4dee-95db-bb6a03d70fc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:02:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Releasing lock "refresh_cache-defae731-4191-4526-99cc-a301cf5b3355" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:02:09 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: defae731-4191-4526-99cc-a301cf5b3355] Updated the network info_cache for instance {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 00:02:09 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:02:10 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-1c5ff436-b747-454d-8b83-a6eb60716c19 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 00:02:10 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5ff436-b747-454d-8b83-a6eb60716c19 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23962653963646163', 'path': '/dev/sdd'} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 00:02:10 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c5ff436-b747-454d-8b83-a6eb60716c19 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962653963646163', 'path': '/dev/sdd'} {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 00:02:10 user nova-compute[75341]: DEBUG nova.objects.instance [None req-1c5ff436-b747-454d-8b83-a6eb60716c19 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lazy-loading 'flavor' on Instance uuid 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:02:10 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-1c5ff436-b747-454d-8b83-a6eb60716c19 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 00:02:10 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 00:02:10 user nova-compute[75341]:   <source dev="/dev/sdd"/>
Nov 15 00:02:10 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 15 00:02:10 user nova-compute[75341]:   <serial>d80b2d2c-3fd7-4dd1-8775-41112be4e74c</serial>
Nov 15 00:02:10 user nova-compute[75341]: </disk>
Nov 15 00:02:10 user nova-compute[75341]:  {{(pid=75341) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 00:02:11 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-1c5ff436-b747-454d-8b83-a6eb60716c19 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 00:02:11 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-1c5ff436-b747-454d-8b83-a6eb60716c19 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 00:02:11 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-1c5ff436-b747-454d-8b83-a6eb60716c19 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] No VIF found with MAC fa:16:3e:0c:1d:ea, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 00:02:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-1c5ff436-b747-454d-8b83-a6eb60716c19 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.756s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:02:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:02:13 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:02:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f8621340-6a9c-4f70-abe9-29f2b706c052 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Acquiring lock "3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:02:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f8621340-6a9c-4f70-abe9-29f2b706c052 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:02:13 user nova-compute[75341]: DEBUG nova.objects.instance [None req-f8621340-6a9c-4f70-abe9-29f2b706c052 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lazy-loading 'flavor' on Instance uuid 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:02:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f8621340-6a9c-4f70-abe9-29f2b706c052 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:02:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f8621340-6a9c-4f70-abe9-29f2b706c052 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Acquiring lock "3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:02:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f8621340-6a9c-4f70-abe9-29f2b706c052 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:02:13 user nova-compute[75341]: INFO nova.compute.manager [None req-f8621340-6a9c-4f70-abe9-29f2b706c052 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Attaching volume 19fac4c0-979b-44af-b1a2-e7755516889e to /dev/vdc
Nov 15 00:02:13 user nova-compute[75341]: DEBUG os_brick.utils [None req-f8621340-6a9c-4f70-abe9-29f2b706c052 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 00:02:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:13 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d04813b-daef-4beb-8b2f-f50852331dbd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6d1cfca09c9\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:02:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:13 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[744d25bc-989e-4337-b29d-62347eaea512]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:02:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:13 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca3742c0-d0f1-45bd-ba58-eb0b10633a68]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:02:13 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[90afed01-4722-4e11-9bf4-332f54d56d34]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:02:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-f8621340-6a9c-4f70-abe9-29f2b706c052 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Running cmd (subprocess): nvme version {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:14 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-f8621340-6a9c-4f70-abe9-29f2b706c052 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] 'nvme version' failed. Not Retrying. {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 00:02:14 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f8621340-6a9c-4f70-abe9-29f2b706c052 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] nvme not present on system {{(pid=75341) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 00:02:14 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:14 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 00:02:14 user nova-compute[75341]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 00:02:14 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc917a9a-0ad2-48ee-a83a-155981f3c71b]: (4, '') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:02:14 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-f8621340-6a9c-4f70-abe9-29f2b706c052 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75341) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 00:02:14 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-f8621340-6a9c-4f70-abe9-29f2b706c052 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 00:02:14 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-f8621340-6a9c-4f70-abe9-29f2b706c052 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] LIGHTOS: no hostnqn found. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 00:02:14 user nova-compute[75341]: DEBUG os_brick.utils [None req-f8621340-6a9c-4f70-abe9-29f2b706c052 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6d1cfca09c9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 00:02:14 user nova-compute[75341]: DEBUG nova.virt.block_device [None req-f8621340-6a9c-4f70-abe9-29f2b706c052 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Updating existing volume attachment record: 83804500-08d3-4e64-915c-13bbb2e0c5a1 {{(pid=75341) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 00:02:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:02:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:02:18 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8621340-6a9c-4f70-abe9-29f2b706c052 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Calling os-brick to attach iSCSI Volume {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 00:02:18 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8621340-6a9c-4f70-abe9-29f2b706c052 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:19fac4c0-979b-44af-b1a2-e7755516889e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AxnWDGjO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 00:02:18 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-f8621340-6a9c-4f70-abe9-29f2b706c052 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 00:02:18 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-f8621340-6a9c-4f70-abe9-29f2b706c052 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 00:02:18 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-f8621340-6a9c-4f70-abe9-29f2b706c052 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 00:02:18 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-f8621340-6a9c-4f70-abe9-29f2b706c052 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 00:02:18 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-f8621340-6a9c-4f70-abe9-29f2b706c052 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19fac4c0-979b-44af-b1a2-e7755516889e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 00:02:18 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-f8621340-6a9c-4f70-abe9-29f2b706c052 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19fac4c0-979b-44af-b1a2-e7755516889e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 00:02:18 user nova-compute[75341]: INFO os_brick.initiator.connectors.iscsi [None req-f8621340-6a9c-4f70-abe9-29f2b706c052 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 00:02:18 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19fac4c0-979b-44af-b1a2-e7755516889e -p 172.16.0.220:3260 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:18 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19fac4c0-979b-44af-b1a2-e7755516889e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:18 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e66963f-2066-4a8c-b4f3-77c5576979f1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:02:18 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8621340-6a9c-4f70-abe9-29f2b706c052 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 00:02:18 user nova-compute[75341]:  {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:02:18 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19fac4c0-979b-44af-b1a2-e7755516889e -p 172.16.0.220:3260 --interface default --op new {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:18 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19fac4c0-979b-44af-b1a2-e7755516889e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:18 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f9bb70-d0a6-470c-8010-bc31bee90f91]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19fac4c0-979b-44af-b1a2-e7755516889e] added\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:02:18 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8621340-6a9c-4f70-abe9-29f2b706c052 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19fac4c0-979b-44af-b1a2-e7755516889e] added
Nov 15 00:02:18 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:02:18 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19fac4c0-979b-44af-b1a2-e7755516889e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:18 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19fac4c0-979b-44af-b1a2-e7755516889e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:18 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[98cb3219-52ab-46e6-9315-faa7b026d536]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:02:18 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8621340-6a9c-4f70-abe9-29f2b706c052 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:02:18 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19fac4c0-979b-44af-b1a2-e7755516889e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:18 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19fac4c0-979b-44af-b1a2-e7755516889e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:18 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[a69ae8d6-6f3a-488a-b923-572c8f91dce1]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:02:18 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8621340-6a9c-4f70-abe9-29f2b706c052 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:02:18 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19fac4c0-979b-44af-b1a2-e7755516889e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AxnWDGjO {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:18 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19fac4c0-979b-44af-b1a2-e7755516889e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AxnWDGjO" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:18 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d07eea-97ef-42a4-bb26-60a6fc24de9e]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:02:18 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8621340-6a9c-4f70-abe9-29f2b706c052 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AxnWDGjO'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:02:18 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19fac4c0-979b-44af-b1a2-e7755516889e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:18 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19fac4c0-979b-44af-b1a2-e7755516889e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:18 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db6579a-eeb3-483e-a767-65257f799424]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:02:18 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8621340-6a9c-4f70-abe9-29f2b706c052 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:02:18 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:18 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:18 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc2003a-4332-433c-9126-567d4aa1265d]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d80b2d2c-3fd7-4dd1-8775-41112be4e74c (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:02:18 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8621340-6a9c-4f70-abe9-29f2b706c052 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 (non-flash)
Nov 15 00:02:18 user nova-compute[75341]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed (non-flash)
Nov 15 00:02:18 user nova-compute[75341]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d80b2d2c-3fd7-4dd1-8775-41112be4e74c (non-flash)
Nov 15 00:02:18 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 00:02:18 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8621340-6a9c-4f70-abe9-29f2b706c052 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 (non-flash)
Nov 15 00:02:18 user nova-compute[75341]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed (non-flash)
Nov 15 00:02:18 user nova-compute[75341]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d80b2d2c-3fd7-4dd1-8775-41112be4e74c (non-flash)
Nov 15 00:02:18 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 00:02:18 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19fac4c0-979b-44af-b1a2-e7755516889e -p 172.16.0.220:3260 --login {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:19 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19fac4c0-979b-44af-b1a2-e7755516889e -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:19 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[92205808-558d-4f11-9384-1047d718ba41]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:19fac4c0-979b-44af-b1a2-e7755516889e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:19fac4c0-979b-44af-b1a2-e7755516889e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:02:19 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8621340-6a9c-4f70-abe9-29f2b706c052 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:19fac4c0-979b-44af-b1a2-e7755516889e, portal: 172.16.0.220,3260]
Nov 15 00:02:19 user nova-compute[75341]: Login to [iface: default, target: iqn.2010-10.org.openstack:19fac4c0-979b-44af-b1a2-e7755516889e, portal: 172.16.0.220,3260] successful.
Nov 15 00:02:19 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:02:19 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19fac4c0-979b-44af-b1a2-e7755516889e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:19 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19fac4c0-979b-44af-b1a2-e7755516889e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:19 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50708b9-8316-4b4d-88ef-b8c6e47d0a0b]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:02:19 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8621340-6a9c-4f70-abe9-29f2b706c052 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:02:19 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:19 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:19 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a385d9-d194-42c2-a083-a7d8ce11434d]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d80b2d2c-3fd7-4dd1-8775-41112be4e74c (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19fac4c0-979b-44af-b1a2-e7755516889e (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:02:19 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8621340-6a9c-4f70-abe9-29f2b706c052 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 (non-flash)
Nov 15 00:02:19 user nova-compute[75341]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed (non-flash)
Nov 15 00:02:19 user nova-compute[75341]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d80b2d2c-3fd7-4dd1-8775-41112be4e74c (non-flash)
Nov 15 00:02:19 user nova-compute[75341]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19fac4c0-979b-44af-b1a2-e7755516889e (non-flash)
Nov 15 00:02:19 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 00:02:19 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8621340-6a9c-4f70-abe9-29f2b706c052 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 (non-flash)
Nov 15 00:02:19 user nova-compute[75341]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed (non-flash)
Nov 15 00:02:19 user nova-compute[75341]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d80b2d2c-3fd7-4dd1-8775-41112be4e74c (non-flash)
Nov 15 00:02:19 user nova-compute[75341]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19fac4c0-979b-44af-b1a2-e7755516889e (non-flash)
Nov 15 00:02:19 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 00:02:19 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-f8621340-6a9c-4f70-abe9-29f2b706c052 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19fac4c0-979b-44af-b1a2-e7755516889e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 00:02:19 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8621340-6a9c-4f70-abe9-29f2b706c052 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Connected to 172.16.0.220:3260 {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 00:02:19 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-f8621340-6a9c-4f70-abe9-29f2b706c052 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] HCTL ('36', '-', '-', 0) found on session 56 with lun 0 {{(pid=75341) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 00:02:19 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-f8621340-6a9c-4f70-abe9-29f2b706c052 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75341) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 00:02:19 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:19 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.025s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:19 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[b635dea8-abe3-4914-9bac-c1f856ae88ed]: (4, ('- - 0', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:02:19 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-f8621340-6a9c-4f70-abe9-29f2b706c052 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Searching for a device in session 56 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 00:02:19 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8621340-6a9c-4f70-abe9-29f2b706c052 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:19fac4c0-979b-44af-b1a2-e7755516889e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AxnWDGjO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 00:02:19 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:02:20 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-f8621340-6a9c-4f70-abe9-29f2b706c052 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 00:02:20 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8621340-6a9c-4f70-abe9-29f2b706c052 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '23539643536313164', 'path': '/dev/sde'} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 00:02:20 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8621340-6a9c-4f70-abe9-29f2b706c052 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23539643536313164', 'path': '/dev/sde'} {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 00:02:20 user nova-compute[75341]: DEBUG nova.objects.instance [None req-f8621340-6a9c-4f70-abe9-29f2b706c052 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lazy-loading 'flavor' on Instance uuid 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:02:20 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-f8621340-6a9c-4f70-abe9-29f2b706c052 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 00:02:20 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 00:02:20 user nova-compute[75341]:   <source dev="/dev/sde"/>
Nov 15 00:02:20 user nova-compute[75341]:   <target dev="vdc" bus="virtio"/>
Nov 15 00:02:20 user nova-compute[75341]:   <serial>19fac4c0-979b-44af-b1a2-e7755516889e</serial>
Nov 15 00:02:20 user nova-compute[75341]: </disk>
Nov 15 00:02:20 user nova-compute[75341]:  {{(pid=75341) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 00:02:20 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-f8621340-6a9c-4f70-abe9-29f2b706c052 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 00:02:20 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-f8621340-6a9c-4f70-abe9-29f2b706c052 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 00:02:20 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-f8621340-6a9c-4f70-abe9-29f2b706c052 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 00:02:20 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-f8621340-6a9c-4f70-abe9-29f2b706c052 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] No VIF found with MAC fa:16:3e:0c:1d:ea, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 00:02:20 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f8621340-6a9c-4f70-abe9-29f2b706c052 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.879s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:02:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ce667460-7e0d-4f5f-90ba-b2bd5304bfe5 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Acquiring lock "3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:02:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ce667460-7e0d-4f5f-90ba-b2bd5304bfe5 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:02:21 user nova-compute[75341]: INFO nova.compute.manager [None req-ce667460-7e0d-4f5f-90ba-b2bd5304bfe5 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Detaching volume d80b2d2c-3fd7-4dd1-8775-41112be4e74c
Nov 15 00:02:21 user nova-compute[75341]: INFO nova.virt.block_device [None req-ce667460-7e0d-4f5f-90ba-b2bd5304bfe5 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Attempting to driver detach volume d80b2d2c-3fd7-4dd1-8775-41112be4e74c from mountpoint /dev/vdb
Nov 15 00:02:21 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-ce667460-7e0d-4f5f-90ba-b2bd5304bfe5 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Attempting to detach device vdb from instance 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0 from the persistent domain config. {{(pid=75341) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 00:02:21 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-ce667460-7e0d-4f5f-90ba-b2bd5304bfe5 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 00:02:21 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 00:02:21 user nova-compute[75341]:   <source dev="/dev/sdd"/>
Nov 15 00:02:21 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 15 00:02:21 user nova-compute[75341]:   <serial>d80b2d2c-3fd7-4dd1-8775-41112be4e74c</serial>
Nov 15 00:02:21 user nova-compute[75341]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 00:02:21 user nova-compute[75341]: </disk>
Nov 15 00:02:21 user nova-compute[75341]:  {{(pid=75341) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 00:02:21 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-ce667460-7e0d-4f5f-90ba-b2bd5304bfe5 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Successfully detached device vdb from instance 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0 from the persistent domain config.
Nov 15 00:02:21 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-ce667460-7e0d-4f5f-90ba-b2bd5304bfe5 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0 from the live domain config. {{(pid=75341) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 00:02:21 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-ce667460-7e0d-4f5f-90ba-b2bd5304bfe5 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 00:02:21 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 00:02:21 user nova-compute[75341]:   <source dev="/dev/sdd"/>
Nov 15 00:02:21 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 15 00:02:21 user nova-compute[75341]:   <serial>d80b2d2c-3fd7-4dd1-8775-41112be4e74c</serial>
Nov 15 00:02:21 user nova-compute[75341]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 00:02:21 user nova-compute[75341]: </disk>
Nov 15 00:02:21 user nova-compute[75341]:  {{(pid=75341) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 00:02:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:02:22 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-ce667460-7e0d-4f5f-90ba-b2bd5304bfe5 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0 {{(pid=75341) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 00:02:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:02:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:02:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:02:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:02:33 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:02:34 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:02:36 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:02:37 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:02:39 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:02:42 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-ce667460-7e0d-4f5f-90ba-b2bd5304bfe5 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0 is timed out.
Nov 15 00:02:42 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-ce667460-7e0d-4f5f-90ba-b2bd5304bfe5 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Successfully detached device vdb from instance 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0 from the live domain config.
Nov 15 00:02:42 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce667460-7e0d-4f5f-90ba-b2bd5304bfe5 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] calling os-brick to detach iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 00:02:42 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce667460-7e0d-4f5f-90ba-b2bd5304bfe5 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, {'target_iqn': 'iqn.2010-10.org.openstack:d80b2d2c-3fd7-4dd1-8775-41112be4e74c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lFVyQcpE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 00:02:42 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-ce667460-7e0d-4f5f-90ba-b2bd5304bfe5 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 00:02:42 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-ce667460-7e0d-4f5f-90ba-b2bd5304bfe5 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 00:02:42 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-ce667460-7e0d-4f5f-90ba-b2bd5304bfe5 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 00:02:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:42 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc3bceb-3903-44ac-98a7-fbec9d20047e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:19fac4c0-979b-44af-b1a2-e7755516889e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d80b2d2c-3fd7-4dd1-8775-41112be4e74c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:02:42 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce667460-7e0d-4f5f-90ba-b2bd5304bfe5 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 00:02:42 user nova-compute[75341]: No targets found.
Nov 15 00:02:42 user nova-compute[75341]: iSNS:
Nov 15 00:02:42 user nova-compute[75341]: No targets found.
Nov 15 00:02:42 user nova-compute[75341]: STATIC:
Nov 15 00:02:42 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:19fac4c0-979b-44af-b1a2-e7755516889e
Nov 15 00:02:42 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 15 00:02:42 user nova-compute[75341]:                 Iface Name: default
Nov 15 00:02:42 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed
Nov 15 00:02:42 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 15 00:02:42 user nova-compute[75341]:                 Iface Name: default
Nov 15 00:02:42 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123
Nov 15 00:02:42 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 15 00:02:42 user nova-compute[75341]:                 Iface Name: default
Nov 15 00:02:42 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:d80b2d2c-3fd7-4dd1-8775-41112be4e74c
Nov 15 00:02:42 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 15 00:02:42 user nova-compute[75341]:                 Iface Name: default
Nov 15 00:02:42 user nova-compute[75341]: FIRMWARE:
Nov 15 00:02:42 user nova-compute[75341]: No targets found.
Nov 15 00:02:42 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 00:02:42 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce667460-7e0d-4f5f-90ba-b2bd5304bfe5 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 00:02:42 user nova-compute[75341]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 00:02:42 user nova-compute[75341]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75341) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 00:02:42 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce667460-7e0d-4f5f-90ba-b2bd5304bfe5 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d80b2d2c-3fd7-4dd1-8775-41112be4e74c', 0)] {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 00:02:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:42 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[871ea21b-326c-4532-a62d-38cfd85d8fa0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19fac4c0-979b-44af-b1a2-e7755516889e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d80b2d2c-3fd7-4dd1-8775-41112be4e74c\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:02:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:42 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3c13ad-21a4-4f05-9039-a35f7d46dd6b]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d80b2d2c-3fd7-4dd1-8775-41112be4e74c (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19fac4c0-979b-44af-b1a2-e7755516889e (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:02:42 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce667460-7e0d-4f5f-90ba-b2bd5304bfe5 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 (non-flash)
Nov 15 00:02:42 user nova-compute[75341]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed (non-flash)
Nov 15 00:02:42 user nova-compute[75341]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d80b2d2c-3fd7-4dd1-8775-41112be4e74c (non-flash)
Nov 15 00:02:42 user nova-compute[75341]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19fac4c0-979b-44af-b1a2-e7755516889e (non-flash)
Nov 15 00:02:42 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 00:02:42 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce667460-7e0d-4f5f-90ba-b2bd5304bfe5 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 (non-flash)
Nov 15 00:02:42 user nova-compute[75341]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed (non-flash)
Nov 15 00:02:42 user nova-compute[75341]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d80b2d2c-3fd7-4dd1-8775-41112be4e74c (non-flash)
Nov 15 00:02:42 user nova-compute[75341]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19fac4c0-979b-44af-b1a2-e7755516889e (non-flash)
Nov 15 00:02:42 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 00:02:42 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce667460-7e0d-4f5f-90ba-b2bd5304bfe5 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1850569fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d80b2d2c-3fd7-4dd1-8775-41112be4e74c'): ({'sdd'}, set())}) {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 00:02:42 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-ce667460-7e0d-4f5f-90ba-b2bd5304bfe5 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Removing single pathed devices sdd {{(pid=75341) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 00:02:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:42 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[979f0ec6-8429-4d66-84c7-1785c15728d4]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:02:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:42 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[e513e225-4935-419d-bfed-1768b5554a54]: (4, ('ok\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:02:42 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-ce667460-7e0d-4f5f-90ba-b2bd5304bfe5 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Flushing IO for device /dev/sdd {{(pid=75341) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 00:02:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:42 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[86eec651-aa70-43f6-8eae-bd569a9088f6]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:02:42 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-ce667460-7e0d-4f5f-90ba-b2bd5304bfe5 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75341) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 00:02:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:42 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e64a40-cee8-4c2f-84c3-04c0ee70613b]: (4, ('1', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:02:42 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-ce667460-7e0d-4f5f-90ba-b2bd5304bfe5 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 00:02:42 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-ce667460-7e0d-4f5f-90ba-b2bd5304bfe5 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] SCSI volumes sdd have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 00:02:42 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce667460-7e0d-4f5f-90ba-b2bd5304bfe5 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d80b2d2c-3fd7-4dd1-8775-41112be4e74c')] {{(pid=75341) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 00:02:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d80b2d2c-3fd7-4dd1-8775-41112be4e74c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d80b2d2c-3fd7-4dd1-8775-41112be4e74c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:42 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[91422ee8-c1b3-49f3-9949-9b488c5b18aa]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:02:42 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce667460-7e0d-4f5f-90ba-b2bd5304bfe5 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:02:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d80b2d2c-3fd7-4dd1-8775-41112be4e74c -p 172.16.0.220:3260 --logout {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d80b2d2c-3fd7-4dd1-8775-41112be4e74c -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:42 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bea8ab9-235f-47dc-949c-369a91c9126c]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:d80b2d2c-3fd7-4dd1-8775-41112be4e74c, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:d80b2d2c-3fd7-4dd1-8775-41112be4e74c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:02:42 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce667460-7e0d-4f5f-90ba-b2bd5304bfe5 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:d80b2d2c-3fd7-4dd1-8775-41112be4e74c, portal: 172.16.0.220,3260]
Nov 15 00:02:42 user nova-compute[75341]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:d80b2d2c-3fd7-4dd1-8775-41112be4e74c, portal: 172.16.0.220,3260] successful.
Nov 15 00:02:42 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:02:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d80b2d2c-3fd7-4dd1-8775-41112be4e74c -p 172.16.0.220:3260 --op delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:02:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d80b2d2c-3fd7-4dd1-8775-41112be4e74c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:02:42 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9b735e-aa9b-4687-8d4c-9f01c886b973]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:02:42 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce667460-7e0d-4f5f-90ba-b2bd5304bfe5 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:02:42 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-ce667460-7e0d-4f5f-90ba-b2bd5304bfe5 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 00:02:42 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce667460-7e0d-4f5f-90ba-b2bd5304bfe5 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] <== disconnect_volume: return (327ms) None {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 00:02:42 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce667460-7e0d-4f5f-90ba-b2bd5304bfe5 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Disconnected iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 00:02:43 user nova-compute[75341]: DEBUG nova.objects.instance [None req-ce667460-7e0d-4f5f-90ba-b2bd5304bfe5 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lazy-loading 'flavor' on Instance uuid 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:02:43 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ce667460-7e0d-4f5f-90ba-b2bd5304bfe5 tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.665s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:02:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:02:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:02:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:02:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:02:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:02:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:02:44 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d952609b-fa28-4427-9659-d545c062e23e tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Acquiring lock "3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:02:44 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d952609b-fa28-4427-9659-d545c062e23e tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:02:44 user nova-compute[75341]: INFO nova.compute.manager [None req-d952609b-fa28-4427-9659-d545c062e23e tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Detaching volume 19fac4c0-979b-44af-b1a2-e7755516889e
Nov 15 00:02:44 user nova-compute[75341]: INFO nova.virt.block_device [None req-d952609b-fa28-4427-9659-d545c062e23e tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Attempting to driver detach volume 19fac4c0-979b-44af-b1a2-e7755516889e from mountpoint /dev/vdc
Nov 15 00:02:44 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d952609b-fa28-4427-9659-d545c062e23e tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Attempting to detach device vdc from instance 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0 from the persistent domain config. {{(pid=75341) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 00:02:44 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-d952609b-fa28-4427-9659-d545c062e23e tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 00:02:44 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 00:02:44 user nova-compute[75341]:   <source dev="/dev/sde"/>
Nov 15 00:02:44 user nova-compute[75341]:   <target dev="vdc" bus="virtio"/>
Nov 15 00:02:44 user nova-compute[75341]:   <serial>19fac4c0-979b-44af-b1a2-e7755516889e</serial>
Nov 15 00:02:44 user nova-compute[75341]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 00:02:44 user nova-compute[75341]: </disk>
Nov 15 00:02:44 user nova-compute[75341]:  {{(pid=75341) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 00:02:44 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-d952609b-fa28-4427-9659-d545c062e23e tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Successfully detached device vdc from instance 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0 from the persistent domain config.
Nov 15 00:02:44 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d952609b-fa28-4427-9659-d545c062e23e tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0 from the live domain config. {{(pid=75341) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 00:02:44 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-d952609b-fa28-4427-9659-d545c062e23e tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 00:02:44 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 00:02:44 user nova-compute[75341]:   <source dev="/dev/sde"/>
Nov 15 00:02:44 user nova-compute[75341]:   <target dev="vdc" bus="virtio"/>
Nov 15 00:02:44 user nova-compute[75341]:   <serial>19fac4c0-979b-44af-b1a2-e7755516889e</serial>
Nov 15 00:02:44 user nova-compute[75341]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 00:02:44 user nova-compute[75341]: </disk>
Nov 15 00:02:44 user nova-compute[75341]:  {{(pid=75341) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 00:02:44 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d952609b-fa28-4427-9659-d545c062e23e tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0 {{(pid=75341) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 00:02:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:02:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:02:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:02:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:02:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:02:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:02:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:02:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:02:58 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:02:59 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:03:03 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:03:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:03:04 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:03:04 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75341) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 00:03:04 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-d952609b-fa28-4427-9659-d545c062e23e tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0 is timed out.
Nov 15 00:03:04 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-d952609b-fa28-4427-9659-d545c062e23e tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Successfully detached device vdc from instance 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0 from the live domain config.
Nov 15 00:03:04 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d952609b-fa28-4427-9659-d545c062e23e tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] calling os-brick to detach iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 00:03:04 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-d952609b-fa28-4427-9659-d545c062e23e tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, {'target_iqn': 'iqn.2010-10.org.openstack:19fac4c0-979b-44af-b1a2-e7755516889e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AxnWDGjO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 00:03:04 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-d952609b-fa28-4427-9659-d545c062e23e tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 00:03:04 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-d952609b-fa28-4427-9659-d545c062e23e tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 00:03:04 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-d952609b-fa28-4427-9659-d545c062e23e tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 00:03:04 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:03:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:03:05 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a773c7-e53c-426b-8c62-b1e4a0bed257]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:19fac4c0-979b-44af-b1a2-e7755516889e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:03:05 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-d952609b-fa28-4427-9659-d545c062e23e tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 00:03:05 user nova-compute[75341]: No targets found.
Nov 15 00:03:05 user nova-compute[75341]: iSNS:
Nov 15 00:03:05 user nova-compute[75341]: No targets found.
Nov 15 00:03:05 user nova-compute[75341]: STATIC:
Nov 15 00:03:05 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:19fac4c0-979b-44af-b1a2-e7755516889e
Nov 15 00:03:05 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 15 00:03:05 user nova-compute[75341]:                 Iface Name: default
Nov 15 00:03:05 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed
Nov 15 00:03:05 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 15 00:03:05 user nova-compute[75341]:                 Iface Name: default
Nov 15 00:03:05 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123
Nov 15 00:03:05 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 15 00:03:05 user nova-compute[75341]:                 Iface Name: default
Nov 15 00:03:05 user nova-compute[75341]: FIRMWARE:
Nov 15 00:03:05 user nova-compute[75341]: No targets found.
Nov 15 00:03:05 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 00:03:05 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-d952609b-fa28-4427-9659-d545c062e23e tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 00:03:05 user nova-compute[75341]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 00:03:05 user nova-compute[75341]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75341) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 00:03:05 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-d952609b-fa28-4427-9659-d545c062e23e tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19fac4c0-979b-44af-b1a2-e7755516889e', 0)] {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 00:03:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:03:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:03:05 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c147b52-06a9-4a78-9106-648813e3004b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19fac4c0-979b-44af-b1a2-e7755516889e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:03:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:03:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:03:05 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db05606-849d-4381-b64a-3a6f21813c08]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19fac4c0-979b-44af-b1a2-e7755516889e (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:03:05 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-d952609b-fa28-4427-9659-d545c062e23e tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 (non-flash)
Nov 15 00:03:05 user nova-compute[75341]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed (non-flash)
Nov 15 00:03:05 user nova-compute[75341]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19fac4c0-979b-44af-b1a2-e7755516889e (non-flash)
Nov 15 00:03:05 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 00:03:05 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-d952609b-fa28-4427-9659-d545c062e23e tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 (non-flash)
Nov 15 00:03:05 user nova-compute[75341]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed (non-flash)
Nov 15 00:03:05 user nova-compute[75341]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19fac4c0-979b-44af-b1a2-e7755516889e (non-flash)
Nov 15 00:03:05 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 00:03:05 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-d952609b-fa28-4427-9659-d545c062e23e tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18902fd750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19fac4c0-979b-44af-b1a2-e7755516889e'): ({'sde'}, set())}) {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 00:03:05 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-d952609b-fa28-4427-9659-d545c062e23e tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Removing single pathed devices sde {{(pid=75341) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 00:03:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:03:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:03:05 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[858d34f4-a15d-4b3e-b232-0e91d874faef]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:03:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:03:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:03:05 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b04ac7-7a41-4646-997a-cc442724d664]: (4, ('ok\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:03:05 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-d952609b-fa28-4427-9659-d545c062e23e tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Flushing IO for device /dev/sde {{(pid=75341) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 00:03:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:03:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:03:05 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d62cad-f434-4de3-be28-31beab87045e]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:03:05 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-d952609b-fa28-4427-9659-d545c062e23e tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75341) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 00:03:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:03:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.052s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:03:05 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea1ae68-fbd4-42a8-96f6-423352696b33]: (4, ('1', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:03:05 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-d952609b-fa28-4427-9659-d545c062e23e tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 00:03:05 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-d952609b-fa28-4427-9659-d545c062e23e tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] SCSI volumes sde have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 00:03:05 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-d952609b-fa28-4427-9659-d545c062e23e tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19fac4c0-979b-44af-b1a2-e7755516889e')] {{(pid=75341) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 00:03:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19fac4c0-979b-44af-b1a2-e7755516889e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:03:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19fac4c0-979b-44af-b1a2-e7755516889e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:03:05 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[f038abc4-ebcd-4c9d-9b9b-ec82394fa531]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:03:05 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-d952609b-fa28-4427-9659-d545c062e23e tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:03:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19fac4c0-979b-44af-b1a2-e7755516889e -p 172.16.0.220:3260 --logout {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:03:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19fac4c0-979b-44af-b1a2-e7755516889e -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:03:05 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc719035-ac8b-4827-802a-bc325407beee]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:19fac4c0-979b-44af-b1a2-e7755516889e, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:19fac4c0-979b-44af-b1a2-e7755516889e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:03:05 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-d952609b-fa28-4427-9659-d545c062e23e tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:19fac4c0-979b-44af-b1a2-e7755516889e, portal: 172.16.0.220,3260]
Nov 15 00:03:05 user nova-compute[75341]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:19fac4c0-979b-44af-b1a2-e7755516889e, portal: 172.16.0.220,3260] successful.
Nov 15 00:03:05 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:03:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19fac4c0-979b-44af-b1a2-e7755516889e -p 172.16.0.220:3260 --op delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:03:05 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19fac4c0-979b-44af-b1a2-e7755516889e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:03:05 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[01bb6148-f849-46f1-b4a6-d7b04e3bc7a1]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:03:05 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-d952609b-fa28-4427-9659-d545c062e23e tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:03:05 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-d952609b-fa28-4427-9659-d545c062e23e tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 00:03:05 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-d952609b-fa28-4427-9659-d545c062e23e tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] <== disconnect_volume: return (309ms) None {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 00:03:05 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d952609b-fa28-4427-9659-d545c062e23e tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Disconnected iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 00:03:05 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:03:06 user nova-compute[75341]: DEBUG nova.objects.instance [None req-d952609b-fa28-4427-9659-d545c062e23e tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lazy-loading 'flavor' on Instance uuid 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:03:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d952609b-fa28-4427-9659-d545c062e23e tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.652s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:03:06 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:03:06 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:03:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:03:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:03:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:03:06 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75341) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 00:03:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:03:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:03:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:03:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c502a4ae-ea3f-4620-8167-254ddb2dd67d tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Acquiring lock "3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:03:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c502a4ae-ea3f-4620-8167-254ddb2dd67d tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:03:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c502a4ae-ea3f-4620-8167-254ddb2dd67d tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Acquiring lock "3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:03:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c502a4ae-ea3f-4620-8167-254ddb2dd67d tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:03:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c502a4ae-ea3f-4620-8167-254ddb2dd67d tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:03:07 user nova-compute[75341]: INFO nova.compute.manager [None req-c502a4ae-ea3f-4620-8167-254ddb2dd67d tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Terminating instance
Nov 15 00:03:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:03:07 user nova-compute[75341]: DEBUG nova.compute.manager [None req-c502a4ae-ea3f-4620-8167-254ddb2dd67d tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Start destroying the instance on the hypervisor. {{(pid=75341) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 00:03:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:03:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:03:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:03:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:03:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:03:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:03:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:03:07 user nova-compute[75341]: DEBUG nova.compute.manager [req-b50e2229-fa73-4822-9c14-e8f3fc62ce03 req-8e45be64-9a76-4659-958c-c021bc03b68a service nova] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Received event network-vif-unplugged-f337ac0b-ba3c-4517-a743-5c489e2798cd {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:03:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-b50e2229-fa73-4822-9c14-e8f3fc62ce03 req-8e45be64-9a76-4659-958c-c021bc03b68a service nova] Acquiring lock "3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:03:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-b50e2229-fa73-4822-9c14-e8f3fc62ce03 req-8e45be64-9a76-4659-958c-c021bc03b68a service nova] Lock "3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:03:07 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-b50e2229-fa73-4822-9c14-e8f3fc62ce03 req-8e45be64-9a76-4659-958c-c021bc03b68a service nova] Lock "3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:03:07 user nova-compute[75341]: DEBUG nova.compute.manager [req-b50e2229-fa73-4822-9c14-e8f3fc62ce03 req-8e45be64-9a76-4659-958c-c021bc03b68a service nova] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] No waiting events found dispatching network-vif-unplugged-f337ac0b-ba3c-4517-a743-5c489e2798cd {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:03:07 user nova-compute[75341]: DEBUG nova.compute.manager [req-b50e2229-fa73-4822-9c14-e8f3fc62ce03 req-8e45be64-9a76-4659-958c-c021bc03b68a service nova] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Received event network-vif-unplugged-f337ac0b-ba3c-4517-a743-5c489e2798cd for instance with task_state deleting. {{(pid=75341) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 00:03:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:03:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48db53c-618c-42fc-a688-974cc75f3598/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:03:08 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48db53c-618c-42fc-a688-974cc75f3598/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:03:08 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48db53c-618c-42fc-a688-974cc75f3598/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:03:08 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48db53c-618c-42fc-a688-974cc75f3598/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:03:08 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 00:03:08 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Instance destroyed successfully.
Nov 15 00:03:08 user nova-compute[75341]: DEBUG nova.objects.instance [None req-c502a4ae-ea3f-4620-8167-254ddb2dd67d tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lazy-loading 'resources' on Instance uuid 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:03:08 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 00:03:08 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-c502a4ae-ea3f-4620-8167-254ddb2dd67d tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T00:00:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1552565157',display_name='tempest-AttachVolumeTestJSON-server-1552565157',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1552565157',id=45,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhDSxY9KzPbmhPSdGFWzNYWivUaBWG8Oljx9bDqaplVFDvcJEMPhhreaJU0l8mW14ZFDOlJlDNeWD7anCj3Ok/wMMyLkxXyBk+yled6c7EJZTZMAqU6wyCjLOWwSjY7kA==',key_name='tempest-keypair-1417763904',keypairs=<?>,launch_index=0,launched_at=2023-11-15T00:00:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e601d11e75d4ec4b7c05e615c67fe20',ramdisk_id='',reservation_id='r-7w79su9i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1907700292',owner_user_name='tempest-AttachVolumeTestJSON-1907700292-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T00:00:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa84b131dff84566810c44b553b09ba8',uuid=3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f337ac0b-ba3c-4517-a743-5c489e2798cd", "address": "fa:16:3e:0c:1d:ea", "network": {"id": "167936c8-5f28-439e-9a1f-d9356b3a1ec9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374167607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e601d11e75d4ec4b7c05e615c67fe20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf337ac0b-ba", "ovs_interfaceid": "f337ac0b-ba3c-4517-a743-5c489e2798cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 00:03:08 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-c502a4ae-ea3f-4620-8167-254ddb2dd67d tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Converting VIF {"id": "f337ac0b-ba3c-4517-a743-5c489e2798cd", "address": "fa:16:3e:0c:1d:ea", "network": {"id": "167936c8-5f28-439e-9a1f-d9356b3a1ec9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374167607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e601d11e75d4ec4b7c05e615c67fe20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf337ac0b-ba", "ovs_interfaceid": "f337ac0b-ba3c-4517-a743-5c489e2798cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 00:03:08 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-c502a4ae-ea3f-4620-8167-254ddb2dd67d tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:1d:ea,bridge_name='br-int',has_traffic_filtering=True,id=f337ac0b-ba3c-4517-a743-5c489e2798cd,network=Network(167936c8-5f28-439e-9a1f-d9356b3a1ec9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf337ac0b-ba') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 00:03:08 user nova-compute[75341]: DEBUG os_vif [None req-c502a4ae-ea3f-4620-8167-254ddb2dd67d tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:1d:ea,bridge_name='br-int',has_traffic_filtering=True,id=f337ac0b-ba3c-4517-a743-5c489e2798cd,network=Network(167936c8-5f28-439e-9a1f-d9356b3a1ec9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf337ac0b-ba') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 00:03:08 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:03:08 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf337ac0b-ba, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:03:08 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:03:08 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:03:08 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:03:08 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=25b6ffb2-07a7-4188-a290-d235a9467578) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:03:08 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:03:08 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:03:08 user nova-compute[75341]: INFO os_vif [None req-c502a4ae-ea3f-4620-8167-254ddb2dd67d tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:1d:ea,bridge_name='br-int',has_traffic_filtering=True,id=f337ac0b-ba3c-4517-a743-5c489e2798cd,network=Network(167936c8-5f28-439e-9a1f-d9356b3a1ec9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf337ac0b-ba')
Nov 15 00:03:08 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-c502a4ae-ea3f-4620-8167-254ddb2dd67d tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Deleting instance files /opt/stack/data/nova/instances/3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0_del
Nov 15 00:03:08 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-c502a4ae-ea3f-4620-8167-254ddb2dd67d tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Deletion of /opt/stack/data/nova/instances/3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0_del complete
Nov 15 00:03:08 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:03:08 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:03:08 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Hypervisor/Node resource view: name=user free_ram=8556MB free_disk=25.359046936035156GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75341) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 00:03:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:03:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:03:08 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance defae731-4191-4526-99cc-a301cf5b3355 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:03:08 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance f48db53c-618c-42fc-a688-974cc75f3598 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:03:08 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:03:08 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance c3524e47-34b3-4b33-a1ff-25a8e4f35d86 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:03:08 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 00:03:08 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 00:03:08 user nova-compute[75341]: INFO nova.compute.manager [None req-c502a4ae-ea3f-4620-8167-254ddb2dd67d tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Took 1.29 seconds to destroy the instance on the hypervisor.
Nov 15 00:03:08 user nova-compute[75341]: DEBUG oslo.service.loopingcall [None req-c502a4ae-ea3f-4620-8167-254ddb2dd67d tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75341) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 00:03:08 user nova-compute[75341]: DEBUG nova.compute.manager [-] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Deallocating network for instance {{(pid=75341) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 00:03:08 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] deallocate_for_instance() {{(pid=75341) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 00:03:08 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 00:03:08 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 00:03:08 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Compute_service record updated for user:user {{(pid=75341) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 00:03:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.270s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:03:09 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:03:09 user nova-compute[75341]: INFO nova.compute.manager [-] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Took 0.79 seconds to deallocate network for instance.
Nov 15 00:03:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c502a4ae-ea3f-4620-8167-254ddb2dd67d tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:03:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c502a4ae-ea3f-4620-8167-254ddb2dd67d tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:03:09 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-c502a4ae-ea3f-4620-8167-254ddb2dd67d tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 00:03:09 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-c502a4ae-ea3f-4620-8167-254ddb2dd67d tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 00:03:09 user nova-compute[75341]: DEBUG nova.compute.manager [req-da1723a7-22d0-4045-aada-1869d3fbe26a req-c1754d1c-d4a2-43eb-b0e3-8e1504a25718 service nova] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Received event network-vif-plugged-f337ac0b-ba3c-4517-a743-5c489e2798cd {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:03:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-da1723a7-22d0-4045-aada-1869d3fbe26a req-c1754d1c-d4a2-43eb-b0e3-8e1504a25718 service nova] Acquiring lock "3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:03:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-da1723a7-22d0-4045-aada-1869d3fbe26a req-c1754d1c-d4a2-43eb-b0e3-8e1504a25718 service nova] Lock "3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:03:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-da1723a7-22d0-4045-aada-1869d3fbe26a req-c1754d1c-d4a2-43eb-b0e3-8e1504a25718 service nova] Lock "3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:03:09 user nova-compute[75341]: DEBUG nova.compute.manager [req-da1723a7-22d0-4045-aada-1869d3fbe26a req-c1754d1c-d4a2-43eb-b0e3-8e1504a25718 service nova] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] No waiting events found dispatching network-vif-plugged-f337ac0b-ba3c-4517-a743-5c489e2798cd {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:03:09 user nova-compute[75341]: WARNING nova.compute.manager [req-da1723a7-22d0-4045-aada-1869d3fbe26a req-c1754d1c-d4a2-43eb-b0e3-8e1504a25718 service nova] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Received unexpected event network-vif-plugged-f337ac0b-ba3c-4517-a743-5c489e2798cd for instance with vm_state deleted and task_state None.
Nov 15 00:03:09 user nova-compute[75341]: DEBUG nova.compute.manager [req-da1723a7-22d0-4045-aada-1869d3fbe26a req-c1754d1c-d4a2-43eb-b0e3-8e1504a25718 service nova] [instance: 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0] Received event network-vif-deleted-f337ac0b-ba3c-4517-a743-5c489e2798cd {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:03:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c502a4ae-ea3f-4620-8167-254ddb2dd67d tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.204s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:03:09 user nova-compute[75341]: INFO nova.scheduler.client.report [None req-c502a4ae-ea3f-4620-8167-254ddb2dd67d tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Deleted allocations for instance 3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0
Nov 15 00:03:09 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:03:09 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:03:09 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Starting heal instance info cache {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 00:03:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c502a4ae-ea3f-4620-8167-254ddb2dd67d tempest-AttachVolumeTestJSON-1907700292 tempest-AttachVolumeTestJSON-1907700292-project-member] Lock "3e5336a8-87d4-4baa-ab5e-04f1b78ea1d0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.477s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:03:10 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "refresh_cache-c3524e47-34b3-4b33-a1ff-25a8e4f35d86" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:03:10 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquired lock "refresh_cache-c3524e47-34b3-4b33-a1ff-25a8e4f35d86" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:03:10 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Forcefully refreshing network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 00:03:10 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Updating instance_info_cache with network_info: [{"id": "50f461fb-27ee-438f-880c-cde1e7441cfe", "address": "fa:16:3e:26:50:43", "network": {"id": "d86a8e7f-6658-4994-9a13-eb3163bd3865", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-635863702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c69a942b4f4b97a1a3152dea86c7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f461fb-27", "ovs_interfaceid": "50f461fb-27ee-438f-880c-cde1e7441cfe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:03:10 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Releasing lock "refresh_cache-c3524e47-34b3-4b33-a1ff-25a8e4f35d86" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:03:10 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Updated the network info_cache for instance {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 00:03:10 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:03:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:03:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:03:23 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:03:23 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:03:23 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:03:23 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:03:23 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:03:23 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:03:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:03:33 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:03:33 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:03:33 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:03:33 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:03:33 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:03:33 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:03:38 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:03:43 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:03:48 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:03:48 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:03:48 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:03:48 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:03:48 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:03:48 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:03:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:03:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:03:52 user nova-compute[75341]: DEBUG nova.compute.manager [req-52f491c9-5b77-4f3e-8b54-44c8cad5111f req-6e3efe43-4701-4c2d-8de8-8d3603f251cc service nova] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Received event network-changed-b9bfab22-02f7-4620-9bd5-f65817bc199a {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:03:52 user nova-compute[75341]: DEBUG nova.compute.manager [req-52f491c9-5b77-4f3e-8b54-44c8cad5111f req-6e3efe43-4701-4c2d-8de8-8d3603f251cc service nova] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Refreshing instance network info cache due to event network-changed-b9bfab22-02f7-4620-9bd5-f65817bc199a. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 00:03:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-52f491c9-5b77-4f3e-8b54-44c8cad5111f req-6e3efe43-4701-4c2d-8de8-8d3603f251cc service nova] Acquiring lock "refresh_cache-f48db53c-618c-42fc-a688-974cc75f3598" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:03:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-52f491c9-5b77-4f3e-8b54-44c8cad5111f req-6e3efe43-4701-4c2d-8de8-8d3603f251cc service nova] Acquired lock "refresh_cache-f48db53c-618c-42fc-a688-974cc75f3598" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:03:52 user nova-compute[75341]: DEBUG nova.network.neutron [req-52f491c9-5b77-4f3e-8b54-44c8cad5111f req-6e3efe43-4701-4c2d-8de8-8d3603f251cc service nova] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Refreshing network info cache for port b9bfab22-02f7-4620-9bd5-f65817bc199a {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 00:03:52 user nova-compute[75341]: DEBUG nova.network.neutron [req-52f491c9-5b77-4f3e-8b54-44c8cad5111f req-6e3efe43-4701-4c2d-8de8-8d3603f251cc service nova] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Updated VIF entry in instance network info cache for port b9bfab22-02f7-4620-9bd5-f65817bc199a. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 00:03:52 user nova-compute[75341]: DEBUG nova.network.neutron [req-52f491c9-5b77-4f3e-8b54-44c8cad5111f req-6e3efe43-4701-4c2d-8de8-8d3603f251cc service nova] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Updating instance_info_cache with network_info: [{"id": "b9bfab22-02f7-4620-9bd5-f65817bc199a", "address": "fa:16:3e:10:f1:8e", "network": {"id": "e8f13b75-3423-43ce-b6dc-843c837e46d2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-617247022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8c1eeb4c3c4f27b774aba29ceb7997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9bfab22-02", "ovs_interfaceid": "b9bfab22-02f7-4620-9bd5-f65817bc199a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:03:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-52f491c9-5b77-4f3e-8b54-44c8cad5111f req-6e3efe43-4701-4c2d-8de8-8d3603f251cc service nova] Releasing lock "refresh_cache-f48db53c-618c-42fc-a688-974cc75f3598" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:03:53 user nova-compute[75341]: DEBUG nova.compute.manager [req-34f44e2b-e1fb-41b2-97b2-477636a3d478 req-feaa3031-e451-41dc-a68f-dd7b375654a4 service nova] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Received event network-changed-b9bfab22-02f7-4620-9bd5-f65817bc199a {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:03:53 user nova-compute[75341]: DEBUG nova.compute.manager [req-34f44e2b-e1fb-41b2-97b2-477636a3d478 req-feaa3031-e451-41dc-a68f-dd7b375654a4 service nova] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Refreshing instance network info cache due to event network-changed-b9bfab22-02f7-4620-9bd5-f65817bc199a. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 00:03:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-34f44e2b-e1fb-41b2-97b2-477636a3d478 req-feaa3031-e451-41dc-a68f-dd7b375654a4 service nova] Acquiring lock "refresh_cache-f48db53c-618c-42fc-a688-974cc75f3598" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:03:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-34f44e2b-e1fb-41b2-97b2-477636a3d478 req-feaa3031-e451-41dc-a68f-dd7b375654a4 service nova] Acquired lock "refresh_cache-f48db53c-618c-42fc-a688-974cc75f3598" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:03:53 user nova-compute[75341]: DEBUG nova.network.neutron [req-34f44e2b-e1fb-41b2-97b2-477636a3d478 req-feaa3031-e451-41dc-a68f-dd7b375654a4 service nova] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Refreshing network info cache for port b9bfab22-02f7-4620-9bd5-f65817bc199a {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 00:03:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-819ca313-193b-43af-8c54-954db963298b tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Acquiring lock "f48db53c-618c-42fc-a688-974cc75f3598" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:03:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-819ca313-193b-43af-8c54-954db963298b tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "f48db53c-618c-42fc-a688-974cc75f3598" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:03:53 user nova-compute[75341]: INFO nova.compute.manager [None req-819ca313-193b-43af-8c54-954db963298b tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Detaching volume d0ab162a-2aa4-49a0-a6b7-21f2172db6ed
Nov 15 00:03:53 user nova-compute[75341]: INFO nova.virt.block_device [None req-819ca313-193b-43af-8c54-954db963298b tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Attempting to driver detach volume d0ab162a-2aa4-49a0-a6b7-21f2172db6ed from mountpoint /dev/vdb
Nov 15 00:03:53 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-819ca313-193b-43af-8c54-954db963298b tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Attempting to detach device vdb from instance f48db53c-618c-42fc-a688-974cc75f3598 from the persistent domain config. {{(pid=75341) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 00:03:53 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-819ca313-193b-43af-8c54-954db963298b tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 00:03:53 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 00:03:53 user nova-compute[75341]:   <source dev="/dev/sdb"/>
Nov 15 00:03:53 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 15 00:03:53 user nova-compute[75341]:   <serial>d0ab162a-2aa4-49a0-a6b7-21f2172db6ed</serial>
Nov 15 00:03:53 user nova-compute[75341]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 00:03:53 user nova-compute[75341]: </disk>
Nov 15 00:03:53 user nova-compute[75341]:  {{(pid=75341) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 00:03:53 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-819ca313-193b-43af-8c54-954db963298b tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Successfully detached device vdb from instance f48db53c-618c-42fc-a688-974cc75f3598 from the persistent domain config.
Nov 15 00:03:53 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-819ca313-193b-43af-8c54-954db963298b tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f48db53c-618c-42fc-a688-974cc75f3598 from the live domain config. {{(pid=75341) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 00:03:53 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-819ca313-193b-43af-8c54-954db963298b tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 00:03:53 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 00:03:53 user nova-compute[75341]:   <source dev="/dev/sdb"/>
Nov 15 00:03:53 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 15 00:03:53 user nova-compute[75341]:   <serial>d0ab162a-2aa4-49a0-a6b7-21f2172db6ed</serial>
Nov 15 00:03:53 user nova-compute[75341]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 00:03:53 user nova-compute[75341]: </disk>
Nov 15 00:03:53 user nova-compute[75341]:  {{(pid=75341) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 00:03:53 user nova-compute[75341]: DEBUG nova.network.neutron [req-34f44e2b-e1fb-41b2-97b2-477636a3d478 req-feaa3031-e451-41dc-a68f-dd7b375654a4 service nova] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Updated VIF entry in instance network info cache for port b9bfab22-02f7-4620-9bd5-f65817bc199a. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 00:03:53 user nova-compute[75341]: DEBUG nova.network.neutron [req-34f44e2b-e1fb-41b2-97b2-477636a3d478 req-feaa3031-e451-41dc-a68f-dd7b375654a4 service nova] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Updating instance_info_cache with network_info: [{"id": "b9bfab22-02f7-4620-9bd5-f65817bc199a", "address": "fa:16:3e:10:f1:8e", "network": {"id": "e8f13b75-3423-43ce-b6dc-843c837e46d2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-617247022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8c1eeb4c3c4f27b774aba29ceb7997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9bfab22-02", "ovs_interfaceid": "b9bfab22-02f7-4620-9bd5-f65817bc199a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:03:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-34f44e2b-e1fb-41b2-97b2-477636a3d478 req-feaa3031-e451-41dc-a68f-dd7b375654a4 service nova] Releasing lock "refresh_cache-f48db53c-618c-42fc-a688-974cc75f3598" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:03:53 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:03:53 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-819ca313-193b-43af-8c54-954db963298b tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f48db53c-618c-42fc-a688-974cc75f3598 {{(pid=75341) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 00:03:57 user nova-compute[75341]: INFO nova.compute.manager [None req-3fa8146b-3191-4c43-bf4e-7fe66d8eba09 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Get console output
Nov 15 00:03:57 user nova-compute[75341]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 15 00:03:58 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:04:00 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:04:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:04:03 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:04:05 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:04:05 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:04:05 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75341) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 00:04:06 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:04:08 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:04:08 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:04:08 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:04:08 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:04:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:04:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:04:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:04:08 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75341) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 00:04:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:04:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:04:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:04:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:04:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48db53c-618c-42fc-a688-974cc75f3598/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:04:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48db53c-618c-42fc-a688-974cc75f3598/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:04:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48db53c-618c-42fc-a688-974cc75f3598/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:04:09 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f48db53c-618c-42fc-a688-974cc75f3598/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:04:09 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 00:04:10 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:04:10 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:04:10 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Hypervisor/Node resource view: name=user free_ram=8704MB free_disk=25.38546371459961GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75341) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 00:04:10 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:04:10 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:04:10 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance defae731-4191-4526-99cc-a301cf5b3355 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:04:10 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance f48db53c-618c-42fc-a688-974cc75f3598 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:04:10 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance c3524e47-34b3-4b33-a1ff-25a8e4f35d86 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:04:10 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 00:04:10 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 00:04:10 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 00:04:10 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 00:04:10 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Compute_service record updated for user:user {{(pid=75341) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 00:04:10 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.285s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:04:11 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:04:11 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:04:11 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Starting heal instance info cache {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 00:04:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "refresh_cache-f48db53c-618c-42fc-a688-974cc75f3598" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:04:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquired lock "refresh_cache-f48db53c-618c-42fc-a688-974cc75f3598" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:04:11 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Forcefully refreshing network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 00:04:12 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Updating instance_info_cache with network_info: [{"id": "b9bfab22-02f7-4620-9bd5-f65817bc199a", "address": "fa:16:3e:10:f1:8e", "network": {"id": "e8f13b75-3423-43ce-b6dc-843c837e46d2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-617247022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8c1eeb4c3c4f27b774aba29ceb7997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9bfab22-02", "ovs_interfaceid": "b9bfab22-02f7-4620-9bd5-f65817bc199a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:04:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Releasing lock "refresh_cache-f48db53c-618c-42fc-a688-974cc75f3598" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:04:12 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Updated the network info_cache for instance {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 00:04:12 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:04:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:04:13 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-819ca313-193b-43af-8c54-954db963298b tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f48db53c-618c-42fc-a688-974cc75f3598 is timed out.
Nov 15 00:04:13 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-819ca313-193b-43af-8c54-954db963298b tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Successfully detached device vdb from instance f48db53c-618c-42fc-a688-974cc75f3598 from the live domain config.
Nov 15 00:04:13 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-819ca313-193b-43af-8c54-954db963298b tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: f48db53c-618c-42fc-a688-974cc75f3598] calling os-brick to detach iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 00:04:13 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-819ca313-193b-43af-8c54-954db963298b tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, {'target_iqn': 'iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qQjFsDIz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 00:04:13 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-819ca313-193b-43af-8c54-954db963298b tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 00:04:13 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-819ca313-193b-43af-8c54-954db963298b tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 00:04:13 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-819ca313-193b-43af-8c54-954db963298b tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 00:04:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:04:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:04:13 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd83a404-1f65-403d-b0ff-1c11ab64da15]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:04:13 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-819ca313-193b-43af-8c54-954db963298b tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 00:04:13 user nova-compute[75341]: No targets found.
Nov 15 00:04:13 user nova-compute[75341]: iSNS:
Nov 15 00:04:13 user nova-compute[75341]: No targets found.
Nov 15 00:04:13 user nova-compute[75341]: STATIC:
Nov 15 00:04:13 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed
Nov 15 00:04:13 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 15 00:04:13 user nova-compute[75341]:                 Iface Name: default
Nov 15 00:04:13 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123
Nov 15 00:04:13 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 15 00:04:13 user nova-compute[75341]:                 Iface Name: default
Nov 15 00:04:13 user nova-compute[75341]: FIRMWARE:
Nov 15 00:04:13 user nova-compute[75341]: No targets found.
Nov 15 00:04:13 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 00:04:13 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-819ca313-193b-43af-8c54-954db963298b tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 00:04:13 user nova-compute[75341]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 00:04:13 user nova-compute[75341]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75341) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 00:04:13 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-819ca313-193b-43af-8c54-954db963298b tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed', 0)] {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 00:04:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:04:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:04:13 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[22db46d8-64b7-4681-84c1-1494c4b3b96e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:04:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:04:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:04:13 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8ba0e5-7d4d-4e98-822a-39089e66c661]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:04:13 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-819ca313-193b-43af-8c54-954db963298b tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 (non-flash)
Nov 15 00:04:13 user nova-compute[75341]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed (non-flash)
Nov 15 00:04:13 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 00:04:13 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-819ca313-193b-43af-8c54-954db963298b tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 (non-flash)
Nov 15 00:04:13 user nova-compute[75341]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed (non-flash)
Nov 15 00:04:13 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 00:04:13 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-819ca313-193b-43af-8c54-954db963298b tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18701ee680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed'): ({'sdb'}, set())}) {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 00:04:13 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-819ca313-193b-43af-8c54-954db963298b tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Removing single pathed devices sdb {{(pid=75341) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 00:04:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:04:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:04:13 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e95671-f5c2-4e42-9c27-757c5cd25a95]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:04:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:04:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:04:13 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a08337-a50c-4bc4-a330-201fef4c0c24]: (4, ('ok\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:04:13 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-819ca313-193b-43af-8c54-954db963298b tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Flushing IO for device /dev/sdb {{(pid=75341) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 00:04:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:04:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:04:13 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ead623-483b-46a3-8c9d-b9159607af53]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:04:13 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-819ca313-193b-43af-8c54-954db963298b tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75341) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 00:04:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:04:14 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:04:14 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43d9e01-ba03-4a8f-bb66-a7a05fc41937]: (4, ('1', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:04:14 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-819ca313-193b-43af-8c54-954db963298b tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 00:04:14 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-819ca313-193b-43af-8c54-954db963298b tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] SCSI volumes sdb have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 00:04:14 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-819ca313-193b-43af-8c54-954db963298b tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed')] {{(pid=75341) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 00:04:14 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:04:14 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:04:14 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92fbbe6-9b88-4f63-9f43-3ef4e3dc8fbf]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:04:14 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-819ca313-193b-43af-8c54-954db963298b tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:04:14 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed -p 172.16.0.220:3260 --logout {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:04:14 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:04:14 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[917d8144-e107-4e63-bec6-dfd92dbc0189]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:04:14 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-819ca313-193b-43af-8c54-954db963298b tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed, portal: 172.16.0.220,3260]
Nov 15 00:04:14 user nova-compute[75341]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed, portal: 172.16.0.220,3260] successful.
Nov 15 00:04:14 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:04:14 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed -p 172.16.0.220:3260 --op delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:04:14 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0ab162a-2aa4-49a0-a6b7-21f2172db6ed -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:04:14 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ac6c1f-28fb-46a4-b431-601d86eb840a]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:04:14 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-819ca313-193b-43af-8c54-954db963298b tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:04:14 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-819ca313-193b-43af-8c54-954db963298b tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 00:04:14 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-819ca313-193b-43af-8c54-954db963298b tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] <== disconnect_volume: return (286ms) None {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 00:04:14 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-819ca313-193b-43af-8c54-954db963298b tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Disconnected iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 00:04:14 user nova-compute[75341]: DEBUG nova.objects.instance [None req-819ca313-193b-43af-8c54-954db963298b tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lazy-loading 'flavor' on Instance uuid f48db53c-618c-42fc-a688-974cc75f3598 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:04:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-819ca313-193b-43af-8c54-954db963298b tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "f48db53c-618c-42fc-a688-974cc75f3598" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.726s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:04:16 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:04:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:04:23 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:04:23 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:04:23 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:04:23 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:04:23 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:04:23 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:04:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:04:33 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:04:33 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:04:33 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:04:33 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:04:33 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:04:33 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:04:38 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:04:43 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:04:45 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ff6053ab-da44-4432-8791-c2c4a96ed76f tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Acquiring lock "f48db53c-618c-42fc-a688-974cc75f3598" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:04:45 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ff6053ab-da44-4432-8791-c2c4a96ed76f tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "f48db53c-618c-42fc-a688-974cc75f3598" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:04:45 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ff6053ab-da44-4432-8791-c2c4a96ed76f tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Acquiring lock "f48db53c-618c-42fc-a688-974cc75f3598-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:04:45 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ff6053ab-da44-4432-8791-c2c4a96ed76f tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "f48db53c-618c-42fc-a688-974cc75f3598-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:04:45 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ff6053ab-da44-4432-8791-c2c4a96ed76f tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "f48db53c-618c-42fc-a688-974cc75f3598-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:04:45 user nova-compute[75341]: INFO nova.compute.manager [None req-ff6053ab-da44-4432-8791-c2c4a96ed76f tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Terminating instance
Nov 15 00:04:45 user nova-compute[75341]: DEBUG nova.compute.manager [None req-ff6053ab-da44-4432-8791-c2c4a96ed76f tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Start destroying the instance on the hypervisor. {{(pid=75341) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 00:04:45 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:04:45 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:04:46 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:04:46 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:04:46 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:04:46 user nova-compute[75341]: DEBUG nova.compute.manager [req-d801f3cc-017b-4b2c-ae88-210cb2b0035a req-d5298df5-134d-4377-b1ad-abbcdf69903c service nova] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Received event network-vif-unplugged-b9bfab22-02f7-4620-9bd5-f65817bc199a {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:04:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-d801f3cc-017b-4b2c-ae88-210cb2b0035a req-d5298df5-134d-4377-b1ad-abbcdf69903c service nova] Acquiring lock "f48db53c-618c-42fc-a688-974cc75f3598-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:04:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-d801f3cc-017b-4b2c-ae88-210cb2b0035a req-d5298df5-134d-4377-b1ad-abbcdf69903c service nova] Lock "f48db53c-618c-42fc-a688-974cc75f3598-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:04:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-d801f3cc-017b-4b2c-ae88-210cb2b0035a req-d5298df5-134d-4377-b1ad-abbcdf69903c service nova] Lock "f48db53c-618c-42fc-a688-974cc75f3598-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:04:46 user nova-compute[75341]: DEBUG nova.compute.manager [req-d801f3cc-017b-4b2c-ae88-210cb2b0035a req-d5298df5-134d-4377-b1ad-abbcdf69903c service nova] [instance: f48db53c-618c-42fc-a688-974cc75f3598] No waiting events found dispatching network-vif-unplugged-b9bfab22-02f7-4620-9bd5-f65817bc199a {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:04:46 user nova-compute[75341]: DEBUG nova.compute.manager [req-d801f3cc-017b-4b2c-ae88-210cb2b0035a req-d5298df5-134d-4377-b1ad-abbcdf69903c service nova] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Received event network-vif-unplugged-b9bfab22-02f7-4620-9bd5-f65817bc199a for instance with task_state deleting. {{(pid=75341) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 00:04:46 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Instance destroyed successfully.
Nov 15 00:04:46 user nova-compute[75341]: DEBUG nova.objects.instance [None req-ff6053ab-da44-4432-8791-c2c4a96ed76f tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lazy-loading 'resources' on Instance uuid f48db53c-618c-42fc-a688-974cc75f3598 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:04:46 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-ff6053ab-da44-4432-8791-c2c4a96ed76f tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:59:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-89893269',display_name='tempest-TestMinimumBasicScenario-server-89893269',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-89893269',id=44,image_ref='a514ccdd-c667-4101-b446-774c8244dedb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD0eZ5MsnBvG5pKKJBm4DlYZrp8vwl0KUIoqF3rAYo2HUDLyr+TZxLNlaqGyAUDWA2dfkwjc9L12nHbBmdHRBsmT0iiatxTfrEomOcKH/IzhH6JOzKHsaGB/tcMn536jXg==',key_name='tempest-TestMinimumBasicScenario-1806050912',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:59:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f8c1eeb4c3c4f27b774aba29ceb7997',ramdisk_id='',reservation_id='r-t0gzgsz8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a514ccdd-c667-4101-b446-774c8244dedb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-157558920',owner_user_name='tempest-TestMinimumBasicScenario-157558920-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T00:02:08Z,user_data=None,user_id='1b1c77e1e34b46319dcd52a38996542c',uuid=f48db53c-618c-42fc-a688-974cc75f3598,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b9bfab22-02f7-4620-9bd5-f65817bc199a", "address": "fa:16:3e:10:f1:8e", "network": {"id": "e8f13b75-3423-43ce-b6dc-843c837e46d2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-617247022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8c1eeb4c3c4f27b774aba29ceb7997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9bfab22-02", "ovs_interfaceid": "b9bfab22-02f7-4620-9bd5-f65817bc199a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 00:04:46 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-ff6053ab-da44-4432-8791-c2c4a96ed76f tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Converting VIF {"id": "b9bfab22-02f7-4620-9bd5-f65817bc199a", "address": "fa:16:3e:10:f1:8e", "network": {"id": "e8f13b75-3423-43ce-b6dc-843c837e46d2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-617247022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8c1eeb4c3c4f27b774aba29ceb7997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9bfab22-02", "ovs_interfaceid": "b9bfab22-02f7-4620-9bd5-f65817bc199a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 00:04:46 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-ff6053ab-da44-4432-8791-c2c4a96ed76f tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:10:f1:8e,bridge_name='br-int',has_traffic_filtering=True,id=b9bfab22-02f7-4620-9bd5-f65817bc199a,network=Network(e8f13b75-3423-43ce-b6dc-843c837e46d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9bfab22-02') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 00:04:46 user nova-compute[75341]: DEBUG os_vif [None req-ff6053ab-da44-4432-8791-c2c4a96ed76f tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:f1:8e,bridge_name='br-int',has_traffic_filtering=True,id=b9bfab22-02f7-4620-9bd5-f65817bc199a,network=Network(e8f13b75-3423-43ce-b6dc-843c837e46d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9bfab22-02') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 00:04:46 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:04:46 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb9bfab22-02, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:04:46 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:04:46 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:04:46 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:04:46 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bcafa74f-5414-46cb-85d0-6f8e24a48e83) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:04:46 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:04:46 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:04:46 user nova-compute[75341]: INFO os_vif [None req-ff6053ab-da44-4432-8791-c2c4a96ed76f tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:f1:8e,bridge_name='br-int',has_traffic_filtering=True,id=b9bfab22-02f7-4620-9bd5-f65817bc199a,network=Network(e8f13b75-3423-43ce-b6dc-843c837e46d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9bfab22-02')
Nov 15 00:04:46 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-ff6053ab-da44-4432-8791-c2c4a96ed76f tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Deleting instance files /opt/stack/data/nova/instances/f48db53c-618c-42fc-a688-974cc75f3598_del
Nov 15 00:04:46 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-ff6053ab-da44-4432-8791-c2c4a96ed76f tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Deletion of /opt/stack/data/nova/instances/f48db53c-618c-42fc-a688-974cc75f3598_del complete
Nov 15 00:04:46 user nova-compute[75341]: INFO nova.compute.manager [None req-ff6053ab-da44-4432-8791-c2c4a96ed76f tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 15 00:04:46 user nova-compute[75341]: DEBUG oslo.service.loopingcall [None req-ff6053ab-da44-4432-8791-c2c4a96ed76f tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75341) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 00:04:46 user nova-compute[75341]: DEBUG nova.compute.manager [-] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Deallocating network for instance {{(pid=75341) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 00:04:46 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: f48db53c-618c-42fc-a688-974cc75f3598] deallocate_for_instance() {{(pid=75341) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 00:04:47 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:04:47 user nova-compute[75341]: INFO nova.compute.manager [-] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Took 0.46 seconds to deallocate network for instance.
Nov 15 00:04:47 user nova-compute[75341]: DEBUG nova.compute.manager [req-812bd352-62bb-44b3-abc0-c67a5a1f9cff req-0b95813f-487e-4bb1-a0d8-605d1389d791 service nova] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Received event network-vif-deleted-b9bfab22-02f7-4620-9bd5-f65817bc199a {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:04:47 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ff6053ab-da44-4432-8791-c2c4a96ed76f tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:04:47 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ff6053ab-da44-4432-8791-c2c4a96ed76f tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:04:47 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-ff6053ab-da44-4432-8791-c2c4a96ed76f tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 00:04:47 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-ff6053ab-da44-4432-8791-c2c4a96ed76f tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 00:04:47 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ff6053ab-da44-4432-8791-c2c4a96ed76f tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.178s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:04:47 user nova-compute[75341]: INFO nova.scheduler.client.report [None req-ff6053ab-da44-4432-8791-c2c4a96ed76f tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Deleted allocations for instance f48db53c-618c-42fc-a688-974cc75f3598
Nov 15 00:04:47 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ff6053ab-da44-4432-8791-c2c4a96ed76f tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "f48db53c-618c-42fc-a688-974cc75f3598" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.659s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:04:48 user nova-compute[75341]: DEBUG nova.compute.manager [req-a52eb513-034c-441b-8f18-7c1e380b5a6c req-9c693d0f-24eb-441c-9dc3-2d5cceff6965 service nova] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Received event network-vif-plugged-b9bfab22-02f7-4620-9bd5-f65817bc199a {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:04:48 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a52eb513-034c-441b-8f18-7c1e380b5a6c req-9c693d0f-24eb-441c-9dc3-2d5cceff6965 service nova] Acquiring lock "f48db53c-618c-42fc-a688-974cc75f3598-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:04:48 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a52eb513-034c-441b-8f18-7c1e380b5a6c req-9c693d0f-24eb-441c-9dc3-2d5cceff6965 service nova] Lock "f48db53c-618c-42fc-a688-974cc75f3598-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:04:48 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a52eb513-034c-441b-8f18-7c1e380b5a6c req-9c693d0f-24eb-441c-9dc3-2d5cceff6965 service nova] Lock "f48db53c-618c-42fc-a688-974cc75f3598-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:04:48 user nova-compute[75341]: DEBUG nova.compute.manager [req-a52eb513-034c-441b-8f18-7c1e380b5a6c req-9c693d0f-24eb-441c-9dc3-2d5cceff6965 service nova] [instance: f48db53c-618c-42fc-a688-974cc75f3598] No waiting events found dispatching network-vif-plugged-b9bfab22-02f7-4620-9bd5-f65817bc199a {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:04:48 user nova-compute[75341]: WARNING nova.compute.manager [req-a52eb513-034c-441b-8f18-7c1e380b5a6c req-9c693d0f-24eb-441c-9dc3-2d5cceff6965 service nova] [instance: f48db53c-618c-42fc-a688-974cc75f3598] Received unexpected event network-vif-plugged-b9bfab22-02f7-4620-9bd5-f65817bc199a for instance with vm_state deleted and task_state None.
Nov 15 00:04:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:04:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:04:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:04:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-438f1b13-ac3c-4f1f-91c8-7a3344db850d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Acquiring lock "c3524e47-34b3-4b33-a1ff-25a8e4f35d86" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:04:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-438f1b13-ac3c-4f1f-91c8-7a3344db850d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "c3524e47-34b3-4b33-a1ff-25a8e4f35d86" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:04:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-438f1b13-ac3c-4f1f-91c8-7a3344db850d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Acquiring lock "c3524e47-34b3-4b33-a1ff-25a8e4f35d86-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:04:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-438f1b13-ac3c-4f1f-91c8-7a3344db850d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "c3524e47-34b3-4b33-a1ff-25a8e4f35d86-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:04:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-438f1b13-ac3c-4f1f-91c8-7a3344db850d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "c3524e47-34b3-4b33-a1ff-25a8e4f35d86-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:04:58 user nova-compute[75341]: INFO nova.compute.manager [None req-438f1b13-ac3c-4f1f-91c8-7a3344db850d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Terminating instance
Nov 15 00:04:58 user nova-compute[75341]: DEBUG nova.compute.manager [None req-438f1b13-ac3c-4f1f-91c8-7a3344db850d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Start destroying the instance on the hypervisor. {{(pid=75341) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 00:04:58 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:04:58 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG nova.compute.manager [req-6b2b5ebc-12e2-4afc-915f-154728bc450c req-b575637f-69ac-4699-b963-161d4fd2328d service nova] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Received event network-vif-unplugged-50f461fb-27ee-438f-880c-cde1e7441cfe {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6b2b5ebc-12e2-4afc-915f-154728bc450c req-b575637f-69ac-4699-b963-161d4fd2328d service nova] Acquiring lock "c3524e47-34b3-4b33-a1ff-25a8e4f35d86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6b2b5ebc-12e2-4afc-915f-154728bc450c req-b575637f-69ac-4699-b963-161d4fd2328d service nova] Lock "c3524e47-34b3-4b33-a1ff-25a8e4f35d86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6b2b5ebc-12e2-4afc-915f-154728bc450c req-b575637f-69ac-4699-b963-161d4fd2328d service nova] Lock "c3524e47-34b3-4b33-a1ff-25a8e4f35d86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG nova.compute.manager [req-6b2b5ebc-12e2-4afc-915f-154728bc450c req-b575637f-69ac-4699-b963-161d4fd2328d service nova] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] No waiting events found dispatching network-vif-unplugged-50f461fb-27ee-438f-880c-cde1e7441cfe {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG nova.compute.manager [req-6b2b5ebc-12e2-4afc-915f-154728bc450c req-b575637f-69ac-4699-b963-161d4fd2328d service nova] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Received event network-vif-unplugged-50f461fb-27ee-438f-880c-cde1e7441cfe for instance with task_state deleting. {{(pid=75341) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 00:04:59 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Instance destroyed successfully.
Nov 15 00:04:59 user nova-compute[75341]: DEBUG nova.objects.instance [None req-438f1b13-ac3c-4f1f-91c8-7a3344db850d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lazy-loading 'resources' on Instance uuid c3524e47-34b3-4b33-a1ff-25a8e4f35d86 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-438f1b13-ac3c-4f1f-91c8-7a3344db850d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:58:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1599301259',display_name='tempest-ServerActionsTestOtherA-server-1599301259',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1599301259',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTmBE+Takjbl0ZrUdtoD/FDS2CHZC4n75Y/1LCLwXLZHE8J0GqhfVD/envyBMKYWUkAGQH/bKcOVnVKa4qF07KOQ/PvMrk+gG45OxOvZ8A6PGkmy0qPqzF8MOOmxhYzVQ==',key_name='tempest-keypair-1744456340',keypairs=<?>,launch_index=0,launched_at=2023-11-15T00:00:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f4c69a942b4f4b97a1a3152dea86c7fb',ramdisk_id='',reservation_id='r-dgx5dk1c',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1796396043',owner_user_name='tempest-ServerActionsTestOtherA-1796396043-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T00:02:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='442aae0161f347d0a79b168a1b60286a',uuid=c3524e47-34b3-4b33-a1ff-25a8e4f35d86,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "50f461fb-27ee-438f-880c-cde1e7441cfe", "address": "fa:16:3e:26:50:43", "network": {"id": "d86a8e7f-6658-4994-9a13-eb3163bd3865", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-635863702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c69a942b4f4b97a1a3152dea86c7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f461fb-27", "ovs_interfaceid": "50f461fb-27ee-438f-880c-cde1e7441cfe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-438f1b13-ac3c-4f1f-91c8-7a3344db850d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Converting VIF {"id": "50f461fb-27ee-438f-880c-cde1e7441cfe", "address": "fa:16:3e:26:50:43", "network": {"id": "d86a8e7f-6658-4994-9a13-eb3163bd3865", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-635863702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c69a942b4f4b97a1a3152dea86c7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f461fb-27", "ovs_interfaceid": "50f461fb-27ee-438f-880c-cde1e7441cfe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-438f1b13-ac3c-4f1f-91c8-7a3344db850d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:50:43,bridge_name='br-int',has_traffic_filtering=True,id=50f461fb-27ee-438f-880c-cde1e7441cfe,network=Network(d86a8e7f-6658-4994-9a13-eb3163bd3865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50f461fb-27') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG os_vif [None req-438f1b13-ac3c-4f1f-91c8-7a3344db850d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:50:43,bridge_name='br-int',has_traffic_filtering=True,id=50f461fb-27ee-438f-880c-cde1e7441cfe,network=Network(d86a8e7f-6658-4994-9a13-eb3163bd3865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50f461fb-27') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap50f461fb-27, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cec6f93a-8beb-4ff6-87ff-181980b9ba8e) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:04:59 user nova-compute[75341]: INFO os_vif [None req-438f1b13-ac3c-4f1f-91c8-7a3344db850d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:50:43,bridge_name='br-int',has_traffic_filtering=True,id=50f461fb-27ee-438f-880c-cde1e7441cfe,network=Network(d86a8e7f-6658-4994-9a13-eb3163bd3865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50f461fb-27')
Nov 15 00:04:59 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-438f1b13-ac3c-4f1f-91c8-7a3344db850d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] calling os-brick to detach iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-438f1b13-ac3c-4f1f-91c8-7a3344db850d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, {'target_iqn': 'iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NaWvjfqe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 00:04:59 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-438f1b13-ac3c-4f1f-91c8-7a3344db850d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 00:04:59 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-438f1b13-ac3c-4f1f-91c8-7a3344db850d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-438f1b13-ac3c-4f1f-91c8-7a3344db850d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69d6b6a-4e89-4afe-8929-d13a209bd91d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-438f1b13-ac3c-4f1f-91c8-7a3344db850d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 00:04:59 user nova-compute[75341]: No targets found.
Nov 15 00:04:59 user nova-compute[75341]: iSNS:
Nov 15 00:04:59 user nova-compute[75341]: No targets found.
Nov 15 00:04:59 user nova-compute[75341]: STATIC:
Nov 15 00:04:59 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123
Nov 15 00:04:59 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 15 00:04:59 user nova-compute[75341]:                 Iface Name: default
Nov 15 00:04:59 user nova-compute[75341]: FIRMWARE:
Nov 15 00:04:59 user nova-compute[75341]: No targets found.
Nov 15 00:04:59 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-438f1b13-ac3c-4f1f-91c8-7a3344db850d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 00:04:59 user nova-compute[75341]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 00:04:59 user nova-compute[75341]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75341) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-438f1b13-ac3c-4f1f-91c8-7a3344db850d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123', 0)] {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21a01bb-6a41-454f-8820-391c7261cbbf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb48afee-f246-47b5-9c67-2ab500ea0f33]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-438f1b13-ac3c-4f1f-91c8-7a3344db850d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 (non-flash)
Nov 15 00:04:59 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-438f1b13-ac3c-4f1f-91c8-7a3344db850d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 (non-flash)
Nov 15 00:04:59 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-438f1b13-ac3c-4f1f-91c8-7a3344db850d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1893e23130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123'): ({'sdc'}, set())}) {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-438f1b13-ac3c-4f1f-91c8-7a3344db850d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Removing single pathed devices sdc {{(pid=75341) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[224c7ee3-d18f-4d2c-8eb8-5a230cf4a06c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb95995c-7f29-4525-a22f-f5292862d505]: (4, ('ok\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-438f1b13-ac3c-4f1f-91c8-7a3344db850d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Flushing IO for device /dev/sdc {{(pid=75341) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[8042aec5-ac0f-4fa3-ab46-e6b6130afb9b]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-438f1b13-ac3c-4f1f-91c8-7a3344db850d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75341) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7494507-0378-48b6-bb41-7a6b85d2e3e4]: (4, ('1', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-438f1b13-ac3c-4f1f-91c8-7a3344db850d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-438f1b13-ac3c-4f1f-91c8-7a3344db850d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] SCSI volumes sdc have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_bad7fd6', '/dev/disk/by-id/scsi-1SCST_BIObad7fd6-ca0e87e3696347af', '/dev/disk/by-id/scsi-26361306538376533') {{(pid=86063) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e0d794-8725-418a-bd8f-bda76c88f0ae]: (4, None) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-438f1b13-ac3c-4f1f-91c8-7a3344db850d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123')] {{(pid=75341) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[1506447a-fb1c-4642-b56c-8af44bf09a9c]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-438f1b13-ac3c-4f1f-91c8-7a3344db850d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 -p 172.16.0.220:3260 --logout {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f10848-4cf5-4bb7-a9e5-2d4492ce32cb]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-438f1b13-ac3c-4f1f-91c8-7a3344db850d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123, portal: 172.16.0.220,3260]
Nov 15 00:04:59 user nova-compute[75341]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123, portal: 172.16.0.220,3260] successful.
Nov 15 00:04:59 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 -p 172.16.0.220:3260 --op delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47542c09-3d82-4329-8a27-3650d4e00123 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd81df5-6c14-438e-94c4-4f04ad8f926f]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-438f1b13-ac3c-4f1f-91c8-7a3344db850d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-438f1b13-ac3c-4f1f-91c8-7a3344db850d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-438f1b13-ac3c-4f1f-91c8-7a3344db850d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] <== disconnect_volume: return (303ms) None {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 00:04:59 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-438f1b13-ac3c-4f1f-91c8-7a3344db850d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Disconnected iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 00:04:59 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-438f1b13-ac3c-4f1f-91c8-7a3344db850d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Deleting instance files /opt/stack/data/nova/instances/c3524e47-34b3-4b33-a1ff-25a8e4f35d86_del
Nov 15 00:04:59 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-438f1b13-ac3c-4f1f-91c8-7a3344db850d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Deletion of /opt/stack/data/nova/instances/c3524e47-34b3-4b33-a1ff-25a8e4f35d86_del complete
Nov 15 00:05:00 user nova-compute[75341]: INFO nova.compute.manager [None req-438f1b13-ac3c-4f1f-91c8-7a3344db850d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 15 00:05:00 user nova-compute[75341]: DEBUG oslo.service.loopingcall [None req-438f1b13-ac3c-4f1f-91c8-7a3344db850d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75341) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 00:05:00 user nova-compute[75341]: DEBUG nova.compute.manager [-] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Deallocating network for instance {{(pid=75341) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 00:05:00 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] deallocate_for_instance() {{(pid=75341) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 00:05:00 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:05:00 user nova-compute[75341]: INFO nova.compute.manager [-] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Took 0.84 seconds to deallocate network for instance.
Nov 15 00:05:00 user nova-compute[75341]: DEBUG nova.compute.manager [req-72d6161f-2f71-46ef-9790-433009660af3 req-48997d11-24a7-459b-8c32-5d1a6bf5c9fe service nova] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Received event network-vif-deleted-50f461fb-27ee-438f-880c-cde1e7441cfe {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:05:01 user nova-compute[75341]: DEBUG nova.compute.manager [req-f260ec4f-7ecc-4df1-b120-c672751ba64e req-70cd58b0-e7a0-47d5-9d9e-a904e1f8afe7 service nova] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Received event network-vif-plugged-50f461fb-27ee-438f-880c-cde1e7441cfe {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:05:01 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-f260ec4f-7ecc-4df1-b120-c672751ba64e req-70cd58b0-e7a0-47d5-9d9e-a904e1f8afe7 service nova] Acquiring lock "c3524e47-34b3-4b33-a1ff-25a8e4f35d86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:05:01 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-f260ec4f-7ecc-4df1-b120-c672751ba64e req-70cd58b0-e7a0-47d5-9d9e-a904e1f8afe7 service nova] Lock "c3524e47-34b3-4b33-a1ff-25a8e4f35d86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:05:01 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-f260ec4f-7ecc-4df1-b120-c672751ba64e req-70cd58b0-e7a0-47d5-9d9e-a904e1f8afe7 service nova] Lock "c3524e47-34b3-4b33-a1ff-25a8e4f35d86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:05:01 user nova-compute[75341]: DEBUG nova.compute.manager [req-f260ec4f-7ecc-4df1-b120-c672751ba64e req-70cd58b0-e7a0-47d5-9d9e-a904e1f8afe7 service nova] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] No waiting events found dispatching network-vif-plugged-50f461fb-27ee-438f-880c-cde1e7441cfe {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:05:01 user nova-compute[75341]: WARNING nova.compute.manager [req-f260ec4f-7ecc-4df1-b120-c672751ba64e req-70cd58b0-e7a0-47d5-9d9e-a904e1f8afe7 service nova] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Received unexpected event network-vif-plugged-50f461fb-27ee-438f-880c-cde1e7441cfe for instance with vm_state active and task_state deleting.
Nov 15 00:05:01 user nova-compute[75341]: INFO nova.compute.manager [None req-438f1b13-ac3c-4f1f-91c8-7a3344db850d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Took 0.69 seconds to detach 1 volumes for instance.
Nov 15 00:05:01 user nova-compute[75341]: DEBUG nova.compute.manager [None req-438f1b13-ac3c-4f1f-91c8-7a3344db850d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: c3524e47-34b3-4b33-a1ff-25a8e4f35d86] Deleting volume: 47542c09-3d82-4329-8a27-3650d4e00123 {{(pid=75341) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 00:05:01 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-438f1b13-ac3c-4f1f-91c8-7a3344db850d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:05:01 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-438f1b13-ac3c-4f1f-91c8-7a3344db850d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:05:01 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-438f1b13-ac3c-4f1f-91c8-7a3344db850d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 00:05:01 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-438f1b13-ac3c-4f1f-91c8-7a3344db850d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 00:05:01 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-438f1b13-ac3c-4f1f-91c8-7a3344db850d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.158s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:05:01 user nova-compute[75341]: INFO nova.scheduler.client.report [None req-438f1b13-ac3c-4f1f-91c8-7a3344db850d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Deleted allocations for instance c3524e47-34b3-4b33-a1ff-25a8e4f35d86
Nov 15 00:05:02 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-438f1b13-ac3c-4f1f-91c8-7a3344db850d tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "c3524e47-34b3-4b33-a1ff-25a8e4f35d86" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.167s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:05:02 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:05:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:05:06 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:05:06 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75341) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 00:05:07 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:05:08 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:05:08 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:05:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:05:09 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:05:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:05:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:05:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:05:09 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75341) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 00:05:10 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:05:10 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:05:10 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:05:10 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:05:10 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:05:10 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:05:10 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Hypervisor/Node resource view: name=user free_ram=8895MB free_disk=25.401737213134766GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75341) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 00:05:10 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:05:10 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:05:10 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance defae731-4191-4526-99cc-a301cf5b3355 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:05:10 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 00:05:10 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 00:05:10 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 00:05:10 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 00:05:10 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Compute_service record updated for user:user {{(pid=75341) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 00:05:10 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.207s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:05:11 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:05:11 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:05:11 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Starting heal instance info cache {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 00:05:11 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Didn't find any instances for network info cache update. {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 00:05:11 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:05:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:05:19 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:05:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:05:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:05:34 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:05:34 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:05:34 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:05:34 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:05:34 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:05:34 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:05:39 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:05:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Acquiring lock "cbf7ae6a-78da-4361-b36b-b7733a01f3bc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:05:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "cbf7ae6a-78da-4361-b36b-b7733a01f3bc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:05:40 user nova-compute[75341]: DEBUG nova.compute.manager [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Starting instance... {{(pid=75341) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 00:05:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:05:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:05:40 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75341) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 00:05:40 user nova-compute[75341]: INFO nova.compute.claims [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Claim successful on node user
Nov 15 00:05:40 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 00:05:40 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 00:05:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.258s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:05:40 user nova-compute[75341]: DEBUG nova.compute.manager [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Start building networks asynchronously for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 00:05:40 user nova-compute[75341]: DEBUG nova.compute.manager [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Allocating IP information in the background. {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 00:05:40 user nova-compute[75341]: DEBUG nova.network.neutron [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] allocate_for_instance() {{(pid=75341) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 00:05:40 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 00:05:40 user nova-compute[75341]: DEBUG nova.compute.manager [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Start building block device mappings for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 00:05:40 user nova-compute[75341]: DEBUG nova.policy [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1b1c77e1e34b46319dcd52a38996542c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8c1eeb4c3c4f27b774aba29ceb7997', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75341) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 00:05:40 user nova-compute[75341]: DEBUG nova.compute.manager [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Start spawning the instance on the hypervisor. {{(pid=75341) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 00:05:40 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Creating instance directory {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 00:05:40 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Creating image(s)
Nov 15 00:05:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Acquiring lock "/opt/stack/data/nova/instances/cbf7ae6a-78da-4361-b36b-b7733a01f3bc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:05:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "/opt/stack/data/nova/instances/cbf7ae6a-78da-4361-b36b-b7733a01f3bc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:05:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "/opt/stack/data/nova/instances/cbf7ae6a-78da-4361-b36b-b7733a01f3bc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:05:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Acquiring lock "c863ad867769118e50e52c162d1af90c0e360fb4" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:05:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "c863ad867769118e50e52c162d1af90c0e360fb4" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:05:41 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c863ad867769118e50e52c162d1af90c0e360fb4.part --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:05:41 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c863ad867769118e50e52c162d1af90c0e360fb4.part --force-share --output=json" returned: 0 in 0.183s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:05:41 user nova-compute[75341]: DEBUG nova.virt.images [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] 8ae249fe-86cc-4262-85be-9553601c741f was qcow2, converting to raw {{(pid=75341) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 00:05:41 user nova-compute[75341]: DEBUG nova.privsep.utils [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75341) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 00:05:41 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c863ad867769118e50e52c162d1af90c0e360fb4.part /opt/stack/data/nova/instances/_base/c863ad867769118e50e52c162d1af90c0e360fb4.converted {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:05:41 user nova-compute[75341]: DEBUG nova.network.neutron [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Successfully created port: e3539392-c398-4e79-9e92-92307e4036d6 {{(pid=75341) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 00:05:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c863ad867769118e50e52c162d1af90c0e360fb4.part /opt/stack/data/nova/instances/_base/c863ad867769118e50e52c162d1af90c0e360fb4.converted" returned: 0 in 0.717s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:05:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c863ad867769118e50e52c162d1af90c0e360fb4.converted --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:05:42 user nova-compute[75341]: DEBUG nova.network.neutron [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Successfully updated port: e3539392-c398-4e79-9e92-92307e4036d6 {{(pid=75341) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 00:05:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c863ad867769118e50e52c162d1af90c0e360fb4.converted --force-share --output=json" returned: 0 in 0.174s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:05:42 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "c863ad867769118e50e52c162d1af90c0e360fb4" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.534s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:05:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c863ad867769118e50e52c162d1af90c0e360fb4 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:05:42 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Acquiring lock "refresh_cache-cbf7ae6a-78da-4361-b36b-b7733a01f3bc" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:05:42 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Acquired lock "refresh_cache-cbf7ae6a-78da-4361-b36b-b7733a01f3bc" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:05:42 user nova-compute[75341]: DEBUG nova.network.neutron [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 00:05:42 user nova-compute[75341]: DEBUG nova.compute.manager [req-d81236a4-a6a4-4788-bde1-00f504c9e87e req-7d67ec2d-d9da-4d8a-9cd6-1d26180b5b3c service nova] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Received event network-changed-e3539392-c398-4e79-9e92-92307e4036d6 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:05:42 user nova-compute[75341]: DEBUG nova.compute.manager [req-d81236a4-a6a4-4788-bde1-00f504c9e87e req-7d67ec2d-d9da-4d8a-9cd6-1d26180b5b3c service nova] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Refreshing instance network info cache due to event network-changed-e3539392-c398-4e79-9e92-92307e4036d6. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 00:05:42 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-d81236a4-a6a4-4788-bde1-00f504c9e87e req-7d67ec2d-d9da-4d8a-9cd6-1d26180b5b3c service nova] Acquiring lock "refresh_cache-cbf7ae6a-78da-4361-b36b-b7733a01f3bc" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:05:42 user nova-compute[75341]: DEBUG nova.network.neutron [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Instance cache missing network info. {{(pid=75341) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 00:05:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c863ad867769118e50e52c162d1af90c0e360fb4 --force-share --output=json" returned: 0 in 0.181s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:05:42 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Acquiring lock "c863ad867769118e50e52c162d1af90c0e360fb4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:05:42 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "c863ad867769118e50e52c162d1af90c0e360fb4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:05:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c863ad867769118e50e52c162d1af90c0e360fb4 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:05:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c863ad867769118e50e52c162d1af90c0e360fb4 --force-share --output=json" returned: 0 in 0.176s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:05:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c863ad867769118e50e52c162d1af90c0e360fb4,backing_fmt=raw /opt/stack/data/nova/instances/cbf7ae6a-78da-4361-b36b-b7733a01f3bc/disk 1073741824 {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:05:42 user nova-compute[75341]: DEBUG nova.network.neutron [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Updating instance_info_cache with network_info: [{"id": "e3539392-c398-4e79-9e92-92307e4036d6", "address": "fa:16:3e:0e:c2:2d", "network": {"id": "e8f13b75-3423-43ce-b6dc-843c837e46d2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-617247022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8c1eeb4c3c4f27b774aba29ceb7997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3539392-c3", "ovs_interfaceid": "e3539392-c398-4e79-9e92-92307e4036d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:05:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c863ad867769118e50e52c162d1af90c0e360fb4,backing_fmt=raw /opt/stack/data/nova/instances/cbf7ae6a-78da-4361-b36b-b7733a01f3bc/disk 1073741824" returned: 0 in 0.053s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:05:42 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "c863ad867769118e50e52c162d1af90c0e360fb4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:05:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c863ad867769118e50e52c162d1af90c0e360fb4 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:05:42 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Releasing lock "refresh_cache-cbf7ae6a-78da-4361-b36b-b7733a01f3bc" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:05:42 user nova-compute[75341]: DEBUG nova.compute.manager [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Instance network_info: |[{"id": "e3539392-c398-4e79-9e92-92307e4036d6", "address": "fa:16:3e:0e:c2:2d", "network": {"id": "e8f13b75-3423-43ce-b6dc-843c837e46d2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-617247022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8c1eeb4c3c4f27b774aba29ceb7997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3539392-c3", "ovs_interfaceid": "e3539392-c398-4e79-9e92-92307e4036d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 00:05:42 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-d81236a4-a6a4-4788-bde1-00f504c9e87e req-7d67ec2d-d9da-4d8a-9cd6-1d26180b5b3c service nova] Acquired lock "refresh_cache-cbf7ae6a-78da-4361-b36b-b7733a01f3bc" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:05:42 user nova-compute[75341]: DEBUG nova.network.neutron [req-d81236a4-a6a4-4788-bde1-00f504c9e87e req-7d67ec2d-d9da-4d8a-9cd6-1d26180b5b3c service nova] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Refreshing network info cache for port e3539392-c398-4e79-9e92-92307e4036d6 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 00:05:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c863ad867769118e50e52c162d1af90c0e360fb4 --force-share --output=json" returned: 0 in 0.170s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:05:42 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cbf7ae6a-78da-4361-b36b-b7733a01f3bc/disk. size=1073741824 {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 00:05:42 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbf7ae6a-78da-4361-b36b-b7733a01f3bc/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:05:43 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbf7ae6a-78da-4361-b36b-b7733a01f3bc/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:05:43 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Cannot resize image /opt/stack/data/nova/instances/cbf7ae6a-78da-4361-b36b-b7733a01f3bc/disk to a smaller size. {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 00:05:43 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Created local disks {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 00:05:43 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Ensure instance console log exists: /opt/stack/data/nova/instances/cbf7ae6a-78da-4361-b36b-b7733a01f3bc/console.log {{(pid=75341) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 00:05:43 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:05:43 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:05:43 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:05:43 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Start _get_guest_xml network_info=[{"id": "e3539392-c398-4e79-9e92-92307e4036d6", "address": "fa:16:3e:0e:c2:2d", "network": {"id": "e8f13b75-3423-43ce-b6dc-843c837e46d2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-617247022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8c1eeb4c3c4f27b774aba29ceb7997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3539392-c3", "ovs_interfaceid": "e3539392-c398-4e79-9e92-92307e4036d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T00:05:37Z,direct_url=<?>,disk_format='qcow2',id=8ae249fe-86cc-4262-85be-9553601c741f,min_disk=0,min_ram=0,name='tempest-scenario-img--928960785',owner='9f8c1eeb4c3c4f27b774aba29ceb7997',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T00:05:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encrypted': False, 'image_id': '8ae249fe-86cc-4262-85be-9553601c741f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 00:05:43 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:05:43 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:05:43 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 00:05:43 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 00:05:43 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 00:05:43 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 00:05:43 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 00:05:43 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T00:05:37Z,direct_url=<?>,disk_format='qcow2',id=8ae249fe-86cc-4262-85be-9553601c741f,min_disk=0,min_ram=0,name='tempest-scenario-img--928960785',owner='9f8c1eeb4c3c4f27b774aba29ceb7997',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T00:05:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 00:05:43 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 00:05:43 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 00:05:43 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 00:05:43 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 00:05:43 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 00:05:43 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 00:05:43 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 00:05:43 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 00:05:43 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 00:05:43 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 00:05:43 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T00:05:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1694659356',display_name='tempest-TestMinimumBasicScenario-server-1694659356',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1694659356',id=46,image_ref='8ae249fe-86cc-4262-85be-9553601c741f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEf7PjHmw6p5xUZ/pEck9JyDCpw8TggB8BHdTujoi1XDHMJnru0QSiWCmn25IccX+U3otOQTs5Y4UdmKX0pFaT/4IrGzR9Ks4CEkPQJW6hD8aZQngMWLmGIr6xMc3lg3pQ==',key_name='tempest-TestMinimumBasicScenario-333149133',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f8c1eeb4c3c4f27b774aba29ceb7997',ramdisk_id='',reservation_id='r-4gt9mtbu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8ae249fe-86cc-4262-85be-9553601c741f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-157558920',owner_user_name='tempest-TestMinimumBasicScenario-157558920-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T00:05:41Z,user_data=None,user_id='1b1c77e1e34b46319dcd52a38996542c',uuid=cbf7ae6a-78da-4361-b36b-b7733a01f3bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e3539392-c398-4e79-9e92-92307e4036d6", "address": "fa:16:3e:0e:c2:2d", "network": {"id": "e8f13b75-3423-43ce-b6dc-843c837e46d2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-617247022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8c1eeb4c3c4f27b774aba29ceb7997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3539392-c3", "ovs_interfaceid": "e3539392-c398-4e79-9e92-92307e4036d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 00:05:43 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Converting VIF {"id": "e3539392-c398-4e79-9e92-92307e4036d6", "address": "fa:16:3e:0e:c2:2d", "network": {"id": "e8f13b75-3423-43ce-b6dc-843c837e46d2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-617247022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8c1eeb4c3c4f27b774aba29ceb7997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3539392-c3", "ovs_interfaceid": "e3539392-c398-4e79-9e92-92307e4036d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 00:05:43 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:c2:2d,bridge_name='br-int',has_traffic_filtering=True,id=e3539392-c398-4e79-9e92-92307e4036d6,network=Network(e8f13b75-3423-43ce-b6dc-843c837e46d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3539392-c3') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 00:05:43 user nova-compute[75341]: DEBUG nova.objects.instance [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lazy-loading 'pci_devices' on Instance uuid cbf7ae6a-78da-4361-b36b-b7733a01f3bc {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:05:43 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] End _get_guest_xml xml=<domain type="kvm">
Nov 15 00:05:43 user nova-compute[75341]:   <uuid>cbf7ae6a-78da-4361-b36b-b7733a01f3bc</uuid>
Nov 15 00:05:43 user nova-compute[75341]:   <name>instance-0000002e</name>
Nov 15 00:05:43 user nova-compute[75341]:   <memory>524288</memory>
Nov 15 00:05:43 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 15 00:05:43 user nova-compute[75341]:   <metadata>
Nov 15 00:05:43 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 00:05:43 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 15 00:05:43 user nova-compute[75341]:       <nova:name>tempest-TestMinimumBasicScenario-server-1694659356</nova:name>
Nov 15 00:05:43 user nova-compute[75341]:       <nova:creationTime>2023-11-15 00:05:43</nova:creationTime>
Nov 15 00:05:43 user nova-compute[75341]:       <nova:flavor name="m1.tiny">
Nov 15 00:05:43 user nova-compute[75341]:         <nova:memory>512</nova:memory>
Nov 15 00:05:43 user nova-compute[75341]:         <nova:disk>1</nova:disk>
Nov 15 00:05:43 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 15 00:05:43 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 00:05:43 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 15 00:05:43 user nova-compute[75341]:       </nova:flavor>
Nov 15 00:05:43 user nova-compute[75341]:       <nova:owner>
Nov 15 00:05:43 user nova-compute[75341]:         <nova:user uuid="1b1c77e1e34b46319dcd52a38996542c">tempest-TestMinimumBasicScenario-157558920-project-member</nova:user>
Nov 15 00:05:43 user nova-compute[75341]:         <nova:project uuid="9f8c1eeb4c3c4f27b774aba29ceb7997">tempest-TestMinimumBasicScenario-157558920</nova:project>
Nov 15 00:05:43 user nova-compute[75341]:       </nova:owner>
Nov 15 00:05:43 user nova-compute[75341]:       <nova:root type="image" uuid="8ae249fe-86cc-4262-85be-9553601c741f"/>
Nov 15 00:05:43 user nova-compute[75341]:       <nova:ports>
Nov 15 00:05:43 user nova-compute[75341]:         <nova:port uuid="e3539392-c398-4e79-9e92-92307e4036d6">
Nov 15 00:05:43 user nova-compute[75341]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 00:05:43 user nova-compute[75341]:         </nova:port>
Nov 15 00:05:43 user nova-compute[75341]:       </nova:ports>
Nov 15 00:05:43 user nova-compute[75341]:     </nova:instance>
Nov 15 00:05:43 user nova-compute[75341]:   </metadata>
Nov 15 00:05:43 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 15 00:05:43 user nova-compute[75341]:     <system>
Nov 15 00:05:43 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 00:05:43 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 15 00:05:43 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 15 00:05:43 user nova-compute[75341]:       <entry name="serial">cbf7ae6a-78da-4361-b36b-b7733a01f3bc</entry>
Nov 15 00:05:43 user nova-compute[75341]:       <entry name="uuid">cbf7ae6a-78da-4361-b36b-b7733a01f3bc</entry>
Nov 15 00:05:43 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 15 00:05:43 user nova-compute[75341]:     </system>
Nov 15 00:05:43 user nova-compute[75341]:   </sysinfo>
Nov 15 00:05:43 user nova-compute[75341]:   <os>
Nov 15 00:05:43 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 00:05:43 user nova-compute[75341]:     <boot dev="hd"/>
Nov 15 00:05:43 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 15 00:05:43 user nova-compute[75341]:   </os>
Nov 15 00:05:43 user nova-compute[75341]:   <features>
Nov 15 00:05:43 user nova-compute[75341]:     <acpi/>
Nov 15 00:05:43 user nova-compute[75341]:     <apic/>
Nov 15 00:05:43 user nova-compute[75341]:     <vmcoreinfo/>
Nov 15 00:05:43 user nova-compute[75341]:   </features>
Nov 15 00:05:43 user nova-compute[75341]:   <clock offset="utc">
Nov 15 00:05:43 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 00:05:43 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 00:05:43 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 15 00:05:43 user nova-compute[75341]:   </clock>
Nov 15 00:05:43 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 15 00:05:43 user nova-compute[75341]:     <model>Nehalem</model>
Nov 15 00:05:43 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 00:05:43 user nova-compute[75341]:   </cpu>
Nov 15 00:05:43 user nova-compute[75341]:   <devices>
Nov 15 00:05:43 user nova-compute[75341]:     <disk type="file" device="disk">
Nov 15 00:05:43 user nova-compute[75341]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 00:05:43 user nova-compute[75341]:       <source file="/opt/stack/data/nova/instances/cbf7ae6a-78da-4361-b36b-b7733a01f3bc/disk"/>
Nov 15 00:05:43 user nova-compute[75341]:       <target dev="vda" bus="virtio"/>
Nov 15 00:05:43 user nova-compute[75341]:     </disk>
Nov 15 00:05:43 user nova-compute[75341]:     <interface type="ethernet">
Nov 15 00:05:43 user nova-compute[75341]:       <mac address="fa:16:3e:0e:c2:2d"/>
Nov 15 00:05:43 user nova-compute[75341]:       <model type="virtio"/>
Nov 15 00:05:43 user nova-compute[75341]:       <mtu size="1442"/>
Nov 15 00:05:43 user nova-compute[75341]:       <target dev="tape3539392-c3"/>
Nov 15 00:05:43 user nova-compute[75341]:     </interface>
Nov 15 00:05:43 user nova-compute[75341]:     <serial type="pty">
Nov 15 00:05:43 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/cbf7ae6a-78da-4361-b36b-b7733a01f3bc/console.log" append="off"/>
Nov 15 00:05:43 user nova-compute[75341]:     </serial>
Nov 15 00:05:43 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 00:05:43 user nova-compute[75341]:     <video>
Nov 15 00:05:43 user nova-compute[75341]:       <model type="virtio"/>
Nov 15 00:05:43 user nova-compute[75341]:     </video>
Nov 15 00:05:43 user nova-compute[75341]:     <rng model="virtio">
Nov 15 00:05:43 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 15 00:05:43 user nova-compute[75341]:     </rng>
Nov 15 00:05:43 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 15 00:05:43 user nova-compute[75341]:     <memballoon model="virtio">
Nov 15 00:05:43 user nova-compute[75341]:       <stats period="10"/>
Nov 15 00:05:43 user nova-compute[75341]:     </memballoon>
Nov 15 00:05:43 user nova-compute[75341]:   </devices>
Nov 15 00:05:43 user nova-compute[75341]: </domain>
Nov 15 00:05:43 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 00:05:43 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T00:05:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1694659356',display_name='tempest-TestMinimumBasicScenario-server-1694659356',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1694659356',id=46,image_ref='8ae249fe-86cc-4262-85be-9553601c741f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEf7PjHmw6p5xUZ/pEck9JyDCpw8TggB8BHdTujoi1XDHMJnru0QSiWCmn25IccX+U3otOQTs5Y4UdmKX0pFaT/4IrGzR9Ks4CEkPQJW6hD8aZQngMWLmGIr6xMc3lg3pQ==',key_name='tempest-TestMinimumBasicScenario-333149133',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f8c1eeb4c3c4f27b774aba29ceb7997',ramdisk_id='',reservation_id='r-4gt9mtbu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8ae249fe-86cc-4262-85be-9553601c741f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-157558920',owner_user_name='tempest-TestMinimumBasicScenario-157558920-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T00:05:41Z,user_data=None,user_id='1b1c77e1e34b46319dcd52a38996542c',uuid=cbf7ae6a-78da-4361-b36b-b7733a01f3bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e3539392-c398-4e79-9e92-92307e4036d6", "address": "fa:16:3e:0e:c2:2d", "network": {"id": "e8f13b75-3423-43ce-b6dc-843c837e46d2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-617247022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8c1eeb4c3c4f27b774aba29ceb7997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3539392-c3", "ovs_interfaceid": "e3539392-c398-4e79-9e92-92307e4036d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 00:05:43 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Converting VIF {"id": "e3539392-c398-4e79-9e92-92307e4036d6", "address": "fa:16:3e:0e:c2:2d", "network": {"id": "e8f13b75-3423-43ce-b6dc-843c837e46d2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-617247022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8c1eeb4c3c4f27b774aba29ceb7997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3539392-c3", "ovs_interfaceid": "e3539392-c398-4e79-9e92-92307e4036d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 00:05:43 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:c2:2d,bridge_name='br-int',has_traffic_filtering=True,id=e3539392-c398-4e79-9e92-92307e4036d6,network=Network(e8f13b75-3423-43ce-b6dc-843c837e46d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3539392-c3') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 00:05:43 user nova-compute[75341]: DEBUG os_vif [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:c2:2d,bridge_name='br-int',has_traffic_filtering=True,id=e3539392-c398-4e79-9e92-92307e4036d6,network=Network(e8f13b75-3423-43ce-b6dc-843c837e46d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3539392-c3') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 00:05:43 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:05:43 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:05:43 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 00:05:43 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:05:43 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4864c78f-b6b9-57c9-bb56-1ab3e1db51fa', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:05:43 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:05:43 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:05:43 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:05:43 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape3539392-c3, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:05:43 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape3539392-c3, col_values=(('qos', UUID('891243c4-6038-42e3-9239-ff5f52a163aa')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:05:43 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape3539392-c3, col_values=(('external_ids', {'iface-id': 'e3539392-c398-4e79-9e92-92307e4036d6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:c2:2d', 'vm-uuid': 'cbf7ae6a-78da-4361-b36b-b7733a01f3bc'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:05:43 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:05:43 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:05:43 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:05:43 user nova-compute[75341]: INFO os_vif [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:c2:2d,bridge_name='br-int',has_traffic_filtering=True,id=e3539392-c398-4e79-9e92-92307e4036d6,network=Network(e8f13b75-3423-43ce-b6dc-843c837e46d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3539392-c3')
Nov 15 00:05:43 user nova-compute[75341]: DEBUG nova.network.neutron [req-d81236a4-a6a4-4788-bde1-00f504c9e87e req-7d67ec2d-d9da-4d8a-9cd6-1d26180b5b3c service nova] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Updated VIF entry in instance network info cache for port e3539392-c398-4e79-9e92-92307e4036d6. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 00:05:43 user nova-compute[75341]: DEBUG nova.network.neutron [req-d81236a4-a6a4-4788-bde1-00f504c9e87e req-7d67ec2d-d9da-4d8a-9cd6-1d26180b5b3c service nova] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Updating instance_info_cache with network_info: [{"id": "e3539392-c398-4e79-9e92-92307e4036d6", "address": "fa:16:3e:0e:c2:2d", "network": {"id": "e8f13b75-3423-43ce-b6dc-843c837e46d2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-617247022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8c1eeb4c3c4f27b774aba29ceb7997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3539392-c3", "ovs_interfaceid": "e3539392-c398-4e79-9e92-92307e4036d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:05:43 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-d81236a4-a6a4-4788-bde1-00f504c9e87e req-7d67ec2d-d9da-4d8a-9cd6-1d26180b5b3c service nova] Releasing lock "refresh_cache-cbf7ae6a-78da-4361-b36b-b7733a01f3bc" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:05:43 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 00:05:43 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] No VIF found with MAC fa:16:3e:0e:c2:2d, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 00:05:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:05:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:05:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:05:44 user nova-compute[75341]: DEBUG nova.compute.manager [req-74d10e29-3349-443c-8edb-c5bf591ac3df req-ec7eb71e-48e7-4535-88eb-5bff52bc98a0 service nova] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Received event network-vif-plugged-e3539392-c398-4e79-9e92-92307e4036d6 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:05:44 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-74d10e29-3349-443c-8edb-c5bf591ac3df req-ec7eb71e-48e7-4535-88eb-5bff52bc98a0 service nova] Acquiring lock "cbf7ae6a-78da-4361-b36b-b7733a01f3bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:05:44 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-74d10e29-3349-443c-8edb-c5bf591ac3df req-ec7eb71e-48e7-4535-88eb-5bff52bc98a0 service nova] Lock "cbf7ae6a-78da-4361-b36b-b7733a01f3bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:05:44 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-74d10e29-3349-443c-8edb-c5bf591ac3df req-ec7eb71e-48e7-4535-88eb-5bff52bc98a0 service nova] Lock "cbf7ae6a-78da-4361-b36b-b7733a01f3bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:05:44 user nova-compute[75341]: DEBUG nova.compute.manager [req-74d10e29-3349-443c-8edb-c5bf591ac3df req-ec7eb71e-48e7-4535-88eb-5bff52bc98a0 service nova] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] No waiting events found dispatching network-vif-plugged-e3539392-c398-4e79-9e92-92307e4036d6 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:05:44 user nova-compute[75341]: WARNING nova.compute.manager [req-74d10e29-3349-443c-8edb-c5bf591ac3df req-ec7eb71e-48e7-4535-88eb-5bff52bc98a0 service nova] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Received unexpected event network-vif-plugged-e3539392-c398-4e79-9e92-92307e4036d6 for instance with vm_state building and task_state spawning.
Nov 15 00:05:45 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:05:45 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:05:45 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:05:46 user nova-compute[75341]: DEBUG nova.compute.manager [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Instance event wait completed in 0 seconds for  {{(pid=75341) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 00:05:46 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Guest created on hypervisor {{(pid=75341) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 00:05:46 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Instance spawned successfully.
Nov 15 00:05:46 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 00:05:46 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Found default for hw_cdrom_bus of ide {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 00:05:46 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Found default for hw_disk_bus of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 00:05:46 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Found default for hw_input_bus of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 00:05:46 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Found default for hw_pointer_model of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 00:05:46 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Found default for hw_video_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 00:05:46 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Found default for hw_vif_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 00:05:46 user nova-compute[75341]: INFO nova.compute.manager [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Took 5.83 seconds to spawn the instance on the hypervisor.
Nov 15 00:05:46 user nova-compute[75341]: DEBUG nova.compute.manager [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 00:05:46 user nova-compute[75341]: INFO nova.compute.manager [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Took 6.44 seconds to build instance.
Nov 15 00:05:46 user nova-compute[75341]: DEBUG nova.compute.manager [req-2e5cf925-30c4-45fe-86bf-0bd18043b593 req-37096367-2db7-4d80-97e8-adef95d2299e service nova] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Received event network-vif-plugged-e3539392-c398-4e79-9e92-92307e4036d6 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:05:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-2e5cf925-30c4-45fe-86bf-0bd18043b593 req-37096367-2db7-4d80-97e8-adef95d2299e service nova] Acquiring lock "cbf7ae6a-78da-4361-b36b-b7733a01f3bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:05:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-2e5cf925-30c4-45fe-86bf-0bd18043b593 req-37096367-2db7-4d80-97e8-adef95d2299e service nova] Lock "cbf7ae6a-78da-4361-b36b-b7733a01f3bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:05:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-2e5cf925-30c4-45fe-86bf-0bd18043b593 req-37096367-2db7-4d80-97e8-adef95d2299e service nova] Lock "cbf7ae6a-78da-4361-b36b-b7733a01f3bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:05:46 user nova-compute[75341]: DEBUG nova.compute.manager [req-2e5cf925-30c4-45fe-86bf-0bd18043b593 req-37096367-2db7-4d80-97e8-adef95d2299e service nova] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] No waiting events found dispatching network-vif-plugged-e3539392-c398-4e79-9e92-92307e4036d6 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:05:46 user nova-compute[75341]: WARNING nova.compute.manager [req-2e5cf925-30c4-45fe-86bf-0bd18043b593 req-37096367-2db7-4d80-97e8-adef95d2299e service nova] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Received unexpected event network-vif-plugged-e3539392-c398-4e79-9e92-92307e4036d6 for instance with vm_state active and task_state None.
Nov 15 00:05:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d0253b20-9020-4566-9475-d0e9132e0520 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "cbf7ae6a-78da-4361-b36b-b7733a01f3bc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.542s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:05:47 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:05:48 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:05:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e9b28b11-c1f6-4311-b573-e6d3161f8778 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Acquiring lock "defae731-4191-4526-99cc-a301cf5b3355" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:05:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e9b28b11-c1f6-4311-b573-e6d3161f8778 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "defae731-4191-4526-99cc-a301cf5b3355" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:05:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e9b28b11-c1f6-4311-b573-e6d3161f8778 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Acquiring lock "defae731-4191-4526-99cc-a301cf5b3355-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:05:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e9b28b11-c1f6-4311-b573-e6d3161f8778 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "defae731-4191-4526-99cc-a301cf5b3355-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:05:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e9b28b11-c1f6-4311-b573-e6d3161f8778 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "defae731-4191-4526-99cc-a301cf5b3355-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:05:51 user nova-compute[75341]: INFO nova.compute.manager [None req-e9b28b11-c1f6-4311-b573-e6d3161f8778 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: defae731-4191-4526-99cc-a301cf5b3355] Terminating instance
Nov 15 00:05:51 user nova-compute[75341]: DEBUG nova.compute.manager [None req-e9b28b11-c1f6-4311-b573-e6d3161f8778 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: defae731-4191-4526-99cc-a301cf5b3355] Start destroying the instance on the hypervisor. {{(pid=75341) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 00:05:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:05:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:05:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:05:52 user nova-compute[75341]: DEBUG nova.compute.manager [req-ff059806-3e77-4b58-8e4a-a5e597102c43 req-e454da1f-4665-4267-a50d-ad0c84908134 service nova] [instance: defae731-4191-4526-99cc-a301cf5b3355] Received event network-vif-unplugged-10b83231-0b39-4dee-95db-bb6a03d70fc0 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:05:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ff059806-3e77-4b58-8e4a-a5e597102c43 req-e454da1f-4665-4267-a50d-ad0c84908134 service nova] Acquiring lock "defae731-4191-4526-99cc-a301cf5b3355-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:05:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ff059806-3e77-4b58-8e4a-a5e597102c43 req-e454da1f-4665-4267-a50d-ad0c84908134 service nova] Lock "defae731-4191-4526-99cc-a301cf5b3355-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:05:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ff059806-3e77-4b58-8e4a-a5e597102c43 req-e454da1f-4665-4267-a50d-ad0c84908134 service nova] Lock "defae731-4191-4526-99cc-a301cf5b3355-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:05:52 user nova-compute[75341]: DEBUG nova.compute.manager [req-ff059806-3e77-4b58-8e4a-a5e597102c43 req-e454da1f-4665-4267-a50d-ad0c84908134 service nova] [instance: defae731-4191-4526-99cc-a301cf5b3355] No waiting events found dispatching network-vif-unplugged-10b83231-0b39-4dee-95db-bb6a03d70fc0 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:05:52 user nova-compute[75341]: DEBUG nova.compute.manager [req-ff059806-3e77-4b58-8e4a-a5e597102c43 req-e454da1f-4665-4267-a50d-ad0c84908134 service nova] [instance: defae731-4191-4526-99cc-a301cf5b3355] Received event network-vif-unplugged-10b83231-0b39-4dee-95db-bb6a03d70fc0 for instance with task_state deleting. {{(pid=75341) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 00:05:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:05:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:05:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:05:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:05:52 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: defae731-4191-4526-99cc-a301cf5b3355] Instance destroyed successfully.
Nov 15 00:05:52 user nova-compute[75341]: DEBUG nova.objects.instance [None req-e9b28b11-c1f6-4311-b573-e6d3161f8778 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lazy-loading 'resources' on Instance uuid defae731-4191-4526-99cc-a301cf5b3355 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:05:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:05:52 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-e9b28b11-c1f6-4311-b573-e6d3161f8778 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T23:46:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-285831932',display_name='tempest-ServerActionsTestOtherA-server-285831932',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-285831932',id=25,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTmBE+Takjbl0ZrUdtoD/FDS2CHZC4n75Y/1LCLwXLZHE8J0GqhfVD/envyBMKYWUkAGQH/bKcOVnVKa4qF07KOQ/PvMrk+gG45OxOvZ8A6PGkmy0qPqzF8MOOmxhYzVQ==',key_name='tempest-keypair-1744456340',keypairs=<?>,launch_index=0,launched_at=2023-11-14T23:47:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f4c69a942b4f4b97a1a3152dea86c7fb',ramdisk_id='',reservation_id='r-p3i0uwft',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1796396043',owner_user_name='tempest-ServerActionsTestOtherA-1796396043-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T23:47:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='442aae0161f347d0a79b168a1b60286a',uuid=defae731-4191-4526-99cc-a301cf5b3355,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "10b83231-0b39-4dee-95db-bb6a03d70fc0", "address": "fa:16:3e:b7:3a:83", "network": {"id": "d86a8e7f-6658-4994-9a13-eb3163bd3865", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-635863702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c69a942b4f4b97a1a3152dea86c7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10b83231-0b", "ovs_interfaceid": "10b83231-0b39-4dee-95db-bb6a03d70fc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 00:05:52 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-e9b28b11-c1f6-4311-b573-e6d3161f8778 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Converting VIF {"id": "10b83231-0b39-4dee-95db-bb6a03d70fc0", "address": "fa:16:3e:b7:3a:83", "network": {"id": "d86a8e7f-6658-4994-9a13-eb3163bd3865", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-635863702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4c69a942b4f4b97a1a3152dea86c7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10b83231-0b", "ovs_interfaceid": "10b83231-0b39-4dee-95db-bb6a03d70fc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 00:05:52 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-e9b28b11-c1f6-4311-b573-e6d3161f8778 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b7:3a:83,bridge_name='br-int',has_traffic_filtering=True,id=10b83231-0b39-4dee-95db-bb6a03d70fc0,network=Network(d86a8e7f-6658-4994-9a13-eb3163bd3865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10b83231-0b') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 00:05:52 user nova-compute[75341]: DEBUG os_vif [None req-e9b28b11-c1f6-4311-b573-e6d3161f8778 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:3a:83,bridge_name='br-int',has_traffic_filtering=True,id=10b83231-0b39-4dee-95db-bb6a03d70fc0,network=Network(d86a8e7f-6658-4994-9a13-eb3163bd3865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10b83231-0b') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 00:05:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:05:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap10b83231-0b, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:05:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:05:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:05:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:05:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8eab567d-9e4c-4a01-811f-e036218258e5) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:05:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:05:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:05:52 user nova-compute[75341]: INFO os_vif [None req-e9b28b11-c1f6-4311-b573-e6d3161f8778 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:3a:83,bridge_name='br-int',has_traffic_filtering=True,id=10b83231-0b39-4dee-95db-bb6a03d70fc0,network=Network(d86a8e7f-6658-4994-9a13-eb3163bd3865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10b83231-0b')
Nov 15 00:05:52 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-e9b28b11-c1f6-4311-b573-e6d3161f8778 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: defae731-4191-4526-99cc-a301cf5b3355] Deleting instance files /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355_del
Nov 15 00:05:52 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-e9b28b11-c1f6-4311-b573-e6d3161f8778 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: defae731-4191-4526-99cc-a301cf5b3355] Deletion of /opt/stack/data/nova/instances/defae731-4191-4526-99cc-a301cf5b3355_del complete
Nov 15 00:05:52 user nova-compute[75341]: INFO nova.compute.manager [None req-e9b28b11-c1f6-4311-b573-e6d3161f8778 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] [instance: defae731-4191-4526-99cc-a301cf5b3355] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 15 00:05:52 user nova-compute[75341]: DEBUG oslo.service.loopingcall [None req-e9b28b11-c1f6-4311-b573-e6d3161f8778 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75341) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 00:05:52 user nova-compute[75341]: DEBUG nova.compute.manager [-] [instance: defae731-4191-4526-99cc-a301cf5b3355] Deallocating network for instance {{(pid=75341) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 00:05:52 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: defae731-4191-4526-99cc-a301cf5b3355] deallocate_for_instance() {{(pid=75341) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 00:05:53 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: defae731-4191-4526-99cc-a301cf5b3355] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:05:53 user nova-compute[75341]: INFO nova.compute.manager [-] [instance: defae731-4191-4526-99cc-a301cf5b3355] Took 0.43 seconds to deallocate network for instance.
Nov 15 00:05:53 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:05:53 user nova-compute[75341]: DEBUG nova.compute.manager [req-c96ac715-90a6-4f88-be32-5215b88dab1f req-5004f906-4ae5-45ae-aaf8-8dfa62f80939 service nova] [instance: defae731-4191-4526-99cc-a301cf5b3355] Received event network-vif-deleted-10b83231-0b39-4dee-95db-bb6a03d70fc0 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:05:53 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:05:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e9b28b11-c1f6-4311-b573-e6d3161f8778 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:05:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e9b28b11-c1f6-4311-b573-e6d3161f8778 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:05:53 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:05:53 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-e9b28b11-c1f6-4311-b573-e6d3161f8778 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 00:05:53 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:05:53 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-e9b28b11-c1f6-4311-b573-e6d3161f8778 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 00:05:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e9b28b11-c1f6-4311-b573-e6d3161f8778 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.142s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:05:53 user nova-compute[75341]: INFO nova.scheduler.client.report [None req-e9b28b11-c1f6-4311-b573-e6d3161f8778 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Deleted allocations for instance defae731-4191-4526-99cc-a301cf5b3355
Nov 15 00:05:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-e9b28b11-c1f6-4311-b573-e6d3161f8778 tempest-ServerActionsTestOtherA-1796396043 tempest-ServerActionsTestOtherA-1796396043-project-member] Lock "defae731-4191-4526-99cc-a301cf5b3355" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.630s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:05:54 user nova-compute[75341]: DEBUG nova.compute.manager [req-7109a3fb-dc8e-4354-a0da-1e347ced1309 req-e14aea6b-72f2-4f43-add6-fe71abcbda7d service nova] [instance: defae731-4191-4526-99cc-a301cf5b3355] Received event network-vif-plugged-10b83231-0b39-4dee-95db-bb6a03d70fc0 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:05:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-7109a3fb-dc8e-4354-a0da-1e347ced1309 req-e14aea6b-72f2-4f43-add6-fe71abcbda7d service nova] Acquiring lock "defae731-4191-4526-99cc-a301cf5b3355-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:05:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-7109a3fb-dc8e-4354-a0da-1e347ced1309 req-e14aea6b-72f2-4f43-add6-fe71abcbda7d service nova] Lock "defae731-4191-4526-99cc-a301cf5b3355-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:05:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-7109a3fb-dc8e-4354-a0da-1e347ced1309 req-e14aea6b-72f2-4f43-add6-fe71abcbda7d service nova] Lock "defae731-4191-4526-99cc-a301cf5b3355-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:05:54 user nova-compute[75341]: DEBUG nova.compute.manager [req-7109a3fb-dc8e-4354-a0da-1e347ced1309 req-e14aea6b-72f2-4f43-add6-fe71abcbda7d service nova] [instance: defae731-4191-4526-99cc-a301cf5b3355] No waiting events found dispatching network-vif-plugged-10b83231-0b39-4dee-95db-bb6a03d70fc0 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:05:54 user nova-compute[75341]: WARNING nova.compute.manager [req-7109a3fb-dc8e-4354-a0da-1e347ced1309 req-e14aea6b-72f2-4f43-add6-fe71abcbda7d service nova] [instance: defae731-4191-4526-99cc-a301cf5b3355] Received unexpected event network-vif-plugged-10b83231-0b39-4dee-95db-bb6a03d70fc0 for instance with vm_state deleted and task_state None.
Nov 15 00:05:54 user nova-compute[75341]: DEBUG nova.compute.manager [req-7109a3fb-dc8e-4354-a0da-1e347ced1309 req-e14aea6b-72f2-4f43-add6-fe71abcbda7d service nova] [instance: defae731-4191-4526-99cc-a301cf5b3355] Received event network-vif-plugged-10b83231-0b39-4dee-95db-bb6a03d70fc0 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:05:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-7109a3fb-dc8e-4354-a0da-1e347ced1309 req-e14aea6b-72f2-4f43-add6-fe71abcbda7d service nova] Acquiring lock "defae731-4191-4526-99cc-a301cf5b3355-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:05:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-7109a3fb-dc8e-4354-a0da-1e347ced1309 req-e14aea6b-72f2-4f43-add6-fe71abcbda7d service nova] Lock "defae731-4191-4526-99cc-a301cf5b3355-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:05:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-7109a3fb-dc8e-4354-a0da-1e347ced1309 req-e14aea6b-72f2-4f43-add6-fe71abcbda7d service nova] Lock "defae731-4191-4526-99cc-a301cf5b3355-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:05:54 user nova-compute[75341]: DEBUG nova.compute.manager [req-7109a3fb-dc8e-4354-a0da-1e347ced1309 req-e14aea6b-72f2-4f43-add6-fe71abcbda7d service nova] [instance: defae731-4191-4526-99cc-a301cf5b3355] No waiting events found dispatching network-vif-plugged-10b83231-0b39-4dee-95db-bb6a03d70fc0 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:05:54 user nova-compute[75341]: WARNING nova.compute.manager [req-7109a3fb-dc8e-4354-a0da-1e347ced1309 req-e14aea6b-72f2-4f43-add6-fe71abcbda7d service nova] [instance: defae731-4191-4526-99cc-a301cf5b3355] Received unexpected event network-vif-plugged-10b83231-0b39-4dee-95db-bb6a03d70fc0 for instance with vm_state deleted and task_state None.
Nov 15 00:05:54 user nova-compute[75341]: DEBUG nova.compute.manager [req-7109a3fb-dc8e-4354-a0da-1e347ced1309 req-e14aea6b-72f2-4f43-add6-fe71abcbda7d service nova] [instance: defae731-4191-4526-99cc-a301cf5b3355] Received event network-vif-plugged-10b83231-0b39-4dee-95db-bb6a03d70fc0 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:05:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-7109a3fb-dc8e-4354-a0da-1e347ced1309 req-e14aea6b-72f2-4f43-add6-fe71abcbda7d service nova] Acquiring lock "defae731-4191-4526-99cc-a301cf5b3355-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:05:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-7109a3fb-dc8e-4354-a0da-1e347ced1309 req-e14aea6b-72f2-4f43-add6-fe71abcbda7d service nova] Lock "defae731-4191-4526-99cc-a301cf5b3355-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:05:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-7109a3fb-dc8e-4354-a0da-1e347ced1309 req-e14aea6b-72f2-4f43-add6-fe71abcbda7d service nova] Lock "defae731-4191-4526-99cc-a301cf5b3355-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:05:54 user nova-compute[75341]: DEBUG nova.compute.manager [req-7109a3fb-dc8e-4354-a0da-1e347ced1309 req-e14aea6b-72f2-4f43-add6-fe71abcbda7d service nova] [instance: defae731-4191-4526-99cc-a301cf5b3355] No waiting events found dispatching network-vif-plugged-10b83231-0b39-4dee-95db-bb6a03d70fc0 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:05:54 user nova-compute[75341]: WARNING nova.compute.manager [req-7109a3fb-dc8e-4354-a0da-1e347ced1309 req-e14aea6b-72f2-4f43-add6-fe71abcbda7d service nova] [instance: defae731-4191-4526-99cc-a301cf5b3355] Received unexpected event network-vif-plugged-10b83231-0b39-4dee-95db-bb6a03d70fc0 for instance with vm_state deleted and task_state None.
Nov 15 00:05:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:06:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:06:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:06:02 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:06:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:06:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:06:07 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:06:07 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:06:07 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75341) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 00:06:07 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:06:07 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Cleaning up deleted instances {{(pid=75341) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 00:06:07 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] There are 0 instances to clean {{(pid=75341) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 00:06:10 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:06:10 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:06:10 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:06:10 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:06:11 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:06:11 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Starting heal instance info cache {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 00:06:11 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Rebuilding the list of instances to heal {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 00:06:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "refresh_cache-cbf7ae6a-78da-4361-b36b-b7733a01f3bc" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:06:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquired lock "refresh_cache-cbf7ae6a-78da-4361-b36b-b7733a01f3bc" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:06:12 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Forcefully refreshing network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 00:06:12 user nova-compute[75341]: DEBUG nova.objects.instance [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lazy-loading 'info_cache' on Instance uuid cbf7ae6a-78da-4361-b36b-b7733a01f3bc {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:06:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:06:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:06:12 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Updating instance_info_cache with network_info: [{"id": "e3539392-c398-4e79-9e92-92307e4036d6", "address": "fa:16:3e:0e:c2:2d", "network": {"id": "e8f13b75-3423-43ce-b6dc-843c837e46d2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-617247022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8c1eeb4c3c4f27b774aba29ceb7997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3539392-c3", "ovs_interfaceid": "e3539392-c398-4e79-9e92-92307e4036d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:06:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Releasing lock "refresh_cache-cbf7ae6a-78da-4361-b36b-b7733a01f3bc" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:06:12 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Updated the network info_cache for instance {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 00:06:12 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:06:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:06:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:06:12 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:06:12 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75341) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 00:06:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbf7ae6a-78da-4361-b36b-b7733a01f3bc/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:06:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbf7ae6a-78da-4361-b36b-b7733a01f3bc/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:06:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbf7ae6a-78da-4361-b36b-b7733a01f3bc/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:06:13 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbf7ae6a-78da-4361-b36b-b7733a01f3bc/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:06:13 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:06:13 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:06:13 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Hypervisor/Node resource view: name=user free_ram=8900MB free_disk=25.378856658935547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75341) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 00:06:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:06:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:06:13 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance cbf7ae6a-78da-4361-b36b-b7733a01f3bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:06:13 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 00:06:13 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 00:06:13 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Refreshing inventories for resource provider 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 00:06:13 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Updating ProviderTree inventory for provider 8fa114cc-b541-418f-865c-16c44294e72d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 00:06:13 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Updating inventory in ProviderTree for provider 8fa114cc-b541-418f-865c-16c44294e72d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 00:06:13 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Refreshing aggregate associations for resource provider 8fa114cc-b541-418f-865c-16c44294e72d, aggregates: None {{(pid=75341) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 00:06:14 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Refreshing trait associations for resource provider 8fa114cc-b541-418f-865c-16c44294e72d, traits: COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_MMX,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000E {{(pid=75341) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 00:06:14 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 00:06:14 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 00:06:14 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Compute_service record updated for user:user {{(pid=75341) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 00:06:14 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.415s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:06:14 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:06:14 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:06:14 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:06:14 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75341) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 00:06:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:06:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:06:18 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:06:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:06:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:06:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:06:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:06:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:06:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:06:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:06:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:06:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:06:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:06:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:06:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:06:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:06:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:06:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:06:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:06:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:06:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:06:35 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:06:35 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Triggering sync for uuid cbf7ae6a-78da-4361-b36b-b7733a01f3bc {{(pid=75341) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 00:06:35 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "cbf7ae6a-78da-4361-b36b-b7733a01f3bc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:06:35 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "cbf7ae6a-78da-4361-b36b-b7733a01f3bc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:06:36 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "cbf7ae6a-78da-4361-b36b-b7733a01f3bc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:06:37 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:06:37 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:06:37 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:06:37 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:06:37 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:06:37 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:06:42 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:06:42 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:06:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:06:47 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:06:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:06:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:06:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:06:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:06:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Acquiring lock "c332ad29-e892-4caf-aa37-fd66fb41f9ec" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:06:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "c332ad29-e892-4caf-aa37-fd66fb41f9ec" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:06:53 user nova-compute[75341]: DEBUG nova.compute.manager [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Starting instance... {{(pid=75341) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 00:06:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:06:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:06:53 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75341) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 00:06:53 user nova-compute[75341]: INFO nova.compute.claims [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Claim successful on node user
Nov 15 00:06:53 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 00:06:53 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 00:06:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.222s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:06:53 user nova-compute[75341]: DEBUG nova.compute.manager [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Start building networks asynchronously for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 00:06:53 user nova-compute[75341]: DEBUG nova.compute.manager [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Allocating IP information in the background. {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 00:06:53 user nova-compute[75341]: DEBUG nova.network.neutron [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] allocate_for_instance() {{(pid=75341) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 00:06:53 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 00:06:53 user nova-compute[75341]: DEBUG nova.compute.manager [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Start building block device mappings for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 00:06:53 user nova-compute[75341]: DEBUG nova.policy [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'abb41e7d020d4c99a55b5029cd2124a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cde913b393e4b1095ae6e8e4a74b5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75341) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 00:06:53 user nova-compute[75341]: DEBUG nova.compute.manager [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Start spawning the instance on the hypervisor. {{(pid=75341) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 00:06:53 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Creating instance directory {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 00:06:53 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Creating image(s)
Nov 15 00:06:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Acquiring lock "/opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:06:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "/opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:06:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "/opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:06:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:06:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.175s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:06:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Acquiring lock "4754efee9a6d73d3647f2add2cfe86c291949740" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:06:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:06:53 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:06:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.178s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:06:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk 1073741824 {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:06:54 user nova-compute[75341]: DEBUG nova.network.neutron [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Successfully created port: 9f65f96b-aa09-4c3a-a23b-ed444c9dacec {{(pid=75341) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 00:06:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk 1073741824" returned: 0 in 0.054s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:06:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:06:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:06:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.171s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:06:54 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk. size=1073741824 {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 00:06:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:06:54 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:06:54 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Cannot resize image /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk to a smaller size. {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 00:06:54 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Created local disks {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 00:06:54 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Ensure instance console log exists: /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/console.log {{(pid=75341) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 00:06:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:06:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:06:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:06:54 user nova-compute[75341]: DEBUG nova.network.neutron [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Successfully updated port: 9f65f96b-aa09-4c3a-a23b-ed444c9dacec {{(pid=75341) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 00:06:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Acquiring lock "refresh_cache-c332ad29-e892-4caf-aa37-fd66fb41f9ec" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:06:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Acquired lock "refresh_cache-c332ad29-e892-4caf-aa37-fd66fb41f9ec" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:06:54 user nova-compute[75341]: DEBUG nova.network.neutron [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 00:06:54 user nova-compute[75341]: DEBUG nova.compute.manager [req-672c73c5-4152-4e3b-8f12-c133e8e7914b req-d747f6a5-2901-4464-b6e0-388a78240095 service nova] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Received event network-changed-9f65f96b-aa09-4c3a-a23b-ed444c9dacec {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:06:54 user nova-compute[75341]: DEBUG nova.compute.manager [req-672c73c5-4152-4e3b-8f12-c133e8e7914b req-d747f6a5-2901-4464-b6e0-388a78240095 service nova] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Refreshing instance network info cache due to event network-changed-9f65f96b-aa09-4c3a-a23b-ed444c9dacec. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 00:06:54 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-672c73c5-4152-4e3b-8f12-c133e8e7914b req-d747f6a5-2901-4464-b6e0-388a78240095 service nova] Acquiring lock "refresh_cache-c332ad29-e892-4caf-aa37-fd66fb41f9ec" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:06:54 user nova-compute[75341]: DEBUG nova.network.neutron [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Instance cache missing network info. {{(pid=75341) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 00:06:54 user nova-compute[75341]: DEBUG nova.network.neutron [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Updating instance_info_cache with network_info: [{"id": "9f65f96b-aa09-4c3a-a23b-ed444c9dacec", "address": "fa:16:3e:c6:2e:8d", "network": {"id": "aed56292-815e-4004-9101-59ff735cf236", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cde913b393e4b1095ae6e8e4a74b5fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f65f96b-aa", "ovs_interfaceid": "9f65f96b-aa09-4c3a-a23b-ed444c9dacec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:06:55 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Releasing lock "refresh_cache-c332ad29-e892-4caf-aa37-fd66fb41f9ec" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:06:55 user nova-compute[75341]: DEBUG nova.compute.manager [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Instance network_info: |[{"id": "9f65f96b-aa09-4c3a-a23b-ed444c9dacec", "address": "fa:16:3e:c6:2e:8d", "network": {"id": "aed56292-815e-4004-9101-59ff735cf236", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cde913b393e4b1095ae6e8e4a74b5fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f65f96b-aa", "ovs_interfaceid": "9f65f96b-aa09-4c3a-a23b-ed444c9dacec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 00:06:55 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-672c73c5-4152-4e3b-8f12-c133e8e7914b req-d747f6a5-2901-4464-b6e0-388a78240095 service nova] Acquired lock "refresh_cache-c332ad29-e892-4caf-aa37-fd66fb41f9ec" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:06:55 user nova-compute[75341]: DEBUG nova.network.neutron [req-672c73c5-4152-4e3b-8f12-c133e8e7914b req-d747f6a5-2901-4464-b6e0-388a78240095 service nova] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Refreshing network info cache for port 9f65f96b-aa09-4c3a-a23b-ed444c9dacec {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 00:06:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Start _get_guest_xml network_info=[{"id": "9f65f96b-aa09-4c3a-a23b-ed444c9dacec", "address": "fa:16:3e:c6:2e:8d", "network": {"id": "aed56292-815e-4004-9101-59ff735cf236", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cde913b393e4b1095ae6e8e4a74b5fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f65f96b-aa", "ovs_interfaceid": "9f65f96b-aa09-4c3a-a23b-ed444c9dacec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encrypted': False, 'image_id': 'e46abb82-b810-490e-a8a1-ccdc5fa1a796'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 00:06:55 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:06:55 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:06:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 00:06:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 00:06:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 00:06:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 00:06:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 00:06:55 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 00:06:55 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 00:06:55 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 00:06:55 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 00:06:55 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 00:06:55 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 00:06:55 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 00:06:55 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 00:06:55 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 00:06:55 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 00:06:55 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 00:06:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T00:06:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1075278355',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1075278355',id=47,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5cde913b393e4b1095ae6e8e4a74b5fb',ramdisk_id='',reservation_id='r-1iwc0cun',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1181444554',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T00:06:54Z,user_data=None,user_id='abb41e7d020d4c99a55b5029cd2124a9',uuid=c332ad29-e892-4caf-aa37-fd66fb41f9ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f65f96b-aa09-4c3a-a23b-ed444c9dacec", "address": "fa:16:3e:c6:2e:8d", "network": {"id": "aed56292-815e-4004-9101-59ff735cf236", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cde913b393e4b1095ae6e8e4a74b5fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f65f96b-aa", "ovs_interfaceid": "9f65f96b-aa09-4c3a-a23b-ed444c9dacec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 00:06:55 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Converting VIF {"id": "9f65f96b-aa09-4c3a-a23b-ed444c9dacec", "address": "fa:16:3e:c6:2e:8d", "network": {"id": "aed56292-815e-4004-9101-59ff735cf236", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cde913b393e4b1095ae6e8e4a74b5fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f65f96b-aa", "ovs_interfaceid": "9f65f96b-aa09-4c3a-a23b-ed444c9dacec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 00:06:55 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:2e:8d,bridge_name='br-int',has_traffic_filtering=True,id=9f65f96b-aa09-4c3a-a23b-ed444c9dacec,network=Network(aed56292-815e-4004-9101-59ff735cf236),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f65f96b-aa') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 00:06:55 user nova-compute[75341]: DEBUG nova.objects.instance [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lazy-loading 'pci_devices' on Instance uuid c332ad29-e892-4caf-aa37-fd66fb41f9ec {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:06:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] End _get_guest_xml xml=<domain type="kvm">
Nov 15 00:06:55 user nova-compute[75341]:   <uuid>c332ad29-e892-4caf-aa37-fd66fb41f9ec</uuid>
Nov 15 00:06:55 user nova-compute[75341]:   <name>instance-0000002f</name>
Nov 15 00:06:55 user nova-compute[75341]:   <memory>524288</memory>
Nov 15 00:06:55 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 15 00:06:55 user nova-compute[75341]:   <metadata>
Nov 15 00:06:55 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 00:06:55 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 15 00:06:55 user nova-compute[75341]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1075278355</nova:name>
Nov 15 00:06:55 user nova-compute[75341]:       <nova:creationTime>2023-11-15 00:06:55</nova:creationTime>
Nov 15 00:06:55 user nova-compute[75341]:       <nova:flavor name="m1.tiny">
Nov 15 00:06:55 user nova-compute[75341]:         <nova:memory>512</nova:memory>
Nov 15 00:06:55 user nova-compute[75341]:         <nova:disk>1</nova:disk>
Nov 15 00:06:55 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 15 00:06:55 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 00:06:55 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 15 00:06:55 user nova-compute[75341]:       </nova:flavor>
Nov 15 00:06:55 user nova-compute[75341]:       <nova:owner>
Nov 15 00:06:55 user nova-compute[75341]:         <nova:user uuid="abb41e7d020d4c99a55b5029cd2124a9">tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member</nova:user>
Nov 15 00:06:55 user nova-compute[75341]:         <nova:project uuid="5cde913b393e4b1095ae6e8e4a74b5fb">tempest-ServerBootFromVolumeStableRescueTest-1181444554</nova:project>
Nov 15 00:06:55 user nova-compute[75341]:       </nova:owner>
Nov 15 00:06:55 user nova-compute[75341]:       <nova:root type="image" uuid="e46abb82-b810-490e-a8a1-ccdc5fa1a796"/>
Nov 15 00:06:55 user nova-compute[75341]:       <nova:ports>
Nov 15 00:06:55 user nova-compute[75341]:         <nova:port uuid="9f65f96b-aa09-4c3a-a23b-ed444c9dacec">
Nov 15 00:06:55 user nova-compute[75341]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 00:06:55 user nova-compute[75341]:         </nova:port>
Nov 15 00:06:55 user nova-compute[75341]:       </nova:ports>
Nov 15 00:06:55 user nova-compute[75341]:     </nova:instance>
Nov 15 00:06:55 user nova-compute[75341]:   </metadata>
Nov 15 00:06:55 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 15 00:06:55 user nova-compute[75341]:     <system>
Nov 15 00:06:55 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 00:06:55 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 15 00:06:55 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 15 00:06:55 user nova-compute[75341]:       <entry name="serial">c332ad29-e892-4caf-aa37-fd66fb41f9ec</entry>
Nov 15 00:06:55 user nova-compute[75341]:       <entry name="uuid">c332ad29-e892-4caf-aa37-fd66fb41f9ec</entry>
Nov 15 00:06:55 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 15 00:06:55 user nova-compute[75341]:     </system>
Nov 15 00:06:55 user nova-compute[75341]:   </sysinfo>
Nov 15 00:06:55 user nova-compute[75341]:   <os>
Nov 15 00:06:55 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 00:06:55 user nova-compute[75341]:     <boot dev="hd"/>
Nov 15 00:06:55 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 15 00:06:55 user nova-compute[75341]:   </os>
Nov 15 00:06:55 user nova-compute[75341]:   <features>
Nov 15 00:06:55 user nova-compute[75341]:     <acpi/>
Nov 15 00:06:55 user nova-compute[75341]:     <apic/>
Nov 15 00:06:55 user nova-compute[75341]:     <vmcoreinfo/>
Nov 15 00:06:55 user nova-compute[75341]:   </features>
Nov 15 00:06:55 user nova-compute[75341]:   <clock offset="utc">
Nov 15 00:06:55 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 00:06:55 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 00:06:55 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 15 00:06:55 user nova-compute[75341]:   </clock>
Nov 15 00:06:55 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 15 00:06:55 user nova-compute[75341]:     <model>Nehalem</model>
Nov 15 00:06:55 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 00:06:55 user nova-compute[75341]:   </cpu>
Nov 15 00:06:55 user nova-compute[75341]:   <devices>
Nov 15 00:06:55 user nova-compute[75341]:     <disk type="file" device="disk">
Nov 15 00:06:55 user nova-compute[75341]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 00:06:55 user nova-compute[75341]:       <source file="/opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk"/>
Nov 15 00:06:55 user nova-compute[75341]:       <target dev="vda" bus="virtio"/>
Nov 15 00:06:55 user nova-compute[75341]:     </disk>
Nov 15 00:06:55 user nova-compute[75341]:     <interface type="ethernet">
Nov 15 00:06:55 user nova-compute[75341]:       <mac address="fa:16:3e:c6:2e:8d"/>
Nov 15 00:06:55 user nova-compute[75341]:       <model type="virtio"/>
Nov 15 00:06:55 user nova-compute[75341]:       <mtu size="1442"/>
Nov 15 00:06:55 user nova-compute[75341]:       <target dev="tap9f65f96b-aa"/>
Nov 15 00:06:55 user nova-compute[75341]:     </interface>
Nov 15 00:06:55 user nova-compute[75341]:     <serial type="pty">
Nov 15 00:06:55 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/console.log" append="off"/>
Nov 15 00:06:55 user nova-compute[75341]:     </serial>
Nov 15 00:06:55 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 00:06:55 user nova-compute[75341]:     <video>
Nov 15 00:06:55 user nova-compute[75341]:       <model type="virtio"/>
Nov 15 00:06:55 user nova-compute[75341]:     </video>
Nov 15 00:06:55 user nova-compute[75341]:     <rng model="virtio">
Nov 15 00:06:55 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 15 00:06:55 user nova-compute[75341]:     </rng>
Nov 15 00:06:55 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 15 00:06:55 user nova-compute[75341]:     <memballoon model="virtio">
Nov 15 00:06:55 user nova-compute[75341]:       <stats period="10"/>
Nov 15 00:06:55 user nova-compute[75341]:     </memballoon>
Nov 15 00:06:55 user nova-compute[75341]:   </devices>
Nov 15 00:06:55 user nova-compute[75341]: </domain>
Nov 15 00:06:55 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 00:06:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T00:06:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1075278355',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1075278355',id=47,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5cde913b393e4b1095ae6e8e4a74b5fb',ramdisk_id='',reservation_id='r-1iwc0cun',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1181444554',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T00:06:54Z,user_data=None,user_id='abb41e7d020d4c99a55b5029cd2124a9',uuid=c332ad29-e892-4caf-aa37-fd66fb41f9ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f65f96b-aa09-4c3a-a23b-ed444c9dacec", "address": "fa:16:3e:c6:2e:8d", "network": {"id": "aed56292-815e-4004-9101-59ff735cf236", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cde913b393e4b1095ae6e8e4a74b5fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f65f96b-aa", "ovs_interfaceid": "9f65f96b-aa09-4c3a-a23b-ed444c9dacec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 00:06:55 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Converting VIF {"id": "9f65f96b-aa09-4c3a-a23b-ed444c9dacec", "address": "fa:16:3e:c6:2e:8d", "network": {"id": "aed56292-815e-4004-9101-59ff735cf236", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cde913b393e4b1095ae6e8e4a74b5fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f65f96b-aa", "ovs_interfaceid": "9f65f96b-aa09-4c3a-a23b-ed444c9dacec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 00:06:55 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:2e:8d,bridge_name='br-int',has_traffic_filtering=True,id=9f65f96b-aa09-4c3a-a23b-ed444c9dacec,network=Network(aed56292-815e-4004-9101-59ff735cf236),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f65f96b-aa') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 00:06:55 user nova-compute[75341]: DEBUG os_vif [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:2e:8d,bridge_name='br-int',has_traffic_filtering=True,id=9f65f96b-aa09-4c3a-a23b-ed444c9dacec,network=Network(aed56292-815e-4004-9101-59ff735cf236),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f65f96b-aa') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 00:06:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:06:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:06:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 00:06:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:06:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2a05c26a-0725-5536-adc5-257f8fde6ebd', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:06:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:06:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:06:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:06:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9f65f96b-aa, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:06:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9f65f96b-aa, col_values=(('qos', UUID('64faf72f-dbf7-48e8-94c6-13e8b57a5d4f')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:06:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9f65f96b-aa, col_values=(('external_ids', {'iface-id': '9f65f96b-aa09-4c3a-a23b-ed444c9dacec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:2e:8d', 'vm-uuid': 'c332ad29-e892-4caf-aa37-fd66fb41f9ec'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:06:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:06:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:06:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:06:55 user nova-compute[75341]: INFO os_vif [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:2e:8d,bridge_name='br-int',has_traffic_filtering=True,id=9f65f96b-aa09-4c3a-a23b-ed444c9dacec,network=Network(aed56292-815e-4004-9101-59ff735cf236),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f65f96b-aa')
Nov 15 00:06:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 00:06:55 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] No VIF found with MAC fa:16:3e:c6:2e:8d, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 00:06:55 user nova-compute[75341]: DEBUG nova.network.neutron [req-672c73c5-4152-4e3b-8f12-c133e8e7914b req-d747f6a5-2901-4464-b6e0-388a78240095 service nova] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Updated VIF entry in instance network info cache for port 9f65f96b-aa09-4c3a-a23b-ed444c9dacec. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 00:06:55 user nova-compute[75341]: DEBUG nova.network.neutron [req-672c73c5-4152-4e3b-8f12-c133e8e7914b req-d747f6a5-2901-4464-b6e0-388a78240095 service nova] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Updating instance_info_cache with network_info: [{"id": "9f65f96b-aa09-4c3a-a23b-ed444c9dacec", "address": "fa:16:3e:c6:2e:8d", "network": {"id": "aed56292-815e-4004-9101-59ff735cf236", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cde913b393e4b1095ae6e8e4a74b5fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f65f96b-aa", "ovs_interfaceid": "9f65f96b-aa09-4c3a-a23b-ed444c9dacec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:06:55 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-672c73c5-4152-4e3b-8f12-c133e8e7914b req-d747f6a5-2901-4464-b6e0-388a78240095 service nova] Releasing lock "refresh_cache-c332ad29-e892-4caf-aa37-fd66fb41f9ec" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:06:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:06:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:06:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:06:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:06:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:06:57 user nova-compute[75341]: DEBUG nova.compute.manager [req-9e541bb8-d744-4f94-99eb-b242e0c06702 req-c450f74f-5090-4283-9c4c-a8978fab1650 service nova] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Received event network-vif-plugged-9f65f96b-aa09-4c3a-a23b-ed444c9dacec {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:06:57 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-9e541bb8-d744-4f94-99eb-b242e0c06702 req-c450f74f-5090-4283-9c4c-a8978fab1650 service nova] Acquiring lock "c332ad29-e892-4caf-aa37-fd66fb41f9ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:06:57 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-9e541bb8-d744-4f94-99eb-b242e0c06702 req-c450f74f-5090-4283-9c4c-a8978fab1650 service nova] Lock "c332ad29-e892-4caf-aa37-fd66fb41f9ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:06:57 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-9e541bb8-d744-4f94-99eb-b242e0c06702 req-c450f74f-5090-4283-9c4c-a8978fab1650 service nova] Lock "c332ad29-e892-4caf-aa37-fd66fb41f9ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:06:57 user nova-compute[75341]: DEBUG nova.compute.manager [req-9e541bb8-d744-4f94-99eb-b242e0c06702 req-c450f74f-5090-4283-9c4c-a8978fab1650 service nova] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] No waiting events found dispatching network-vif-plugged-9f65f96b-aa09-4c3a-a23b-ed444c9dacec {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:06:57 user nova-compute[75341]: WARNING nova.compute.manager [req-9e541bb8-d744-4f94-99eb-b242e0c06702 req-c450f74f-5090-4283-9c4c-a8978fab1650 service nova] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Received unexpected event network-vif-plugged-9f65f96b-aa09-4c3a-a23b-ed444c9dacec for instance with vm_state building and task_state spawning.
Nov 15 00:06:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:06:58 user nova-compute[75341]: DEBUG nova.compute.manager [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Instance event wait completed in 0 seconds for  {{(pid=75341) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 00:06:58 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Guest created on hypervisor {{(pid=75341) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 00:06:58 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Instance spawned successfully.
Nov 15 00:06:58 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 00:06:58 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Found default for hw_cdrom_bus of ide {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 00:06:58 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Found default for hw_disk_bus of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 00:06:58 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Found default for hw_input_bus of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 00:06:58 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Found default for hw_pointer_model of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 00:06:58 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Found default for hw_video_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 00:06:58 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Found default for hw_vif_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 00:06:58 user nova-compute[75341]: INFO nova.compute.manager [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Took 4.98 seconds to spawn the instance on the hypervisor.
Nov 15 00:06:58 user nova-compute[75341]: DEBUG nova.compute.manager [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 00:06:58 user nova-compute[75341]: INFO nova.compute.manager [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Took 5.52 seconds to build instance.
Nov 15 00:06:58 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f86b862a-4e31-480d-8033-e0d5d7074a5d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "c332ad29-e892-4caf-aa37-fd66fb41f9ec" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.614s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:06:59 user nova-compute[75341]: DEBUG nova.compute.manager [req-2dd68233-bb12-4a4c-a783-87afd10b3057 req-50b0e44b-5268-449e-8ccc-46ced2615d3b service nova] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Received event network-vif-plugged-9f65f96b-aa09-4c3a-a23b-ed444c9dacec {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:06:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-2dd68233-bb12-4a4c-a783-87afd10b3057 req-50b0e44b-5268-449e-8ccc-46ced2615d3b service nova] Acquiring lock "c332ad29-e892-4caf-aa37-fd66fb41f9ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:06:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-2dd68233-bb12-4a4c-a783-87afd10b3057 req-50b0e44b-5268-449e-8ccc-46ced2615d3b service nova] Lock "c332ad29-e892-4caf-aa37-fd66fb41f9ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:06:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-2dd68233-bb12-4a4c-a783-87afd10b3057 req-50b0e44b-5268-449e-8ccc-46ced2615d3b service nova] Lock "c332ad29-e892-4caf-aa37-fd66fb41f9ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:06:59 user nova-compute[75341]: DEBUG nova.compute.manager [req-2dd68233-bb12-4a4c-a783-87afd10b3057 req-50b0e44b-5268-449e-8ccc-46ced2615d3b service nova] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] No waiting events found dispatching network-vif-plugged-9f65f96b-aa09-4c3a-a23b-ed444c9dacec {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:06:59 user nova-compute[75341]: WARNING nova.compute.manager [req-2dd68233-bb12-4a4c-a783-87afd10b3057 req-50b0e44b-5268-449e-8ccc-46ced2615d3b service nova] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Received unexpected event network-vif-plugged-9f65f96b-aa09-4c3a-a23b-ed444c9dacec for instance with vm_state active and task_state None.
Nov 15 00:07:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:07:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:07:04 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:07:05 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:07:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:07:08 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:07:08 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75341) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 00:07:09 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:07:10 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:07:11 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:07:11 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:07:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:07:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:07:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:07:11 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75341) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 00:07:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbf7ae6a-78da-4361-b36b-b7733a01f3bc/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:07:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbf7ae6a-78da-4361-b36b-b7733a01f3bc/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:07:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbf7ae6a-78da-4361-b36b-b7733a01f3bc/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:07:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:07:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbf7ae6a-78da-4361-b36b-b7733a01f3bc/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:07:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:07:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:07:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:07:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:07:13 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:07:13 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:07:13 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Hypervisor/Node resource view: name=user free_ram=8736MB free_disk=25.350261688232422GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75341) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 00:07:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:07:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:07:13 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance cbf7ae6a-78da-4361-b36b-b7733a01f3bc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:07:13 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance c332ad29-e892-4caf-aa37-fd66fb41f9ec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:07:13 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 00:07:13 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 00:07:13 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 00:07:13 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 00:07:13 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Compute_service record updated for user:user {{(pid=75341) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 00:07:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.214s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:07:14 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:07:14 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Starting heal instance info cache {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 00:07:14 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Rebuilding the list of instances to heal {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 00:07:14 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "refresh_cache-cbf7ae6a-78da-4361-b36b-b7733a01f3bc" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:07:14 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquired lock "refresh_cache-cbf7ae6a-78da-4361-b36b-b7733a01f3bc" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:07:14 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Forcefully refreshing network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 00:07:14 user nova-compute[75341]: DEBUG nova.objects.instance [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lazy-loading 'info_cache' on Instance uuid cbf7ae6a-78da-4361-b36b-b7733a01f3bc {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:07:14 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Updating instance_info_cache with network_info: [{"id": "e3539392-c398-4e79-9e92-92307e4036d6", "address": "fa:16:3e:0e:c2:2d", "network": {"id": "e8f13b75-3423-43ce-b6dc-843c837e46d2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-617247022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8c1eeb4c3c4f27b774aba29ceb7997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3539392-c3", "ovs_interfaceid": "e3539392-c398-4e79-9e92-92307e4036d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:07:14 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Releasing lock "refresh_cache-cbf7ae6a-78da-4361-b36b-b7733a01f3bc" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:07:14 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Updated the network info_cache for instance {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 00:07:14 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:07:14 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:07:14 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:07:15 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:07:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:07:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:07:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:07:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:07:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:07:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:07:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:07:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-28536f1e-bbc4-4237-b0fc-57b5b4326a26 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Acquiring lock "cbf7ae6a-78da-4361-b36b-b7733a01f3bc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:07:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-28536f1e-bbc4-4237-b0fc-57b5b4326a26 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "cbf7ae6a-78da-4361-b36b-b7733a01f3bc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:07:32 user nova-compute[75341]: DEBUG nova.objects.instance [None req-28536f1e-bbc4-4237-b0fc-57b5b4326a26 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lazy-loading 'flavor' on Instance uuid cbf7ae6a-78da-4361-b36b-b7733a01f3bc {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:07:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-28536f1e-bbc4-4237-b0fc-57b5b4326a26 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "cbf7ae6a-78da-4361-b36b-b7733a01f3bc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:07:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-28536f1e-bbc4-4237-b0fc-57b5b4326a26 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Acquiring lock "cbf7ae6a-78da-4361-b36b-b7733a01f3bc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:07:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-28536f1e-bbc4-4237-b0fc-57b5b4326a26 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "cbf7ae6a-78da-4361-b36b-b7733a01f3bc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:07:32 user nova-compute[75341]: INFO nova.compute.manager [None req-28536f1e-bbc4-4237-b0fc-57b5b4326a26 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Attaching volume 43454687-2a41-48cf-b956-2d43c88a79f1 to /dev/vdb
Nov 15 00:07:32 user nova-compute[75341]: DEBUG os_brick.utils [None req-28536f1e-bbc4-4237-b0fc-57b5b4326a26 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 00:07:32 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:07:32 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:07:32 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b78cd21-4212-450e-a3e3-39e918f163c0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6d1cfca09c9\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:07:32 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:07:32 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:07:32 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bbcbf5c-263c-4e96-a6c5-deec75c50b89]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:07:32 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:07:32 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:07:32 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a35dd41-c4ce-4525-9ada-c7c2a08b7696]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:07:32 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf94b194-cd86-4367-a2cb-74c62800ea91]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:07:32 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-28536f1e-bbc4-4237-b0fc-57b5b4326a26 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Running cmd (subprocess): nvme version {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:07:32 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-28536f1e-bbc4-4237-b0fc-57b5b4326a26 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] 'nvme version' failed. Not Retrying. {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 00:07:32 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.nvmeof [None req-28536f1e-bbc4-4237-b0fc-57b5b4326a26 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] nvme not present on system {{(pid=75341) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 00:07:32 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:07:32 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 00:07:32 user nova-compute[75341]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 00:07:32 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ec4086-b94e-42a2-908b-d5c6a0469750]: (4, '') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:07:32 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-28536f1e-bbc4-4237-b0fc-57b5b4326a26 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75341) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 00:07:32 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-28536f1e-bbc4-4237-b0fc-57b5b4326a26 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 00:07:32 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-28536f1e-bbc4-4237-b0fc-57b5b4326a26 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] LIGHTOS: no hostnqn found. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 00:07:32 user nova-compute[75341]: DEBUG os_brick.utils [None req-28536f1e-bbc4-4237-b0fc-57b5b4326a26 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6d1cfca09c9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 00:07:32 user nova-compute[75341]: DEBUG nova.virt.block_device [None req-28536f1e-bbc4-4237-b0fc-57b5b4326a26 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Updating existing volume attachment record: 2989d984-140d-49a0-b57d-a872e43909b1 {{(pid=75341) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 00:07:35 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:07:36 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28536f1e-bbc4-4237-b0fc-57b5b4326a26 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Calling os-brick to attach iSCSI Volume {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 00:07:36 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-28536f1e-bbc4-4237-b0fc-57b5b4326a26 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:43454687-2a41-48cf-b956-2d43c88a79f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ncoANHbZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 00:07:36 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-28536f1e-bbc4-4237-b0fc-57b5b4326a26 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 00:07:36 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-28536f1e-bbc4-4237-b0fc-57b5b4326a26 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 00:07:36 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-28536f1e-bbc4-4237-b0fc-57b5b4326a26 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 00:07:36 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-28536f1e-bbc4-4237-b0fc-57b5b4326a26 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 00:07:36 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-28536f1e-bbc4-4237-b0fc-57b5b4326a26 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43454687-2a41-48cf-b956-2d43c88a79f1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 00:07:36 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-28536f1e-bbc4-4237-b0fc-57b5b4326a26 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43454687-2a41-48cf-b956-2d43c88a79f1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 00:07:36 user nova-compute[75341]: INFO os_brick.initiator.connectors.iscsi [None req-28536f1e-bbc4-4237-b0fc-57b5b4326a26 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 00:07:36 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43454687-2a41-48cf-b956-2d43c88a79f1 -p 172.16.0.220:3260 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:07:36 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43454687-2a41-48cf-b956-2d43c88a79f1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:07:36 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[773fa33d-65bc-40ae-ae59-3af273f6df6f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:07:36 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-28536f1e-bbc4-4237-b0fc-57b5b4326a26 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 00:07:36 user nova-compute[75341]:  {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:07:36 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43454687-2a41-48cf-b956-2d43c88a79f1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:07:36 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43454687-2a41-48cf-b956-2d43c88a79f1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:07:36 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52bb38f-1e9d-4acd-922f-88aa1e98c579]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:43454687-2a41-48cf-b956-2d43c88a79f1] added\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:07:36 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-28536f1e-bbc4-4237-b0fc-57b5b4326a26 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:43454687-2a41-48cf-b956-2d43c88a79f1] added
Nov 15 00:07:36 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:07:36 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43454687-2a41-48cf-b956-2d43c88a79f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:07:37 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43454687-2a41-48cf-b956-2d43c88a79f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:07:37 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[82409b92-3baa-4bc9-9030-00c5d0b4c2f5]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:07:37 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-28536f1e-bbc4-4237-b0fc-57b5b4326a26 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:07:37 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43454687-2a41-48cf-b956-2d43c88a79f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:07:37 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43454687-2a41-48cf-b956-2d43c88a79f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:07:37 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[74699c88-3633-4af3-b13b-97e0dac44d60]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:07:37 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-28536f1e-bbc4-4237-b0fc-57b5b4326a26 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:07:37 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43454687-2a41-48cf-b956-2d43c88a79f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ncoANHbZ {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:07:37 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43454687-2a41-48cf-b956-2d43c88a79f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ncoANHbZ" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:07:37 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b11024e-c0d4-4fcc-9d7a-8ede424d040c]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:07:37 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-28536f1e-bbc4-4237-b0fc-57b5b4326a26 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ncoANHbZ'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:07:37 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43454687-2a41-48cf-b956-2d43c88a79f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:07:37 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43454687-2a41-48cf-b956-2d43c88a79f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:07:37 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a1511d-b3c9-401b-aaec-8645883efdb5]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:07:37 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-28536f1e-bbc4-4237-b0fc-57b5b4326a26 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:07:37 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:07:37 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:07:37 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ab71a8-668e-41c9-9ea1-65e9a5b9f138]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:07:37 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-28536f1e-bbc4-4237-b0fc-57b5b4326a26 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 00:07:37 user nova-compute[75341]:  {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 00:07:37 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-28536f1e-bbc4-4237-b0fc-57b5b4326a26 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 00:07:37 user nova-compute[75341]:  {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 00:07:37 user nova-compute[75341]: WARNING os_brick.initiator.connectors.iscsi [None req-28536f1e-bbc4-4237-b0fc-57b5b4326a26 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 00:07:37 user nova-compute[75341]: 
Nov 15 00:07:37 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43454687-2a41-48cf-b956-2d43c88a79f1 -p 172.16.0.220:3260 --login {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:07:37 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43454687-2a41-48cf-b956-2d43c88a79f1 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:07:37 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2662bc-1855-4247-af0a-81fbb5322afb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:43454687-2a41-48cf-b956-2d43c88a79f1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:43454687-2a41-48cf-b956-2d43c88a79f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:07:37 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-28536f1e-bbc4-4237-b0fc-57b5b4326a26 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:43454687-2a41-48cf-b956-2d43c88a79f1, portal: 172.16.0.220,3260]
Nov 15 00:07:37 user nova-compute[75341]: Login to [iface: default, target: iqn.2010-10.org.openstack:43454687-2a41-48cf-b956-2d43c88a79f1, portal: 172.16.0.220,3260] successful.
Nov 15 00:07:37 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:07:37 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43454687-2a41-48cf-b956-2d43c88a79f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:07:37 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43454687-2a41-48cf-b956-2d43c88a79f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:07:37 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0d2b87-b88c-4b20-be53-6de2adfb488b]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:07:37 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-28536f1e-bbc4-4237-b0fc-57b5b4326a26 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:07:37 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:07:37 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:07:37 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[f692a0f6-137f-48c3-9dd8-6a6f29a79c7c]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43454687-2a41-48cf-b956-2d43c88a79f1 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:07:37 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-28536f1e-bbc4-4237-b0fc-57b5b4326a26 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43454687-2a41-48cf-b956-2d43c88a79f1 (non-flash)
Nov 15 00:07:37 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 00:07:37 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-28536f1e-bbc4-4237-b0fc-57b5b4326a26 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43454687-2a41-48cf-b956-2d43c88a79f1 (non-flash)
Nov 15 00:07:37 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 00:07:37 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-28536f1e-bbc4-4237-b0fc-57b5b4326a26 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43454687-2a41-48cf-b956-2d43c88a79f1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 00:07:37 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-28536f1e-bbc4-4237-b0fc-57b5b4326a26 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Connected to 172.16.0.220:3260 {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 00:07:37 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-28536f1e-bbc4-4237-b0fc-57b5b4326a26 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=75341) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 00:07:37 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-28536f1e-bbc4-4237-b0fc-57b5b4326a26 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75341) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 00:07:37 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:07:37 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:07:37 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[383c2ced-de84-4345-aae6-b07eb3f56130]: (4, ('- - 0', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:07:37 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-28536f1e-bbc4-4237-b0fc-57b5b4326a26 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: None {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 00:07:38 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-28536f1e-bbc4-4237-b0fc-57b5b4326a26 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 00:07:38 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-28536f1e-bbc4-4237-b0fc-57b5b4326a26 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:43454687-2a41-48cf-b956-2d43c88a79f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ncoANHbZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 00:07:38 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-28536f1e-bbc4-4237-b0fc-57b5b4326a26 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 00:07:38 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-28536f1e-bbc4-4237-b0fc-57b5b4326a26 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '26239373032383433', 'path': '/dev/sdb'} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 00:07:38 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28536f1e-bbc4-4237-b0fc-57b5b4326a26 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26239373032383433', 'path': '/dev/sdb'} {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 00:07:38 user nova-compute[75341]: DEBUG nova.objects.instance [None req-28536f1e-bbc4-4237-b0fc-57b5b4326a26 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lazy-loading 'flavor' on Instance uuid cbf7ae6a-78da-4361-b36b-b7733a01f3bc {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:07:38 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-28536f1e-bbc4-4237-b0fc-57b5b4326a26 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 00:07:38 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 00:07:38 user nova-compute[75341]:   <source dev="/dev/sdb"/>
Nov 15 00:07:38 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 15 00:07:38 user nova-compute[75341]:   <serial>43454687-2a41-48cf-b956-2d43c88a79f1</serial>
Nov 15 00:07:38 user nova-compute[75341]: </disk>
Nov 15 00:07:38 user nova-compute[75341]:  {{(pid=75341) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 00:07:38 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-28536f1e-bbc4-4237-b0fc-57b5b4326a26 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 00:07:38 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-28536f1e-bbc4-4237-b0fc-57b5b4326a26 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 00:07:38 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-28536f1e-bbc4-4237-b0fc-57b5b4326a26 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] No VIF found with MAC fa:16:3e:0e:c2:2d, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 00:07:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-28536f1e-bbc4-4237-b0fc-57b5b4326a26 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "cbf7ae6a-78da-4361-b36b-b7733a01f3bc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.227s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:07:40 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:07:40 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:07:40 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:07:40 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:07:40 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:07:40 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:07:40 user nova-compute[75341]: DEBUG nova.compute.manager [req-754f8893-e524-48b9-9e1d-306b47321ebd req-a78bd7f2-f3f4-432b-893a-ec6455760e36 service nova] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Received event network-changed-e3539392-c398-4e79-9e92-92307e4036d6 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:07:40 user nova-compute[75341]: DEBUG nova.compute.manager [req-754f8893-e524-48b9-9e1d-306b47321ebd req-a78bd7f2-f3f4-432b-893a-ec6455760e36 service nova] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Refreshing instance network info cache due to event network-changed-e3539392-c398-4e79-9e92-92307e4036d6. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 00:07:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-754f8893-e524-48b9-9e1d-306b47321ebd req-a78bd7f2-f3f4-432b-893a-ec6455760e36 service nova] Acquiring lock "refresh_cache-cbf7ae6a-78da-4361-b36b-b7733a01f3bc" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:07:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-754f8893-e524-48b9-9e1d-306b47321ebd req-a78bd7f2-f3f4-432b-893a-ec6455760e36 service nova] Acquired lock "refresh_cache-cbf7ae6a-78da-4361-b36b-b7733a01f3bc" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:07:40 user nova-compute[75341]: DEBUG nova.network.neutron [req-754f8893-e524-48b9-9e1d-306b47321ebd req-a78bd7f2-f3f4-432b-893a-ec6455760e36 service nova] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Refreshing network info cache for port e3539392-c398-4e79-9e92-92307e4036d6 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 00:07:41 user nova-compute[75341]: DEBUG nova.network.neutron [req-754f8893-e524-48b9-9e1d-306b47321ebd req-a78bd7f2-f3f4-432b-893a-ec6455760e36 service nova] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Updated VIF entry in instance network info cache for port e3539392-c398-4e79-9e92-92307e4036d6. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 00:07:41 user nova-compute[75341]: DEBUG nova.network.neutron [req-754f8893-e524-48b9-9e1d-306b47321ebd req-a78bd7f2-f3f4-432b-893a-ec6455760e36 service nova] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Updating instance_info_cache with network_info: [{"id": "e3539392-c398-4e79-9e92-92307e4036d6", "address": "fa:16:3e:0e:c2:2d", "network": {"id": "e8f13b75-3423-43ce-b6dc-843c837e46d2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-617247022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8c1eeb4c3c4f27b774aba29ceb7997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3539392-c3", "ovs_interfaceid": "e3539392-c398-4e79-9e92-92307e4036d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:07:41 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-754f8893-e524-48b9-9e1d-306b47321ebd req-a78bd7f2-f3f4-432b-893a-ec6455760e36 service nova] Releasing lock "refresh_cache-cbf7ae6a-78da-4361-b36b-b7733a01f3bc" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:07:42 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:07:42 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:07:42 user nova-compute[75341]: DEBUG nova.compute.manager [req-b347b2fa-97ec-4903-bfd9-99ea324b1db9 req-13fd3fca-3203-425e-83f7-d09a835aed9c service nova] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Received event network-changed-e3539392-c398-4e79-9e92-92307e4036d6 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:07:42 user nova-compute[75341]: DEBUG nova.compute.manager [req-b347b2fa-97ec-4903-bfd9-99ea324b1db9 req-13fd3fca-3203-425e-83f7-d09a835aed9c service nova] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Refreshing instance network info cache due to event network-changed-e3539392-c398-4e79-9e92-92307e4036d6. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 00:07:42 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-b347b2fa-97ec-4903-bfd9-99ea324b1db9 req-13fd3fca-3203-425e-83f7-d09a835aed9c service nova] Acquiring lock "refresh_cache-cbf7ae6a-78da-4361-b36b-b7733a01f3bc" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:07:42 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-b347b2fa-97ec-4903-bfd9-99ea324b1db9 req-13fd3fca-3203-425e-83f7-d09a835aed9c service nova] Acquired lock "refresh_cache-cbf7ae6a-78da-4361-b36b-b7733a01f3bc" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:07:42 user nova-compute[75341]: DEBUG nova.network.neutron [req-b347b2fa-97ec-4903-bfd9-99ea324b1db9 req-13fd3fca-3203-425e-83f7-d09a835aed9c service nova] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Refreshing network info cache for port e3539392-c398-4e79-9e92-92307e4036d6 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 00:07:43 user nova-compute[75341]: DEBUG nova.network.neutron [req-b347b2fa-97ec-4903-bfd9-99ea324b1db9 req-13fd3fca-3203-425e-83f7-d09a835aed9c service nova] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Updated VIF entry in instance network info cache for port e3539392-c398-4e79-9e92-92307e4036d6. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 00:07:43 user nova-compute[75341]: DEBUG nova.network.neutron [req-b347b2fa-97ec-4903-bfd9-99ea324b1db9 req-13fd3fca-3203-425e-83f7-d09a835aed9c service nova] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Updating instance_info_cache with network_info: [{"id": "e3539392-c398-4e79-9e92-92307e4036d6", "address": "fa:16:3e:0e:c2:2d", "network": {"id": "e8f13b75-3423-43ce-b6dc-843c837e46d2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-617247022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8c1eeb4c3c4f27b774aba29ceb7997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3539392-c3", "ovs_interfaceid": "e3539392-c398-4e79-9e92-92307e4036d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:07:43 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-b347b2fa-97ec-4903-bfd9-99ea324b1db9 req-13fd3fca-3203-425e-83f7-d09a835aed9c service nova] Releasing lock "refresh_cache-cbf7ae6a-78da-4361-b36b-b7733a01f3bc" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:07:43 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d9f38da2-4668-408c-b4f1-02490faa8398 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Acquiring lock "cbf7ae6a-78da-4361-b36b-b7733a01f3bc" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:07:43 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d9f38da2-4668-408c-b4f1-02490faa8398 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "cbf7ae6a-78da-4361-b36b-b7733a01f3bc" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.004s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:07:43 user nova-compute[75341]: INFO nova.compute.manager [None req-d9f38da2-4668-408c-b4f1-02490faa8398 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Rebooting instance
Nov 15 00:07:43 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d9f38da2-4668-408c-b4f1-02490faa8398 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Acquiring lock "refresh_cache-cbf7ae6a-78da-4361-b36b-b7733a01f3bc" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:07:43 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d9f38da2-4668-408c-b4f1-02490faa8398 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Acquired lock "refresh_cache-cbf7ae6a-78da-4361-b36b-b7733a01f3bc" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:07:43 user nova-compute[75341]: DEBUG nova.network.neutron [None req-d9f38da2-4668-408c-b4f1-02490faa8398 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 00:07:43 user nova-compute[75341]: DEBUG nova.network.neutron [None req-d9f38da2-4668-408c-b4f1-02490faa8398 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Updating instance_info_cache with network_info: [{"id": "e3539392-c398-4e79-9e92-92307e4036d6", "address": "fa:16:3e:0e:c2:2d", "network": {"id": "e8f13b75-3423-43ce-b6dc-843c837e46d2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-617247022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8c1eeb4c3c4f27b774aba29ceb7997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3539392-c3", "ovs_interfaceid": "e3539392-c398-4e79-9e92-92307e4036d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:07:43 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d9f38da2-4668-408c-b4f1-02490faa8398 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Releasing lock "refresh_cache-cbf7ae6a-78da-4361-b36b-b7733a01f3bc" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:07:43 user nova-compute[75341]: DEBUG nova.compute.manager [None req-d9f38da2-4668-408c-b4f1-02490faa8398 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 00:07:45 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:07:46 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:07:46 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:07:46 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:07:46 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:07:46 user nova-compute[75341]: DEBUG nova.compute.manager [req-ab8ac4bb-9692-44b8-9eba-b5016b9aa628 req-ee1f4322-bd0e-4242-8306-0c5b641c7f86 service nova] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Received event network-vif-unplugged-e3539392-c398-4e79-9e92-92307e4036d6 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:07:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ab8ac4bb-9692-44b8-9eba-b5016b9aa628 req-ee1f4322-bd0e-4242-8306-0c5b641c7f86 service nova] Acquiring lock "cbf7ae6a-78da-4361-b36b-b7733a01f3bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:07:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ab8ac4bb-9692-44b8-9eba-b5016b9aa628 req-ee1f4322-bd0e-4242-8306-0c5b641c7f86 service nova] Lock "cbf7ae6a-78da-4361-b36b-b7733a01f3bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:07:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ab8ac4bb-9692-44b8-9eba-b5016b9aa628 req-ee1f4322-bd0e-4242-8306-0c5b641c7f86 service nova] Lock "cbf7ae6a-78da-4361-b36b-b7733a01f3bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:07:46 user nova-compute[75341]: DEBUG nova.compute.manager [req-ab8ac4bb-9692-44b8-9eba-b5016b9aa628 req-ee1f4322-bd0e-4242-8306-0c5b641c7f86 service nova] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] No waiting events found dispatching network-vif-unplugged-e3539392-c398-4e79-9e92-92307e4036d6 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:07:46 user nova-compute[75341]: WARNING nova.compute.manager [req-ab8ac4bb-9692-44b8-9eba-b5016b9aa628 req-ee1f4322-bd0e-4242-8306-0c5b641c7f86 service nova] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Received unexpected event network-vif-unplugged-e3539392-c398-4e79-9e92-92307e4036d6 for instance with vm_state active and task_state reboot_started.
Nov 15 00:07:47 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-d9f38da2-4668-408c-b4f1-02490faa8398 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Instance shutdown successfully.
Nov 15 00:07:47 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:07:48 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:07:48 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:07:48 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:07:48 user nova-compute[75341]: DEBUG nova.compute.manager [req-966ee830-b44e-413e-807a-e0857a4aeeb1 req-9e3d67c2-d100-4179-b266-5702c6584a8a service nova] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Received event network-vif-plugged-e3539392-c398-4e79-9e92-92307e4036d6 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:07:48 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-966ee830-b44e-413e-807a-e0857a4aeeb1 req-9e3d67c2-d100-4179-b266-5702c6584a8a service nova] Acquiring lock "cbf7ae6a-78da-4361-b36b-b7733a01f3bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:07:48 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-966ee830-b44e-413e-807a-e0857a4aeeb1 req-9e3d67c2-d100-4179-b266-5702c6584a8a service nova] Lock "cbf7ae6a-78da-4361-b36b-b7733a01f3bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:07:48 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-966ee830-b44e-413e-807a-e0857a4aeeb1 req-9e3d67c2-d100-4179-b266-5702c6584a8a service nova] Lock "cbf7ae6a-78da-4361-b36b-b7733a01f3bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:07:48 user nova-compute[75341]: DEBUG nova.compute.manager [req-966ee830-b44e-413e-807a-e0857a4aeeb1 req-9e3d67c2-d100-4179-b266-5702c6584a8a service nova] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] No waiting events found dispatching network-vif-plugged-e3539392-c398-4e79-9e92-92307e4036d6 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:07:48 user nova-compute[75341]: WARNING nova.compute.manager [req-966ee830-b44e-413e-807a-e0857a4aeeb1 req-9e3d67c2-d100-4179-b266-5702c6584a8a service nova] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Received unexpected event network-vif-plugged-e3539392-c398-4e79-9e92-92307e4036d6 for instance with vm_state active and task_state reboot_started.
Nov 15 00:07:48 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:07:48 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:07:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:07:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:07:50 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Instance running successfully.
Nov 15 00:07:50 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-d9f38da2-4668-408c-b4f1-02490faa8398 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Instance soft rebooted successfully.
Nov 15 00:07:50 user nova-compute[75341]: DEBUG nova.compute.manager [None req-d9f38da2-4668-408c-b4f1-02490faa8398 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 00:07:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d9f38da2-4668-408c-b4f1-02490faa8398 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "cbf7ae6a-78da-4361-b36b-b7733a01f3bc" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.129s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:07:50 user nova-compute[75341]: DEBUG nova.compute.manager [req-1a81e08d-d2d5-489f-8cc9-fe2eb93a39e7 req-474253d6-5caf-431e-9bc2-547f644e54dd service nova] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Received event network-vif-plugged-e3539392-c398-4e79-9e92-92307e4036d6 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:07:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-1a81e08d-d2d5-489f-8cc9-fe2eb93a39e7 req-474253d6-5caf-431e-9bc2-547f644e54dd service nova] Acquiring lock "cbf7ae6a-78da-4361-b36b-b7733a01f3bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:07:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-1a81e08d-d2d5-489f-8cc9-fe2eb93a39e7 req-474253d6-5caf-431e-9bc2-547f644e54dd service nova] Lock "cbf7ae6a-78da-4361-b36b-b7733a01f3bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:07:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-1a81e08d-d2d5-489f-8cc9-fe2eb93a39e7 req-474253d6-5caf-431e-9bc2-547f644e54dd service nova] Lock "cbf7ae6a-78da-4361-b36b-b7733a01f3bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:07:50 user nova-compute[75341]: DEBUG nova.compute.manager [req-1a81e08d-d2d5-489f-8cc9-fe2eb93a39e7 req-474253d6-5caf-431e-9bc2-547f644e54dd service nova] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] No waiting events found dispatching network-vif-plugged-e3539392-c398-4e79-9e92-92307e4036d6 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:07:50 user nova-compute[75341]: WARNING nova.compute.manager [req-1a81e08d-d2d5-489f-8cc9-fe2eb93a39e7 req-474253d6-5caf-431e-9bc2-547f644e54dd service nova] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Received unexpected event network-vif-plugged-e3539392-c398-4e79-9e92-92307e4036d6 for instance with vm_state active and task_state None.
Nov 15 00:07:50 user nova-compute[75341]: DEBUG nova.compute.manager [req-1a81e08d-d2d5-489f-8cc9-fe2eb93a39e7 req-474253d6-5caf-431e-9bc2-547f644e54dd service nova] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Received event network-vif-plugged-e3539392-c398-4e79-9e92-92307e4036d6 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:07:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-1a81e08d-d2d5-489f-8cc9-fe2eb93a39e7 req-474253d6-5caf-431e-9bc2-547f644e54dd service nova] Acquiring lock "cbf7ae6a-78da-4361-b36b-b7733a01f3bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:07:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-1a81e08d-d2d5-489f-8cc9-fe2eb93a39e7 req-474253d6-5caf-431e-9bc2-547f644e54dd service nova] Lock "cbf7ae6a-78da-4361-b36b-b7733a01f3bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:07:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-1a81e08d-d2d5-489f-8cc9-fe2eb93a39e7 req-474253d6-5caf-431e-9bc2-547f644e54dd service nova] Lock "cbf7ae6a-78da-4361-b36b-b7733a01f3bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:07:50 user nova-compute[75341]: DEBUG nova.compute.manager [req-1a81e08d-d2d5-489f-8cc9-fe2eb93a39e7 req-474253d6-5caf-431e-9bc2-547f644e54dd service nova] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] No waiting events found dispatching network-vif-plugged-e3539392-c398-4e79-9e92-92307e4036d6 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:07:50 user nova-compute[75341]: WARNING nova.compute.manager [req-1a81e08d-d2d5-489f-8cc9-fe2eb93a39e7 req-474253d6-5caf-431e-9bc2-547f644e54dd service nova] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Received unexpected event network-vif-plugged-e3539392-c398-4e79-9e92-92307e4036d6 for instance with vm_state active and task_state None.
Nov 15 00:07:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:07:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:07:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:08:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:08:05 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:08:05 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:08:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:08:09 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:08:09 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75341) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 00:08:10 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:08:11 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:08:11 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:08:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:08:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:08:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:08:11 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75341) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 00:08:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbf7ae6a-78da-4361-b36b-b7733a01f3bc/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:08:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbf7ae6a-78da-4361-b36b-b7733a01f3bc/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:08:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbf7ae6a-78da-4361-b36b-b7733a01f3bc/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:08:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:08:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbf7ae6a-78da-4361-b36b-b7733a01f3bc/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:08:12 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 00:08:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:08:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:08:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:08:12 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:08:13 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:08:13 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:08:13 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Hypervisor/Node resource view: name=user free_ram=8764MB free_disk=25.338836669921875GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75341) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 00:08:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:08:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:08:13 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance cbf7ae6a-78da-4361-b36b-b7733a01f3bc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:08:13 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance c332ad29-e892-4caf-aa37-fd66fb41f9ec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:08:13 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 00:08:13 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 00:08:13 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 00:08:13 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 00:08:13 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Compute_service record updated for user:user {{(pid=75341) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 00:08:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.219s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:08:14 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:08:14 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:08:14 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:08:14 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Starting heal instance info cache {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 00:08:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "refresh_cache-c332ad29-e892-4caf-aa37-fd66fb41f9ec" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:08:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquired lock "refresh_cache-c332ad29-e892-4caf-aa37-fd66fb41f9ec" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:08:15 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Forcefully refreshing network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 00:08:15 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:08:15 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Updating instance_info_cache with network_info: [{"id": "9f65f96b-aa09-4c3a-a23b-ed444c9dacec", "address": "fa:16:3e:c6:2e:8d", "network": {"id": "aed56292-815e-4004-9101-59ff735cf236", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cde913b393e4b1095ae6e8e4a74b5fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f65f96b-aa", "ovs_interfaceid": "9f65f96b-aa09-4c3a-a23b-ed444c9dacec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:08:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Releasing lock "refresh_cache-c332ad29-e892-4caf-aa37-fd66fb41f9ec" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:08:15 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Updated the network info_cache for instance {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 00:08:16 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:08:16 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:08:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:08:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:08:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:08:23 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:08:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:08:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:08:35 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:08:35 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:08:35 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:08:35 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:08:35 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:08:35 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:08:40 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:08:44 user nova-compute[75341]: DEBUG nova.compute.manager [None req-ff4f7309-83c4-4e01-9fdc-47c8f5f6f2e3 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 00:08:44 user nova-compute[75341]: INFO nova.compute.manager [None req-ff4f7309-83c4-4e01-9fdc-47c8f5f6f2e3 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] instance snapshotting
Nov 15 00:08:44 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-ff4f7309-83c4-4e01-9fdc-47c8f5f6f2e3 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Beginning live snapshot process
Nov 15 00:08:44 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-ff4f7309-83c4-4e01-9fdc-47c8f5f6f2e3 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json -f qcow2 {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:08:44 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-ff4f7309-83c4-4e01-9fdc-47c8f5f6f2e3 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json -f qcow2" returned: 0 in 0.184s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:08:44 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-ff4f7309-83c4-4e01-9fdc-47c8f5f6f2e3 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json -f qcow2 {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:08:44 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-ff4f7309-83c4-4e01-9fdc-47c8f5f6f2e3 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json -f qcow2" returned: 0 in 0.168s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:08:44 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-ff4f7309-83c4-4e01-9fdc-47c8f5f6f2e3 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:08:44 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-ff4f7309-83c4-4e01-9fdc-47c8f5f6f2e3 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.172s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:08:44 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-ff4f7309-83c4-4e01-9fdc-47c8f5f6f2e3 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpa9rvf873/67f5429cddb84ebc81598ddfb3639d70.delta 1073741824 {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:08:44 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-ff4f7309-83c4-4e01-9fdc-47c8f5f6f2e3 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpa9rvf873/67f5429cddb84ebc81598ddfb3639d70.delta 1073741824" returned: 0 in 0.048s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:08:44 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-ff4f7309-83c4-4e01-9fdc-47c8f5f6f2e3 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 15 00:08:45 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:08:45 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-ff4f7309-83c4-4e01-9fdc-47c8f5f6f2e3 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75341) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 00:08:46 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-ff4f7309-83c4-4e01-9fdc-47c8f5f6f2e3 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] COPY block job progress, current cursor: 22478848 final cursor: 75497472 {{(pid=75341) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 00:08:46 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-ff4f7309-83c4-4e01-9fdc-47c8f5f6f2e3 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75341) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 00:08:46 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-ff4f7309-83c4-4e01-9fdc-47c8f5f6f2e3 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 15 00:08:46 user nova-compute[75341]: DEBUG nova.privsep.utils [None req-ff4f7309-83c4-4e01-9fdc-47c8f5f6f2e3 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75341) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 00:08:46 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-ff4f7309-83c4-4e01-9fdc-47c8f5f6f2e3 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpa9rvf873/67f5429cddb84ebc81598ddfb3639d70.delta /opt/stack/data/nova/instances/snapshots/tmpa9rvf873/67f5429cddb84ebc81598ddfb3639d70 {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:08:47 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-ff4f7309-83c4-4e01-9fdc-47c8f5f6f2e3 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpa9rvf873/67f5429cddb84ebc81598ddfb3639d70.delta /opt/stack/data/nova/instances/snapshots/tmpa9rvf873/67f5429cddb84ebc81598ddfb3639d70" returned: 0 in 0.420s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:08:47 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-ff4f7309-83c4-4e01-9fdc-47c8f5f6f2e3 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Snapshot extracted, beginning image upload
Nov 15 00:08:49 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-ff4f7309-83c4-4e01-9fdc-47c8f5f6f2e3 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Snapshot image upload complete
Nov 15 00:08:49 user nova-compute[75341]: INFO nova.compute.manager [None req-ff4f7309-83c4-4e01-9fdc-47c8f5f6f2e3 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Took 5.38 seconds to snapshot the instance on the hypervisor.
Nov 15 00:08:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:08:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:09:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:09:05 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:09:05 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:09:10 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:09:11 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:09:11 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:09:11 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75341) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 00:09:12 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:09:13 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:09:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:09:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:09:13 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:09:13 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75341) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 00:09:14 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbf7ae6a-78da-4361-b36b-b7733a01f3bc/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:09:14 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbf7ae6a-78da-4361-b36b-b7733a01f3bc/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:09:14 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbf7ae6a-78da-4361-b36b-b7733a01f3bc/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:09:14 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbf7ae6a-78da-4361-b36b-b7733a01f3bc/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:09:14 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 00:09:14 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:09:14 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:09:14 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:09:14 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:09:15 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:09:15 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:09:15 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:09:15 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Hypervisor/Node resource view: name=user free_ram=8848MB free_disk=25.289230346679688GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75341) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 00:09:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:09:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:09:15 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance cbf7ae6a-78da-4361-b36b-b7733a01f3bc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:09:15 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance c332ad29-e892-4caf-aa37-fd66fb41f9ec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:09:15 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 00:09:15 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 00:09:15 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 00:09:15 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 00:09:15 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Compute_service record updated for user:user {{(pid=75341) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 00:09:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.205s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:09:16 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:09:16 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Starting heal instance info cache {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 00:09:16 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Rebuilding the list of instances to heal {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 00:09:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "refresh_cache-cbf7ae6a-78da-4361-b36b-b7733a01f3bc" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:09:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquired lock "refresh_cache-cbf7ae6a-78da-4361-b36b-b7733a01f3bc" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:09:16 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Forcefully refreshing network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 00:09:16 user nova-compute[75341]: DEBUG nova.objects.instance [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lazy-loading 'info_cache' on Instance uuid cbf7ae6a-78da-4361-b36b-b7733a01f3bc {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:09:16 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Updating instance_info_cache with network_info: [{"id": "e3539392-c398-4e79-9e92-92307e4036d6", "address": "fa:16:3e:0e:c2:2d", "network": {"id": "e8f13b75-3423-43ce-b6dc-843c837e46d2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-617247022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8c1eeb4c3c4f27b774aba29ceb7997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3539392-c3", "ovs_interfaceid": "e3539392-c398-4e79-9e92-92307e4036d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:09:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Releasing lock "refresh_cache-cbf7ae6a-78da-4361-b36b-b7733a01f3bc" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:09:16 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Updated the network info_cache for instance {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 00:09:16 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:09:17 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:09:18 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:09:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:09:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:09:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:09:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:09:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:09:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:09:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:09:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:09:34 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:09:34 user nova-compute[75341]: DEBUG nova.compute.manager [req-4b8e9d70-49ae-41f3-a979-6f402afc5082 req-1c3305de-e209-4d6d-9e19-22c491420563 service nova] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Received event network-changed-e3539392-c398-4e79-9e92-92307e4036d6 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:09:34 user nova-compute[75341]: DEBUG nova.compute.manager [req-4b8e9d70-49ae-41f3-a979-6f402afc5082 req-1c3305de-e209-4d6d-9e19-22c491420563 service nova] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Refreshing instance network info cache due to event network-changed-e3539392-c398-4e79-9e92-92307e4036d6. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 00:09:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4b8e9d70-49ae-41f3-a979-6f402afc5082 req-1c3305de-e209-4d6d-9e19-22c491420563 service nova] Acquiring lock "refresh_cache-cbf7ae6a-78da-4361-b36b-b7733a01f3bc" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:09:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4b8e9d70-49ae-41f3-a979-6f402afc5082 req-1c3305de-e209-4d6d-9e19-22c491420563 service nova] Acquired lock "refresh_cache-cbf7ae6a-78da-4361-b36b-b7733a01f3bc" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:09:34 user nova-compute[75341]: DEBUG nova.network.neutron [req-4b8e9d70-49ae-41f3-a979-6f402afc5082 req-1c3305de-e209-4d6d-9e19-22c491420563 service nova] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Refreshing network info cache for port e3539392-c398-4e79-9e92-92307e4036d6 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 00:09:35 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:09:35 user nova-compute[75341]: DEBUG nova.network.neutron [req-4b8e9d70-49ae-41f3-a979-6f402afc5082 req-1c3305de-e209-4d6d-9e19-22c491420563 service nova] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Updated VIF entry in instance network info cache for port e3539392-c398-4e79-9e92-92307e4036d6. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 00:09:35 user nova-compute[75341]: DEBUG nova.network.neutron [req-4b8e9d70-49ae-41f3-a979-6f402afc5082 req-1c3305de-e209-4d6d-9e19-22c491420563 service nova] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Updating instance_info_cache with network_info: [{"id": "e3539392-c398-4e79-9e92-92307e4036d6", "address": "fa:16:3e:0e:c2:2d", "network": {"id": "e8f13b75-3423-43ce-b6dc-843c837e46d2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-617247022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8c1eeb4c3c4f27b774aba29ceb7997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3539392-c3", "ovs_interfaceid": "e3539392-c398-4e79-9e92-92307e4036d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:09:35 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4b8e9d70-49ae-41f3-a979-6f402afc5082 req-1c3305de-e209-4d6d-9e19-22c491420563 service nova] Releasing lock "refresh_cache-cbf7ae6a-78da-4361-b36b-b7733a01f3bc" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:09:35 user nova-compute[75341]: DEBUG nova.compute.manager [req-00131506-b144-427c-9d7a-0b1133573e51 req-876a0ce3-8c95-4b49-9e35-9c63ca4afb75 service nova] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Received event network-changed-e3539392-c398-4e79-9e92-92307e4036d6 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:09:35 user nova-compute[75341]: DEBUG nova.compute.manager [req-00131506-b144-427c-9d7a-0b1133573e51 req-876a0ce3-8c95-4b49-9e35-9c63ca4afb75 service nova] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Refreshing instance network info cache due to event network-changed-e3539392-c398-4e79-9e92-92307e4036d6. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 00:09:35 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-00131506-b144-427c-9d7a-0b1133573e51 req-876a0ce3-8c95-4b49-9e35-9c63ca4afb75 service nova] Acquiring lock "refresh_cache-cbf7ae6a-78da-4361-b36b-b7733a01f3bc" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:09:35 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-00131506-b144-427c-9d7a-0b1133573e51 req-876a0ce3-8c95-4b49-9e35-9c63ca4afb75 service nova] Acquired lock "refresh_cache-cbf7ae6a-78da-4361-b36b-b7733a01f3bc" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:09:35 user nova-compute[75341]: DEBUG nova.network.neutron [req-00131506-b144-427c-9d7a-0b1133573e51 req-876a0ce3-8c95-4b49-9e35-9c63ca4afb75 service nova] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Refreshing network info cache for port e3539392-c398-4e79-9e92-92307e4036d6 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 00:09:35 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-4fcd4cf1-e715-421d-a5be-4a033863f696 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Acquiring lock "cbf7ae6a-78da-4361-b36b-b7733a01f3bc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:09:35 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-4fcd4cf1-e715-421d-a5be-4a033863f696 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "cbf7ae6a-78da-4361-b36b-b7733a01f3bc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:09:35 user nova-compute[75341]: INFO nova.compute.manager [None req-4fcd4cf1-e715-421d-a5be-4a033863f696 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Detaching volume 43454687-2a41-48cf-b956-2d43c88a79f1
Nov 15 00:09:35 user nova-compute[75341]: INFO nova.virt.block_device [None req-4fcd4cf1-e715-421d-a5be-4a033863f696 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Attempting to driver detach volume 43454687-2a41-48cf-b956-2d43c88a79f1 from mountpoint /dev/vdb
Nov 15 00:09:35 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-4fcd4cf1-e715-421d-a5be-4a033863f696 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Attempting to detach device vdb from instance cbf7ae6a-78da-4361-b36b-b7733a01f3bc from the persistent domain config. {{(pid=75341) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 00:09:35 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-4fcd4cf1-e715-421d-a5be-4a033863f696 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 00:09:35 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 00:09:35 user nova-compute[75341]:   <source dev="/dev/sdb"/>
Nov 15 00:09:35 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 15 00:09:35 user nova-compute[75341]:   <serial>43454687-2a41-48cf-b956-2d43c88a79f1</serial>
Nov 15 00:09:35 user nova-compute[75341]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 00:09:35 user nova-compute[75341]: </disk>
Nov 15 00:09:35 user nova-compute[75341]:  {{(pid=75341) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 00:09:35 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-4fcd4cf1-e715-421d-a5be-4a033863f696 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Successfully detached device vdb from instance cbf7ae6a-78da-4361-b36b-b7733a01f3bc from the persistent domain config.
Nov 15 00:09:35 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-4fcd4cf1-e715-421d-a5be-4a033863f696 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cbf7ae6a-78da-4361-b36b-b7733a01f3bc from the live domain config. {{(pid=75341) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 00:09:35 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-4fcd4cf1-e715-421d-a5be-4a033863f696 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 00:09:35 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 00:09:35 user nova-compute[75341]:   <source dev="/dev/sdb"/>
Nov 15 00:09:35 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 15 00:09:35 user nova-compute[75341]:   <serial>43454687-2a41-48cf-b956-2d43c88a79f1</serial>
Nov 15 00:09:35 user nova-compute[75341]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 00:09:35 user nova-compute[75341]: </disk>
Nov 15 00:09:35 user nova-compute[75341]:  {{(pid=75341) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 00:09:36 user nova-compute[75341]: DEBUG nova.network.neutron [req-00131506-b144-427c-9d7a-0b1133573e51 req-876a0ce3-8c95-4b49-9e35-9c63ca4afb75 service nova] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Updated VIF entry in instance network info cache for port e3539392-c398-4e79-9e92-92307e4036d6. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 00:09:36 user nova-compute[75341]: DEBUG nova.network.neutron [req-00131506-b144-427c-9d7a-0b1133573e51 req-876a0ce3-8c95-4b49-9e35-9c63ca4afb75 service nova] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Updating instance_info_cache with network_info: [{"id": "e3539392-c398-4e79-9e92-92307e4036d6", "address": "fa:16:3e:0e:c2:2d", "network": {"id": "e8f13b75-3423-43ce-b6dc-843c837e46d2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-617247022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8c1eeb4c3c4f27b774aba29ceb7997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3539392-c3", "ovs_interfaceid": "e3539392-c398-4e79-9e92-92307e4036d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:09:36 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-00131506-b144-427c-9d7a-0b1133573e51 req-876a0ce3-8c95-4b49-9e35-9c63ca4afb75 service nova] Releasing lock "refresh_cache-cbf7ae6a-78da-4361-b36b-b7733a01f3bc" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:09:36 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-4fcd4cf1-e715-421d-a5be-4a033863f696 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cbf7ae6a-78da-4361-b36b-b7733a01f3bc {{(pid=75341) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 00:09:37 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:09:40 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:09:45 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:09:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:09:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Acquiring lock "5a57dc05-73fa-45a8-98d9-c355f2f35d17" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:09:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "5a57dc05-73fa-45a8-98d9-c355f2f35d17" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:09:51 user nova-compute[75341]: DEBUG nova.compute.manager [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Starting instance... {{(pid=75341) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 00:09:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:09:51 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:09:51 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75341) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 00:09:51 user nova-compute[75341]: INFO nova.compute.claims [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Claim successful on node user
Nov 15 00:09:51 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 00:09:51 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 00:09:52 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.230s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:09:52 user nova-compute[75341]: DEBUG nova.compute.manager [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Start building networks asynchronously for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 00:09:52 user nova-compute[75341]: DEBUG nova.compute.manager [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Allocating IP information in the background. {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 00:09:52 user nova-compute[75341]: DEBUG nova.network.neutron [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] allocate_for_instance() {{(pid=75341) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 00:09:52 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 00:09:52 user nova-compute[75341]: DEBUG nova.compute.manager [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Start building block device mappings for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 00:09:52 user nova-compute[75341]: DEBUG nova.policy [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'abb41e7d020d4c99a55b5029cd2124a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cde913b393e4b1095ae6e8e4a74b5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75341) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 00:09:52 user nova-compute[75341]: INFO nova.virt.block_device [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Booting with blank volume at /dev/vda
Nov 15 00:09:52 user nova-compute[75341]: DEBUG nova.network.neutron [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Successfully created port: 6b89e652-396c-42ad-9a1a-402e18e1a9f3 {{(pid=75341) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 00:09:53 user nova-compute[75341]: DEBUG nova.network.neutron [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Successfully updated port: 6b89e652-396c-42ad-9a1a-402e18e1a9f3 {{(pid=75341) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 00:09:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Acquiring lock "refresh_cache-5a57dc05-73fa-45a8-98d9-c355f2f35d17" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:09:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Acquired lock "refresh_cache-5a57dc05-73fa-45a8-98d9-c355f2f35d17" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:09:53 user nova-compute[75341]: DEBUG nova.network.neutron [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 00:09:53 user nova-compute[75341]: DEBUG nova.compute.manager [req-d89c9546-1b5b-441a-a42f-1dffa70ce5ff req-d746839c-16ae-4a7d-9b8d-764c1c7691ce service nova] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Received event network-changed-6b89e652-396c-42ad-9a1a-402e18e1a9f3 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:09:53 user nova-compute[75341]: DEBUG nova.compute.manager [req-d89c9546-1b5b-441a-a42f-1dffa70ce5ff req-d746839c-16ae-4a7d-9b8d-764c1c7691ce service nova] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Refreshing instance network info cache due to event network-changed-6b89e652-396c-42ad-9a1a-402e18e1a9f3. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 00:09:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-d89c9546-1b5b-441a-a42f-1dffa70ce5ff req-d746839c-16ae-4a7d-9b8d-764c1c7691ce service nova] Acquiring lock "refresh_cache-5a57dc05-73fa-45a8-98d9-c355f2f35d17" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:09:53 user nova-compute[75341]: DEBUG nova.network.neutron [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Instance cache missing network info. {{(pid=75341) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 00:09:53 user nova-compute[75341]: DEBUG nova.network.neutron [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Updating instance_info_cache with network_info: [{"id": "6b89e652-396c-42ad-9a1a-402e18e1a9f3", "address": "fa:16:3e:f1:b5:9c", "network": {"id": "aed56292-815e-4004-9101-59ff735cf236", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cde913b393e4b1095ae6e8e4a74b5fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b89e652-39", "ovs_interfaceid": "6b89e652-396c-42ad-9a1a-402e18e1a9f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:09:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Releasing lock "refresh_cache-5a57dc05-73fa-45a8-98d9-c355f2f35d17" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:09:53 user nova-compute[75341]: DEBUG nova.compute.manager [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Instance network_info: |[{"id": "6b89e652-396c-42ad-9a1a-402e18e1a9f3", "address": "fa:16:3e:f1:b5:9c", "network": {"id": "aed56292-815e-4004-9101-59ff735cf236", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cde913b393e4b1095ae6e8e4a74b5fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b89e652-39", "ovs_interfaceid": "6b89e652-396c-42ad-9a1a-402e18e1a9f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 00:09:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-d89c9546-1b5b-441a-a42f-1dffa70ce5ff req-d746839c-16ae-4a7d-9b8d-764c1c7691ce service nova] Acquired lock "refresh_cache-5a57dc05-73fa-45a8-98d9-c355f2f35d17" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:09:53 user nova-compute[75341]: DEBUG nova.network.neutron [req-d89c9546-1b5b-441a-a42f-1dffa70ce5ff req-d746839c-16ae-4a7d-9b8d-764c1c7691ce service nova] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Refreshing network info cache for port 6b89e652-396c-42ad-9a1a-402e18e1a9f3 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 00:09:53 user nova-compute[75341]: DEBUG nova.network.neutron [req-d89c9546-1b5b-441a-a42f-1dffa70ce5ff req-d746839c-16ae-4a7d-9b8d-764c1c7691ce service nova] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Updated VIF entry in instance network info cache for port 6b89e652-396c-42ad-9a1a-402e18e1a9f3. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 00:09:53 user nova-compute[75341]: DEBUG nova.network.neutron [req-d89c9546-1b5b-441a-a42f-1dffa70ce5ff req-d746839c-16ae-4a7d-9b8d-764c1c7691ce service nova] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Updating instance_info_cache with network_info: [{"id": "6b89e652-396c-42ad-9a1a-402e18e1a9f3", "address": "fa:16:3e:f1:b5:9c", "network": {"id": "aed56292-815e-4004-9101-59ff735cf236", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cde913b393e4b1095ae6e8e4a74b5fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b89e652-39", "ovs_interfaceid": "6b89e652-396c-42ad-9a1a-402e18e1a9f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:09:53 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-d89c9546-1b5b-441a-a42f-1dffa70ce5ff req-d746839c-16ae-4a7d-9b8d-764c1c7691ce service nova] Releasing lock "refresh_cache-5a57dc05-73fa-45a8-98d9-c355f2f35d17" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:09:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:09:56 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-4fcd4cf1-e715-421d-a5be-4a033863f696 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cbf7ae6a-78da-4361-b36b-b7733a01f3bc is timed out.
Nov 15 00:09:56 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-4fcd4cf1-e715-421d-a5be-4a033863f696 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Successfully detached device vdb from instance cbf7ae6a-78da-4361-b36b-b7733a01f3bc from the live domain config.
Nov 15 00:09:56 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fcd4cf1-e715-421d-a5be-4a033863f696 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] calling os-brick to detach iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 00:09:56 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fcd4cf1-e715-421d-a5be-4a033863f696 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, {'target_iqn': 'iqn.2010-10.org.openstack:43454687-2a41-48cf-b956-2d43c88a79f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ncoANHbZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 00:09:56 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-4fcd4cf1-e715-421d-a5be-4a033863f696 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 00:09:56 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-4fcd4cf1-e715-421d-a5be-4a033863f696 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 00:09:56 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-4fcd4cf1-e715-421d-a5be-4a033863f696 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 00:09:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:09:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:09:56 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[87836b7d-469e-496d-9d6d-a44c88972485]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:43454687-2a41-48cf-b956-2d43c88a79f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:09:56 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fcd4cf1-e715-421d-a5be-4a033863f696 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 00:09:56 user nova-compute[75341]: No targets found.
Nov 15 00:09:56 user nova-compute[75341]: iSNS:
Nov 15 00:09:56 user nova-compute[75341]: No targets found.
Nov 15 00:09:56 user nova-compute[75341]: STATIC:
Nov 15 00:09:56 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:43454687-2a41-48cf-b956-2d43c88a79f1
Nov 15 00:09:56 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 15 00:09:56 user nova-compute[75341]:                 Iface Name: default
Nov 15 00:09:56 user nova-compute[75341]: FIRMWARE:
Nov 15 00:09:56 user nova-compute[75341]: No targets found.
Nov 15 00:09:56 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 00:09:56 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fcd4cf1-e715-421d-a5be-4a033863f696 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 00:09:56 user nova-compute[75341]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 00:09:56 user nova-compute[75341]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75341) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 00:09:56 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fcd4cf1-e715-421d-a5be-4a033863f696 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43454687-2a41-48cf-b956-2d43c88a79f1', 0)] {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 00:09:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:09:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:09:56 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[360808df-2e3d-4d8e-be1d-98416fd62305]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43454687-2a41-48cf-b956-2d43c88a79f1\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:09:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:09:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:09:56 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[3179417e-41b3-4fb4-910d-af0a72d404ae]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43454687-2a41-48cf-b956-2d43c88a79f1 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:09:56 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fcd4cf1-e715-421d-a5be-4a033863f696 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43454687-2a41-48cf-b956-2d43c88a79f1 (non-flash)
Nov 15 00:09:56 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 00:09:56 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fcd4cf1-e715-421d-a5be-4a033863f696 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43454687-2a41-48cf-b956-2d43c88a79f1 (non-flash)
Nov 15 00:09:56 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 00:09:56 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fcd4cf1-e715-421d-a5be-4a033863f696 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f185055a950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43454687-2a41-48cf-b956-2d43c88a79f1'): ({'sdb'}, set())}) {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 00:09:56 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-4fcd4cf1-e715-421d-a5be-4a033863f696 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Removing single pathed devices sdb {{(pid=75341) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 00:09:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:09:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:09:56 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[92813955-e8b7-4938-9a40-08ce2b3b30ac]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:09:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:09:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:09:56 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1797b5-b350-4706-884f-c632b82fc380]: (4, ('ok\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:09:56 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-4fcd4cf1-e715-421d-a5be-4a033863f696 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Flushing IO for device /dev/sdb {{(pid=75341) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 00:09:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:09:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:09:56 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[8893ddc7-e6c7-4deb-aa1b-518e3632ff5b]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:09:56 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-4fcd4cf1-e715-421d-a5be-4a033863f696 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75341) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 00:09:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:09:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.062s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:09:56 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a458e4f-1de6-4990-a8fc-2124bef1409c]: (4, ('1', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:09:56 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-4fcd4cf1-e715-421d-a5be-4a033863f696 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 00:09:56 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-4fcd4cf1-e715-421d-a5be-4a033863f696 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] SCSI volumes sdb have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 00:09:56 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fcd4cf1-e715-421d-a5be-4a033863f696 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43454687-2a41-48cf-b956-2d43c88a79f1')] {{(pid=75341) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 00:09:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43454687-2a41-48cf-b956-2d43c88a79f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:09:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43454687-2a41-48cf-b956-2d43c88a79f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:09:56 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21924fd-f038-4c89-86cb-04e4164bb5a4]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:09:56 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fcd4cf1-e715-421d-a5be-4a033863f696 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:09:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43454687-2a41-48cf-b956-2d43c88a79f1 -p 172.16.0.220:3260 --logout {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:09:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43454687-2a41-48cf-b956-2d43c88a79f1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:09:56 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[956075a9-abf3-454c-95cc-ceda2593d24e]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:43454687-2a41-48cf-b956-2d43c88a79f1, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:43454687-2a41-48cf-b956-2d43c88a79f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:09:56 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fcd4cf1-e715-421d-a5be-4a033863f696 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:43454687-2a41-48cf-b956-2d43c88a79f1, portal: 172.16.0.220,3260]
Nov 15 00:09:56 user nova-compute[75341]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:43454687-2a41-48cf-b956-2d43c88a79f1, portal: 172.16.0.220,3260] successful.
Nov 15 00:09:56 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:09:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43454687-2a41-48cf-b956-2d43c88a79f1 -p 172.16.0.220:3260 --op delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:09:56 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43454687-2a41-48cf-b956-2d43c88a79f1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:09:56 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[212728ac-5ca7-4dfe-b199-1bc82da1f676]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:09:56 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fcd4cf1-e715-421d-a5be-4a033863f696 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:09:56 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-4fcd4cf1-e715-421d-a5be-4a033863f696 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 00:09:56 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fcd4cf1-e715-421d-a5be-4a033863f696 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] <== disconnect_volume: return (297ms) None {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 00:09:56 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fcd4cf1-e715-421d-a5be-4a033863f696 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Disconnected iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 00:09:57 user nova-compute[75341]: DEBUG nova.objects.instance [None req-4fcd4cf1-e715-421d-a5be-4a033863f696 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lazy-loading 'flavor' on Instance uuid cbf7ae6a-78da-4361-b36b-b7733a01f3bc {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:09:57 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-4fcd4cf1-e715-421d-a5be-4a033863f696 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "cbf7ae6a-78da-4361-b36b-b7733a01f3bc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.622s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:09:57 user nova-compute[75341]: DEBUG os_brick.utils [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 00:09:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:09:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:09:57 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[88835dae-7524-4441-a321-381dc2329315]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6d1cfca09c9\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:09:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:09:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:09:57 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[32bc7616-23b3-4cc1-b2f4-66d782333033]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:09:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:09:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:09:57 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d0a7318-b83d-4e28-ac91-79a120ee68aa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:09:57 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c2bdaaa-8165-4382-a8a6-1588308f0c8d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:09:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Running cmd (subprocess): nvme version {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:09:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] 'nvme version' failed. Not Retrying. {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 00:09:57 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] nvme not present on system {{(pid=75341) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 00:09:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:09:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 00:09:57 user nova-compute[75341]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 00:09:57 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43072c0-391a-4d1a-b2b8-00c91a3a3525]: (4, '') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:09:57 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75341) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 00:09:57 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 00:09:57 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] LIGHTOS: no hostnqn found. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 00:09:57 user nova-compute[75341]: DEBUG os_brick.utils [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6d1cfca09c9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 00:09:57 user nova-compute[75341]: DEBUG nova.virt.block_device [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Updating existing volume attachment record: b58a2351-d18b-4b15-bce7-78698e9649d9 {{(pid=75341) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 00:10:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG nova.compute.manager [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Start spawning the instance on the hypervisor. {{(pid=75341) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Creating instance directory {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 00:10:03 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Creating image(s)
Nov 15 00:10:03 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Did not create local disks {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Ensure instance console log exists: /opt/stack/data/nova/instances/5a57dc05-73fa-45a8-98d9-c355f2f35d17/console.log {{(pid=75341) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Start _get_guest_xml network_info=[{"id": "6b89e652-396c-42ad-9a1a-402e18e1a9f3", "address": "fa:16:3e:f1:b5:9c", "network": {"id": "aed56292-815e-4004-9101-59ff735cf236", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cde913b393e4b1095ae6e8e4a74b5fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b89e652-39", "ovs_interfaceid": "6b89e652-396c-42ad-9a1a-402e18e1a9f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'b58a2351-d18b-4b15-bce7-78698e9649d9', 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sFmYiKyv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5a57dc05-73fa-45a8-98d9-c355f2f35d17', 'attached_at': '', 'detached_at': '', 'volume_id': '7500ff6d-ab61-40fe-b910-9ae8a4160f4e', 'serial': '7500ff6d-ab61-40fe-b910-9ae8a4160f4e'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 00:10:03 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:10:03 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:10:03 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Calling os-brick to attach iSCSI Volume {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sFmYiKyv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 00:10:03 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 00:10:03 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 00:10:03 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 00:10:03 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 00:10:03 user nova-compute[75341]: INFO os_brick.initiator.connectors.iscsi [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 00:10:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e -p 172.16.0.220:3260 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ee0bc2-fbae-4786-a098-88340ff7f3d4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 00:10:03 user nova-compute[75341]:  {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e -p 172.16.0.220:3260 --interface default --op new {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4e01db-158f-4bd5-abc7-c120b1870456]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e] added\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e] added
Nov 15 00:10:03 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e29308c-00e8-4f05-b69d-f67556677e62]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26ab720-4648-4642-8037-eaec23fe7fcf]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sFmYiKyv {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sFmYiKyv" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[33697b8e-d413-4aee-b378-0f53039c4c79]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sFmYiKyv'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5fcc48b-2855-48bc-99d0-6d04803f44be]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[28833e4a-28e7-49b8-871c-91532931a059]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 00:10:03 user nova-compute[75341]:  {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 00:10:03 user nova-compute[75341]:  {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 00:10:03 user nova-compute[75341]: WARNING os_brick.initiator.connectors.iscsi [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 00:10:03 user nova-compute[75341]: 
Nov 15 00:10:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e -p 172.16.0.220:3260 --login {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a8932f-1980-4e11-aa8b-838e7d306d8b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e, portal: 172.16.0.220,3260]
Nov 15 00:10:03 user nova-compute[75341]: Login to [iface: default, target: iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e, portal: 172.16.0.220,3260] successful.
Nov 15 00:10:03 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd47f878-71b6-4e1d-99ab-019162855498]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[71125d23-0995-4744-9b69-3ac3f4439e92]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e (non-flash)
Nov 15 00:10:03 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e (non-flash)
Nov 15 00:10:03 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.230s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Connected to 172.16.0.220:3260 {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=75341) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75341) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b773bba-5cb8-45f2-8589-0d2ba42e66db]: (4, ('- - 0', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 00:10:03 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sFmYiKyv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 00:10:04 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.259s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 00:10:04 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] <== connect_volume: return (1260ms) {'type': 'block', 'scsi_wwn': '23262633666373936', 'path': '/dev/sdb'} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 00:10:04 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23262633666373936', 'path': '/dev/sdb'} {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 00:10:04 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T00:09:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-771342845',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-771342845',id=48,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5cde913b393e4b1095ae6e8e4a74b5fb',ramdisk_id='',reservation_id='r-h0zbeakv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1181444554',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T00:09:52Z,user_data=None,user_id='abb41e7d020d4c99a55b5029cd2124a9',uuid=5a57dc05-73fa-45a8-98d9-c355f2f35d17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b89e652-396c-42ad-9a1a-402e18e1a9f3", "address": "fa:16:3e:f1:b5:9c", "network": {"id": "aed56292-815e-4004-9101-59ff735cf236", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cde913b393e4b1095ae6e8e4a74b5fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b89e652-39", "ovs_interfaceid": "6b89e652-396c-42ad-9a1a-402e18e1a9f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 00:10:04 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Converting VIF {"id": "6b89e652-396c-42ad-9a1a-402e18e1a9f3", "address": "fa:16:3e:f1:b5:9c", "network": {"id": "aed56292-815e-4004-9101-59ff735cf236", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cde913b393e4b1095ae6e8e4a74b5fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b89e652-39", "ovs_interfaceid": "6b89e652-396c-42ad-9a1a-402e18e1a9f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 00:10:04 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:b5:9c,bridge_name='br-int',has_traffic_filtering=True,id=6b89e652-396c-42ad-9a1a-402e18e1a9f3,network=Network(aed56292-815e-4004-9101-59ff735cf236),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b89e652-39') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 00:10:04 user nova-compute[75341]: DEBUG nova.objects.instance [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lazy-loading 'pci_devices' on Instance uuid 5a57dc05-73fa-45a8-98d9-c355f2f35d17 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:10:04 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] End _get_guest_xml xml=<domain type="kvm">
Nov 15 00:10:04 user nova-compute[75341]:   <uuid>5a57dc05-73fa-45a8-98d9-c355f2f35d17</uuid>
Nov 15 00:10:04 user nova-compute[75341]:   <name>instance-00000030</name>
Nov 15 00:10:04 user nova-compute[75341]:   <memory>524288</memory>
Nov 15 00:10:04 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 15 00:10:04 user nova-compute[75341]:   <metadata>
Nov 15 00:10:04 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 00:10:04 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 15 00:10:04 user nova-compute[75341]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-771342845</nova:name>
Nov 15 00:10:04 user nova-compute[75341]:       <nova:creationTime>2023-11-15 00:10:03</nova:creationTime>
Nov 15 00:10:04 user nova-compute[75341]:       <nova:flavor name="m1.tiny">
Nov 15 00:10:04 user nova-compute[75341]:         <nova:memory>512</nova:memory>
Nov 15 00:10:04 user nova-compute[75341]:         <nova:disk>1</nova:disk>
Nov 15 00:10:04 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 15 00:10:04 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 00:10:04 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 15 00:10:04 user nova-compute[75341]:       </nova:flavor>
Nov 15 00:10:04 user nova-compute[75341]:       <nova:owner>
Nov 15 00:10:04 user nova-compute[75341]:         <nova:user uuid="abb41e7d020d4c99a55b5029cd2124a9">tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member</nova:user>
Nov 15 00:10:04 user nova-compute[75341]:         <nova:project uuid="5cde913b393e4b1095ae6e8e4a74b5fb">tempest-ServerBootFromVolumeStableRescueTest-1181444554</nova:project>
Nov 15 00:10:04 user nova-compute[75341]:       </nova:owner>
Nov 15 00:10:04 user nova-compute[75341]:       <nova:root type="image" uuid="e46abb82-b810-490e-a8a1-ccdc5fa1a796"/>
Nov 15 00:10:04 user nova-compute[75341]:       <nova:ports>
Nov 15 00:10:04 user nova-compute[75341]:         <nova:port uuid="6b89e652-396c-42ad-9a1a-402e18e1a9f3">
Nov 15 00:10:04 user nova-compute[75341]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 00:10:04 user nova-compute[75341]:         </nova:port>
Nov 15 00:10:04 user nova-compute[75341]:       </nova:ports>
Nov 15 00:10:04 user nova-compute[75341]:     </nova:instance>
Nov 15 00:10:04 user nova-compute[75341]:   </metadata>
Nov 15 00:10:04 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 15 00:10:04 user nova-compute[75341]:     <system>
Nov 15 00:10:04 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 00:10:04 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 15 00:10:04 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 15 00:10:04 user nova-compute[75341]:       <entry name="serial">5a57dc05-73fa-45a8-98d9-c355f2f35d17</entry>
Nov 15 00:10:04 user nova-compute[75341]:       <entry name="uuid">5a57dc05-73fa-45a8-98d9-c355f2f35d17</entry>
Nov 15 00:10:04 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 15 00:10:04 user nova-compute[75341]:     </system>
Nov 15 00:10:04 user nova-compute[75341]:   </sysinfo>
Nov 15 00:10:04 user nova-compute[75341]:   <os>
Nov 15 00:10:04 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 00:10:04 user nova-compute[75341]:     <boot dev="hd"/>
Nov 15 00:10:04 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 15 00:10:04 user nova-compute[75341]:   </os>
Nov 15 00:10:04 user nova-compute[75341]:   <features>
Nov 15 00:10:04 user nova-compute[75341]:     <acpi/>
Nov 15 00:10:04 user nova-compute[75341]:     <apic/>
Nov 15 00:10:04 user nova-compute[75341]:     <vmcoreinfo/>
Nov 15 00:10:04 user nova-compute[75341]:   </features>
Nov 15 00:10:04 user nova-compute[75341]:   <clock offset="utc">
Nov 15 00:10:04 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 00:10:04 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 00:10:04 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 15 00:10:04 user nova-compute[75341]:   </clock>
Nov 15 00:10:04 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 15 00:10:04 user nova-compute[75341]:     <model>Nehalem</model>
Nov 15 00:10:04 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 00:10:04 user nova-compute[75341]:   </cpu>
Nov 15 00:10:04 user nova-compute[75341]:   <devices>
Nov 15 00:10:04 user nova-compute[75341]:     <disk type="block" device="disk">
Nov 15 00:10:04 user nova-compute[75341]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 00:10:04 user nova-compute[75341]:       <source dev="/dev/sdb"/>
Nov 15 00:10:04 user nova-compute[75341]:       <target dev="vda" bus="virtio"/>
Nov 15 00:10:04 user nova-compute[75341]:       <serial>7500ff6d-ab61-40fe-b910-9ae8a4160f4e</serial>
Nov 15 00:10:04 user nova-compute[75341]:     </disk>
Nov 15 00:10:04 user nova-compute[75341]:     <interface type="ethernet">
Nov 15 00:10:04 user nova-compute[75341]:       <mac address="fa:16:3e:f1:b5:9c"/>
Nov 15 00:10:04 user nova-compute[75341]:       <model type="virtio"/>
Nov 15 00:10:04 user nova-compute[75341]:       <mtu size="1442"/>
Nov 15 00:10:04 user nova-compute[75341]:       <target dev="tap6b89e652-39"/>
Nov 15 00:10:04 user nova-compute[75341]:     </interface>
Nov 15 00:10:04 user nova-compute[75341]:     <serial type="pty">
Nov 15 00:10:04 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/5a57dc05-73fa-45a8-98d9-c355f2f35d17/console.log" append="off"/>
Nov 15 00:10:04 user nova-compute[75341]:     </serial>
Nov 15 00:10:04 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 00:10:04 user nova-compute[75341]:     <video>
Nov 15 00:10:04 user nova-compute[75341]:       <model type="virtio"/>
Nov 15 00:10:04 user nova-compute[75341]:     </video>
Nov 15 00:10:04 user nova-compute[75341]:     <rng model="virtio">
Nov 15 00:10:04 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 15 00:10:04 user nova-compute[75341]:     </rng>
Nov 15 00:10:04 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 15 00:10:04 user nova-compute[75341]:     <memballoon model="virtio">
Nov 15 00:10:04 user nova-compute[75341]:       <stats period="10"/>
Nov 15 00:10:04 user nova-compute[75341]:     </memballoon>
Nov 15 00:10:04 user nova-compute[75341]:   </devices>
Nov 15 00:10:04 user nova-compute[75341]: </domain>
Nov 15 00:10:04 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 00:10:04 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T00:09:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-771342845',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-771342845',id=48,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5cde913b393e4b1095ae6e8e4a74b5fb',ramdisk_id='',reservation_id='r-h0zbeakv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1181444554',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T00:09:52Z,user_data=None,user_id='abb41e7d020d4c99a55b5029cd2124a9',uuid=5a57dc05-73fa-45a8-98d9-c355f2f35d17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b89e652-396c-42ad-9a1a-402e18e1a9f3", "address": "fa:16:3e:f1:b5:9c", "network": {"id": "aed56292-815e-4004-9101-59ff735cf236", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cde913b393e4b1095ae6e8e4a74b5fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b89e652-39", "ovs_interfaceid": "6b89e652-396c-42ad-9a1a-402e18e1a9f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 00:10:04 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Converting VIF {"id": "6b89e652-396c-42ad-9a1a-402e18e1a9f3", "address": "fa:16:3e:f1:b5:9c", "network": {"id": "aed56292-815e-4004-9101-59ff735cf236", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cde913b393e4b1095ae6e8e4a74b5fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b89e652-39", "ovs_interfaceid": "6b89e652-396c-42ad-9a1a-402e18e1a9f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 00:10:04 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:b5:9c,bridge_name='br-int',has_traffic_filtering=True,id=6b89e652-396c-42ad-9a1a-402e18e1a9f3,network=Network(aed56292-815e-4004-9101-59ff735cf236),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b89e652-39') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 00:10:04 user nova-compute[75341]: DEBUG os_vif [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:b5:9c,bridge_name='br-int',has_traffic_filtering=True,id=6b89e652-396c-42ad-9a1a-402e18e1a9f3,network=Network(aed56292-815e-4004-9101-59ff735cf236),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b89e652-39') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 00:10:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:10:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:10:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 00:10:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:10:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bc3c1d33-1c2e-59a7-a6cf-13121ffc2c90', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:10:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:10:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:10:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:10:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6b89e652-39, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:10:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6b89e652-39, col_values=(('qos', UUID('7e066a86-c4b1-4f7d-a58f-8b6ce33f08aa')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:10:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6b89e652-39, col_values=(('external_ids', {'iface-id': '6b89e652-396c-42ad-9a1a-402e18e1a9f3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:b5:9c', 'vm-uuid': '5a57dc05-73fa-45a8-98d9-c355f2f35d17'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:10:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:10:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:10:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:10:04 user nova-compute[75341]: INFO os_vif [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:b5:9c,bridge_name='br-int',has_traffic_filtering=True,id=6b89e652-396c-42ad-9a1a-402e18e1a9f3,network=Network(aed56292-815e-4004-9101-59ff735cf236),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b89e652-39')
Nov 15 00:10:04 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 00:10:04 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] No VIF found with MAC fa:16:3e:f1:b5:9c, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 00:10:05 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:10:05 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:10:05 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:10:05 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:10:06 user nova-compute[75341]: DEBUG nova.compute.manager [req-e9ffb850-b919-4467-b5d8-6333bf0f6cc2 req-e5b4faa9-3ee9-401a-97c1-11334560b54f service nova] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Received event network-vif-plugged-6b89e652-396c-42ad-9a1a-402e18e1a9f3 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:10:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-e9ffb850-b919-4467-b5d8-6333bf0f6cc2 req-e5b4faa9-3ee9-401a-97c1-11334560b54f service nova] Acquiring lock "5a57dc05-73fa-45a8-98d9-c355f2f35d17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:10:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-e9ffb850-b919-4467-b5d8-6333bf0f6cc2 req-e5b4faa9-3ee9-401a-97c1-11334560b54f service nova] Lock "5a57dc05-73fa-45a8-98d9-c355f2f35d17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:10:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-e9ffb850-b919-4467-b5d8-6333bf0f6cc2 req-e5b4faa9-3ee9-401a-97c1-11334560b54f service nova] Lock "5a57dc05-73fa-45a8-98d9-c355f2f35d17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:10:06 user nova-compute[75341]: DEBUG nova.compute.manager [req-e9ffb850-b919-4467-b5d8-6333bf0f6cc2 req-e5b4faa9-3ee9-401a-97c1-11334560b54f service nova] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] No waiting events found dispatching network-vif-plugged-6b89e652-396c-42ad-9a1a-402e18e1a9f3 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:10:06 user nova-compute[75341]: WARNING nova.compute.manager [req-e9ffb850-b919-4467-b5d8-6333bf0f6cc2 req-e5b4faa9-3ee9-401a-97c1-11334560b54f service nova] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Received unexpected event network-vif-plugged-6b89e652-396c-42ad-9a1a-402e18e1a9f3 for instance with vm_state building and task_state spawning.
Nov 15 00:10:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:10:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:10:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:10:07 user nova-compute[75341]: DEBUG nova.compute.manager [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Instance event wait completed in 0 seconds for  {{(pid=75341) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 00:10:07 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Guest created on hypervisor {{(pid=75341) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 00:10:07 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Instance spawned successfully.
Nov 15 00:10:07 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 00:10:08 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Found default for hw_cdrom_bus of ide {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 00:10:08 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Found default for hw_disk_bus of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 00:10:08 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Found default for hw_input_bus of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 00:10:08 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Found default for hw_pointer_model of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 00:10:08 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Found default for hw_video_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 00:10:08 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Found default for hw_vif_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 00:10:08 user nova-compute[75341]: DEBUG nova.compute.manager [req-b592fa1f-dd8c-45a8-84ba-77069aa105a3 req-541e748b-525c-40ce-8acd-08be83194758 service nova] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Received event network-vif-plugged-6b89e652-396c-42ad-9a1a-402e18e1a9f3 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:10:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-b592fa1f-dd8c-45a8-84ba-77069aa105a3 req-541e748b-525c-40ce-8acd-08be83194758 service nova] Acquiring lock "5a57dc05-73fa-45a8-98d9-c355f2f35d17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:10:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-b592fa1f-dd8c-45a8-84ba-77069aa105a3 req-541e748b-525c-40ce-8acd-08be83194758 service nova] Lock "5a57dc05-73fa-45a8-98d9-c355f2f35d17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:10:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-b592fa1f-dd8c-45a8-84ba-77069aa105a3 req-541e748b-525c-40ce-8acd-08be83194758 service nova] Lock "5a57dc05-73fa-45a8-98d9-c355f2f35d17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:10:08 user nova-compute[75341]: DEBUG nova.compute.manager [req-b592fa1f-dd8c-45a8-84ba-77069aa105a3 req-541e748b-525c-40ce-8acd-08be83194758 service nova] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] No waiting events found dispatching network-vif-plugged-6b89e652-396c-42ad-9a1a-402e18e1a9f3 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:10:08 user nova-compute[75341]: WARNING nova.compute.manager [req-b592fa1f-dd8c-45a8-84ba-77069aa105a3 req-541e748b-525c-40ce-8acd-08be83194758 service nova] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Received unexpected event network-vif-plugged-6b89e652-396c-42ad-9a1a-402e18e1a9f3 for instance with vm_state building and task_state spawning.
Nov 15 00:10:08 user nova-compute[75341]: INFO nova.compute.manager [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Took 4.89 seconds to spawn the instance on the hypervisor.
Nov 15 00:10:08 user nova-compute[75341]: DEBUG nova.compute.manager [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 00:10:08 user nova-compute[75341]: INFO nova.compute.manager [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Took 16.43 seconds to build instance.
Nov 15 00:10:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-9f6f8558-5035-424d-9cf1-422e189459e0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "5a57dc05-73fa-45a8-98d9-c355f2f35d17" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.521s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:10:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:10:12 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:10:12 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:10:13 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:10:13 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75341) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 00:10:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:10:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:10:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:10:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:10:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:10:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:10:15 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:10:15 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:10:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:10:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:10:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:10:15 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75341) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 00:10:16 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbf7ae6a-78da-4361-b36b-b7733a01f3bc/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:10:16 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbf7ae6a-78da-4361-b36b-b7733a01f3bc/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:10:16 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbf7ae6a-78da-4361-b36b-b7733a01f3bc/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:10:16 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbf7ae6a-78da-4361-b36b-b7733a01f3bc/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:10:16 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:10:16 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:10:16 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:10:16 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:10:16 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 00:10:17 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:10:17 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:10:17 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Hypervisor/Node resource view: name=user free_ram=8828MB free_disk=25.289386749267578GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75341) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 00:10:17 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:10:17 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:10:17 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance cbf7ae6a-78da-4361-b36b-b7733a01f3bc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:10:17 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance c332ad29-e892-4caf-aa37-fd66fb41f9ec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:10:17 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 5a57dc05-73fa-45a8-98d9-c355f2f35d17 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:10:17 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 00:10:17 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 00:10:17 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 00:10:17 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 00:10:17 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Compute_service record updated for user:user {{(pid=75341) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 00:10:17 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.313s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:10:19 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:10:19 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:10:19 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Starting heal instance info cache {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 00:10:19 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:10:19 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "refresh_cache-c332ad29-e892-4caf-aa37-fd66fb41f9ec" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:10:19 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquired lock "refresh_cache-c332ad29-e892-4caf-aa37-fd66fb41f9ec" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:10:19 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Forcefully refreshing network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 00:10:19 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Updating instance_info_cache with network_info: [{"id": "9f65f96b-aa09-4c3a-a23b-ed444c9dacec", "address": "fa:16:3e:c6:2e:8d", "network": {"id": "aed56292-815e-4004-9101-59ff735cf236", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cde913b393e4b1095ae6e8e4a74b5fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f65f96b-aa", "ovs_interfaceid": "9f65f96b-aa09-4c3a-a23b-ed444c9dacec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:10:20 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Releasing lock "refresh_cache-c332ad29-e892-4caf-aa37-fd66fb41f9ec" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:10:20 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Updated the network info_cache for instance {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 00:10:20 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:10:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:10:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:10:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:10:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:10:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:10:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:10:28 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f0407ca6-9c3a-4cb5-ba91-371354050bf6 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Acquiring lock "cbf7ae6a-78da-4361-b36b-b7733a01f3bc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:10:28 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f0407ca6-9c3a-4cb5-ba91-371354050bf6 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "cbf7ae6a-78da-4361-b36b-b7733a01f3bc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:10:28 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f0407ca6-9c3a-4cb5-ba91-371354050bf6 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Acquiring lock "cbf7ae6a-78da-4361-b36b-b7733a01f3bc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:10:28 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f0407ca6-9c3a-4cb5-ba91-371354050bf6 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "cbf7ae6a-78da-4361-b36b-b7733a01f3bc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:10:28 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f0407ca6-9c3a-4cb5-ba91-371354050bf6 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "cbf7ae6a-78da-4361-b36b-b7733a01f3bc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:10:28 user nova-compute[75341]: INFO nova.compute.manager [None req-f0407ca6-9c3a-4cb5-ba91-371354050bf6 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Terminating instance
Nov 15 00:10:28 user nova-compute[75341]: DEBUG nova.compute.manager [None req-f0407ca6-9c3a-4cb5-ba91-371354050bf6 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Start destroying the instance on the hypervisor. {{(pid=75341) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 00:10:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:10:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:10:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:10:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:10:28 user nova-compute[75341]: DEBUG nova.compute.manager [req-2c1a4647-d590-4cbe-b947-44e6c3004cfb req-405e7299-9492-4fd7-9316-f6c7e2e766d2 service nova] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Received event network-vif-unplugged-e3539392-c398-4e79-9e92-92307e4036d6 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:10:28 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-2c1a4647-d590-4cbe-b947-44e6c3004cfb req-405e7299-9492-4fd7-9316-f6c7e2e766d2 service nova] Acquiring lock "cbf7ae6a-78da-4361-b36b-b7733a01f3bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:10:28 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-2c1a4647-d590-4cbe-b947-44e6c3004cfb req-405e7299-9492-4fd7-9316-f6c7e2e766d2 service nova] Lock "cbf7ae6a-78da-4361-b36b-b7733a01f3bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:10:28 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-2c1a4647-d590-4cbe-b947-44e6c3004cfb req-405e7299-9492-4fd7-9316-f6c7e2e766d2 service nova] Lock "cbf7ae6a-78da-4361-b36b-b7733a01f3bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:10:28 user nova-compute[75341]: DEBUG nova.compute.manager [req-2c1a4647-d590-4cbe-b947-44e6c3004cfb req-405e7299-9492-4fd7-9316-f6c7e2e766d2 service nova] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] No waiting events found dispatching network-vif-unplugged-e3539392-c398-4e79-9e92-92307e4036d6 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:10:28 user nova-compute[75341]: DEBUG nova.compute.manager [req-2c1a4647-d590-4cbe-b947-44e6c3004cfb req-405e7299-9492-4fd7-9316-f6c7e2e766d2 service nova] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Received event network-vif-unplugged-e3539392-c398-4e79-9e92-92307e4036d6 for instance with task_state deleting. {{(pid=75341) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 00:10:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:10:29 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Instance destroyed successfully.
Nov 15 00:10:29 user nova-compute[75341]: DEBUG nova.objects.instance [None req-f0407ca6-9c3a-4cb5-ba91-371354050bf6 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lazy-loading 'resources' on Instance uuid cbf7ae6a-78da-4361-b36b-b7733a01f3bc {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:10:29 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-f0407ca6-9c3a-4cb5-ba91-371354050bf6 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T00:05:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1694659356',display_name='tempest-TestMinimumBasicScenario-server-1694659356',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1694659356',id=46,image_ref='8ae249fe-86cc-4262-85be-9553601c741f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEf7PjHmw6p5xUZ/pEck9JyDCpw8TggB8BHdTujoi1XDHMJnru0QSiWCmn25IccX+U3otOQTs5Y4UdmKX0pFaT/4IrGzR9Ks4CEkPQJW6hD8aZQngMWLmGIr6xMc3lg3pQ==',key_name='tempest-TestMinimumBasicScenario-333149133',keypairs=<?>,launch_index=0,launched_at=2023-11-15T00:05:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f8c1eeb4c3c4f27b774aba29ceb7997',ramdisk_id='',reservation_id='r-4gt9mtbu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8ae249fe-86cc-4262-85be-9553601c741f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-157558920',owner_user_name='tempest-TestMinimumBasicScenario-157558920-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T00:07:51Z,user_data=None,user_id='1b1c77e1e34b46319dcd52a38996542c',uuid=cbf7ae6a-78da-4361-b36b-b7733a01f3bc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e3539392-c398-4e79-9e92-92307e4036d6", "address": "fa:16:3e:0e:c2:2d", "network": {"id": "e8f13b75-3423-43ce-b6dc-843c837e46d2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-617247022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8c1eeb4c3c4f27b774aba29ceb7997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3539392-c3", "ovs_interfaceid": "e3539392-c398-4e79-9e92-92307e4036d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 00:10:29 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-f0407ca6-9c3a-4cb5-ba91-371354050bf6 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Converting VIF {"id": "e3539392-c398-4e79-9e92-92307e4036d6", "address": "fa:16:3e:0e:c2:2d", "network": {"id": "e8f13b75-3423-43ce-b6dc-843c837e46d2", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-617247022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8c1eeb4c3c4f27b774aba29ceb7997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3539392-c3", "ovs_interfaceid": "e3539392-c398-4e79-9e92-92307e4036d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 00:10:29 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-f0407ca6-9c3a-4cb5-ba91-371354050bf6 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0e:c2:2d,bridge_name='br-int',has_traffic_filtering=True,id=e3539392-c398-4e79-9e92-92307e4036d6,network=Network(e8f13b75-3423-43ce-b6dc-843c837e46d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3539392-c3') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 00:10:29 user nova-compute[75341]: DEBUG os_vif [None req-f0407ca6-9c3a-4cb5-ba91-371354050bf6 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:c2:2d,bridge_name='br-int',has_traffic_filtering=True,id=e3539392-c398-4e79-9e92-92307e4036d6,network=Network(e8f13b75-3423-43ce-b6dc-843c837e46d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3539392-c3') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 00:10:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:10:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape3539392-c3, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:10:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:10:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:10:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:10:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=891243c4-6038-42e3-9239-ff5f52a163aa) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:10:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:10:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:10:29 user nova-compute[75341]: INFO os_vif [None req-f0407ca6-9c3a-4cb5-ba91-371354050bf6 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:c2:2d,bridge_name='br-int',has_traffic_filtering=True,id=e3539392-c398-4e79-9e92-92307e4036d6,network=Network(e8f13b75-3423-43ce-b6dc-843c837e46d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3539392-c3')
Nov 15 00:10:29 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-f0407ca6-9c3a-4cb5-ba91-371354050bf6 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Deleting instance files /opt/stack/data/nova/instances/cbf7ae6a-78da-4361-b36b-b7733a01f3bc_del
Nov 15 00:10:29 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-f0407ca6-9c3a-4cb5-ba91-371354050bf6 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Deletion of /opt/stack/data/nova/instances/cbf7ae6a-78da-4361-b36b-b7733a01f3bc_del complete
Nov 15 00:10:29 user nova-compute[75341]: INFO nova.compute.manager [None req-f0407ca6-9c3a-4cb5-ba91-371354050bf6 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 15 00:10:29 user nova-compute[75341]: DEBUG oslo.service.loopingcall [None req-f0407ca6-9c3a-4cb5-ba91-371354050bf6 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75341) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 00:10:29 user nova-compute[75341]: DEBUG nova.compute.manager [-] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Deallocating network for instance {{(pid=75341) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 00:10:29 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] deallocate_for_instance() {{(pid=75341) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 00:10:29 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:10:29 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:10:29 user nova-compute[75341]: INFO nova.compute.manager [-] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Took 0.40 seconds to deallocate network for instance.
Nov 15 00:10:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f0407ca6-9c3a-4cb5-ba91-371354050bf6 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:10:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f0407ca6-9c3a-4cb5-ba91-371354050bf6 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:10:29 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-f0407ca6-9c3a-4cb5-ba91-371354050bf6 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 00:10:29 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-f0407ca6-9c3a-4cb5-ba91-371354050bf6 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 00:10:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f0407ca6-9c3a-4cb5-ba91-371354050bf6 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.257s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:10:29 user nova-compute[75341]: INFO nova.scheduler.client.report [None req-f0407ca6-9c3a-4cb5-ba91-371354050bf6 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Deleted allocations for instance cbf7ae6a-78da-4361-b36b-b7733a01f3bc
Nov 15 00:10:30 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f0407ca6-9c3a-4cb5-ba91-371354050bf6 tempest-TestMinimumBasicScenario-157558920 tempest-TestMinimumBasicScenario-157558920-project-member] Lock "cbf7ae6a-78da-4361-b36b-b7733a01f3bc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.691s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:10:30 user nova-compute[75341]: DEBUG nova.compute.manager [req-55ce9a94-a7fe-43a8-aac3-5edecf49324f req-5e92d42f-0bdf-4a21-91a8-d8db15d6434d service nova] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Received event network-vif-plugged-e3539392-c398-4e79-9e92-92307e4036d6 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:10:30 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-55ce9a94-a7fe-43a8-aac3-5edecf49324f req-5e92d42f-0bdf-4a21-91a8-d8db15d6434d service nova] Acquiring lock "cbf7ae6a-78da-4361-b36b-b7733a01f3bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:10:30 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-55ce9a94-a7fe-43a8-aac3-5edecf49324f req-5e92d42f-0bdf-4a21-91a8-d8db15d6434d service nova] Lock "cbf7ae6a-78da-4361-b36b-b7733a01f3bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:10:30 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-55ce9a94-a7fe-43a8-aac3-5edecf49324f req-5e92d42f-0bdf-4a21-91a8-d8db15d6434d service nova] Lock "cbf7ae6a-78da-4361-b36b-b7733a01f3bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:10:30 user nova-compute[75341]: DEBUG nova.compute.manager [req-55ce9a94-a7fe-43a8-aac3-5edecf49324f req-5e92d42f-0bdf-4a21-91a8-d8db15d6434d service nova] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] No waiting events found dispatching network-vif-plugged-e3539392-c398-4e79-9e92-92307e4036d6 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:10:30 user nova-compute[75341]: WARNING nova.compute.manager [req-55ce9a94-a7fe-43a8-aac3-5edecf49324f req-5e92d42f-0bdf-4a21-91a8-d8db15d6434d service nova] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Received unexpected event network-vif-plugged-e3539392-c398-4e79-9e92-92307e4036d6 for instance with vm_state deleted and task_state None.
Nov 15 00:10:30 user nova-compute[75341]: DEBUG nova.compute.manager [req-55ce9a94-a7fe-43a8-aac3-5edecf49324f req-5e92d42f-0bdf-4a21-91a8-d8db15d6434d service nova] [instance: cbf7ae6a-78da-4361-b36b-b7733a01f3bc] Received event network-vif-deleted-e3539392-c398-4e79-9e92-92307e4036d6 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:10:34 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:10:39 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:10:39 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:10:39 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:10:39 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:10:39 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:10:39 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:10:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:10:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:10:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:10:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:10:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:10:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:10:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:10:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:10:59 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:11:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:11:07 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:11:08 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:11:08 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Cleaning up deleted instances {{(pid=75341) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 00:11:08 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] There are 0 instances to clean {{(pid=75341) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 00:11:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:11:11 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:11:12 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:11:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:11:14 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:11:14 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:11:14 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75341) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 00:11:15 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:11:17 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:11:17 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Starting heal instance info cache {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 00:11:17 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Rebuilding the list of instances to heal {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 00:11:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "refresh_cache-c332ad29-e892-4caf-aa37-fd66fb41f9ec" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:11:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquired lock "refresh_cache-c332ad29-e892-4caf-aa37-fd66fb41f9ec" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:11:18 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Forcefully refreshing network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 00:11:18 user nova-compute[75341]: DEBUG nova.objects.instance [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lazy-loading 'info_cache' on Instance uuid c332ad29-e892-4caf-aa37-fd66fb41f9ec {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:11:18 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Updating instance_info_cache with network_info: [{"id": "9f65f96b-aa09-4c3a-a23b-ed444c9dacec", "address": "fa:16:3e:c6:2e:8d", "network": {"id": "aed56292-815e-4004-9101-59ff735cf236", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cde913b393e4b1095ae6e8e4a74b5fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f65f96b-aa", "ovs_interfaceid": "9f65f96b-aa09-4c3a-a23b-ed444c9dacec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:11:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Releasing lock "refresh_cache-c332ad29-e892-4caf-aa37-fd66fb41f9ec" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:11:18 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Updated the network info_cache for instance {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 00:11:18 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:11:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:11:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:11:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:11:18 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75341) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 00:11:18 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:11:18 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:11:18 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:11:18 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:11:18 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 00:11:19 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:11:19 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:11:19 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:11:19 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Hypervisor/Node resource view: name=user free_ram=8918MB free_disk=25.31667709350586GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75341) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 00:11:19 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:11:19 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:11:19 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance c332ad29-e892-4caf-aa37-fd66fb41f9ec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:11:19 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 5a57dc05-73fa-45a8-98d9-c355f2f35d17 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:11:19 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 00:11:19 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 00:11:19 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Refreshing inventories for resource provider 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 00:11:19 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Updating ProviderTree inventory for provider 8fa114cc-b541-418f-865c-16c44294e72d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 00:11:19 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Updating inventory in ProviderTree for provider 8fa114cc-b541-418f-865c-16c44294e72d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 00:11:19 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Refreshing aggregate associations for resource provider 8fa114cc-b541-418f-865c-16c44294e72d, aggregates: None {{(pid=75341) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 00:11:19 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Refreshing trait associations for resource provider 8fa114cc-b541-418f-865c-16c44294e72d, traits: COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_MMX,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000E {{(pid=75341) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 00:11:19 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:11:19 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 00:11:19 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 00:11:19 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Compute_service record updated for user:user {{(pid=75341) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 00:11:19 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.574s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:11:20 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:11:20 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:11:21 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:11:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:11:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:11:24 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:11:24 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75341) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 00:11:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:11:34 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:11:39 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:11:42 user nova-compute[75341]: INFO nova.compute.manager [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Rescuing
Nov 15 00:11:42 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Acquiring lock "refresh_cache-5a57dc05-73fa-45a8-98d9-c355f2f35d17" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:11:42 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Acquired lock "refresh_cache-5a57dc05-73fa-45a8-98d9-c355f2f35d17" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:11:42 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 00:11:43 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Updating instance_info_cache with network_info: [{"id": "6b89e652-396c-42ad-9a1a-402e18e1a9f3", "address": "fa:16:3e:f1:b5:9c", "network": {"id": "aed56292-815e-4004-9101-59ff735cf236", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cde913b393e4b1095ae6e8e4a74b5fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b89e652-39", "ovs_interfaceid": "6b89e652-396c-42ad-9a1a-402e18e1a9f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:11:43 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Releasing lock "refresh_cache-5a57dc05-73fa-45a8-98d9-c355f2f35d17" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:11:43 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:11:43 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:11:43 user nova-compute[75341]: DEBUG nova.compute.manager [req-8c1f00aa-54d4-4650-930d-c94bad7e82cb req-3be2bc10-306a-4329-ac7e-5eec9e35182c service nova] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Received event network-vif-unplugged-6b89e652-396c-42ad-9a1a-402e18e1a9f3 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:11:43 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-8c1f00aa-54d4-4650-930d-c94bad7e82cb req-3be2bc10-306a-4329-ac7e-5eec9e35182c service nova] Acquiring lock "5a57dc05-73fa-45a8-98d9-c355f2f35d17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:11:43 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-8c1f00aa-54d4-4650-930d-c94bad7e82cb req-3be2bc10-306a-4329-ac7e-5eec9e35182c service nova] Lock "5a57dc05-73fa-45a8-98d9-c355f2f35d17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:11:43 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-8c1f00aa-54d4-4650-930d-c94bad7e82cb req-3be2bc10-306a-4329-ac7e-5eec9e35182c service nova] Lock "5a57dc05-73fa-45a8-98d9-c355f2f35d17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:11:43 user nova-compute[75341]: DEBUG nova.compute.manager [req-8c1f00aa-54d4-4650-930d-c94bad7e82cb req-3be2bc10-306a-4329-ac7e-5eec9e35182c service nova] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] No waiting events found dispatching network-vif-unplugged-6b89e652-396c-42ad-9a1a-402e18e1a9f3 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:11:43 user nova-compute[75341]: WARNING nova.compute.manager [req-8c1f00aa-54d4-4650-930d-c94bad7e82cb req-3be2bc10-306a-4329-ac7e-5eec9e35182c service nova] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Received unexpected event network-vif-unplugged-6b89e652-396c-42ad-9a1a-402e18e1a9f3 for instance with vm_state active and task_state rescuing.
Nov 15 00:11:43 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:11:43 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:11:43 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Instance destroyed successfully.
Nov 15 00:11:43 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Attempting a stable device rescue
Nov 15 00:11:43 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75341) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 00:11:43 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Instance directory exists: not creating {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 00:11:43 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Creating image(s)
Nov 15 00:11:43 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Acquiring lock "/opt/stack/data/nova/instances/5a57dc05-73fa-45a8-98d9-c355f2f35d17/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:11:43 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "/opt/stack/data/nova/instances/5a57dc05-73fa-45a8-98d9-c355f2f35d17/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:11:43 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "/opt/stack/data/nova/instances/5a57dc05-73fa-45a8-98d9-c355f2f35d17/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:11:43 user nova-compute[75341]: DEBUG nova.objects.instance [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5a57dc05-73fa-45a8-98d9-c355f2f35d17 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:11:43 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Acquiring lock "7f30899dc47815726749a05ebb41d7df6cae0d6f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:11:43 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "7f30899dc47815726749a05ebb41d7df6cae0d6f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:11:44 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f30899dc47815726749a05ebb41d7df6cae0d6f.part --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:11:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:11:44 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f30899dc47815726749a05ebb41d7df6cae0d6f.part --force-share --output=json" returned: 0 in 0.167s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:11:44 user nova-compute[75341]: DEBUG nova.virt.images [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] 941a1f46-bd4d-40e9-9948-8a0f388bf30a was qcow2, converting to raw {{(pid=75341) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 00:11:44 user nova-compute[75341]: DEBUG nova.privsep.utils [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75341) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 00:11:44 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7f30899dc47815726749a05ebb41d7df6cae0d6f.part /opt/stack/data/nova/instances/_base/7f30899dc47815726749a05ebb41d7df6cae0d6f.converted {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:11:45 user nova-compute[75341]: DEBUG nova.compute.manager [req-314ddda6-bb89-4986-851e-f65462913953 req-c5765c46-612e-42a7-b5bf-94cf413b3573 service nova] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Received event network-vif-plugged-6b89e652-396c-42ad-9a1a-402e18e1a9f3 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:11:45 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-314ddda6-bb89-4986-851e-f65462913953 req-c5765c46-612e-42a7-b5bf-94cf413b3573 service nova] Acquiring lock "5a57dc05-73fa-45a8-98d9-c355f2f35d17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:11:45 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-314ddda6-bb89-4986-851e-f65462913953 req-c5765c46-612e-42a7-b5bf-94cf413b3573 service nova] Lock "5a57dc05-73fa-45a8-98d9-c355f2f35d17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:11:45 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-314ddda6-bb89-4986-851e-f65462913953 req-c5765c46-612e-42a7-b5bf-94cf413b3573 service nova] Lock "5a57dc05-73fa-45a8-98d9-c355f2f35d17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:11:45 user nova-compute[75341]: DEBUG nova.compute.manager [req-314ddda6-bb89-4986-851e-f65462913953 req-c5765c46-612e-42a7-b5bf-94cf413b3573 service nova] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] No waiting events found dispatching network-vif-plugged-6b89e652-396c-42ad-9a1a-402e18e1a9f3 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:11:45 user nova-compute[75341]: WARNING nova.compute.manager [req-314ddda6-bb89-4986-851e-f65462913953 req-c5765c46-612e-42a7-b5bf-94cf413b3573 service nova] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Received unexpected event network-vif-plugged-6b89e652-396c-42ad-9a1a-402e18e1a9f3 for instance with vm_state active and task_state rescuing.
Nov 15 00:11:45 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7f30899dc47815726749a05ebb41d7df6cae0d6f.part /opt/stack/data/nova/instances/_base/7f30899dc47815726749a05ebb41d7df6cae0d6f.converted" returned: 0 in 0.714s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:11:45 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f30899dc47815726749a05ebb41d7df6cae0d6f.converted --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:11:45 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f30899dc47815726749a05ebb41d7df6cae0d6f.converted --force-share --output=json" returned: 0 in 0.174s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:11:45 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "7f30899dc47815726749a05ebb41d7df6cae0d6f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.954s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:11:45 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Acquiring lock "7f30899dc47815726749a05ebb41d7df6cae0d6f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:11:45 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "7f30899dc47815726749a05ebb41d7df6cae0d6f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:11:45 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f30899dc47815726749a05ebb41d7df6cae0d6f --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f30899dc47815726749a05ebb41d7df6cae0d6f --force-share --output=json" returned: 0 in 0.163s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7f30899dc47815726749a05ebb41d7df6cae0d6f,backing_fmt=raw /opt/stack/data/nova/instances/5a57dc05-73fa-45a8-98d9-c355f2f35d17/disk.rescue {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7f30899dc47815726749a05ebb41d7df6cae0d6f,backing_fmt=raw /opt/stack/data/nova/instances/5a57dc05-73fa-45a8-98d9-c355f2f35d17/disk.rescue" returned: 0 in 0.047s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "7f30899dc47815726749a05ebb41d7df6cae0d6f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.218s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG nova.objects.instance [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lazy-loading 'migration_context' on Instance uuid 5a57dc05-73fa-45a8-98d9-c355f2f35d17 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG nova.objects.base [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Object Instance<5a57dc05-73fa-45a8-98d9-c355f2f35d17> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75341) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Created local disks {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Start _get_guest_xml network_info=[{"id": "6b89e652-396c-42ad-9a1a-402e18e1a9f3", "address": "fa:16:3e:f1:b5:9c", "network": {"id": "aed56292-815e-4004-9101-59ff735cf236", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "vif_mac": "fa:16:3e:f1:b5:9c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cde913b393e4b1095ae6e8e4a74b5fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b89e652-39", "ovs_interfaceid": "6b89e652-396c-42ad-9a1a-402e18e1a9f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '941a1f46-bd4d-40e9-9948-8a0f388bf30a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'b58a2351-d18b-4b15-bce7-78698e9649d9', 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sFmYiKyv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '5a57dc05-73fa-45a8-98d9-c355f2f35d17', 'attached_at': '', 'detached_at': '', 'volume_id': '7500ff6d-ab61-40fe-b910-9ae8a4160f4e', 'serial': '7500ff6d-ab61-40fe-b910-9ae8a4160f4e'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG nova.objects.instance [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lazy-loading 'resources' on Instance uuid 5a57dc05-73fa-45a8-98d9-c355f2f35d17 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG nova.objects.base [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Object Instance<5a57dc05-73fa-45a8-98d9-c355f2f35d17> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75341) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG nova.objects.instance [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lazy-loading 'numa_topology' on Instance uuid 5a57dc05-73fa-45a8-98d9-c355f2f35d17 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG nova.objects.base [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Object Instance<5a57dc05-73fa-45a8-98d9-c355f2f35d17> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75341) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 00:11:46 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:11:46 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:11:46 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG nova.objects.instance [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5a57dc05-73fa-45a8-98d9-c355f2f35d17 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG nova.objects.base [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Object Instance<5a57dc05-73fa-45a8-98d9-c355f2f35d17> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75341) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Calling os-brick to attach iSCSI Volume {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sFmYiKyv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 00:11:46 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 00:11:46 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 00:11:46 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 00:11:46 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 00:11:46 user nova-compute[75341]: INFO os_brick.initiator.connectors.iscsi [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 00:11:46 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e -p 172.16.0.220:3260 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f131378-098f-4688-b0c1-c5fbb1f3400f]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = sFmYiKyv\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 15 00:11:46 user nova-compute[75341]: node.name = iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e
Nov 15 00:11:46 user nova-compute[75341]: node.tpgt = -1
Nov 15 00:11:46 user nova-compute[75341]: node.startup = automatic
Nov 15 00:11:46 user nova-compute[75341]: node.leading_login = No
Nov 15 00:11:46 user nova-compute[75341]: iface.iscsi_ifacename = default
Nov 15 00:11:46 user nova-compute[75341]: iface.net_ifacename = <empty>
Nov 15 00:11:46 user nova-compute[75341]: iface.ipaddress = <empty>
Nov 15 00:11:46 user nova-compute[75341]: iface.prefix_len = 0
Nov 15 00:11:46 user nova-compute[75341]: iface.hwaddress = <empty>
Nov 15 00:11:46 user nova-compute[75341]: iface.transport_name = tcp
Nov 15 00:11:46 user nova-compute[75341]: iface.initiatorname = <empty>
Nov 15 00:11:46 user nova-compute[75341]: iface.state = <empty>
Nov 15 00:11:46 user nova-compute[75341]: iface.vlan_id = 0
Nov 15 00:11:46 user nova-compute[75341]: iface.vlan_priority = 0
Nov 15 00:11:46 user nova-compute[75341]: iface.vlan_state = <empty>
Nov 15 00:11:46 user nova-compute[75341]: iface.iface_num = 0
Nov 15 00:11:46 user nova-compute[75341]: iface.mtu = 0
Nov 15 00:11:46 user nova-compute[75341]: iface.port = 0
Nov 15 00:11:46 user nova-compute[75341]: iface.bootproto = <empty>
Nov 15 00:11:46 user nova-compute[75341]: iface.subnet_mask = <empty>
Nov 15 00:11:46 user nova-compute[75341]: iface.gateway = <empty>
Nov 15 00:11:46 user nova-compute[75341]: iface.dhcp_alt_client_id_state = <empty>
Nov 15 00:11:46 user nova-compute[75341]: iface.dhcp_alt_client_id = <empty>
Nov 15 00:11:46 user nova-compute[75341]: iface.dhcp_dns = <empty>
Nov 15 00:11:46 user nova-compute[75341]: iface.dhcp_learn_iqn = <empty>
Nov 15 00:11:46 user nova-compute[75341]: iface.dhcp_req_vendor_id_state = <empty>
Nov 15 00:11:46 user nova-compute[75341]: iface.dhcp_vendor_id_state = <empty>
Nov 15 00:11:46 user nova-compute[75341]: iface.dhcp_vendor_id = <empty>
Nov 15 00:11:46 user nova-compute[75341]: iface.dhcp_slp_da = <empty>
Nov 15 00:11:46 user nova-compute[75341]: iface.fragmentation = <empty>
Nov 15 00:11:46 user nova-compute[75341]: iface.gratuitous_arp = <empty>
Nov 15 00:11:46 user nova-compute[75341]: iface.incoming_forwarding = <empty>
Nov 15 00:11:46 user nova-compute[75341]: iface.tos_state = <empty>
Nov 15 00:11:46 user nova-compute[75341]: iface.tos = 0
Nov 15 00:11:46 user nova-compute[75341]: iface.ttl = 0
Nov 15 00:11:46 user nova-compute[75341]: iface.delayed_ack = <empty>
Nov 15 00:11:46 user nova-compute[75341]: iface.tcp_nagle = <empty>
Nov 15 00:11:46 user nova-compute[75341]: iface.tcp_wsf_state = <empty>
Nov 15 00:11:46 user nova-compute[75341]: iface.tcp_wsf = 0
Nov 15 00:11:46 user nova-compute[75341]: iface.tcp_timer_scale = 0
Nov 15 00:11:46 user nova-compute[75341]: iface.tcp_timestamp = <empty>
Nov 15 00:11:46 user nova-compute[75341]: iface.redirect = <empty>
Nov 15 00:11:46 user nova-compute[75341]: iface.def_task_mgmt_timeout = 0
Nov 15 00:11:46 user nova-compute[75341]: iface.header_digest = <empty>
Nov 15 00:11:46 user nova-compute[75341]: iface.data_digest = <empty>
Nov 15 00:11:46 user nova-compute[75341]: iface.immediate_data = <empty>
Nov 15 00:11:46 user nova-compute[75341]: iface.initial_r2t = <empty>
Nov 15 00:11:46 user nova-compute[75341]: iface.data_seq_inorder = <empty>
Nov 15 00:11:46 user nova-compute[75341]: iface.data_pdu_inorder = <empty>
Nov 15 00:11:46 user nova-compute[75341]: iface.erl = 0
Nov 15 00:11:46 user nova-compute[75341]: iface.max_receive_data_len = 0
Nov 15 00:11:46 user nova-compute[75341]: iface.first_burst_len = 0
Nov 15 00:11:46 user nova-compute[75341]: iface.max_outstanding_r2t = 0
Nov 15 00:11:46 user nova-compute[75341]: iface.max_burst_len = 0
Nov 15 00:11:46 user nova-compute[75341]: iface.chap_auth = <empty>
Nov 15 00:11:46 user nova-compute[75341]: iface.bidi_chap = <empty>
Nov 15 00:11:46 user nova-compute[75341]: iface.strict_login_compliance = <empty>
Nov 15 00:11:46 user nova-compute[75341]: iface.discovery_auth = <empty>
Nov 15 00:11:46 user nova-compute[75341]: iface.discovery_logout = <empty>
Nov 15 00:11:46 user nova-compute[75341]: node.discovery_address = <empty>
Nov 15 00:11:46 user nova-compute[75341]: node.discovery_port = 0
Nov 15 00:11:46 user nova-compute[75341]: node.discovery_type = static
Nov 15 00:11:46 user nova-compute[75341]: node.session.initial_cmdsn = 0
Nov 15 00:11:46 user nova-compute[75341]: node.session.initial_login_retry_max = 8
Nov 15 00:11:46 user nova-compute[75341]: node.session.xmit_thread_priority = -20
Nov 15 00:11:46 user nova-compute[75341]: node.session.cmds_max = 128
Nov 15 00:11:46 user nova-compute[75341]: node.session.queue_depth = 32
Nov 15 00:11:46 user nova-compute[75341]: node.session.nr_sessions = 1
Nov 15 00:11:46 user nova-compute[75341]: node.session.auth.authmethod = CHAP
Nov 15 00:11:46 user nova-compute[75341]: node.session.auth.username = sFmYiKyv
Nov 15 00:11:46 user nova-compute[75341]: node.session.auth.password = ***
Nov 15 00:11:46 user nova-compute[75341]: node.session.auth.username_in = <empty>
Nov 15 00:11:46 user nova-compute[75341]: node.session.auth.password_in = <empty>
Nov 15 00:11:46 user nova-compute[75341]: node.session.auth.chap_algs = MD5
Nov 15 00:11:46 user nova-compute[75341]: node.session.timeo.replacement_timeout = 120
Nov 15 00:11:46 user nova-compute[75341]: node.session.err_timeo.abort_timeout = 15
Nov 15 00:11:46 user nova-compute[75341]: node.session.err_timeo.lu_reset_timeout = 30
Nov 15 00:11:46 user nova-compute[75341]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 15 00:11:46 user nova-compute[75341]: node.session.err_timeo.host_reset_timeout = 60
Nov 15 00:11:46 user nova-compute[75341]: node.session.iscsi.FastAbort = Yes
Nov 15 00:11:46 user nova-compute[75341]: node.session.iscsi.InitialR2T = No
Nov 15 00:11:46 user nova-compute[75341]: node.session.iscsi.ImmediateData = Yes
Nov 15 00:11:46 user nova-compute[75341]: node.session.iscsi.FirstBurstLength = 262144
Nov 15 00:11:46 user nova-compute[75341]: node.session.iscsi.MaxBurstLength = 16776192
Nov 15 00:11:46 user nova-compute[75341]: node.session.iscsi.DefaultTime2Retain = 0
Nov 15 00:11:46 user nova-compute[75341]: node.session.iscsi.DefaultTime2Wait = 2
Nov 15 00:11:46 user nova-compute[75341]: node.session.iscsi.MaxConnections = 1
Nov 15 00:11:46 user nova-compute[75341]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 15 00:11:46 user nova-compute[75341]: node.session.iscsi.ERL = 0
Nov 15 00:11:46 user nova-compute[75341]: node.session.scan = manual
Nov 15 00:11:46 user nova-compute[75341]: node.session.reopen_max = 0
Nov 15 00:11:46 user nova-compute[75341]: node.conn[0].address = 172.16.0.220
Nov 15 00:11:46 user nova-compute[75341]: node.conn[0].port = 3260
Nov 15 00:11:46 user nova-compute[75341]: node.conn[0].startup = manual
Nov 15 00:11:46 user nova-compute[75341]: node.conn[0].tcp.window_size = 524288
Nov 15 00:11:46 user nova-compute[75341]: node.conn[0].tcp.type_of_service = 0
Nov 15 00:11:46 user nova-compute[75341]: node.conn[0].timeo.logout_timeout = 15
Nov 15 00:11:46 user nova-compute[75341]: node.conn[0].timeo.login_timeout = 15
Nov 15 00:11:46 user nova-compute[75341]: node.conn[0].timeo.auth_timeout = 45
Nov 15 00:11:46 user nova-compute[75341]: node.conn[0].timeo.noop_out_interval = 5
Nov 15 00:11:46 user nova-compute[75341]: node.conn[0].timeo.noop_out_timeout = 5
Nov 15 00:11:46 user nova-compute[75341]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 15 00:11:46 user nova-compute[75341]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 15 00:11:46 user nova-compute[75341]: node.conn[0].iscsi.HeaderDigest = None
Nov 15 00:11:46 user nova-compute[75341]: node.conn[0].iscsi.DataDigest = None
Nov 15 00:11:46 user nova-compute[75341]: node.conn[0].iscsi.IFMarker = No
Nov 15 00:11:46 user nova-compute[75341]: node.conn[0].iscsi.OFMarker = No
Nov 15 00:11:46 user nova-compute[75341]: # END RECORD
Nov 15 00:11:46 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[b931153f-223d-4bdd-a555-77b545744341]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e3209d-243f-4363-b264-513484b71e30]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sFmYiKyv {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sFmYiKyv" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a5e4c8-002c-4ba1-9cad-62b8a2d17e1c]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sFmYiKyv'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[933a76c6-d685-4a7b-a035-010c8f05254d]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[1efa0249-2731-401b-916e-924542d757e9]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e (non-flash)
Nov 15 00:11:46 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e (non-flash)
Nov 15 00:11:46 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.126s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Connected to 172.16.0.220:3260 {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] HCTL ('33', '0', '0', 0) found on session 58 with lun 0 {{(pid=75341) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75341) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.013s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf64fd2-3ac6-4a07-91d8-5b916cc14505]: (4, ('0 0 0', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Searching for a device in session 58 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sFmYiKyv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.148s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] <== connect_volume: return (149ms) {'type': 'block', 'scsi_wwn': '23262633666373936', 'path': '/dev/sdb'} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23262633666373936', 'path': '/dev/sdb'} {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T00:09:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-771342845',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-771342845',id=48,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T00:10:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5cde913b393e4b1095ae6e8e4a74b5fb',ramdisk_id='',reservation_id='r-h0zbeakv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1181444554',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T00:10:08Z,user_data=None,user_id='abb41e7d020d4c99a55b5029cd2124a9',uuid=5a57dc05-73fa-45a8-98d9-c355f2f35d17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6b89e652-396c-42ad-9a1a-402e18e1a9f3", "address": "fa:16:3e:f1:b5:9c", "network": {"id": "aed56292-815e-4004-9101-59ff735cf236", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "vif_mac": "fa:16:3e:f1:b5:9c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cde913b393e4b1095ae6e8e4a74b5fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b89e652-39", "ovs_interfaceid": "6b89e652-396c-42ad-9a1a-402e18e1a9f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Converting VIF {"id": "6b89e652-396c-42ad-9a1a-402e18e1a9f3", "address": "fa:16:3e:f1:b5:9c", "network": {"id": "aed56292-815e-4004-9101-59ff735cf236", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "vif_mac": "fa:16:3e:f1:b5:9c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cde913b393e4b1095ae6e8e4a74b5fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b89e652-39", "ovs_interfaceid": "6b89e652-396c-42ad-9a1a-402e18e1a9f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:b5:9c,bridge_name='br-int',has_traffic_filtering=True,id=6b89e652-396c-42ad-9a1a-402e18e1a9f3,network=Network(aed56292-815e-4004-9101-59ff735cf236),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b89e652-39') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG nova.objects.instance [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lazy-loading 'pci_devices' on Instance uuid 5a57dc05-73fa-45a8-98d9-c355f2f35d17 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG nova.objects.base [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Object Instance<5a57dc05-73fa-45a8-98d9-c355f2f35d17> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75341) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] End _get_guest_xml xml=<domain type="kvm">
Nov 15 00:11:46 user nova-compute[75341]:   <uuid>5a57dc05-73fa-45a8-98d9-c355f2f35d17</uuid>
Nov 15 00:11:46 user nova-compute[75341]:   <name>instance-00000030</name>
Nov 15 00:11:46 user nova-compute[75341]:   <memory>524288</memory>
Nov 15 00:11:46 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 15 00:11:46 user nova-compute[75341]:   <metadata>
Nov 15 00:11:46 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 00:11:46 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 15 00:11:46 user nova-compute[75341]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-771342845</nova:name>
Nov 15 00:11:46 user nova-compute[75341]:       <nova:creationTime>2023-11-15 00:11:46</nova:creationTime>
Nov 15 00:11:46 user nova-compute[75341]:       <nova:flavor name="m1.tiny">
Nov 15 00:11:46 user nova-compute[75341]:         <nova:memory>512</nova:memory>
Nov 15 00:11:46 user nova-compute[75341]:         <nova:disk>1</nova:disk>
Nov 15 00:11:46 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 15 00:11:46 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 00:11:46 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 15 00:11:46 user nova-compute[75341]:       </nova:flavor>
Nov 15 00:11:46 user nova-compute[75341]:       <nova:owner>
Nov 15 00:11:46 user nova-compute[75341]:         <nova:user uuid="abb41e7d020d4c99a55b5029cd2124a9">tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member</nova:user>
Nov 15 00:11:46 user nova-compute[75341]:         <nova:project uuid="5cde913b393e4b1095ae6e8e4a74b5fb">tempest-ServerBootFromVolumeStableRescueTest-1181444554</nova:project>
Nov 15 00:11:46 user nova-compute[75341]:       </nova:owner>
Nov 15 00:11:46 user nova-compute[75341]:       <nova:root type="image" uuid="e46abb82-b810-490e-a8a1-ccdc5fa1a796"/>
Nov 15 00:11:46 user nova-compute[75341]:       <nova:ports>
Nov 15 00:11:46 user nova-compute[75341]:         <nova:port uuid="6b89e652-396c-42ad-9a1a-402e18e1a9f3">
Nov 15 00:11:46 user nova-compute[75341]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 00:11:46 user nova-compute[75341]:         </nova:port>
Nov 15 00:11:46 user nova-compute[75341]:       </nova:ports>
Nov 15 00:11:46 user nova-compute[75341]:     </nova:instance>
Nov 15 00:11:46 user nova-compute[75341]:   </metadata>
Nov 15 00:11:46 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 15 00:11:46 user nova-compute[75341]:     <system>
Nov 15 00:11:46 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 00:11:46 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 15 00:11:46 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 15 00:11:46 user nova-compute[75341]:       <entry name="serial">5a57dc05-73fa-45a8-98d9-c355f2f35d17</entry>
Nov 15 00:11:46 user nova-compute[75341]:       <entry name="uuid">5a57dc05-73fa-45a8-98d9-c355f2f35d17</entry>
Nov 15 00:11:46 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 15 00:11:46 user nova-compute[75341]:     </system>
Nov 15 00:11:46 user nova-compute[75341]:   </sysinfo>
Nov 15 00:11:46 user nova-compute[75341]:   <os>
Nov 15 00:11:46 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 00:11:46 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 15 00:11:46 user nova-compute[75341]:   </os>
Nov 15 00:11:46 user nova-compute[75341]:   <features>
Nov 15 00:11:46 user nova-compute[75341]:     <acpi/>
Nov 15 00:11:46 user nova-compute[75341]:     <apic/>
Nov 15 00:11:46 user nova-compute[75341]:     <vmcoreinfo/>
Nov 15 00:11:46 user nova-compute[75341]:   </features>
Nov 15 00:11:46 user nova-compute[75341]:   <clock offset="utc">
Nov 15 00:11:46 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 00:11:46 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 00:11:46 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 15 00:11:46 user nova-compute[75341]:   </clock>
Nov 15 00:11:46 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 15 00:11:46 user nova-compute[75341]:     <model>Nehalem</model>
Nov 15 00:11:46 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 00:11:46 user nova-compute[75341]:   </cpu>
Nov 15 00:11:46 user nova-compute[75341]:   <devices>
Nov 15 00:11:46 user nova-compute[75341]:     <disk type="block" device="disk">
Nov 15 00:11:46 user nova-compute[75341]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 00:11:46 user nova-compute[75341]:       <source dev="/dev/sdb"/>
Nov 15 00:11:46 user nova-compute[75341]:       <target dev="vda" bus="virtio"/>
Nov 15 00:11:46 user nova-compute[75341]:       <serial>7500ff6d-ab61-40fe-b910-9ae8a4160f4e</serial>
Nov 15 00:11:46 user nova-compute[75341]:     </disk>
Nov 15 00:11:46 user nova-compute[75341]:     <disk type="file" device="disk">
Nov 15 00:11:46 user nova-compute[75341]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 00:11:46 user nova-compute[75341]:       <source file="/opt/stack/data/nova/instances/5a57dc05-73fa-45a8-98d9-c355f2f35d17/disk.rescue"/>
Nov 15 00:11:46 user nova-compute[75341]:       <target dev="vdb" bus="virtio"/>
Nov 15 00:11:46 user nova-compute[75341]:       <boot order="1"/>
Nov 15 00:11:46 user nova-compute[75341]:     </disk>
Nov 15 00:11:46 user nova-compute[75341]:     <interface type="ethernet">
Nov 15 00:11:46 user nova-compute[75341]:       <mac address="fa:16:3e:f1:b5:9c"/>
Nov 15 00:11:46 user nova-compute[75341]:       <model type="virtio"/>
Nov 15 00:11:46 user nova-compute[75341]:       <mtu size="1442"/>
Nov 15 00:11:46 user nova-compute[75341]:       <target dev="tap6b89e652-39"/>
Nov 15 00:11:46 user nova-compute[75341]:     </interface>
Nov 15 00:11:46 user nova-compute[75341]:     <serial type="pty">
Nov 15 00:11:46 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/5a57dc05-73fa-45a8-98d9-c355f2f35d17/console.log" append="off"/>
Nov 15 00:11:46 user nova-compute[75341]:     </serial>
Nov 15 00:11:46 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 00:11:46 user nova-compute[75341]:     <video>
Nov 15 00:11:46 user nova-compute[75341]:       <model type="virtio"/>
Nov 15 00:11:46 user nova-compute[75341]:     </video>
Nov 15 00:11:46 user nova-compute[75341]:     <rng model="virtio">
Nov 15 00:11:46 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 15 00:11:46 user nova-compute[75341]:     </rng>
Nov 15 00:11:46 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 15 00:11:46 user nova-compute[75341]:     <memballoon model="virtio">
Nov 15 00:11:46 user nova-compute[75341]:       <stats period="10"/>
Nov 15 00:11:46 user nova-compute[75341]:     </memballoon>
Nov 15 00:11:46 user nova-compute[75341]:   </devices>
Nov 15 00:11:46 user nova-compute[75341]: </domain>
Nov 15 00:11:46 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 00:11:46 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Instance destroyed successfully.
Nov 15 00:11:46 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 00:11:46 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] No VIF found with MAC fa:16:3e:f1:b5:9c, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 00:11:47 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:11:47 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:11:47 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:11:47 user nova-compute[75341]: DEBUG nova.compute.manager [req-0aa4d954-5165-4669-a940-4d21803af700 req-1f4bc634-3e7c-4147-893f-83be9c9dfefd service nova] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Received event network-vif-plugged-6b89e652-396c-42ad-9a1a-402e18e1a9f3 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:11:47 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-0aa4d954-5165-4669-a940-4d21803af700 req-1f4bc634-3e7c-4147-893f-83be9c9dfefd service nova] Acquiring lock "5a57dc05-73fa-45a8-98d9-c355f2f35d17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:11:47 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-0aa4d954-5165-4669-a940-4d21803af700 req-1f4bc634-3e7c-4147-893f-83be9c9dfefd service nova] Lock "5a57dc05-73fa-45a8-98d9-c355f2f35d17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:11:47 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-0aa4d954-5165-4669-a940-4d21803af700 req-1f4bc634-3e7c-4147-893f-83be9c9dfefd service nova] Lock "5a57dc05-73fa-45a8-98d9-c355f2f35d17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:11:47 user nova-compute[75341]: DEBUG nova.compute.manager [req-0aa4d954-5165-4669-a940-4d21803af700 req-1f4bc634-3e7c-4147-893f-83be9c9dfefd service nova] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] No waiting events found dispatching network-vif-plugged-6b89e652-396c-42ad-9a1a-402e18e1a9f3 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:11:47 user nova-compute[75341]: WARNING nova.compute.manager [req-0aa4d954-5165-4669-a940-4d21803af700 req-1f4bc634-3e7c-4147-893f-83be9c9dfefd service nova] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Received unexpected event network-vif-plugged-6b89e652-396c-42ad-9a1a-402e18e1a9f3 for instance with vm_state active and task_state rescuing.
Nov 15 00:11:47 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:11:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:11:49 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a959c32c-2f5f-43c9-a39e-a1c0373cb32c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 00:11:49 user nova-compute[75341]: DEBUG nova.compute.manager [req-cdb80066-0569-4047-88d0-14e6f1436005 req-79090d54-1b67-432a-873d-4052daa741b8 service nova] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Received event network-vif-plugged-6b89e652-396c-42ad-9a1a-402e18e1a9f3 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:11:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-cdb80066-0569-4047-88d0-14e6f1436005 req-79090d54-1b67-432a-873d-4052daa741b8 service nova] Acquiring lock "5a57dc05-73fa-45a8-98d9-c355f2f35d17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:11:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-cdb80066-0569-4047-88d0-14e6f1436005 req-79090d54-1b67-432a-873d-4052daa741b8 service nova] Lock "5a57dc05-73fa-45a8-98d9-c355f2f35d17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:11:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-cdb80066-0569-4047-88d0-14e6f1436005 req-79090d54-1b67-432a-873d-4052daa741b8 service nova] Lock "5a57dc05-73fa-45a8-98d9-c355f2f35d17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:11:49 user nova-compute[75341]: DEBUG nova.compute.manager [req-cdb80066-0569-4047-88d0-14e6f1436005 req-79090d54-1b67-432a-873d-4052daa741b8 service nova] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] No waiting events found dispatching network-vif-plugged-6b89e652-396c-42ad-9a1a-402e18e1a9f3 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:11:49 user nova-compute[75341]: WARNING nova.compute.manager [req-cdb80066-0569-4047-88d0-14e6f1436005 req-79090d54-1b67-432a-873d-4052daa741b8 service nova] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Received unexpected event network-vif-plugged-6b89e652-396c-42ad-9a1a-402e18e1a9f3 for instance with vm_state rescued and task_state None.
Nov 15 00:11:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:11:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:11:59 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:12:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:12:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:12:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:12:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:12:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:12:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:12:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:12:08 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:12:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:12:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:12:13 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:12:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:12:14 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:12:14 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:12:14 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75341) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 00:12:16 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:12:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:12:19 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:12:19 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:12:19 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Starting heal instance info cache {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 00:12:20 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "refresh_cache-5a57dc05-73fa-45a8-98d9-c355f2f35d17" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:12:20 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquired lock "refresh_cache-5a57dc05-73fa-45a8-98d9-c355f2f35d17" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:12:20 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Forcefully refreshing network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 00:12:20 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Updating instance_info_cache with network_info: [{"id": "6b89e652-396c-42ad-9a1a-402e18e1a9f3", "address": "fa:16:3e:f1:b5:9c", "network": {"id": "aed56292-815e-4004-9101-59ff735cf236", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cde913b393e4b1095ae6e8e4a74b5fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b89e652-39", "ovs_interfaceid": "6b89e652-396c-42ad-9a1a-402e18e1a9f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:12:20 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Releasing lock "refresh_cache-5a57dc05-73fa-45a8-98d9-c355f2f35d17" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:12:20 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Updated the network info_cache for instance {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 00:12:20 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:12:20 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:12:20 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:12:20 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:12:20 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75341) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 00:12:20 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:12:20 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:12:20 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:12:21 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:12:21 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 00:12:21 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a57dc05-73fa-45a8-98d9-c355f2f35d17/disk.rescue --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:12:21 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a57dc05-73fa-45a8-98d9-c355f2f35d17/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:12:21 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a57dc05-73fa-45a8-98d9-c355f2f35d17/disk.rescue --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:12:21 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a57dc05-73fa-45a8-98d9-c355f2f35d17/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:12:21 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:12:21 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:12:21 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Hypervisor/Node resource view: name=user free_ram=8875MB free_disk=25.25954818725586GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75341) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 00:12:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:12:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:12:21 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance c332ad29-e892-4caf-aa37-fd66fb41f9ec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:12:21 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 5a57dc05-73fa-45a8-98d9-c355f2f35d17 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:12:21 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 00:12:21 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 00:12:21 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 00:12:21 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 00:12:22 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Compute_service record updated for user:user {{(pid=75341) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 00:12:22 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.237s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:12:22 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:12:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:12:22 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:12:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:12:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:12:28 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:12:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:12:34 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:12:34 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:12:34 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:12:34 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:12:34 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:12:34 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:12:39 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:12:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:12:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:12:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:12:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:12:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:12:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:12:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:12:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:12:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:12:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:12:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:12:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:12:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:12:59 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:12:59 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:12:59 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:12:59 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:12:59 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:12:59 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:13:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:13:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:13:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:13:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:13:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:13:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:13:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:13:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:13:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:13:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:13:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:13:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:13:09 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:13:13 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:13:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:13:16 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:13:16 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:13:16 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75341) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 00:13:18 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:13:19 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:13:19 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:13:19 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:13:19 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:13:19 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:13:19 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:13:19 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:13:19 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:13:19 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:13:19 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:13:19 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75341) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 00:13:20 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:13:20 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:13:20 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:13:20 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:13:20 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 00:13:20 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a57dc05-73fa-45a8-98d9-c355f2f35d17/disk.rescue --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:13:20 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a57dc05-73fa-45a8-98d9-c355f2f35d17/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:13:20 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a57dc05-73fa-45a8-98d9-c355f2f35d17/disk.rescue --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:13:20 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a57dc05-73fa-45a8-98d9-c355f2f35d17/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:13:21 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:13:21 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:13:21 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Hypervisor/Node resource view: name=user free_ram=8940MB free_disk=25.258563995361328GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75341) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 00:13:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:13:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:13:21 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance c332ad29-e892-4caf-aa37-fd66fb41f9ec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:13:21 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 5a57dc05-73fa-45a8-98d9-c355f2f35d17 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:13:21 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 00:13:21 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 00:13:21 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 00:13:21 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 00:13:21 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Compute_service record updated for user:user {{(pid=75341) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 00:13:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.192s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:13:23 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:13:23 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Starting heal instance info cache {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 00:13:23 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Rebuilding the list of instances to heal {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 00:13:23 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "refresh_cache-c332ad29-e892-4caf-aa37-fd66fb41f9ec" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:13:23 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquired lock "refresh_cache-c332ad29-e892-4caf-aa37-fd66fb41f9ec" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:13:23 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Forcefully refreshing network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 00:13:23 user nova-compute[75341]: DEBUG nova.objects.instance [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lazy-loading 'info_cache' on Instance uuid c332ad29-e892-4caf-aa37-fd66fb41f9ec {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:13:23 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Updating instance_info_cache with network_info: [{"id": "9f65f96b-aa09-4c3a-a23b-ed444c9dacec", "address": "fa:16:3e:c6:2e:8d", "network": {"id": "aed56292-815e-4004-9101-59ff735cf236", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cde913b393e4b1095ae6e8e4a74b5fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f65f96b-aa", "ovs_interfaceid": "9f65f96b-aa09-4c3a-a23b-ed444c9dacec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:13:23 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Releasing lock "refresh_cache-c332ad29-e892-4caf-aa37-fd66fb41f9ec" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:13:23 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Updated the network info_cache for instance {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 00:13:23 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:13:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:13:25 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:13:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:13:33 user nova-compute[75341]: INFO nova.compute.manager [None req-4728cd69-3880-4bc2-9eff-60f366650a3d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Unrescuing
Nov 15 00:13:33 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-4728cd69-3880-4bc2-9eff-60f366650a3d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Acquiring lock "refresh_cache-5a57dc05-73fa-45a8-98d9-c355f2f35d17" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:13:33 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-4728cd69-3880-4bc2-9eff-60f366650a3d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Acquired lock "refresh_cache-5a57dc05-73fa-45a8-98d9-c355f2f35d17" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:13:33 user nova-compute[75341]: DEBUG nova.network.neutron [None req-4728cd69-3880-4bc2-9eff-60f366650a3d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 00:13:33 user nova-compute[75341]: DEBUG nova.network.neutron [None req-4728cd69-3880-4bc2-9eff-60f366650a3d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Updating instance_info_cache with network_info: [{"id": "6b89e652-396c-42ad-9a1a-402e18e1a9f3", "address": "fa:16:3e:f1:b5:9c", "network": {"id": "aed56292-815e-4004-9101-59ff735cf236", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cde913b393e4b1095ae6e8e4a74b5fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b89e652-39", "ovs_interfaceid": "6b89e652-396c-42ad-9a1a-402e18e1a9f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:13:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-4728cd69-3880-4bc2-9eff-60f366650a3d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Releasing lock "refresh_cache-5a57dc05-73fa-45a8-98d9-c355f2f35d17" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:13:34 user nova-compute[75341]: DEBUG nova.objects.instance [None req-4728cd69-3880-4bc2-9eff-60f366650a3d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lazy-loading 'flavor' on Instance uuid 5a57dc05-73fa-45a8-98d9-c355f2f35d17 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:13:34 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:13:34 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:13:34 user nova-compute[75341]: DEBUG nova.compute.manager [req-a8535248-f890-4a7e-8ba1-b4009a1fcc4b req-b0737f07-e9dd-4d68-9842-818842dc47dd service nova] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Received event network-vif-unplugged-6b89e652-396c-42ad-9a1a-402e18e1a9f3 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:13:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a8535248-f890-4a7e-8ba1-b4009a1fcc4b req-b0737f07-e9dd-4d68-9842-818842dc47dd service nova] Acquiring lock "5a57dc05-73fa-45a8-98d9-c355f2f35d17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:13:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a8535248-f890-4a7e-8ba1-b4009a1fcc4b req-b0737f07-e9dd-4d68-9842-818842dc47dd service nova] Lock "5a57dc05-73fa-45a8-98d9-c355f2f35d17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:13:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a8535248-f890-4a7e-8ba1-b4009a1fcc4b req-b0737f07-e9dd-4d68-9842-818842dc47dd service nova] Lock "5a57dc05-73fa-45a8-98d9-c355f2f35d17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:13:34 user nova-compute[75341]: DEBUG nova.compute.manager [req-a8535248-f890-4a7e-8ba1-b4009a1fcc4b req-b0737f07-e9dd-4d68-9842-818842dc47dd service nova] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] No waiting events found dispatching network-vif-unplugged-6b89e652-396c-42ad-9a1a-402e18e1a9f3 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:13:34 user nova-compute[75341]: WARNING nova.compute.manager [req-a8535248-f890-4a7e-8ba1-b4009a1fcc4b req-b0737f07-e9dd-4d68-9842-818842dc47dd service nova] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Received unexpected event network-vif-unplugged-6b89e652-396c-42ad-9a1a-402e18e1a9f3 for instance with vm_state rescued and task_state unrescuing.
Nov 15 00:13:34 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:13:34 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:13:34 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:13:34 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Instance destroyed successfully.
Nov 15 00:13:34 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:13:35 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:13:36 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:13:36 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:13:36 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:13:36 user nova-compute[75341]: DEBUG nova.compute.manager [req-89a88f44-a8bc-4808-9760-aa8dd0cc570a req-9c9af8c5-afe1-4406-8f83-b609302b2b6f service nova] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Received event network-vif-plugged-6b89e652-396c-42ad-9a1a-402e18e1a9f3 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:13:36 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-89a88f44-a8bc-4808-9760-aa8dd0cc570a req-9c9af8c5-afe1-4406-8f83-b609302b2b6f service nova] Acquiring lock "5a57dc05-73fa-45a8-98d9-c355f2f35d17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:13:36 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-89a88f44-a8bc-4808-9760-aa8dd0cc570a req-9c9af8c5-afe1-4406-8f83-b609302b2b6f service nova] Lock "5a57dc05-73fa-45a8-98d9-c355f2f35d17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:13:36 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-89a88f44-a8bc-4808-9760-aa8dd0cc570a req-9c9af8c5-afe1-4406-8f83-b609302b2b6f service nova] Lock "5a57dc05-73fa-45a8-98d9-c355f2f35d17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:13:36 user nova-compute[75341]: DEBUG nova.compute.manager [req-89a88f44-a8bc-4808-9760-aa8dd0cc570a req-9c9af8c5-afe1-4406-8f83-b609302b2b6f service nova] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] No waiting events found dispatching network-vif-plugged-6b89e652-396c-42ad-9a1a-402e18e1a9f3 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:13:36 user nova-compute[75341]: WARNING nova.compute.manager [req-89a88f44-a8bc-4808-9760-aa8dd0cc570a req-9c9af8c5-afe1-4406-8f83-b609302b2b6f service nova] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Received unexpected event network-vif-plugged-6b89e652-396c-42ad-9a1a-402e18e1a9f3 for instance with vm_state rescued and task_state unrescuing.
Nov 15 00:13:36 user nova-compute[75341]: DEBUG nova.compute.manager [req-89a88f44-a8bc-4808-9760-aa8dd0cc570a req-9c9af8c5-afe1-4406-8f83-b609302b2b6f service nova] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Received event network-vif-plugged-6b89e652-396c-42ad-9a1a-402e18e1a9f3 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:13:36 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-89a88f44-a8bc-4808-9760-aa8dd0cc570a req-9c9af8c5-afe1-4406-8f83-b609302b2b6f service nova] Acquiring lock "5a57dc05-73fa-45a8-98d9-c355f2f35d17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:13:36 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-89a88f44-a8bc-4808-9760-aa8dd0cc570a req-9c9af8c5-afe1-4406-8f83-b609302b2b6f service nova] Lock "5a57dc05-73fa-45a8-98d9-c355f2f35d17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:13:36 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-89a88f44-a8bc-4808-9760-aa8dd0cc570a req-9c9af8c5-afe1-4406-8f83-b609302b2b6f service nova] Lock "5a57dc05-73fa-45a8-98d9-c355f2f35d17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:13:36 user nova-compute[75341]: DEBUG nova.compute.manager [req-89a88f44-a8bc-4808-9760-aa8dd0cc570a req-9c9af8c5-afe1-4406-8f83-b609302b2b6f service nova] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] No waiting events found dispatching network-vif-plugged-6b89e652-396c-42ad-9a1a-402e18e1a9f3 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:13:36 user nova-compute[75341]: WARNING nova.compute.manager [req-89a88f44-a8bc-4808-9760-aa8dd0cc570a req-9c9af8c5-afe1-4406-8f83-b609302b2b6f service nova] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Received unexpected event network-vif-plugged-6b89e652-396c-42ad-9a1a-402e18e1a9f3 for instance with vm_state rescued and task_state unrescuing.
Nov 15 00:13:36 user nova-compute[75341]: DEBUG nova.compute.manager [req-89a88f44-a8bc-4808-9760-aa8dd0cc570a req-9c9af8c5-afe1-4406-8f83-b609302b2b6f service nova] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Received event network-vif-plugged-6b89e652-396c-42ad-9a1a-402e18e1a9f3 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:13:36 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-89a88f44-a8bc-4808-9760-aa8dd0cc570a req-9c9af8c5-afe1-4406-8f83-b609302b2b6f service nova] Acquiring lock "5a57dc05-73fa-45a8-98d9-c355f2f35d17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:13:36 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-89a88f44-a8bc-4808-9760-aa8dd0cc570a req-9c9af8c5-afe1-4406-8f83-b609302b2b6f service nova] Lock "5a57dc05-73fa-45a8-98d9-c355f2f35d17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:13:36 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-89a88f44-a8bc-4808-9760-aa8dd0cc570a req-9c9af8c5-afe1-4406-8f83-b609302b2b6f service nova] Lock "5a57dc05-73fa-45a8-98d9-c355f2f35d17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:13:36 user nova-compute[75341]: DEBUG nova.compute.manager [req-89a88f44-a8bc-4808-9760-aa8dd0cc570a req-9c9af8c5-afe1-4406-8f83-b609302b2b6f service nova] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] No waiting events found dispatching network-vif-plugged-6b89e652-396c-42ad-9a1a-402e18e1a9f3 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:13:36 user nova-compute[75341]: WARNING nova.compute.manager [req-89a88f44-a8bc-4808-9760-aa8dd0cc570a req-9c9af8c5-afe1-4406-8f83-b609302b2b6f service nova] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Received unexpected event network-vif-plugged-6b89e652-396c-42ad-9a1a-402e18e1a9f3 for instance with vm_state rescued and task_state unrescuing.
Nov 15 00:13:37 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:13:38 user nova-compute[75341]: DEBUG nova.compute.manager [None req-4728cd69-3880-4bc2-9eff-60f366650a3d tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 00:13:39 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:13:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:13:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:13:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:13:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:13:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:13:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:13:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:13:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:13:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:13:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:13:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:13:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:13:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:13:59 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:14:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:14:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:14:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:14:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:14:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:14:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:14:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:14:10 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:14:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:14:14 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:14:17 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:14:17 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75341) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 00:14:18 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:14:18 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:14:19 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:14:19 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:14:19 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:14:19 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:14:19 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:14:19 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:14:19 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:14:19 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:14:19 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:14:19 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:14:19 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75341) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 00:14:20 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:14:20 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:14:20 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:14:20 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:14:20 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 00:14:20 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:14:20 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:14:20 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Hypervisor/Node resource view: name=user free_ram=8989MB free_disk=25.25888442993164GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75341) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 00:14:20 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:14:20 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:14:20 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance c332ad29-e892-4caf-aa37-fd66fb41f9ec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:14:20 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 5a57dc05-73fa-45a8-98d9-c355f2f35d17 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:14:20 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 00:14:20 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 00:14:20 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 00:14:20 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 00:14:21 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Compute_service record updated for user:user {{(pid=75341) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 00:14:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.252s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:14:24 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:14:24 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Starting heal instance info cache {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 00:14:24 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "refresh_cache-5a57dc05-73fa-45a8-98d9-c355f2f35d17" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:14:24 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquired lock "refresh_cache-5a57dc05-73fa-45a8-98d9-c355f2f35d17" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:14:24 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Forcefully refreshing network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 00:14:24 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Updating instance_info_cache with network_info: [{"id": "6b89e652-396c-42ad-9a1a-402e18e1a9f3", "address": "fa:16:3e:f1:b5:9c", "network": {"id": "aed56292-815e-4004-9101-59ff735cf236", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cde913b393e4b1095ae6e8e4a74b5fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b89e652-39", "ovs_interfaceid": "6b89e652-396c-42ad-9a1a-402e18e1a9f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:14:24 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Releasing lock "refresh_cache-5a57dc05-73fa-45a8-98d9-c355f2f35d17" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:14:24 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Updated the network info_cache for instance {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 00:14:24 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:14:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:14:25 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:14:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:14:29 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:14:34 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:14:39 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:14:39 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:14:39 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:14:39 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:14:39 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:14:39 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:14:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:14:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:14:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:14:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:14:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:14:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:14:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:14:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:14:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:14:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:14:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:14:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:14:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:14:59 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:14:59 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:14:59 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:14:59 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:14:59 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:14:59 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:15:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:15:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:15:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:15:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:15:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:15:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:15:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:15:11 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:15:14 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:15:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:15:17 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:15:17 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75341) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 00:15:19 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:15:19 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:15:20 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:15:21 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:15:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:15:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:15:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:15:21 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75341) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 00:15:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:15:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:15:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:15:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:15:22 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 00:15:22 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:15:22 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:15:22 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Hypervisor/Node resource view: name=user free_ram=9004MB free_disk=25.258312225341797GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75341) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 00:15:22 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:15:22 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:15:22 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance c332ad29-e892-4caf-aa37-fd66fb41f9ec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:15:22 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 5a57dc05-73fa-45a8-98d9-c355f2f35d17 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:15:22 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 00:15:22 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 00:15:22 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 00:15:23 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 00:15:23 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Compute_service record updated for user:user {{(pid=75341) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 00:15:23 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.204s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:15:24 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:15:24 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Starting heal instance info cache {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 00:15:24 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Rebuilding the list of instances to heal {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 00:15:24 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "refresh_cache-c332ad29-e892-4caf-aa37-fd66fb41f9ec" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:15:24 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquired lock "refresh_cache-c332ad29-e892-4caf-aa37-fd66fb41f9ec" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:15:24 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Forcefully refreshing network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 00:15:24 user nova-compute[75341]: DEBUG nova.objects.instance [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lazy-loading 'info_cache' on Instance uuid c332ad29-e892-4caf-aa37-fd66fb41f9ec {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:15:24 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Updating instance_info_cache with network_info: [{"id": "9f65f96b-aa09-4c3a-a23b-ed444c9dacec", "address": "fa:16:3e:c6:2e:8d", "network": {"id": "aed56292-815e-4004-9101-59ff735cf236", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cde913b393e4b1095ae6e8e4a74b5fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f65f96b-aa", "ovs_interfaceid": "9f65f96b-aa09-4c3a-a23b-ed444c9dacec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:15:24 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Releasing lock "refresh_cache-c332ad29-e892-4caf-aa37-fd66fb41f9ec" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:15:24 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Updated the network info_cache for instance {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 00:15:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:15:25 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Acquiring lock "b4dbe374-f603-4970-be0c-473ccc467e49" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:15:25 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "b4dbe374-f603-4970-be0c-473ccc467e49" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:15:25 user nova-compute[75341]: DEBUG nova.compute.manager [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] Starting instance... {{(pid=75341) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 00:15:25 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:15:25 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:15:25 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75341) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 00:15:25 user nova-compute[75341]: INFO nova.compute.claims [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] Claim successful on node user
Nov 15 00:15:25 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:15:25 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:15:25 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 00:15:25 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 00:15:26 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.258s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:15:26 user nova-compute[75341]: DEBUG nova.compute.manager [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] Start building networks asynchronously for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 00:15:26 user nova-compute[75341]: DEBUG nova.compute.manager [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] Allocating IP information in the background. {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 00:15:26 user nova-compute[75341]: DEBUG nova.network.neutron [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] allocate_for_instance() {{(pid=75341) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 00:15:26 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 00:15:26 user nova-compute[75341]: DEBUG nova.compute.manager [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] Start building block device mappings for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 00:15:26 user nova-compute[75341]: DEBUG nova.policy [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'abb41e7d020d4c99a55b5029cd2124a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cde913b393e4b1095ae6e8e4a74b5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75341) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 00:15:26 user nova-compute[75341]: DEBUG nova.compute.manager [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] Start spawning the instance on the hypervisor. {{(pid=75341) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 00:15:26 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] Creating instance directory {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 00:15:26 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] Creating image(s)
Nov 15 00:15:26 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Acquiring lock "/opt/stack/data/nova/instances/b4dbe374-f603-4970-be0c-473ccc467e49/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:15:26 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "/opt/stack/data/nova/instances/b4dbe374-f603-4970-be0c-473ccc467e49/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:15:26 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "/opt/stack/data/nova/instances/b4dbe374-f603-4970-be0c-473ccc467e49/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:15:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:15:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.178s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:15:26 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Acquiring lock "4754efee9a6d73d3647f2add2cfe86c291949740" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:15:26 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:15:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:15:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.175s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:15:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/b4dbe374-f603-4970-be0c-473ccc467e49/disk 1073741824 {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:15:26 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:15:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/b4dbe374-f603-4970-be0c-473ccc467e49/disk 1073741824" returned: 0 in 0.054s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:15:26 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:15:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:15:26 user nova-compute[75341]: DEBUG nova.network.neutron [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] Successfully created port: 92b4fa25-bd9f-40bb-b7a4-d153db0a1857 {{(pid=75341) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 00:15:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.173s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:15:26 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b4dbe374-f603-4970-be0c-473ccc467e49/disk. size=1073741824 {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 00:15:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4dbe374-f603-4970-be0c-473ccc467e49/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:15:27 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4dbe374-f603-4970-be0c-473ccc467e49/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:15:27 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Cannot resize image /opt/stack/data/nova/instances/b4dbe374-f603-4970-be0c-473ccc467e49/disk to a smaller size. {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 00:15:27 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] Created local disks {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 00:15:27 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] Ensure instance console log exists: /opt/stack/data/nova/instances/b4dbe374-f603-4970-be0c-473ccc467e49/console.log {{(pid=75341) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 00:15:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:15:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:15:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:15:27 user nova-compute[75341]: DEBUG nova.network.neutron [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] Successfully updated port: 92b4fa25-bd9f-40bb-b7a4-d153db0a1857 {{(pid=75341) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 00:15:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Acquiring lock "refresh_cache-b4dbe374-f603-4970-be0c-473ccc467e49" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:15:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Acquired lock "refresh_cache-b4dbe374-f603-4970-be0c-473ccc467e49" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:15:27 user nova-compute[75341]: DEBUG nova.network.neutron [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 00:15:27 user nova-compute[75341]: DEBUG nova.network.neutron [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] Instance cache missing network info. {{(pid=75341) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 00:15:27 user nova-compute[75341]: DEBUG nova.compute.manager [req-d8c07083-1601-461d-96b9-278b030d8411 req-aac6d867-e90f-4cfb-a4b9-b8d253cfd18c service nova] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] Received event network-changed-92b4fa25-bd9f-40bb-b7a4-d153db0a1857 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:15:27 user nova-compute[75341]: DEBUG nova.compute.manager [req-d8c07083-1601-461d-96b9-278b030d8411 req-aac6d867-e90f-4cfb-a4b9-b8d253cfd18c service nova] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] Refreshing instance network info cache due to event network-changed-92b4fa25-bd9f-40bb-b7a4-d153db0a1857. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 00:15:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-d8c07083-1601-461d-96b9-278b030d8411 req-aac6d867-e90f-4cfb-a4b9-b8d253cfd18c service nova] Acquiring lock "refresh_cache-b4dbe374-f603-4970-be0c-473ccc467e49" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:15:27 user nova-compute[75341]: DEBUG nova.network.neutron [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] Updating instance_info_cache with network_info: [{"id": "92b4fa25-bd9f-40bb-b7a4-d153db0a1857", "address": "fa:16:3e:94:44:86", "network": {"id": "aed56292-815e-4004-9101-59ff735cf236", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cde913b393e4b1095ae6e8e4a74b5fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92b4fa25-bd", "ovs_interfaceid": "92b4fa25-bd9f-40bb-b7a4-d153db0a1857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:15:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Releasing lock "refresh_cache-b4dbe374-f603-4970-be0c-473ccc467e49" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:15:27 user nova-compute[75341]: DEBUG nova.compute.manager [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] Instance network_info: |[{"id": "92b4fa25-bd9f-40bb-b7a4-d153db0a1857", "address": "fa:16:3e:94:44:86", "network": {"id": "aed56292-815e-4004-9101-59ff735cf236", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cde913b393e4b1095ae6e8e4a74b5fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92b4fa25-bd", "ovs_interfaceid": "92b4fa25-bd9f-40bb-b7a4-d153db0a1857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 00:15:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-d8c07083-1601-461d-96b9-278b030d8411 req-aac6d867-e90f-4cfb-a4b9-b8d253cfd18c service nova] Acquired lock "refresh_cache-b4dbe374-f603-4970-be0c-473ccc467e49" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:15:27 user nova-compute[75341]: DEBUG nova.network.neutron [req-d8c07083-1601-461d-96b9-278b030d8411 req-aac6d867-e90f-4cfb-a4b9-b8d253cfd18c service nova] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] Refreshing network info cache for port 92b4fa25-bd9f-40bb-b7a4-d153db0a1857 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 00:15:27 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] Start _get_guest_xml network_info=[{"id": "92b4fa25-bd9f-40bb-b7a4-d153db0a1857", "address": "fa:16:3e:94:44:86", "network": {"id": "aed56292-815e-4004-9101-59ff735cf236", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cde913b393e4b1095ae6e8e4a74b5fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92b4fa25-bd", "ovs_interfaceid": "92b4fa25-bd9f-40bb-b7a4-d153db0a1857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encrypted': False, 'image_id': 'e46abb82-b810-490e-a8a1-ccdc5fa1a796'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 00:15:27 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:15:27 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:15:27 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 00:15:27 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 00:15:27 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 00:15:27 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 00:15:27 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 00:15:27 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 00:15:27 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 00:15:27 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 00:15:27 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 00:15:27 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 00:15:27 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 00:15:27 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 00:15:27 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 00:15:27 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 00:15:27 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 00:15:27 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 00:15:27 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T00:15:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-410137495',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-410137495',id=49,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5cde913b393e4b1095ae6e8e4a74b5fb',ramdisk_id='',reservation_id='r-avsccmp0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1181444554',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T00:15:26Z,user_data=None,user_id='abb41e7d020d4c99a55b5029cd2124a9',uuid=b4dbe374-f603-4970-be0c-473ccc467e49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92b4fa25-bd9f-40bb-b7a4-d153db0a1857", "address": "fa:16:3e:94:44:86", "network": {"id": "aed56292-815e-4004-9101-59ff735cf236", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cde913b393e4b1095ae6e8e4a74b5fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92b4fa25-bd", "ovs_interfaceid": "92b4fa25-bd9f-40bb-b7a4-d153db0a1857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 00:15:27 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Converting VIF {"id": "92b4fa25-bd9f-40bb-b7a4-d153db0a1857", "address": "fa:16:3e:94:44:86", "network": {"id": "aed56292-815e-4004-9101-59ff735cf236", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cde913b393e4b1095ae6e8e4a74b5fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92b4fa25-bd", "ovs_interfaceid": "92b4fa25-bd9f-40bb-b7a4-d153db0a1857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 00:15:27 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:44:86,bridge_name='br-int',has_traffic_filtering=True,id=92b4fa25-bd9f-40bb-b7a4-d153db0a1857,network=Network(aed56292-815e-4004-9101-59ff735cf236),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92b4fa25-bd') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 00:15:27 user nova-compute[75341]: DEBUG nova.objects.instance [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lazy-loading 'pci_devices' on Instance uuid b4dbe374-f603-4970-be0c-473ccc467e49 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:15:27 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] End _get_guest_xml xml=<domain type="kvm">
Nov 15 00:15:27 user nova-compute[75341]:   <uuid>b4dbe374-f603-4970-be0c-473ccc467e49</uuid>
Nov 15 00:15:27 user nova-compute[75341]:   <name>instance-00000031</name>
Nov 15 00:15:27 user nova-compute[75341]:   <memory>524288</memory>
Nov 15 00:15:27 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 15 00:15:27 user nova-compute[75341]:   <metadata>
Nov 15 00:15:27 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 00:15:27 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 15 00:15:27 user nova-compute[75341]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-410137495</nova:name>
Nov 15 00:15:27 user nova-compute[75341]:       <nova:creationTime>2023-11-15 00:15:27</nova:creationTime>
Nov 15 00:15:27 user nova-compute[75341]:       <nova:flavor name="m1.tiny">
Nov 15 00:15:27 user nova-compute[75341]:         <nova:memory>512</nova:memory>
Nov 15 00:15:27 user nova-compute[75341]:         <nova:disk>1</nova:disk>
Nov 15 00:15:27 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 15 00:15:27 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 00:15:27 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 15 00:15:27 user nova-compute[75341]:       </nova:flavor>
Nov 15 00:15:27 user nova-compute[75341]:       <nova:owner>
Nov 15 00:15:27 user nova-compute[75341]:         <nova:user uuid="abb41e7d020d4c99a55b5029cd2124a9">tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member</nova:user>
Nov 15 00:15:27 user nova-compute[75341]:         <nova:project uuid="5cde913b393e4b1095ae6e8e4a74b5fb">tempest-ServerBootFromVolumeStableRescueTest-1181444554</nova:project>
Nov 15 00:15:27 user nova-compute[75341]:       </nova:owner>
Nov 15 00:15:27 user nova-compute[75341]:       <nova:root type="image" uuid="e46abb82-b810-490e-a8a1-ccdc5fa1a796"/>
Nov 15 00:15:27 user nova-compute[75341]:       <nova:ports>
Nov 15 00:15:27 user nova-compute[75341]:         <nova:port uuid="92b4fa25-bd9f-40bb-b7a4-d153db0a1857">
Nov 15 00:15:27 user nova-compute[75341]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 00:15:27 user nova-compute[75341]:         </nova:port>
Nov 15 00:15:27 user nova-compute[75341]:       </nova:ports>
Nov 15 00:15:27 user nova-compute[75341]:     </nova:instance>
Nov 15 00:15:27 user nova-compute[75341]:   </metadata>
Nov 15 00:15:27 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 15 00:15:27 user nova-compute[75341]:     <system>
Nov 15 00:15:27 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 00:15:27 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 15 00:15:27 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 15 00:15:27 user nova-compute[75341]:       <entry name="serial">b4dbe374-f603-4970-be0c-473ccc467e49</entry>
Nov 15 00:15:27 user nova-compute[75341]:       <entry name="uuid">b4dbe374-f603-4970-be0c-473ccc467e49</entry>
Nov 15 00:15:27 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 15 00:15:27 user nova-compute[75341]:     </system>
Nov 15 00:15:27 user nova-compute[75341]:   </sysinfo>
Nov 15 00:15:27 user nova-compute[75341]:   <os>
Nov 15 00:15:27 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 00:15:27 user nova-compute[75341]:     <boot dev="hd"/>
Nov 15 00:15:27 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 15 00:15:27 user nova-compute[75341]:   </os>
Nov 15 00:15:27 user nova-compute[75341]:   <features>
Nov 15 00:15:27 user nova-compute[75341]:     <acpi/>
Nov 15 00:15:27 user nova-compute[75341]:     <apic/>
Nov 15 00:15:27 user nova-compute[75341]:     <vmcoreinfo/>
Nov 15 00:15:27 user nova-compute[75341]:   </features>
Nov 15 00:15:27 user nova-compute[75341]:   <clock offset="utc">
Nov 15 00:15:27 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 00:15:27 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 00:15:27 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 15 00:15:27 user nova-compute[75341]:   </clock>
Nov 15 00:15:27 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 15 00:15:27 user nova-compute[75341]:     <model>Nehalem</model>
Nov 15 00:15:27 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 00:15:27 user nova-compute[75341]:   </cpu>
Nov 15 00:15:27 user nova-compute[75341]:   <devices>
Nov 15 00:15:27 user nova-compute[75341]:     <disk type="file" device="disk">
Nov 15 00:15:27 user nova-compute[75341]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 00:15:27 user nova-compute[75341]:       <source file="/opt/stack/data/nova/instances/b4dbe374-f603-4970-be0c-473ccc467e49/disk"/>
Nov 15 00:15:27 user nova-compute[75341]:       <target dev="vda" bus="virtio"/>
Nov 15 00:15:27 user nova-compute[75341]:     </disk>
Nov 15 00:15:27 user nova-compute[75341]:     <interface type="ethernet">
Nov 15 00:15:27 user nova-compute[75341]:       <mac address="fa:16:3e:94:44:86"/>
Nov 15 00:15:27 user nova-compute[75341]:       <model type="virtio"/>
Nov 15 00:15:27 user nova-compute[75341]:       <mtu size="1442"/>
Nov 15 00:15:27 user nova-compute[75341]:       <target dev="tap92b4fa25-bd"/>
Nov 15 00:15:27 user nova-compute[75341]:     </interface>
Nov 15 00:15:27 user nova-compute[75341]:     <serial type="pty">
Nov 15 00:15:27 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/b4dbe374-f603-4970-be0c-473ccc467e49/console.log" append="off"/>
Nov 15 00:15:27 user nova-compute[75341]:     </serial>
Nov 15 00:15:27 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 00:15:27 user nova-compute[75341]:     <video>
Nov 15 00:15:27 user nova-compute[75341]:       <model type="virtio"/>
Nov 15 00:15:27 user nova-compute[75341]:     </video>
Nov 15 00:15:27 user nova-compute[75341]:     <rng model="virtio">
Nov 15 00:15:27 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 15 00:15:27 user nova-compute[75341]:     </rng>
Nov 15 00:15:27 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 15 00:15:27 user nova-compute[75341]:     <memballoon model="virtio">
Nov 15 00:15:27 user nova-compute[75341]:       <stats period="10"/>
Nov 15 00:15:27 user nova-compute[75341]:     </memballoon>
Nov 15 00:15:27 user nova-compute[75341]:   </devices>
Nov 15 00:15:27 user nova-compute[75341]: </domain>
Nov 15 00:15:27 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 00:15:27 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T00:15:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-410137495',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-410137495',id=49,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5cde913b393e4b1095ae6e8e4a74b5fb',ramdisk_id='',reservation_id='r-avsccmp0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1181444554',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T00:15:26Z,user_data=None,user_id='abb41e7d020d4c99a55b5029cd2124a9',uuid=b4dbe374-f603-4970-be0c-473ccc467e49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92b4fa25-bd9f-40bb-b7a4-d153db0a1857", "address": "fa:16:3e:94:44:86", "network": {"id": "aed56292-815e-4004-9101-59ff735cf236", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cde913b393e4b1095ae6e8e4a74b5fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92b4fa25-bd", "ovs_interfaceid": "92b4fa25-bd9f-40bb-b7a4-d153db0a1857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 00:15:27 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Converting VIF {"id": "92b4fa25-bd9f-40bb-b7a4-d153db0a1857", "address": "fa:16:3e:94:44:86", "network": {"id": "aed56292-815e-4004-9101-59ff735cf236", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cde913b393e4b1095ae6e8e4a74b5fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92b4fa25-bd", "ovs_interfaceid": "92b4fa25-bd9f-40bb-b7a4-d153db0a1857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 00:15:27 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:44:86,bridge_name='br-int',has_traffic_filtering=True,id=92b4fa25-bd9f-40bb-b7a4-d153db0a1857,network=Network(aed56292-815e-4004-9101-59ff735cf236),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92b4fa25-bd') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 00:15:27 user nova-compute[75341]: DEBUG os_vif [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:44:86,bridge_name='br-int',has_traffic_filtering=True,id=92b4fa25-bd9f-40bb-b7a4-d153db0a1857,network=Network(aed56292-815e-4004-9101-59ff735cf236),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92b4fa25-bd') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 00:15:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:15:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:15:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 00:15:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:15:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '02e14165-d113-580d-a878-00204f067486', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:15:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:15:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:15:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap92b4fa25-bd, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:15:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap92b4fa25-bd, col_values=(('qos', UUID('90fb9b82-613b-46a0-8b29-c39cbb94564f')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:15:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap92b4fa25-bd, col_values=(('external_ids', {'iface-id': '92b4fa25-bd9f-40bb-b7a4-d153db0a1857', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:44:86', 'vm-uuid': 'b4dbe374-f603-4970-be0c-473ccc467e49'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:15:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:15:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:15:27 user nova-compute[75341]: INFO os_vif [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:44:86,bridge_name='br-int',has_traffic_filtering=True,id=92b4fa25-bd9f-40bb-b7a4-d153db0a1857,network=Network(aed56292-815e-4004-9101-59ff735cf236),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92b4fa25-bd')
Nov 15 00:15:27 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 00:15:27 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] No VIF found with MAC fa:16:3e:94:44:86, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 00:15:28 user nova-compute[75341]: DEBUG nova.network.neutron [req-d8c07083-1601-461d-96b9-278b030d8411 req-aac6d867-e90f-4cfb-a4b9-b8d253cfd18c service nova] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] Updated VIF entry in instance network info cache for port 92b4fa25-bd9f-40bb-b7a4-d153db0a1857. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 00:15:28 user nova-compute[75341]: DEBUG nova.network.neutron [req-d8c07083-1601-461d-96b9-278b030d8411 req-aac6d867-e90f-4cfb-a4b9-b8d253cfd18c service nova] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] Updating instance_info_cache with network_info: [{"id": "92b4fa25-bd9f-40bb-b7a4-d153db0a1857", "address": "fa:16:3e:94:44:86", "network": {"id": "aed56292-815e-4004-9101-59ff735cf236", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cde913b393e4b1095ae6e8e4a74b5fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92b4fa25-bd", "ovs_interfaceid": "92b4fa25-bd9f-40bb-b7a4-d153db0a1857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:15:28 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-d8c07083-1601-461d-96b9-278b030d8411 req-aac6d867-e90f-4cfb-a4b9-b8d253cfd18c service nova] Releasing lock "refresh_cache-b4dbe374-f603-4970-be0c-473ccc467e49" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:15:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:15:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:15:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:15:29 user nova-compute[75341]: DEBUG nova.compute.manager [req-a39fbdb0-ebdf-4759-8e5a-71d95c93adc2 req-220085a5-00bf-4cf5-8264-79706a0a644b service nova] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] Received event network-vif-plugged-92b4fa25-bd9f-40bb-b7a4-d153db0a1857 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:15:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a39fbdb0-ebdf-4759-8e5a-71d95c93adc2 req-220085a5-00bf-4cf5-8264-79706a0a644b service nova] Acquiring lock "b4dbe374-f603-4970-be0c-473ccc467e49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:15:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a39fbdb0-ebdf-4759-8e5a-71d95c93adc2 req-220085a5-00bf-4cf5-8264-79706a0a644b service nova] Lock "b4dbe374-f603-4970-be0c-473ccc467e49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:15:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-a39fbdb0-ebdf-4759-8e5a-71d95c93adc2 req-220085a5-00bf-4cf5-8264-79706a0a644b service nova] Lock "b4dbe374-f603-4970-be0c-473ccc467e49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:15:29 user nova-compute[75341]: DEBUG nova.compute.manager [req-a39fbdb0-ebdf-4759-8e5a-71d95c93adc2 req-220085a5-00bf-4cf5-8264-79706a0a644b service nova] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] No waiting events found dispatching network-vif-plugged-92b4fa25-bd9f-40bb-b7a4-d153db0a1857 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:15:29 user nova-compute[75341]: WARNING nova.compute.manager [req-a39fbdb0-ebdf-4759-8e5a-71d95c93adc2 req-220085a5-00bf-4cf5-8264-79706a0a644b service nova] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] Received unexpected event network-vif-plugged-92b4fa25-bd9f-40bb-b7a4-d153db0a1857 for instance with vm_state building and task_state spawning.
Nov 15 00:15:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:15:31 user nova-compute[75341]: DEBUG nova.compute.manager [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] Instance event wait completed in 0 seconds for  {{(pid=75341) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 00:15:31 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] Guest created on hypervisor {{(pid=75341) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 00:15:31 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] Instance spawned successfully.
Nov 15 00:15:31 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 00:15:31 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] Found default for hw_cdrom_bus of ide {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 00:15:31 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] Found default for hw_disk_bus of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 00:15:31 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] Found default for hw_input_bus of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 00:15:31 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] Found default for hw_pointer_model of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 00:15:31 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] Found default for hw_video_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 00:15:31 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] Found default for hw_vif_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 00:15:31 user nova-compute[75341]: INFO nova.compute.manager [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] Took 5.09 seconds to spawn the instance on the hypervisor.
Nov 15 00:15:31 user nova-compute[75341]: DEBUG nova.compute.manager [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 00:15:31 user nova-compute[75341]: DEBUG nova.compute.manager [req-6c7c2216-564d-417b-8876-e169ad39df04 req-e9a4dac5-dc0d-4b68-81b4-d93ee0732fab service nova] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] Received event network-vif-plugged-92b4fa25-bd9f-40bb-b7a4-d153db0a1857 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:15:31 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6c7c2216-564d-417b-8876-e169ad39df04 req-e9a4dac5-dc0d-4b68-81b4-d93ee0732fab service nova] Acquiring lock "b4dbe374-f603-4970-be0c-473ccc467e49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:15:31 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6c7c2216-564d-417b-8876-e169ad39df04 req-e9a4dac5-dc0d-4b68-81b4-d93ee0732fab service nova] Lock "b4dbe374-f603-4970-be0c-473ccc467e49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:15:31 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6c7c2216-564d-417b-8876-e169ad39df04 req-e9a4dac5-dc0d-4b68-81b4-d93ee0732fab service nova] Lock "b4dbe374-f603-4970-be0c-473ccc467e49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:15:31 user nova-compute[75341]: DEBUG nova.compute.manager [req-6c7c2216-564d-417b-8876-e169ad39df04 req-e9a4dac5-dc0d-4b68-81b4-d93ee0732fab service nova] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] No waiting events found dispatching network-vif-plugged-92b4fa25-bd9f-40bb-b7a4-d153db0a1857 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:15:31 user nova-compute[75341]: WARNING nova.compute.manager [req-6c7c2216-564d-417b-8876-e169ad39df04 req-e9a4dac5-dc0d-4b68-81b4-d93ee0732fab service nova] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] Received unexpected event network-vif-plugged-92b4fa25-bd9f-40bb-b7a4-d153db0a1857 for instance with vm_state building and task_state spawning.
Nov 15 00:15:31 user nova-compute[75341]: INFO nova.compute.manager [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] Took 5.67 seconds to build instance.
Nov 15 00:15:31 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-bb8af91a-efec-49f2-bd5c-3a3e8c86a923 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "b4dbe374-f603-4970-be0c-473ccc467e49" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.788s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:15:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:15:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:15:37 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:15:37 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:15:37 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:15:37 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:15:37 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:15:37 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:15:37 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:15:37 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:15:37 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:15:37 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:15:37 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:15:37 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:15:37 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:15:38 user nova-compute[75341]: DEBUG nova.virt.libvirt.imagecache [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Verify base images {{(pid=75341) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 15 00:15:38 user nova-compute[75341]: DEBUG nova.virt.libvirt.imagecache [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Image id e46abb82-b810-490e-a8a1-ccdc5fa1a796 yields fingerprint 4754efee9a6d73d3647f2add2cfe86c291949740 {{(pid=75341) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 15 00:15:38 user nova-compute[75341]: INFO nova.virt.libvirt.imagecache [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] image e46abb82-b810-490e-a8a1-ccdc5fa1a796 at (/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740): checking
Nov 15 00:15:38 user nova-compute[75341]: DEBUG nova.virt.libvirt.imagecache [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] image e46abb82-b810-490e-a8a1-ccdc5fa1a796 at (/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740): image is in use {{(pid=75341) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 15 00:15:38 user nova-compute[75341]: DEBUG nova.virt.libvirt.imagecache [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75341) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 15 00:15:38 user nova-compute[75341]: DEBUG nova.virt.libvirt.imagecache [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] c332ad29-e892-4caf-aa37-fd66fb41f9ec is a valid instance name {{(pid=75341) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 15 00:15:38 user nova-compute[75341]: DEBUG nova.virt.libvirt.imagecache [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] c332ad29-e892-4caf-aa37-fd66fb41f9ec has a disk file {{(pid=75341) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 15 00:15:38 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:15:38 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:15:38 user nova-compute[75341]: DEBUG nova.virt.libvirt.imagecache [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance c332ad29-e892-4caf-aa37-fd66fb41f9ec is backed by 4754efee9a6d73d3647f2add2cfe86c291949740 {{(pid=75341) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 15 00:15:38 user nova-compute[75341]: DEBUG nova.virt.libvirt.imagecache [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] b4dbe374-f603-4970-be0c-473ccc467e49 is a valid instance name {{(pid=75341) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 15 00:15:38 user nova-compute[75341]: DEBUG nova.virt.libvirt.imagecache [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] b4dbe374-f603-4970-be0c-473ccc467e49 has a disk file {{(pid=75341) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 15 00:15:38 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4dbe374-f603-4970-be0c-473ccc467e49/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:15:38 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4dbe374-f603-4970-be0c-473ccc467e49/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:15:38 user nova-compute[75341]: DEBUG nova.virt.libvirt.imagecache [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance b4dbe374-f603-4970-be0c-473ccc467e49 is backed by 4754efee9a6d73d3647f2add2cfe86c291949740 {{(pid=75341) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 15 00:15:38 user nova-compute[75341]: DEBUG nova.virt.libvirt.imagecache [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] 5a57dc05-73fa-45a8-98d9-c355f2f35d17 is a valid instance name {{(pid=75341) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 15 00:15:38 user nova-compute[75341]: WARNING nova.virt.libvirt.imagecache [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/7f30899dc47815726749a05ebb41d7df6cae0d6f
Nov 15 00:15:38 user nova-compute[75341]: WARNING nova.virt.libvirt.imagecache [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/f1eaa53cf8956265d1b6cfc1e10555dadeebb835
Nov 15 00:15:38 user nova-compute[75341]: WARNING nova.virt.libvirt.imagecache [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/a226ef0bac4e3c80b432f10ecbdca15260668496
Nov 15 00:15:38 user nova-compute[75341]: WARNING nova.virt.libvirt.imagecache [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/abb285b7db1935171570ab92e3f78b91898e244d
Nov 15 00:15:38 user nova-compute[75341]: WARNING nova.virt.libvirt.imagecache [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/c71e7f810e936a49bb8ef251c7e0a1c3ee3ef7f8
Nov 15 00:15:38 user nova-compute[75341]: WARNING nova.virt.libvirt.imagecache [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/cb60ccba765983a5b3e0e36eba011aaa71328a3b
Nov 15 00:15:38 user nova-compute[75341]: WARNING nova.virt.libvirt.imagecache [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/c863ad867769118e50e52c162d1af90c0e360fb4
Nov 15 00:15:38 user nova-compute[75341]: INFO nova.virt.libvirt.imagecache [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Active base files: /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740
Nov 15 00:15:38 user nova-compute[75341]: INFO nova.virt.libvirt.imagecache [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Removable base files: /opt/stack/data/nova/instances/_base/7f30899dc47815726749a05ebb41d7df6cae0d6f /opt/stack/data/nova/instances/_base/f1eaa53cf8956265d1b6cfc1e10555dadeebb835 /opt/stack/data/nova/instances/_base/a226ef0bac4e3c80b432f10ecbdca15260668496 /opt/stack/data/nova/instances/_base/abb285b7db1935171570ab92e3f78b91898e244d /opt/stack/data/nova/instances/_base/c71e7f810e936a49bb8ef251c7e0a1c3ee3ef7f8 /opt/stack/data/nova/instances/_base/cb60ccba765983a5b3e0e36eba011aaa71328a3b /opt/stack/data/nova/instances/_base/c863ad867769118e50e52c162d1af90c0e360fb4
Nov 15 00:15:38 user nova-compute[75341]: INFO nova.virt.libvirt.imagecache [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7f30899dc47815726749a05ebb41d7df6cae0d6f
Nov 15 00:15:38 user nova-compute[75341]: INFO nova.virt.libvirt.imagecache [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f1eaa53cf8956265d1b6cfc1e10555dadeebb835
Nov 15 00:15:38 user nova-compute[75341]: INFO nova.virt.libvirt.imagecache [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a226ef0bac4e3c80b432f10ecbdca15260668496
Nov 15 00:15:38 user nova-compute[75341]: INFO nova.virt.libvirt.imagecache [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/abb285b7db1935171570ab92e3f78b91898e244d
Nov 15 00:15:38 user nova-compute[75341]: INFO nova.virt.libvirt.imagecache [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c71e7f810e936a49bb8ef251c7e0a1c3ee3ef7f8
Nov 15 00:15:38 user nova-compute[75341]: INFO nova.virt.libvirt.imagecache [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/cb60ccba765983a5b3e0e36eba011aaa71328a3b
Nov 15 00:15:38 user nova-compute[75341]: INFO nova.virt.libvirt.imagecache [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c863ad867769118e50e52c162d1af90c0e360fb4
Nov 15 00:15:38 user nova-compute[75341]: DEBUG nova.virt.libvirt.imagecache [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Verification complete {{(pid=75341) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 15 00:15:38 user nova-compute[75341]: DEBUG nova.virt.libvirt.imagecache [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Verify swap images {{(pid=75341) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 15 00:15:38 user nova-compute[75341]: DEBUG nova.virt.libvirt.imagecache [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Verify ephemeral images {{(pid=75341) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 15 00:15:42 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:15:47 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:15:47 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:15:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:15:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:15:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:15:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:16:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:16:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:16:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:16:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:16:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:16:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:16:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:16:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:16:12 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:16:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:16:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:16:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:16:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:16:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:16:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:16:13 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:16:13 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Cleaning up deleted instances {{(pid=75341) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 00:16:13 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] There are 0 instances to clean {{(pid=75341) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 00:16:14 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:16:14 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:16:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:16:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:16:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:16:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:16:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:16:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:16:17 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:16:17 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75341) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 00:16:20 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:16:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:16:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:16:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:16:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:16:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:16:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:16:22 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:16:22 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Starting heal instance info cache {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 00:16:23 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "refresh_cache-5a57dc05-73fa-45a8-98d9-c355f2f35d17" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:16:23 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquired lock "refresh_cache-5a57dc05-73fa-45a8-98d9-c355f2f35d17" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:16:23 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Forcefully refreshing network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 00:16:23 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Updating instance_info_cache with network_info: [{"id": "6b89e652-396c-42ad-9a1a-402e18e1a9f3", "address": "fa:16:3e:f1:b5:9c", "network": {"id": "aed56292-815e-4004-9101-59ff735cf236", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cde913b393e4b1095ae6e8e4a74b5fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b89e652-39", "ovs_interfaceid": "6b89e652-396c-42ad-9a1a-402e18e1a9f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:16:23 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Releasing lock "refresh_cache-5a57dc05-73fa-45a8-98d9-c355f2f35d17" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:16:23 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Updated the network info_cache for instance {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 00:16:23 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:16:23 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:16:23 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:16:23 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:16:23 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:16:23 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75341) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 00:16:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4dbe374-f603-4970-be0c-473ccc467e49/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:16:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4dbe374-f603-4970-be0c-473ccc467e49/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:16:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4dbe374-f603-4970-be0c-473ccc467e49/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:16:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4dbe374-f603-4970-be0c-473ccc467e49/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:16:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:16:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:16:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:16:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:16:24 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 00:16:25 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:16:25 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:16:25 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Hypervisor/Node resource view: name=user free_ram=8892MB free_disk=25.228771209716797GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75341) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 00:16:25 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:16:25 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:16:25 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance c332ad29-e892-4caf-aa37-fd66fb41f9ec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:16:25 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 5a57dc05-73fa-45a8-98d9-c355f2f35d17 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:16:25 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance b4dbe374-f603-4970-be0c-473ccc467e49 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:16:25 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 00:16:25 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 00:16:25 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Refreshing inventories for resource provider 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 00:16:25 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Updating ProviderTree inventory for provider 8fa114cc-b541-418f-865c-16c44294e72d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 00:16:25 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Updating inventory in ProviderTree for provider 8fa114cc-b541-418f-865c-16c44294e72d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 00:16:25 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Refreshing aggregate associations for resource provider 8fa114cc-b541-418f-865c-16c44294e72d, aggregates: None {{(pid=75341) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 00:16:25 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Refreshing trait associations for resource provider 8fa114cc-b541-418f-865c-16c44294e72d, traits: COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_MMX,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000E {{(pid=75341) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 00:16:25 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 00:16:25 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 00:16:25 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Compute_service record updated for user:user {{(pid=75341) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 00:16:25 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.556s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:16:27 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:16:27 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:16:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:16:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:16:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:16:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:16:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:16:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:16:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:16:34 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:16:35 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:16:35 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75341) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 00:16:37 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:16:37 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:16:37 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:16:37 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:16:37 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:16:37 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:16:42 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:16:45 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:16:46 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Triggering sync for uuid c332ad29-e892-4caf-aa37-fd66fb41f9ec {{(pid=75341) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 00:16:46 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Triggering sync for uuid 5a57dc05-73fa-45a8-98d9-c355f2f35d17 {{(pid=75341) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 00:16:46 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Triggering sync for uuid b4dbe374-f603-4970-be0c-473ccc467e49 {{(pid=75341) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 00:16:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "c332ad29-e892-4caf-aa37-fd66fb41f9ec" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:16:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "c332ad29-e892-4caf-aa37-fd66fb41f9ec" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:16:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "5a57dc05-73fa-45a8-98d9-c355f2f35d17" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:16:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "5a57dc05-73fa-45a8-98d9-c355f2f35d17" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:16:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "b4dbe374-f603-4970-be0c-473ccc467e49" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:16:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "b4dbe374-f603-4970-be0c-473ccc467e49" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:16:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "c332ad29-e892-4caf-aa37-fd66fb41f9ec" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:16:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "5a57dc05-73fa-45a8-98d9-c355f2f35d17" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:16:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "b4dbe374-f603-4970-be0c-473ccc467e49" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:16:47 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:16:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:16:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:16:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:16:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:16:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:16:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:16:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:16:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:16:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:16:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:16:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:16:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:17:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:17:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:17:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:17:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:17:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:17:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:17:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:17:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:17:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:17:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:17:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:17:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:17:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:17:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:17:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:17:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:17:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:17:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:17:12 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:17:16 user nova-compute[75341]: DEBUG nova.compute.manager [None req-7ab493cf-e00b-4a00-8405-29436c8a268b tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 00:17:16 user nova-compute[75341]: INFO nova.compute.manager [None req-7ab493cf-e00b-4a00-8405-29436c8a268b tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] instance snapshotting
Nov 15 00:17:16 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-7ab493cf-e00b-4a00-8405-29436c8a268b tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] Beginning live snapshot process
Nov 15 00:17:16 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-7ab493cf-e00b-4a00-8405-29436c8a268b tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4dbe374-f603-4970-be0c-473ccc467e49/disk --force-share --output=json -f qcow2 {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:17:16 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:17:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-7ab493cf-e00b-4a00-8405-29436c8a268b tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4dbe374-f603-4970-be0c-473ccc467e49/disk --force-share --output=json -f qcow2" returned: 0 in 0.182s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:17:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-7ab493cf-e00b-4a00-8405-29436c8a268b tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4dbe374-f603-4970-be0c-473ccc467e49/disk --force-share --output=json -f qcow2 {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:17:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-7ab493cf-e00b-4a00-8405-29436c8a268b tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4dbe374-f603-4970-be0c-473ccc467e49/disk --force-share --output=json -f qcow2" returned: 0 in 0.174s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:17:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-7ab493cf-e00b-4a00-8405-29436c8a268b tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:17:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-7ab493cf-e00b-4a00-8405-29436c8a268b tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.181s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:17:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-7ab493cf-e00b-4a00-8405-29436c8a268b tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpeihx0ahr/3f8f946179354684a5da5f19acf225c4.delta 1073741824 {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:17:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-7ab493cf-e00b-4a00-8405-29436c8a268b tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpeihx0ahr/3f8f946179354684a5da5f19acf225c4.delta 1073741824" returned: 0 in 0.053s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:17:17 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-7ab493cf-e00b-4a00-8405-29436c8a268b tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 15 00:17:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:17:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:17:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:17:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:17:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:17:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:17:18 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-7ab493cf-e00b-4a00-8405-29436c8a268b tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75341) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 00:17:18 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-7ab493cf-e00b-4a00-8405-29436c8a268b tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75341) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 00:17:18 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-7ab493cf-e00b-4a00-8405-29436c8a268b tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 15 00:17:18 user nova-compute[75341]: DEBUG nova.privsep.utils [None req-7ab493cf-e00b-4a00-8405-29436c8a268b tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75341) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 00:17:18 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-7ab493cf-e00b-4a00-8405-29436c8a268b tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpeihx0ahr/3f8f946179354684a5da5f19acf225c4.delta /opt/stack/data/nova/instances/snapshots/tmpeihx0ahr/3f8f946179354684a5da5f19acf225c4 {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:17:18 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:17:18 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75341) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 00:17:19 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-7ab493cf-e00b-4a00-8405-29436c8a268b tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpeihx0ahr/3f8f946179354684a5da5f19acf225c4.delta /opt/stack/data/nova/instances/snapshots/tmpeihx0ahr/3f8f946179354684a5da5f19acf225c4" returned: 0 in 0.364s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:17:19 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-7ab493cf-e00b-4a00-8405-29436c8a268b tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] Snapshot extracted, beginning image upload
Nov 15 00:17:21 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-7ab493cf-e00b-4a00-8405-29436c8a268b tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] Snapshot image upload complete
Nov 15 00:17:21 user nova-compute[75341]: INFO nova.compute.manager [None req-7ab493cf-e00b-4a00-8405-29436c8a268b tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] Took 5.19 seconds to snapshot the instance on the hypervisor.
Nov 15 00:17:21 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:17:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:17:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:17:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:17:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:17:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:17:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:17:22 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:17:23 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:17:23 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Starting heal instance info cache {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 00:17:23 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Rebuilding the list of instances to heal {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 00:17:24 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "refresh_cache-c332ad29-e892-4caf-aa37-fd66fb41f9ec" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:17:24 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquired lock "refresh_cache-c332ad29-e892-4caf-aa37-fd66fb41f9ec" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:17:24 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Forcefully refreshing network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 00:17:24 user nova-compute[75341]: DEBUG nova.objects.instance [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lazy-loading 'info_cache' on Instance uuid c332ad29-e892-4caf-aa37-fd66fb41f9ec {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:17:24 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Updating instance_info_cache with network_info: [{"id": "9f65f96b-aa09-4c3a-a23b-ed444c9dacec", "address": "fa:16:3e:c6:2e:8d", "network": {"id": "aed56292-815e-4004-9101-59ff735cf236", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cde913b393e4b1095ae6e8e4a74b5fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f65f96b-aa", "ovs_interfaceid": "9f65f96b-aa09-4c3a-a23b-ed444c9dacec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:17:24 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Releasing lock "refresh_cache-c332ad29-e892-4caf-aa37-fd66fb41f9ec" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:17:24 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Updated the network info_cache for instance {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 00:17:25 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:17:25 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:17:25 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:17:25 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:17:25 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75341) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 00:17:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4dbe374-f603-4970-be0c-473ccc467e49/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:17:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4dbe374-f603-4970-be0c-473ccc467e49/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:17:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4dbe374-f603-4970-be0c-473ccc467e49/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:17:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4dbe374-f603-4970-be0c-473ccc467e49/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:17:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:17:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:17:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:17:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:17:26 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 00:17:27 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:17:27 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:17:27 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Hypervisor/Node resource view: name=user free_ram=8904MB free_disk=25.179248809814453GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75341) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 00:17:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:17:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:17:27 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance c332ad29-e892-4caf-aa37-fd66fb41f9ec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:17:27 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 5a57dc05-73fa-45a8-98d9-c355f2f35d17 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:17:27 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance b4dbe374-f603-4970-be0c-473ccc467e49 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:17:27 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 00:17:27 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 00:17:27 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 00:17:27 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 00:17:27 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Compute_service record updated for user:user {{(pid=75341) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 00:17:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.234s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:17:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:17:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:17:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:17:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:17:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:17:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:17:28 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:17:28 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:17:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:17:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:17:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:17:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:17:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:17:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:17:37 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:17:42 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:17:47 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:17:47 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:17:47 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:17:47 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:17:47 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:17:47 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:17:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:17:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:17:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:17:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:17:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:17:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:17:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:18:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:18:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:18:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:18:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:18:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:18:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:18:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:18:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:18:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:18:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:18:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:18:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:18:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:18:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:18:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:18:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:18:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:18:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:18:14 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:18:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:18:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:18:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:18:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:18:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:18:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:18:18 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:18:18 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:18:18 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75341) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 00:18:22 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:18:22 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:18:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:18:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:18:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:18:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:18:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:18:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:18:24 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Acquiring lock "8712f776-9a39-432c-814b-0ced1f51f15b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:18:24 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "8712f776-9a39-432c-814b-0ced1f51f15b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:18:24 user nova-compute[75341]: DEBUG nova.compute.manager [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Starting instance... {{(pid=75341) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 00:18:24 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:18:24 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:18:24 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75341) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 00:18:24 user nova-compute[75341]: INFO nova.compute.claims [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Claim successful on node user
Nov 15 00:18:24 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 00:18:24 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 00:18:24 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.265s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:18:24 user nova-compute[75341]: DEBUG nova.compute.manager [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Start building networks asynchronously for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 00:18:24 user nova-compute[75341]: DEBUG nova.compute.manager [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Allocating IP information in the background. {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 00:18:24 user nova-compute[75341]: DEBUG nova.network.neutron [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] allocate_for_instance() {{(pid=75341) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 00:18:24 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 00:18:24 user nova-compute[75341]: DEBUG nova.compute.manager [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Start building block device mappings for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 00:18:24 user nova-compute[75341]: DEBUG nova.policy [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'abb41e7d020d4c99a55b5029cd2124a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cde913b393e4b1095ae6e8e4a74b5fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75341) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 00:18:24 user nova-compute[75341]: INFO nova.virt.block_device [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Booting with volume-backed-image e46abb82-b810-490e-a8a1-ccdc5fa1a796 at /dev/vda
Nov 15 00:18:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:18:25 user nova-compute[75341]: DEBUG nova.network.neutron [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Successfully created port: 0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1 {{(pid=75341) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 00:18:25 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:18:25 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Starting heal instance info cache {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 00:18:26 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "refresh_cache-5a57dc05-73fa-45a8-98d9-c355f2f35d17" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:18:26 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquired lock "refresh_cache-5a57dc05-73fa-45a8-98d9-c355f2f35d17" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:18:26 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Forcefully refreshing network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 00:18:26 user nova-compute[75341]: DEBUG nova.network.neutron [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Successfully updated port: 0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1 {{(pid=75341) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 00:18:26 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Acquiring lock "refresh_cache-8712f776-9a39-432c-814b-0ced1f51f15b" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:18:26 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Acquired lock "refresh_cache-8712f776-9a39-432c-814b-0ced1f51f15b" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:18:26 user nova-compute[75341]: DEBUG nova.network.neutron [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 00:18:26 user nova-compute[75341]: DEBUG nova.compute.manager [req-229b2080-eac5-47d1-8fa7-66f5286d3d86 req-cbc0d894-1b31-4c23-b5a0-ad135381e6bd service nova] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Received event network-changed-0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:18:26 user nova-compute[75341]: DEBUG nova.compute.manager [req-229b2080-eac5-47d1-8fa7-66f5286d3d86 req-cbc0d894-1b31-4c23-b5a0-ad135381e6bd service nova] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Refreshing instance network info cache due to event network-changed-0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 00:18:26 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-229b2080-eac5-47d1-8fa7-66f5286d3d86 req-cbc0d894-1b31-4c23-b5a0-ad135381e6bd service nova] Acquiring lock "refresh_cache-8712f776-9a39-432c-814b-0ced1f51f15b" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:18:26 user nova-compute[75341]: DEBUG nova.network.neutron [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Instance cache missing network info. {{(pid=75341) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 00:18:26 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Updating instance_info_cache with network_info: [{"id": "6b89e652-396c-42ad-9a1a-402e18e1a9f3", "address": "fa:16:3e:f1:b5:9c", "network": {"id": "aed56292-815e-4004-9101-59ff735cf236", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cde913b393e4b1095ae6e8e4a74b5fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b89e652-39", "ovs_interfaceid": "6b89e652-396c-42ad-9a1a-402e18e1a9f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:18:26 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Releasing lock "refresh_cache-5a57dc05-73fa-45a8-98d9-c355f2f35d17" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:18:26 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Updated the network info_cache for instance {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 00:18:27 user nova-compute[75341]: DEBUG nova.network.neutron [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Updating instance_info_cache with network_info: [{"id": "0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1", "address": "fa:16:3e:53:d2:59", "network": {"id": "aed56292-815e-4004-9101-59ff735cf236", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cde913b393e4b1095ae6e8e4a74b5fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0beb622d-8d", "ovs_interfaceid": "0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:18:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Releasing lock "refresh_cache-8712f776-9a39-432c-814b-0ced1f51f15b" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:18:27 user nova-compute[75341]: DEBUG nova.compute.manager [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Instance network_info: |[{"id": "0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1", "address": "fa:16:3e:53:d2:59", "network": {"id": "aed56292-815e-4004-9101-59ff735cf236", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cde913b393e4b1095ae6e8e4a74b5fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0beb622d-8d", "ovs_interfaceid": "0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 00:18:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-229b2080-eac5-47d1-8fa7-66f5286d3d86 req-cbc0d894-1b31-4c23-b5a0-ad135381e6bd service nova] Acquired lock "refresh_cache-8712f776-9a39-432c-814b-0ced1f51f15b" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:18:27 user nova-compute[75341]: DEBUG nova.network.neutron [req-229b2080-eac5-47d1-8fa7-66f5286d3d86 req-cbc0d894-1b31-4c23-b5a0-ad135381e6bd service nova] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Refreshing network info cache for port 0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 00:18:27 user nova-compute[75341]: DEBUG nova.network.neutron [req-229b2080-eac5-47d1-8fa7-66f5286d3d86 req-cbc0d894-1b31-4c23-b5a0-ad135381e6bd service nova] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Updated VIF entry in instance network info cache for port 0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 00:18:27 user nova-compute[75341]: DEBUG nova.network.neutron [req-229b2080-eac5-47d1-8fa7-66f5286d3d86 req-cbc0d894-1b31-4c23-b5a0-ad135381e6bd service nova] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Updating instance_info_cache with network_info: [{"id": "0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1", "address": "fa:16:3e:53:d2:59", "network": {"id": "aed56292-815e-4004-9101-59ff735cf236", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cde913b393e4b1095ae6e8e4a74b5fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0beb622d-8d", "ovs_interfaceid": "0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:18:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-229b2080-eac5-47d1-8fa7-66f5286d3d86 req-cbc0d894-1b31-4c23-b5a0-ad135381e6bd service nova] Releasing lock "refresh_cache-8712f776-9a39-432c-814b-0ced1f51f15b" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:18:27 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:18:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:18:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:18:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:18:27 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75341) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 00:18:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:18:28 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4dbe374-f603-4970-be0c-473ccc467e49/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:18:28 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4dbe374-f603-4970-be0c-473ccc467e49/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:18:28 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4dbe374-f603-4970-be0c-473ccc467e49/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:18:28 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4dbe374-f603-4970-be0c-473ccc467e49/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:18:28 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:18:28 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:18:28 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:18:28 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:18:28 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 00:18:29 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:18:29 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:18:29 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Hypervisor/Node resource view: name=user free_ram=8920MB free_disk=25.17831802368164GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75341) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 00:18:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:18:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:18:29 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance c332ad29-e892-4caf-aa37-fd66fb41f9ec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:18:29 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 5a57dc05-73fa-45a8-98d9-c355f2f35d17 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:18:29 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance b4dbe374-f603-4970-be0c-473ccc467e49 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:18:29 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 8712f776-9a39-432c-814b-0ced1f51f15b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:18:29 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 00:18:29 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 00:18:29 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 00:18:29 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 00:18:29 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Compute_service record updated for user:user {{(pid=75341) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 00:18:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.288s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:18:30 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:18:30 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:18:30 user nova-compute[75341]: DEBUG os_brick.utils [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 00:18:30 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:18:30 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:18:30 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5d0802-fcdc-4776-bb8f-171ab2109db3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6d1cfca09c9\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:18:30 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:18:30 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:18:30 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a9dc73-9f2a-44b1-8a21-c873b9a056c3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:18:30 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:18:30 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:18:30 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc90566-5979-4db3-bdf7-3b0408332d70]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:18:30 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[50deffbf-cb73-4992-a469-912f380662f6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:18:30 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Running cmd (subprocess): nvme version {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:18:30 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] 'nvme version' failed. Not Retrying. {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 00:18:30 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] nvme not present on system {{(pid=75341) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 00:18:30 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:18:30 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 00:18:30 user nova-compute[75341]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 00:18:30 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fef2d26-00b8-46c1-b9ff-59c6aa81fada]: (4, '') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:18:30 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75341) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 00:18:30 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 00:18:30 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] LIGHTOS: no hostnqn found. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 00:18:30 user nova-compute[75341]: DEBUG os_brick.utils [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6d1cfca09c9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 00:18:30 user nova-compute[75341]: DEBUG nova.virt.block_device [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Updating existing volume attachment record: dc029ea6-a503-4b03-825e-fc6f6d7ae720 {{(pid=75341) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 00:18:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG nova.compute.manager [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Start spawning the instance on the hypervisor. {{(pid=75341) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Creating instance directory {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 00:18:35 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Creating image(s)
Nov 15 00:18:35 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Did not create local disks {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Ensure instance console log exists: /opt/stack/data/nova/instances/8712f776-9a39-432c-814b-0ced1f51f15b/console.log {{(pid=75341) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Start _get_guest_xml network_info=[{"id": "0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1", "address": "fa:16:3e:53:d2:59", "network": {"id": "aed56292-815e-4004-9101-59ff735cf236", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cde913b393e4b1095ae6e8e4a74b5fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0beb622d-8d", "ovs_interfaceid": "0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'dc029ea6-a503-4b03-825e-fc6f6d7ae720', 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dOWXjHIQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8712f776-9a39-432c-814b-0ced1f51f15b', 'attached_at': '', 'detached_at': '', 'volume_id': '285b4532-a4ca-4c05-8697-54877e819277', 'serial': '285b4532-a4ca-4c05-8697-54877e819277'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 00:18:35 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:18:35 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:18:35 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Calling os-brick to attach iSCSI Volume {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dOWXjHIQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 00:18:35 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 00:18:35 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 00:18:35 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 00:18:35 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 00:18:35 user nova-compute[75341]: INFO os_brick.initiator.connectors.iscsi [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 00:18:35 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277 -p 172.16.0.220:3260 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7967ace-5c6b-4937-8944-c818ad338af8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 00:18:35 user nova-compute[75341]:  {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277 -p 172.16.0.220:3260 --interface default --op new {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[22af8c32-fbde-4e46-ab6a-b1f034275e65]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277] added\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277] added
Nov 15 00:18:35 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[61478ce9-c3ad-440b-88c1-fbfb0511d609]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4c227c-6a2f-498a-bdd0-97b3b7faaa59]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dOWXjHIQ {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dOWXjHIQ" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[b306de93-6a81-4de6-b597-d0b529b6517b]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dOWXjHIQ'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[33cf9d36-24ee-4a6d-9920-6ea5a606ec77]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[af3e4340-615b-4bb5-8a8e-58aa9375743e]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e (non-flash)
Nov 15 00:18:35 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e (non-flash)
Nov 15 00:18:35 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277 -p 172.16.0.220:3260 --login {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec6d1d4-4b6f-47ef-8599-fd674f19604f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277, portal: 172.16.0.220,3260]
Nov 15 00:18:35 user nova-compute[75341]: Login to [iface: default, target: iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277, portal: 172.16.0.220,3260] successful.
Nov 15 00:18:35 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b059952-eeb3-4132-a0d2-5856aaf26528]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff23356e-db1f-44f0-8539-a6067d02c568]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e (non-flash)
Nov 15 00:18:35 user nova-compute[75341]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277 (non-flash)
Nov 15 00:18:35 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e (non-flash)
Nov 15 00:18:35 user nova-compute[75341]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277 (non-flash)
Nov 15 00:18:35 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Connected to 172.16.0.220:3260 {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] HCTL ('34', '-', '-', 0) found on session 59 with lun 0 {{(pid=75341) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75341) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[9280976e-cfb8-4854-a8f3-30ac3c56d719]: (4, ('- - 0', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:18:35 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Searching for a device in session 59 and hctl ['34', '*', '*', 0] yield: None {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 00:18:36 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Searching for a device in session 59 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 00:18:36 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dOWXjHIQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 00:18:36 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 00:18:36 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '23034376564633232', 'path': '/dev/sdc'} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 00:18:36 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034376564633232', 'path': '/dev/sdc'} {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 00:18:36 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T00:18:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-779236539',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-779236539',id=50,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5cde913b393e4b1095ae6e8e4a74b5fb',ramdisk_id='',reservation_id='r-pg4m6ojg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1181444554',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T00:18:25Z,user_data=None,user_id='abb41e7d020d4c99a55b5029cd2124a9',uuid=8712f776-9a39-432c-814b-0ced1f51f15b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1", "address": "fa:16:3e:53:d2:59", "network": {"id": "aed56292-815e-4004-9101-59ff735cf236", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cde913b393e4b1095ae6e8e4a74b5fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0beb622d-8d", "ovs_interfaceid": "0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 00:18:36 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Converting VIF {"id": "0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1", "address": "fa:16:3e:53:d2:59", "network": {"id": "aed56292-815e-4004-9101-59ff735cf236", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cde913b393e4b1095ae6e8e4a74b5fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0beb622d-8d", "ovs_interfaceid": "0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 00:18:36 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:d2:59,bridge_name='br-int',has_traffic_filtering=True,id=0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1,network=Network(aed56292-815e-4004-9101-59ff735cf236),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0beb622d-8d') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 00:18:36 user nova-compute[75341]: DEBUG nova.objects.instance [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lazy-loading 'pci_devices' on Instance uuid 8712f776-9a39-432c-814b-0ced1f51f15b {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:18:36 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] End _get_guest_xml xml=<domain type="kvm">
Nov 15 00:18:36 user nova-compute[75341]:   <uuid>8712f776-9a39-432c-814b-0ced1f51f15b</uuid>
Nov 15 00:18:36 user nova-compute[75341]:   <name>instance-00000032</name>
Nov 15 00:18:36 user nova-compute[75341]:   <memory>524288</memory>
Nov 15 00:18:36 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 15 00:18:36 user nova-compute[75341]:   <metadata>
Nov 15 00:18:36 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 00:18:36 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 15 00:18:36 user nova-compute[75341]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-779236539</nova:name>
Nov 15 00:18:36 user nova-compute[75341]:       <nova:creationTime>2023-11-15 00:18:35</nova:creationTime>
Nov 15 00:18:36 user nova-compute[75341]:       <nova:flavor name="m1.tiny">
Nov 15 00:18:36 user nova-compute[75341]:         <nova:memory>512</nova:memory>
Nov 15 00:18:36 user nova-compute[75341]:         <nova:disk>1</nova:disk>
Nov 15 00:18:36 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 15 00:18:36 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 00:18:36 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 15 00:18:36 user nova-compute[75341]:       </nova:flavor>
Nov 15 00:18:36 user nova-compute[75341]:       <nova:owner>
Nov 15 00:18:36 user nova-compute[75341]:         <nova:user uuid="abb41e7d020d4c99a55b5029cd2124a9">tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member</nova:user>
Nov 15 00:18:36 user nova-compute[75341]:         <nova:project uuid="5cde913b393e4b1095ae6e8e4a74b5fb">tempest-ServerBootFromVolumeStableRescueTest-1181444554</nova:project>
Nov 15 00:18:36 user nova-compute[75341]:       </nova:owner>
Nov 15 00:18:36 user nova-compute[75341]:       <nova:root type="image" uuid="e46abb82-b810-490e-a8a1-ccdc5fa1a796"/>
Nov 15 00:18:36 user nova-compute[75341]:       <nova:ports>
Nov 15 00:18:36 user nova-compute[75341]:         <nova:port uuid="0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1">
Nov 15 00:18:36 user nova-compute[75341]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 00:18:36 user nova-compute[75341]:         </nova:port>
Nov 15 00:18:36 user nova-compute[75341]:       </nova:ports>
Nov 15 00:18:36 user nova-compute[75341]:     </nova:instance>
Nov 15 00:18:36 user nova-compute[75341]:   </metadata>
Nov 15 00:18:36 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 15 00:18:36 user nova-compute[75341]:     <system>
Nov 15 00:18:36 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 00:18:36 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 15 00:18:36 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 15 00:18:36 user nova-compute[75341]:       <entry name="serial">8712f776-9a39-432c-814b-0ced1f51f15b</entry>
Nov 15 00:18:36 user nova-compute[75341]:       <entry name="uuid">8712f776-9a39-432c-814b-0ced1f51f15b</entry>
Nov 15 00:18:36 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 15 00:18:36 user nova-compute[75341]:     </system>
Nov 15 00:18:36 user nova-compute[75341]:   </sysinfo>
Nov 15 00:18:36 user nova-compute[75341]:   <os>
Nov 15 00:18:36 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 00:18:36 user nova-compute[75341]:     <boot dev="hd"/>
Nov 15 00:18:36 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 15 00:18:36 user nova-compute[75341]:   </os>
Nov 15 00:18:36 user nova-compute[75341]:   <features>
Nov 15 00:18:36 user nova-compute[75341]:     <acpi/>
Nov 15 00:18:36 user nova-compute[75341]:     <apic/>
Nov 15 00:18:36 user nova-compute[75341]:     <vmcoreinfo/>
Nov 15 00:18:36 user nova-compute[75341]:   </features>
Nov 15 00:18:36 user nova-compute[75341]:   <clock offset="utc">
Nov 15 00:18:36 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 00:18:36 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 00:18:36 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 15 00:18:36 user nova-compute[75341]:   </clock>
Nov 15 00:18:36 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 15 00:18:36 user nova-compute[75341]:     <model>Nehalem</model>
Nov 15 00:18:36 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 00:18:36 user nova-compute[75341]:   </cpu>
Nov 15 00:18:36 user nova-compute[75341]:   <devices>
Nov 15 00:18:36 user nova-compute[75341]:     <disk type="block" device="disk">
Nov 15 00:18:36 user nova-compute[75341]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 00:18:36 user nova-compute[75341]:       <source dev="/dev/sdc"/>
Nov 15 00:18:36 user nova-compute[75341]:       <target dev="vda" bus="virtio"/>
Nov 15 00:18:36 user nova-compute[75341]:       <serial>285b4532-a4ca-4c05-8697-54877e819277</serial>
Nov 15 00:18:36 user nova-compute[75341]:     </disk>
Nov 15 00:18:36 user nova-compute[75341]:     <interface type="ethernet">
Nov 15 00:18:36 user nova-compute[75341]:       <mac address="fa:16:3e:53:d2:59"/>
Nov 15 00:18:36 user nova-compute[75341]:       <model type="virtio"/>
Nov 15 00:18:36 user nova-compute[75341]:       <mtu size="1442"/>
Nov 15 00:18:36 user nova-compute[75341]:       <target dev="tap0beb622d-8d"/>
Nov 15 00:18:36 user nova-compute[75341]:     </interface>
Nov 15 00:18:36 user nova-compute[75341]:     <serial type="pty">
Nov 15 00:18:36 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/8712f776-9a39-432c-814b-0ced1f51f15b/console.log" append="off"/>
Nov 15 00:18:36 user nova-compute[75341]:     </serial>
Nov 15 00:18:36 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 00:18:36 user nova-compute[75341]:     <video>
Nov 15 00:18:36 user nova-compute[75341]:       <model type="virtio"/>
Nov 15 00:18:36 user nova-compute[75341]:     </video>
Nov 15 00:18:36 user nova-compute[75341]:     <rng model="virtio">
Nov 15 00:18:36 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 15 00:18:36 user nova-compute[75341]:     </rng>
Nov 15 00:18:36 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 15 00:18:36 user nova-compute[75341]:     <memballoon model="virtio">
Nov 15 00:18:36 user nova-compute[75341]:       <stats period="10"/>
Nov 15 00:18:36 user nova-compute[75341]:     </memballoon>
Nov 15 00:18:36 user nova-compute[75341]:   </devices>
Nov 15 00:18:36 user nova-compute[75341]: </domain>
Nov 15 00:18:36 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 00:18:36 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T00:18:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-779236539',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-779236539',id=50,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5cde913b393e4b1095ae6e8e4a74b5fb',ramdisk_id='',reservation_id='r-pg4m6ojg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1181444554',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T00:18:25Z,user_data=None,user_id='abb41e7d020d4c99a55b5029cd2124a9',uuid=8712f776-9a39-432c-814b-0ced1f51f15b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1", "address": "fa:16:3e:53:d2:59", "network": {"id": "aed56292-815e-4004-9101-59ff735cf236", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cde913b393e4b1095ae6e8e4a74b5fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0beb622d-8d", "ovs_interfaceid": "0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 00:18:36 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Converting VIF {"id": "0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1", "address": "fa:16:3e:53:d2:59", "network": {"id": "aed56292-815e-4004-9101-59ff735cf236", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cde913b393e4b1095ae6e8e4a74b5fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0beb622d-8d", "ovs_interfaceid": "0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 00:18:36 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:d2:59,bridge_name='br-int',has_traffic_filtering=True,id=0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1,network=Network(aed56292-815e-4004-9101-59ff735cf236),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0beb622d-8d') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 00:18:36 user nova-compute[75341]: DEBUG os_vif [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:d2:59,bridge_name='br-int',has_traffic_filtering=True,id=0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1,network=Network(aed56292-815e-4004-9101-59ff735cf236),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0beb622d-8d') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 00:18:36 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:18:36 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:18:36 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 00:18:36 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:18:36 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '81186db2-948a-54a9-a10f-9d642ac768f0', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:18:36 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:18:36 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:18:36 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0beb622d-8d, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:18:36 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0beb622d-8d, col_values=(('qos', UUID('49660dbc-cfce-4d5d-abcb-67fba8bd87eb')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:18:36 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0beb622d-8d, col_values=(('external_ids', {'iface-id': '0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:d2:59', 'vm-uuid': '8712f776-9a39-432c-814b-0ced1f51f15b'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:18:36 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:18:36 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:18:36 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:18:36 user nova-compute[75341]: INFO os_vif [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:d2:59,bridge_name='br-int',has_traffic_filtering=True,id=0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1,network=Network(aed56292-815e-4004-9101-59ff735cf236),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0beb622d-8d')
Nov 15 00:18:36 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 00:18:36 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] No VIF found with MAC fa:16:3e:53:d2:59, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 00:18:38 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:18:38 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:18:38 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:18:38 user nova-compute[75341]: DEBUG nova.compute.manager [req-ae2c8339-924c-4396-8f71-4a70ccfec8aa req-dd97341a-2d0d-41c5-aa80-f65ba3415175 service nova] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Received event network-vif-plugged-0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:18:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ae2c8339-924c-4396-8f71-4a70ccfec8aa req-dd97341a-2d0d-41c5-aa80-f65ba3415175 service nova] Acquiring lock "8712f776-9a39-432c-814b-0ced1f51f15b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:18:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ae2c8339-924c-4396-8f71-4a70ccfec8aa req-dd97341a-2d0d-41c5-aa80-f65ba3415175 service nova] Lock "8712f776-9a39-432c-814b-0ced1f51f15b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:18:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ae2c8339-924c-4396-8f71-4a70ccfec8aa req-dd97341a-2d0d-41c5-aa80-f65ba3415175 service nova] Lock "8712f776-9a39-432c-814b-0ced1f51f15b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:18:38 user nova-compute[75341]: DEBUG nova.compute.manager [req-ae2c8339-924c-4396-8f71-4a70ccfec8aa req-dd97341a-2d0d-41c5-aa80-f65ba3415175 service nova] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] No waiting events found dispatching network-vif-plugged-0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:18:38 user nova-compute[75341]: WARNING nova.compute.manager [req-ae2c8339-924c-4396-8f71-4a70ccfec8aa req-dd97341a-2d0d-41c5-aa80-f65ba3415175 service nova] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Received unexpected event network-vif-plugged-0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1 for instance with vm_state building and task_state spawning.
Nov 15 00:18:38 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:18:38 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:18:38 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:18:40 user nova-compute[75341]: DEBUG nova.compute.manager [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Instance event wait completed in 0 seconds for  {{(pid=75341) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 00:18:40 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Guest created on hypervisor {{(pid=75341) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 00:18:40 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Instance spawned successfully.
Nov 15 00:18:40 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 00:18:40 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Found default for hw_cdrom_bus of ide {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 00:18:40 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Found default for hw_disk_bus of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 00:18:40 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Found default for hw_input_bus of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 00:18:40 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Found default for hw_pointer_model of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 00:18:40 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Found default for hw_video_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 00:18:40 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Found default for hw_vif_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 00:18:40 user nova-compute[75341]: INFO nova.compute.manager [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Took 5.06 seconds to spawn the instance on the hypervisor.
Nov 15 00:18:40 user nova-compute[75341]: DEBUG nova.compute.manager [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 00:18:40 user nova-compute[75341]: DEBUG nova.compute.manager [req-aab628d8-abff-45bf-814f-f3b194ea5a03 req-3f3621a9-99be-4f33-98c1-1cdc52d380fd service nova] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Received event network-vif-plugged-0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:18:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-aab628d8-abff-45bf-814f-f3b194ea5a03 req-3f3621a9-99be-4f33-98c1-1cdc52d380fd service nova] Acquiring lock "8712f776-9a39-432c-814b-0ced1f51f15b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:18:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-aab628d8-abff-45bf-814f-f3b194ea5a03 req-3f3621a9-99be-4f33-98c1-1cdc52d380fd service nova] Lock "8712f776-9a39-432c-814b-0ced1f51f15b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:18:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-aab628d8-abff-45bf-814f-f3b194ea5a03 req-3f3621a9-99be-4f33-98c1-1cdc52d380fd service nova] Lock "8712f776-9a39-432c-814b-0ced1f51f15b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:18:40 user nova-compute[75341]: DEBUG nova.compute.manager [req-aab628d8-abff-45bf-814f-f3b194ea5a03 req-3f3621a9-99be-4f33-98c1-1cdc52d380fd service nova] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] No waiting events found dispatching network-vif-plugged-0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:18:40 user nova-compute[75341]: WARNING nova.compute.manager [req-aab628d8-abff-45bf-814f-f3b194ea5a03 req-3f3621a9-99be-4f33-98c1-1cdc52d380fd service nova] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Received unexpected event network-vif-plugged-0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1 for instance with vm_state building and task_state spawning.
Nov 15 00:18:40 user nova-compute[75341]: INFO nova.compute.manager [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Took 16.05 seconds to build instance.
Nov 15 00:18:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-d9e0ae4b-cdbe-4b0c-9420-5cdcf16ae20a tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "8712f776-9a39-432c-814b-0ced1f51f15b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.157s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:18:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:18:42 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:18:46 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:18:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:18:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:18:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:19:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:19:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:19:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:19:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:19:11 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:19:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:19:14 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:19:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:19:20 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:19:20 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:19:20 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75341) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 00:19:21 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:19:22 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:19:24 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:19:26 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:19:26 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:19:26 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:19:26 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:19:26 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:19:26 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:19:27 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:19:27 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Starting heal instance info cache {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 00:19:28 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "refresh_cache-b4dbe374-f603-4970-be0c-473ccc467e49" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:19:28 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquired lock "refresh_cache-b4dbe374-f603-4970-be0c-473ccc467e49" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:19:28 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] Forcefully refreshing network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 00:19:28 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] Updating instance_info_cache with network_info: [{"id": "92b4fa25-bd9f-40bb-b7a4-d153db0a1857", "address": "fa:16:3e:94:44:86", "network": {"id": "aed56292-815e-4004-9101-59ff735cf236", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cde913b393e4b1095ae6e8e4a74b5fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92b4fa25-bd", "ovs_interfaceid": "92b4fa25-bd9f-40bb-b7a4-d153db0a1857", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:19:28 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Releasing lock "refresh_cache-b4dbe374-f603-4970-be0c-473ccc467e49" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:19:28 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] Updated the network info_cache for instance {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 00:19:29 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:19:29 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:19:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:19:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:19:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:19:29 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75341) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 00:19:30 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4dbe374-f603-4970-be0c-473ccc467e49/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:19:30 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4dbe374-f603-4970-be0c-473ccc467e49/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:19:30 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4dbe374-f603-4970-be0c-473ccc467e49/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:19:30 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4dbe374-f603-4970-be0c-473ccc467e49/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:19:30 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:19:30 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:19:30 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:19:30 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:19:30 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 00:19:30 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 00:19:31 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:19:31 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:19:31 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Hypervisor/Node resource view: name=user free_ram=8767MB free_disk=25.16912078857422GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75341) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 00:19:31 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:19:31 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:19:31 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance c332ad29-e892-4caf-aa37-fd66fb41f9ec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:19:31 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 5a57dc05-73fa-45a8-98d9-c355f2f35d17 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:19:31 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance b4dbe374-f603-4970-be0c-473ccc467e49 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:19:31 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 8712f776-9a39-432c-814b-0ced1f51f15b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:19:31 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 00:19:31 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 00:19:31 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 00:19:31 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 00:19:31 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Compute_service record updated for user:user {{(pid=75341) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 00:19:31 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.365s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:19:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:19:32 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:19:36 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:19:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:19:46 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:19:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:19:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:19:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:19:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:19:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:19:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:19:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:20:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:20:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:20:11 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:20:15 user nova-compute[75341]: INFO nova.compute.manager [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Rescuing
Nov 15 00:20:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Acquiring lock "refresh_cache-8712f776-9a39-432c-814b-0ced1f51f15b" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:20:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Acquired lock "refresh_cache-8712f776-9a39-432c-814b-0ced1f51f15b" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:20:15 user nova-compute[75341]: DEBUG nova.network.neutron [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 00:20:15 user nova-compute[75341]: DEBUG nova.network.neutron [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Updating instance_info_cache with network_info: [{"id": "0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1", "address": "fa:16:3e:53:d2:59", "network": {"id": "aed56292-815e-4004-9101-59ff735cf236", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cde913b393e4b1095ae6e8e4a74b5fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0beb622d-8d", "ovs_interfaceid": "0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:20:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Releasing lock "refresh_cache-8712f776-9a39-432c-814b-0ced1f51f15b" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:20:15 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:20:15 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:20:15 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:20:16 user nova-compute[75341]: DEBUG nova.compute.manager [req-25800e33-cf30-4cf5-929e-2e41f04c8e73 req-520e6bea-b25c-417e-a9a0-26b2d5354fa7 service nova] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Received event network-vif-unplugged-0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:20:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-25800e33-cf30-4cf5-929e-2e41f04c8e73 req-520e6bea-b25c-417e-a9a0-26b2d5354fa7 service nova] Acquiring lock "8712f776-9a39-432c-814b-0ced1f51f15b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:20:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-25800e33-cf30-4cf5-929e-2e41f04c8e73 req-520e6bea-b25c-417e-a9a0-26b2d5354fa7 service nova] Lock "8712f776-9a39-432c-814b-0ced1f51f15b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:20:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-25800e33-cf30-4cf5-929e-2e41f04c8e73 req-520e6bea-b25c-417e-a9a0-26b2d5354fa7 service nova] Lock "8712f776-9a39-432c-814b-0ced1f51f15b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:20:16 user nova-compute[75341]: DEBUG nova.compute.manager [req-25800e33-cf30-4cf5-929e-2e41f04c8e73 req-520e6bea-b25c-417e-a9a0-26b2d5354fa7 service nova] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] No waiting events found dispatching network-vif-unplugged-0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:20:16 user nova-compute[75341]: WARNING nova.compute.manager [req-25800e33-cf30-4cf5-929e-2e41f04c8e73 req-520e6bea-b25c-417e-a9a0-26b2d5354fa7 service nova] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Received unexpected event network-vif-unplugged-0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1 for instance with vm_state active and task_state rescuing.
Nov 15 00:20:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:20:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:20:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:20:16 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Instance destroyed successfully.
Nov 15 00:20:16 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Attempting a stable device rescue
Nov 15 00:20:16 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75341) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 00:20:16 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Instance directory exists: not creating {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 00:20:16 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Creating image(s)
Nov 15 00:20:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Acquiring lock "/opt/stack/data/nova/instances/8712f776-9a39-432c-814b-0ced1f51f15b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:20:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "/opt/stack/data/nova/instances/8712f776-9a39-432c-814b-0ced1f51f15b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:20:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "/opt/stack/data/nova/instances/8712f776-9a39-432c-814b-0ced1f51f15b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:20:16 user nova-compute[75341]: DEBUG nova.objects.instance [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8712f776-9a39-432c-814b-0ced1f51f15b {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:20:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Acquiring lock "f7bb2e5a175e43354fbd63df96f8ffd521cf74f3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:20:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "f7bb2e5a175e43354fbd63df96f8ffd521cf74f3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:20:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7bb2e5a175e43354fbd63df96f8ffd521cf74f3.part --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:20:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:20:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7bb2e5a175e43354fbd63df96f8ffd521cf74f3.part --force-share --output=json" returned: 0 in 0.175s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:20:17 user nova-compute[75341]: DEBUG nova.virt.images [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] 159567d3-8755-426d-ac67-4dd3d7b92590 was qcow2, converting to raw {{(pid=75341) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 00:20:17 user nova-compute[75341]: DEBUG nova.privsep.utils [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75341) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 00:20:17 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f7bb2e5a175e43354fbd63df96f8ffd521cf74f3.part /opt/stack/data/nova/instances/_base/f7bb2e5a175e43354fbd63df96f8ffd521cf74f3.converted {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:20:18 user nova-compute[75341]: DEBUG nova.compute.manager [req-51b54b2b-7f62-42bc-bef5-5ccbcf2ce92e req-1e987345-aeb0-4143-893d-116b702b99be service nova] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Received event network-vif-plugged-0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:20:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-51b54b2b-7f62-42bc-bef5-5ccbcf2ce92e req-1e987345-aeb0-4143-893d-116b702b99be service nova] Acquiring lock "8712f776-9a39-432c-814b-0ced1f51f15b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:20:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-51b54b2b-7f62-42bc-bef5-5ccbcf2ce92e req-1e987345-aeb0-4143-893d-116b702b99be service nova] Lock "8712f776-9a39-432c-814b-0ced1f51f15b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:20:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-51b54b2b-7f62-42bc-bef5-5ccbcf2ce92e req-1e987345-aeb0-4143-893d-116b702b99be service nova] Lock "8712f776-9a39-432c-814b-0ced1f51f15b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:20:18 user nova-compute[75341]: DEBUG nova.compute.manager [req-51b54b2b-7f62-42bc-bef5-5ccbcf2ce92e req-1e987345-aeb0-4143-893d-116b702b99be service nova] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] No waiting events found dispatching network-vif-plugged-0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:20:18 user nova-compute[75341]: WARNING nova.compute.manager [req-51b54b2b-7f62-42bc-bef5-5ccbcf2ce92e req-1e987345-aeb0-4143-893d-116b702b99be service nova] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Received unexpected event network-vif-plugged-0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1 for instance with vm_state active and task_state rescuing.
Nov 15 00:20:18 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f7bb2e5a175e43354fbd63df96f8ffd521cf74f3.part /opt/stack/data/nova/instances/_base/f7bb2e5a175e43354fbd63df96f8ffd521cf74f3.converted" returned: 0 in 0.747s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:20:18 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7bb2e5a175e43354fbd63df96f8ffd521cf74f3.converted --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:20:18 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7bb2e5a175e43354fbd63df96f8ffd521cf74f3.converted --force-share --output=json" returned: 0 in 0.179s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:20:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "f7bb2e5a175e43354fbd63df96f8ffd521cf74f3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.106s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:20:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Acquiring lock "f7bb2e5a175e43354fbd63df96f8ffd521cf74f3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:20:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "f7bb2e5a175e43354fbd63df96f8ffd521cf74f3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:20:18 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7bb2e5a175e43354fbd63df96f8ffd521cf74f3 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:20:18 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f7bb2e5a175e43354fbd63df96f8ffd521cf74f3 --force-share --output=json" returned: 0 in 0.171s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:20:18 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7bb2e5a175e43354fbd63df96f8ffd521cf74f3,backing_fmt=raw /opt/stack/data/nova/instances/8712f776-9a39-432c-814b-0ced1f51f15b/disk.rescue {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:20:18 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f7bb2e5a175e43354fbd63df96f8ffd521cf74f3,backing_fmt=raw /opt/stack/data/nova/instances/8712f776-9a39-432c-814b-0ced1f51f15b/disk.rescue" returned: 0 in 0.059s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:20:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "f7bb2e5a175e43354fbd63df96f8ffd521cf74f3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:20:18 user nova-compute[75341]: DEBUG nova.objects.instance [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lazy-loading 'migration_context' on Instance uuid 8712f776-9a39-432c-814b-0ced1f51f15b {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:20:18 user nova-compute[75341]: DEBUG nova.objects.base [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Object Instance<8712f776-9a39-432c-814b-0ced1f51f15b> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75341) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 00:20:18 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Created local disks {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 00:20:18 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Start _get_guest_xml network_info=[{"id": "0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1", "address": "fa:16:3e:53:d2:59", "network": {"id": "aed56292-815e-4004-9101-59ff735cf236", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "vif_mac": "fa:16:3e:53:d2:59"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cde913b393e4b1095ae6e8e4a74b5fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0beb622d-8d", "ovs_interfaceid": "0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '159567d3-8755-426d-ac67-4dd3d7b92590', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'dc029ea6-a503-4b03-825e-fc6f6d7ae720', 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dOWXjHIQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '8712f776-9a39-432c-814b-0ced1f51f15b', 'attached_at': '', 'detached_at': '', 'volume_id': '285b4532-a4ca-4c05-8697-54877e819277', 'serial': '285b4532-a4ca-4c05-8697-54877e819277'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 00:20:18 user nova-compute[75341]: DEBUG nova.objects.instance [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lazy-loading 'resources' on Instance uuid 8712f776-9a39-432c-814b-0ced1f51f15b {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:20:18 user nova-compute[75341]: DEBUG nova.objects.base [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Object Instance<8712f776-9a39-432c-814b-0ced1f51f15b> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75341) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 00:20:18 user nova-compute[75341]: DEBUG nova.objects.instance [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lazy-loading 'numa_topology' on Instance uuid 8712f776-9a39-432c-814b-0ced1f51f15b {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:20:19 user nova-compute[75341]: DEBUG nova.objects.base [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Object Instance<8712f776-9a39-432c-814b-0ced1f51f15b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75341) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 00:20:19 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:20:19 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:20:19 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 00:20:19 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 00:20:19 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 00:20:19 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 00:20:19 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 00:20:19 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 00:20:19 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 00:20:19 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 00:20:19 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 00:20:19 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 00:20:19 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 00:20:19 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 00:20:19 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 00:20:19 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 00:20:19 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 00:20:19 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 00:20:19 user nova-compute[75341]: DEBUG nova.objects.instance [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8712f776-9a39-432c-814b-0ced1f51f15b {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:20:19 user nova-compute[75341]: DEBUG nova.objects.base [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Object Instance<8712f776-9a39-432c-814b-0ced1f51f15b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75341) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 00:20:19 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Calling os-brick to attach iSCSI Volume {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 00:20:19 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dOWXjHIQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 00:20:19 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 00:20:19 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 00:20:19 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 00:20:19 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 00:20:19 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 00:20:19 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 00:20:19 user nova-compute[75341]: INFO os_brick.initiator.connectors.iscsi [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 00:20:19 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277 -p 172.16.0.220:3260 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:20:19 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:20:19 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd2236f-abff-4f1b-bd3a-04ef80e29f14]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = dOWXjHIQ\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:20:19 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 15 00:20:19 user nova-compute[75341]: node.name = iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277
Nov 15 00:20:19 user nova-compute[75341]: node.tpgt = -1
Nov 15 00:20:19 user nova-compute[75341]: node.startup = automatic
Nov 15 00:20:19 user nova-compute[75341]: node.leading_login = No
Nov 15 00:20:19 user nova-compute[75341]: iface.iscsi_ifacename = default
Nov 15 00:20:19 user nova-compute[75341]: iface.net_ifacename = <empty>
Nov 15 00:20:19 user nova-compute[75341]: iface.ipaddress = <empty>
Nov 15 00:20:19 user nova-compute[75341]: iface.prefix_len = 0
Nov 15 00:20:19 user nova-compute[75341]: iface.hwaddress = <empty>
Nov 15 00:20:19 user nova-compute[75341]: iface.transport_name = tcp
Nov 15 00:20:19 user nova-compute[75341]: iface.initiatorname = <empty>
Nov 15 00:20:19 user nova-compute[75341]: iface.state = <empty>
Nov 15 00:20:19 user nova-compute[75341]: iface.vlan_id = 0
Nov 15 00:20:19 user nova-compute[75341]: iface.vlan_priority = 0
Nov 15 00:20:19 user nova-compute[75341]: iface.vlan_state = <empty>
Nov 15 00:20:19 user nova-compute[75341]: iface.iface_num = 0
Nov 15 00:20:19 user nova-compute[75341]: iface.mtu = 0
Nov 15 00:20:19 user nova-compute[75341]: iface.port = 0
Nov 15 00:20:19 user nova-compute[75341]: iface.bootproto = <empty>
Nov 15 00:20:19 user nova-compute[75341]: iface.subnet_mask = <empty>
Nov 15 00:20:19 user nova-compute[75341]: iface.gateway = <empty>
Nov 15 00:20:19 user nova-compute[75341]: iface.dhcp_alt_client_id_state = <empty>
Nov 15 00:20:19 user nova-compute[75341]: iface.dhcp_alt_client_id = <empty>
Nov 15 00:20:19 user nova-compute[75341]: iface.dhcp_dns = <empty>
Nov 15 00:20:19 user nova-compute[75341]: iface.dhcp_learn_iqn = <empty>
Nov 15 00:20:19 user nova-compute[75341]: iface.dhcp_req_vendor_id_state = <empty>
Nov 15 00:20:19 user nova-compute[75341]: iface.dhcp_vendor_id_state = <empty>
Nov 15 00:20:19 user nova-compute[75341]: iface.dhcp_vendor_id = <empty>
Nov 15 00:20:19 user nova-compute[75341]: iface.dhcp_slp_da = <empty>
Nov 15 00:20:19 user nova-compute[75341]: iface.fragmentation = <empty>
Nov 15 00:20:19 user nova-compute[75341]: iface.gratuitous_arp = <empty>
Nov 15 00:20:19 user nova-compute[75341]: iface.incoming_forwarding = <empty>
Nov 15 00:20:19 user nova-compute[75341]: iface.tos_state = <empty>
Nov 15 00:20:19 user nova-compute[75341]: iface.tos = 0
Nov 15 00:20:19 user nova-compute[75341]: iface.ttl = 0
Nov 15 00:20:19 user nova-compute[75341]: iface.delayed_ack = <empty>
Nov 15 00:20:19 user nova-compute[75341]: iface.tcp_nagle = <empty>
Nov 15 00:20:19 user nova-compute[75341]: iface.tcp_wsf_state = <empty>
Nov 15 00:20:19 user nova-compute[75341]: iface.tcp_wsf = 0
Nov 15 00:20:19 user nova-compute[75341]: iface.tcp_timer_scale = 0
Nov 15 00:20:19 user nova-compute[75341]: iface.tcp_timestamp = <empty>
Nov 15 00:20:19 user nova-compute[75341]: iface.redirect = <empty>
Nov 15 00:20:19 user nova-compute[75341]: iface.def_task_mgmt_timeout = 0
Nov 15 00:20:19 user nova-compute[75341]: iface.header_digest = <empty>
Nov 15 00:20:19 user nova-compute[75341]: iface.data_digest = <empty>
Nov 15 00:20:19 user nova-compute[75341]: iface.immediate_data = <empty>
Nov 15 00:20:19 user nova-compute[75341]: iface.initial_r2t = <empty>
Nov 15 00:20:19 user nova-compute[75341]: iface.data_seq_inorder = <empty>
Nov 15 00:20:19 user nova-compute[75341]: iface.data_pdu_inorder = <empty>
Nov 15 00:20:19 user nova-compute[75341]: iface.erl = 0
Nov 15 00:20:19 user nova-compute[75341]: iface.max_receive_data_len = 0
Nov 15 00:20:19 user nova-compute[75341]: iface.first_burst_len = 0
Nov 15 00:20:19 user nova-compute[75341]: iface.max_outstanding_r2t = 0
Nov 15 00:20:19 user nova-compute[75341]: iface.max_burst_len = 0
Nov 15 00:20:19 user nova-compute[75341]: iface.chap_auth = <empty>
Nov 15 00:20:19 user nova-compute[75341]: iface.bidi_chap = <empty>
Nov 15 00:20:19 user nova-compute[75341]: iface.strict_login_compliance = <empty>
Nov 15 00:20:19 user nova-compute[75341]: iface.discovery_auth = <empty>
Nov 15 00:20:19 user nova-compute[75341]: iface.discovery_logout = <empty>
Nov 15 00:20:19 user nova-compute[75341]: node.discovery_address = <empty>
Nov 15 00:20:19 user nova-compute[75341]: node.discovery_port = 0
Nov 15 00:20:19 user nova-compute[75341]: node.discovery_type = static
Nov 15 00:20:19 user nova-compute[75341]: node.session.initial_cmdsn = 0
Nov 15 00:20:19 user nova-compute[75341]: node.session.initial_login_retry_max = 8
Nov 15 00:20:19 user nova-compute[75341]: node.session.xmit_thread_priority = -20
Nov 15 00:20:19 user nova-compute[75341]: node.session.cmds_max = 128
Nov 15 00:20:19 user nova-compute[75341]: node.session.queue_depth = 32
Nov 15 00:20:19 user nova-compute[75341]: node.session.nr_sessions = 1
Nov 15 00:20:19 user nova-compute[75341]: node.session.auth.authmethod = CHAP
Nov 15 00:20:19 user nova-compute[75341]: node.session.auth.username = dOWXjHIQ
Nov 15 00:20:19 user nova-compute[75341]: node.session.auth.password = ***
Nov 15 00:20:19 user nova-compute[75341]: node.session.auth.username_in = <empty>
Nov 15 00:20:19 user nova-compute[75341]: node.session.auth.password_in = <empty>
Nov 15 00:20:19 user nova-compute[75341]: node.session.auth.chap_algs = MD5
Nov 15 00:20:19 user nova-compute[75341]: node.session.timeo.replacement_timeout = 120
Nov 15 00:20:19 user nova-compute[75341]: node.session.err_timeo.abort_timeout = 15
Nov 15 00:20:19 user nova-compute[75341]: node.session.err_timeo.lu_reset_timeout = 30
Nov 15 00:20:19 user nova-compute[75341]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 15 00:20:19 user nova-compute[75341]: node.session.err_timeo.host_reset_timeout = 60
Nov 15 00:20:19 user nova-compute[75341]: node.session.iscsi.FastAbort = Yes
Nov 15 00:20:19 user nova-compute[75341]: node.session.iscsi.InitialR2T = No
Nov 15 00:20:19 user nova-compute[75341]: node.session.iscsi.ImmediateData = Yes
Nov 15 00:20:19 user nova-compute[75341]: node.session.iscsi.FirstBurstLength = 262144
Nov 15 00:20:19 user nova-compute[75341]: node.session.iscsi.MaxBurstLength = 16776192
Nov 15 00:20:19 user nova-compute[75341]: node.session.iscsi.DefaultTime2Retain = 0
Nov 15 00:20:19 user nova-compute[75341]: node.session.iscsi.DefaultTime2Wait = 2
Nov 15 00:20:19 user nova-compute[75341]: node.session.iscsi.MaxConnections = 1
Nov 15 00:20:19 user nova-compute[75341]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 15 00:20:19 user nova-compute[75341]: node.session.iscsi.ERL = 0
Nov 15 00:20:19 user nova-compute[75341]: node.session.scan = manual
Nov 15 00:20:19 user nova-compute[75341]: node.session.reopen_max = 0
Nov 15 00:20:19 user nova-compute[75341]: node.conn[0].address = 172.16.0.220
Nov 15 00:20:19 user nova-compute[75341]: node.conn[0].port = 3260
Nov 15 00:20:19 user nova-compute[75341]: node.conn[0].startup = manual
Nov 15 00:20:19 user nova-compute[75341]: node.conn[0].tcp.window_size = 524288
Nov 15 00:20:19 user nova-compute[75341]: node.conn[0].tcp.type_of_service = 0
Nov 15 00:20:19 user nova-compute[75341]: node.conn[0].timeo.logout_timeout = 15
Nov 15 00:20:19 user nova-compute[75341]: node.conn[0].timeo.login_timeout = 15
Nov 15 00:20:19 user nova-compute[75341]: node.conn[0].timeo.auth_timeout = 45
Nov 15 00:20:19 user nova-compute[75341]: node.conn[0].timeo.noop_out_interval = 5
Nov 15 00:20:19 user nova-compute[75341]: node.conn[0].timeo.noop_out_timeout = 5
Nov 15 00:20:19 user nova-compute[75341]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 15 00:20:19 user nova-compute[75341]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 15 00:20:19 user nova-compute[75341]: node.conn[0].iscsi.HeaderDigest = None
Nov 15 00:20:19 user nova-compute[75341]: node.conn[0].iscsi.DataDigest = None
Nov 15 00:20:19 user nova-compute[75341]: node.conn[0].iscsi.IFMarker = No
Nov 15 00:20:19 user nova-compute[75341]: node.conn[0].iscsi.OFMarker = No
Nov 15 00:20:19 user nova-compute[75341]: # END RECORD
Nov 15 00:20:19 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:20:19 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:20:19 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:20:19 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd88c5f-187c-4dc6-8528-3648eb63d2be]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:20:19 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:20:19 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:20:19 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:20:19 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a88606-d6f8-43fa-87ea-fe2259ac0074]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:20:19 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:20:19 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dOWXjHIQ {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:20:19 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dOWXjHIQ" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:20:19 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[838b1960-4bcf-40dd-9480-a6fa813575ef]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:20:19 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dOWXjHIQ'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:20:19 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:20:19 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:20:19 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e12391b-da46-4330-bbff-2d24c059781d]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:20:19 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:20:19 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:20:19 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:20:19 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a80fcea-f4d3-49af-8d8a-9d3ba15ba34e]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:20:19 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e (non-flash)
Nov 15 00:20:19 user nova-compute[75341]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277 (non-flash)
Nov 15 00:20:19 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 00:20:19 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e (non-flash)
Nov 15 00:20:19 user nova-compute[75341]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277 (non-flash)
Nov 15 00:20:19 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 00:20:19 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.134s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 00:20:19 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Connected to 172.16.0.220:3260 {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 00:20:19 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] HCTL ('34', '0', '0', 0) found on session 59 with lun 0 {{(pid=75341) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 00:20:19 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=75341) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 00:20:19 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:20:19 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.013s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:20:19 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[6614e5e1-5028-4781-afcb-413d128ee476]: (4, ('0 0 0', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:20:19 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Searching for a device in session 59 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 00:20:19 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dOWXjHIQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 00:20:19 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.156s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 00:20:19 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] <== connect_volume: return (158ms) {'type': 'block', 'scsi_wwn': '23034376564633232', 'path': '/dev/sdc'} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 00:20:19 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034376564633232', 'path': '/dev/sdc'} {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 00:20:19 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T00:18:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-779236539',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-779236539',id=50,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T00:18:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5cde913b393e4b1095ae6e8e4a74b5fb',ramdisk_id='',reservation_id='r-pg4m6ojg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1181444554',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T00:18:40Z,user_data=None,user_id='abb41e7d020d4c99a55b5029cd2124a9',uuid=8712f776-9a39-432c-814b-0ced1f51f15b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1", "address": "fa:16:3e:53:d2:59", "network": {"id": "aed56292-815e-4004-9101-59ff735cf236", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "vif_mac": "fa:16:3e:53:d2:59"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cde913b393e4b1095ae6e8e4a74b5fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0beb622d-8d", "ovs_interfaceid": "0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 00:20:19 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Converting VIF {"id": "0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1", "address": "fa:16:3e:53:d2:59", "network": {"id": "aed56292-815e-4004-9101-59ff735cf236", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "vif_mac": "fa:16:3e:53:d2:59"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cde913b393e4b1095ae6e8e4a74b5fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0beb622d-8d", "ovs_interfaceid": "0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 00:20:19 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:d2:59,bridge_name='br-int',has_traffic_filtering=True,id=0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1,network=Network(aed56292-815e-4004-9101-59ff735cf236),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0beb622d-8d') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 00:20:19 user nova-compute[75341]: DEBUG nova.objects.instance [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lazy-loading 'pci_devices' on Instance uuid 8712f776-9a39-432c-814b-0ced1f51f15b {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:20:19 user nova-compute[75341]: DEBUG nova.objects.base [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Object Instance<8712f776-9a39-432c-814b-0ced1f51f15b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75341) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 00:20:19 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] End _get_guest_xml xml=<domain type="kvm">
Nov 15 00:20:19 user nova-compute[75341]:   <uuid>8712f776-9a39-432c-814b-0ced1f51f15b</uuid>
Nov 15 00:20:19 user nova-compute[75341]:   <name>instance-00000032</name>
Nov 15 00:20:19 user nova-compute[75341]:   <memory>524288</memory>
Nov 15 00:20:19 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 15 00:20:19 user nova-compute[75341]:   <metadata>
Nov 15 00:20:19 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 00:20:19 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 15 00:20:19 user nova-compute[75341]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-779236539</nova:name>
Nov 15 00:20:19 user nova-compute[75341]:       <nova:creationTime>2023-11-15 00:20:19</nova:creationTime>
Nov 15 00:20:19 user nova-compute[75341]:       <nova:flavor name="m1.tiny">
Nov 15 00:20:19 user nova-compute[75341]:         <nova:memory>512</nova:memory>
Nov 15 00:20:19 user nova-compute[75341]:         <nova:disk>1</nova:disk>
Nov 15 00:20:19 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 15 00:20:19 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 00:20:19 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 15 00:20:19 user nova-compute[75341]:       </nova:flavor>
Nov 15 00:20:19 user nova-compute[75341]:       <nova:owner>
Nov 15 00:20:19 user nova-compute[75341]:         <nova:user uuid="abb41e7d020d4c99a55b5029cd2124a9">tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member</nova:user>
Nov 15 00:20:19 user nova-compute[75341]:         <nova:project uuid="5cde913b393e4b1095ae6e8e4a74b5fb">tempest-ServerBootFromVolumeStableRescueTest-1181444554</nova:project>
Nov 15 00:20:19 user nova-compute[75341]:       </nova:owner>
Nov 15 00:20:19 user nova-compute[75341]:       <nova:root type="image" uuid="e46abb82-b810-490e-a8a1-ccdc5fa1a796"/>
Nov 15 00:20:19 user nova-compute[75341]:       <nova:ports>
Nov 15 00:20:19 user nova-compute[75341]:         <nova:port uuid="0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1">
Nov 15 00:20:19 user nova-compute[75341]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 00:20:19 user nova-compute[75341]:         </nova:port>
Nov 15 00:20:19 user nova-compute[75341]:       </nova:ports>
Nov 15 00:20:19 user nova-compute[75341]:     </nova:instance>
Nov 15 00:20:19 user nova-compute[75341]:   </metadata>
Nov 15 00:20:19 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 15 00:20:19 user nova-compute[75341]:     <system>
Nov 15 00:20:19 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 00:20:19 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 15 00:20:19 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 15 00:20:19 user nova-compute[75341]:       <entry name="serial">8712f776-9a39-432c-814b-0ced1f51f15b</entry>
Nov 15 00:20:19 user nova-compute[75341]:       <entry name="uuid">8712f776-9a39-432c-814b-0ced1f51f15b</entry>
Nov 15 00:20:19 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 15 00:20:19 user nova-compute[75341]:     </system>
Nov 15 00:20:19 user nova-compute[75341]:   </sysinfo>
Nov 15 00:20:19 user nova-compute[75341]:   <os>
Nov 15 00:20:19 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 00:20:19 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 15 00:20:19 user nova-compute[75341]:   </os>
Nov 15 00:20:19 user nova-compute[75341]:   <features>
Nov 15 00:20:19 user nova-compute[75341]:     <acpi/>
Nov 15 00:20:19 user nova-compute[75341]:     <apic/>
Nov 15 00:20:19 user nova-compute[75341]:     <vmcoreinfo/>
Nov 15 00:20:19 user nova-compute[75341]:   </features>
Nov 15 00:20:19 user nova-compute[75341]:   <clock offset="utc">
Nov 15 00:20:19 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 00:20:19 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 00:20:19 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 15 00:20:19 user nova-compute[75341]:   </clock>
Nov 15 00:20:19 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 15 00:20:19 user nova-compute[75341]:     <model>Nehalem</model>
Nov 15 00:20:19 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 00:20:19 user nova-compute[75341]:   </cpu>
Nov 15 00:20:19 user nova-compute[75341]:   <devices>
Nov 15 00:20:19 user nova-compute[75341]:     <disk type="block" device="disk">
Nov 15 00:20:19 user nova-compute[75341]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 00:20:19 user nova-compute[75341]:       <source dev="/dev/sdc"/>
Nov 15 00:20:19 user nova-compute[75341]:       <target dev="vda" bus="virtio"/>
Nov 15 00:20:19 user nova-compute[75341]:       <serial>285b4532-a4ca-4c05-8697-54877e819277</serial>
Nov 15 00:20:19 user nova-compute[75341]:     </disk>
Nov 15 00:20:19 user nova-compute[75341]:     <disk type="file" device="disk">
Nov 15 00:20:19 user nova-compute[75341]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 00:20:19 user nova-compute[75341]:       <source file="/opt/stack/data/nova/instances/8712f776-9a39-432c-814b-0ced1f51f15b/disk.rescue"/>
Nov 15 00:20:19 user nova-compute[75341]:       <target dev="vdb" bus="virtio"/>
Nov 15 00:20:19 user nova-compute[75341]:       <boot order="1"/>
Nov 15 00:20:19 user nova-compute[75341]:     </disk>
Nov 15 00:20:19 user nova-compute[75341]:     <interface type="ethernet">
Nov 15 00:20:19 user nova-compute[75341]:       <mac address="fa:16:3e:53:d2:59"/>
Nov 15 00:20:19 user nova-compute[75341]:       <model type="virtio"/>
Nov 15 00:20:19 user nova-compute[75341]:       <mtu size="1442"/>
Nov 15 00:20:19 user nova-compute[75341]:       <target dev="tap0beb622d-8d"/>
Nov 15 00:20:19 user nova-compute[75341]:     </interface>
Nov 15 00:20:19 user nova-compute[75341]:     <serial type="pty">
Nov 15 00:20:19 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/8712f776-9a39-432c-814b-0ced1f51f15b/console.log" append="off"/>
Nov 15 00:20:19 user nova-compute[75341]:     </serial>
Nov 15 00:20:19 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 00:20:19 user nova-compute[75341]:     <video>
Nov 15 00:20:19 user nova-compute[75341]:       <model type="virtio"/>
Nov 15 00:20:19 user nova-compute[75341]:     </video>
Nov 15 00:20:19 user nova-compute[75341]:     <rng model="virtio">
Nov 15 00:20:19 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 15 00:20:19 user nova-compute[75341]:     </rng>
Nov 15 00:20:19 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 15 00:20:19 user nova-compute[75341]:     <memballoon model="virtio">
Nov 15 00:20:19 user nova-compute[75341]:       <stats period="10"/>
Nov 15 00:20:19 user nova-compute[75341]:     </memballoon>
Nov 15 00:20:19 user nova-compute[75341]:   </devices>
Nov 15 00:20:19 user nova-compute[75341]: </domain>
Nov 15 00:20:19 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 00:20:19 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Instance destroyed successfully.
Nov 15 00:20:19 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 00:20:19 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 00:20:19 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] No VIF found with MAC fa:16:3e:53:d2:59, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 00:20:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:20:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:20:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:20:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:20:20 user nova-compute[75341]: DEBUG nova.compute.manager [req-1d4147e8-821b-4632-8e16-f2c220c1f7b2 req-4977a72e-3ae0-464d-b269-db1801ad713d service nova] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Received event network-vif-plugged-0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:20:20 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-1d4147e8-821b-4632-8e16-f2c220c1f7b2 req-4977a72e-3ae0-464d-b269-db1801ad713d service nova] Acquiring lock "8712f776-9a39-432c-814b-0ced1f51f15b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:20:20 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-1d4147e8-821b-4632-8e16-f2c220c1f7b2 req-4977a72e-3ae0-464d-b269-db1801ad713d service nova] Lock "8712f776-9a39-432c-814b-0ced1f51f15b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:20:20 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-1d4147e8-821b-4632-8e16-f2c220c1f7b2 req-4977a72e-3ae0-464d-b269-db1801ad713d service nova] Lock "8712f776-9a39-432c-814b-0ced1f51f15b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:20:20 user nova-compute[75341]: DEBUG nova.compute.manager [req-1d4147e8-821b-4632-8e16-f2c220c1f7b2 req-4977a72e-3ae0-464d-b269-db1801ad713d service nova] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] No waiting events found dispatching network-vif-plugged-0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:20:20 user nova-compute[75341]: WARNING nova.compute.manager [req-1d4147e8-821b-4632-8e16-f2c220c1f7b2 req-4977a72e-3ae0-464d-b269-db1801ad713d service nova] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Received unexpected event network-vif-plugged-0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1 for instance with vm_state active and task_state rescuing.
Nov 15 00:20:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:20:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:20:21 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:20:21 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75341) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 00:20:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:20:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:20:22 user nova-compute[75341]: DEBUG nova.compute.manager [None req-0d43a658-69c9-4f7b-a0f6-9b66b0ab9a65 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 00:20:22 user nova-compute[75341]: DEBUG nova.compute.manager [req-9f3ea763-d920-4c70-87e6-86f34c94017c req-b285b766-090e-4096-a30c-2f4462cfa948 service nova] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Received event network-vif-plugged-0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:20:22 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-9f3ea763-d920-4c70-87e6-86f34c94017c req-b285b766-090e-4096-a30c-2f4462cfa948 service nova] Acquiring lock "8712f776-9a39-432c-814b-0ced1f51f15b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:20:22 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-9f3ea763-d920-4c70-87e6-86f34c94017c req-b285b766-090e-4096-a30c-2f4462cfa948 service nova] Lock "8712f776-9a39-432c-814b-0ced1f51f15b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:20:22 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-9f3ea763-d920-4c70-87e6-86f34c94017c req-b285b766-090e-4096-a30c-2f4462cfa948 service nova] Lock "8712f776-9a39-432c-814b-0ced1f51f15b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:20:22 user nova-compute[75341]: DEBUG nova.compute.manager [req-9f3ea763-d920-4c70-87e6-86f34c94017c req-b285b766-090e-4096-a30c-2f4462cfa948 service nova] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] No waiting events found dispatching network-vif-plugged-0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:20:22 user nova-compute[75341]: WARNING nova.compute.manager [req-9f3ea763-d920-4c70-87e6-86f34c94017c req-b285b766-090e-4096-a30c-2f4462cfa948 service nova] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Received unexpected event network-vif-plugged-0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1 for instance with vm_state active and task_state rescuing.
Nov 15 00:20:22 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:20:23 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:20:26 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:20:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:20:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:20:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:20:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:20:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:20:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:20:28 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:20:28 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Starting heal instance info cache {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 00:20:28 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Rebuilding the list of instances to heal {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 00:20:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "refresh_cache-c332ad29-e892-4caf-aa37-fd66fb41f9ec" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:20:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquired lock "refresh_cache-c332ad29-e892-4caf-aa37-fd66fb41f9ec" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:20:29 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Forcefully refreshing network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 00:20:29 user nova-compute[75341]: DEBUG nova.objects.instance [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lazy-loading 'info_cache' on Instance uuid c332ad29-e892-4caf-aa37-fd66fb41f9ec {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:20:29 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Updating instance_info_cache with network_info: [{"id": "9f65f96b-aa09-4c3a-a23b-ed444c9dacec", "address": "fa:16:3e:c6:2e:8d", "network": {"id": "aed56292-815e-4004-9101-59ff735cf236", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cde913b393e4b1095ae6e8e4a74b5fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f65f96b-aa", "ovs_interfaceid": "9f65f96b-aa09-4c3a-a23b-ed444c9dacec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:20:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Releasing lock "refresh_cache-c332ad29-e892-4caf-aa37-fd66fb41f9ec" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:20:29 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Updated the network info_cache for instance {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 00:20:30 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:20:30 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:20:31 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:20:31 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:20:31 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:20:31 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:20:31 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75341) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 00:20:32 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4dbe374-f603-4970-be0c-473ccc467e49/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:20:32 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4dbe374-f603-4970-be0c-473ccc467e49/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:20:32 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4dbe374-f603-4970-be0c-473ccc467e49/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:20:32 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4dbe374-f603-4970-be0c-473ccc467e49/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:20:32 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:20:32 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:20:32 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:20:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:20:32 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:20:32 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 00:20:32 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8712f776-9a39-432c-814b-0ced1f51f15b/disk.rescue --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:20:32 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8712f776-9a39-432c-814b-0ced1f51f15b/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:20:32 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8712f776-9a39-432c-814b-0ced1f51f15b/disk.rescue --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:20:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8712f776-9a39-432c-814b-0ced1f51f15b/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:20:33 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 00:20:33 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:20:33 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:20:33 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Hypervisor/Node resource view: name=user free_ram=8730MB free_disk=25.07343292236328GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75341) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 00:20:33 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:20:33 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:20:33 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance c332ad29-e892-4caf-aa37-fd66fb41f9ec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:20:33 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 5a57dc05-73fa-45a8-98d9-c355f2f35d17 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:20:33 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance b4dbe374-f603-4970-be0c-473ccc467e49 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:20:33 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 8712f776-9a39-432c-814b-0ced1f51f15b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:20:33 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 00:20:33 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 00:20:33 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 00:20:33 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 00:20:33 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Compute_service record updated for user:user {{(pid=75341) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 00:20:33 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.289s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:20:37 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:20:37 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:20:40 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:20:42 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:20:42 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:20:47 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:20:47 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:20:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:20:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:20:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:20:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:21:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:21:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:21:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:21:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:21:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:21:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:21:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:21:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:21:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:21:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:21:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:21:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:21:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:21:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:21:14 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:21:15 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:21:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:21:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:21:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:21:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:21:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:21:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:21:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:21:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:21:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:21:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:21:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:21:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:21:22 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:21:22 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75341) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 00:21:23 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:21:24 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:21:24 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Cleaning up deleted instances {{(pid=75341) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 00:21:24 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] There are 0 instances to clean {{(pid=75341) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 00:21:25 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:21:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:21:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:21:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:21:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:21:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:21:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:21:28 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:21:30 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:21:30 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Starting heal instance info cache {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 00:21:31 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "refresh_cache-5a57dc05-73fa-45a8-98d9-c355f2f35d17" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:21:31 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquired lock "refresh_cache-5a57dc05-73fa-45a8-98d9-c355f2f35d17" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:21:31 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Forcefully refreshing network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 00:21:31 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Updating instance_info_cache with network_info: [{"id": "6b89e652-396c-42ad-9a1a-402e18e1a9f3", "address": "fa:16:3e:f1:b5:9c", "network": {"id": "aed56292-815e-4004-9101-59ff735cf236", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cde913b393e4b1095ae6e8e4a74b5fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b89e652-39", "ovs_interfaceid": "6b89e652-396c-42ad-9a1a-402e18e1a9f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:21:31 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Releasing lock "refresh_cache-5a57dc05-73fa-45a8-98d9-c355f2f35d17" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:21:31 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Updated the network info_cache for instance {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 00:21:31 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:21:31 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:21:31 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:21:31 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:21:31 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:21:31 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:21:31 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75341) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 00:21:32 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4dbe374-f603-4970-be0c-473ccc467e49/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:21:32 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4dbe374-f603-4970-be0c-473ccc467e49/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:21:32 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4dbe374-f603-4970-be0c-473ccc467e49/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:21:32 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4dbe374-f603-4970-be0c-473ccc467e49/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:21:32 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:21:32 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:21:32 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:21:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:21:32 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:21:32 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 00:21:32 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8712f776-9a39-432c-814b-0ced1f51f15b/disk.rescue --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:21:32 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8712f776-9a39-432c-814b-0ced1f51f15b/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:21:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8712f776-9a39-432c-814b-0ced1f51f15b/disk.rescue --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:21:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8712f776-9a39-432c-814b-0ced1f51f15b/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:21:33 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 00:21:33 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:21:33 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:21:33 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Hypervisor/Node resource view: name=user free_ram=8808MB free_disk=25.071613311767578GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75341) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 00:21:33 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:21:33 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:21:33 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance c332ad29-e892-4caf-aa37-fd66fb41f9ec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:21:33 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 5a57dc05-73fa-45a8-98d9-c355f2f35d17 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:21:33 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance b4dbe374-f603-4970-be0c-473ccc467e49 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:21:33 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 8712f776-9a39-432c-814b-0ced1f51f15b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:21:33 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 00:21:33 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 00:21:33 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Refreshing inventories for resource provider 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 00:21:33 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Updating ProviderTree inventory for provider 8fa114cc-b541-418f-865c-16c44294e72d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 00:21:33 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Updating inventory in ProviderTree for provider 8fa114cc-b541-418f-865c-16c44294e72d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 00:21:33 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Refreshing aggregate associations for resource provider 8fa114cc-b541-418f-865c-16c44294e72d, aggregates: None {{(pid=75341) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 00:21:33 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Refreshing trait associations for resource provider 8fa114cc-b541-418f-865c-16c44294e72d, traits: COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_MMX,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000E {{(pid=75341) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 00:21:34 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 00:21:34 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 00:21:34 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Compute_service record updated for user:user {{(pid=75341) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 00:21:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.463s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:21:37 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:21:42 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:21:47 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:21:47 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:21:47 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:21:47 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:21:47 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:21:47 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:21:48 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:21:48 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75341) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 00:21:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:21:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:21:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:21:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:21:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:21:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:21:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:22:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:22:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:22:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:22:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:22:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:22:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:22:06 user nova-compute[75341]: INFO nova.compute.manager [None req-8aa70034-44d4-45d5-a069-c70709e38b88 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Unrescuing
Nov 15 00:22:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8aa70034-44d4-45d5-a069-c70709e38b88 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Acquiring lock "refresh_cache-8712f776-9a39-432c-814b-0ced1f51f15b" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:22:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8aa70034-44d4-45d5-a069-c70709e38b88 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Acquired lock "refresh_cache-8712f776-9a39-432c-814b-0ced1f51f15b" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:22:06 user nova-compute[75341]: DEBUG nova.network.neutron [None req-8aa70034-44d4-45d5-a069-c70709e38b88 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 00:22:06 user nova-compute[75341]: DEBUG nova.network.neutron [None req-8aa70034-44d4-45d5-a069-c70709e38b88 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Updating instance_info_cache with network_info: [{"id": "0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1", "address": "fa:16:3e:53:d2:59", "network": {"id": "aed56292-815e-4004-9101-59ff735cf236", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cde913b393e4b1095ae6e8e4a74b5fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0beb622d-8d", "ovs_interfaceid": "0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:22:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8aa70034-44d4-45d5-a069-c70709e38b88 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Releasing lock "refresh_cache-8712f776-9a39-432c-814b-0ced1f51f15b" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:22:06 user nova-compute[75341]: DEBUG nova.objects.instance [None req-8aa70034-44d4-45d5-a069-c70709e38b88 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lazy-loading 'flavor' on Instance uuid 8712f776-9a39-432c-814b-0ced1f51f15b {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:22:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:22:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:22:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:22:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:22:06 user nova-compute[75341]: DEBUG nova.compute.manager [req-9a4e734f-4d70-4bc0-b3e8-bdce4aa7d6c9 req-73e7ebce-1851-4b29-9080-0d6f8b302d37 service nova] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Received event network-vif-unplugged-0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:22:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-9a4e734f-4d70-4bc0-b3e8-bdce4aa7d6c9 req-73e7ebce-1851-4b29-9080-0d6f8b302d37 service nova] Acquiring lock "8712f776-9a39-432c-814b-0ced1f51f15b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:22:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-9a4e734f-4d70-4bc0-b3e8-bdce4aa7d6c9 req-73e7ebce-1851-4b29-9080-0d6f8b302d37 service nova] Lock "8712f776-9a39-432c-814b-0ced1f51f15b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:22:06 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-9a4e734f-4d70-4bc0-b3e8-bdce4aa7d6c9 req-73e7ebce-1851-4b29-9080-0d6f8b302d37 service nova] Lock "8712f776-9a39-432c-814b-0ced1f51f15b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:22:06 user nova-compute[75341]: DEBUG nova.compute.manager [req-9a4e734f-4d70-4bc0-b3e8-bdce4aa7d6c9 req-73e7ebce-1851-4b29-9080-0d6f8b302d37 service nova] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] No waiting events found dispatching network-vif-unplugged-0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:22:06 user nova-compute[75341]: WARNING nova.compute.manager [req-9a4e734f-4d70-4bc0-b3e8-bdce4aa7d6c9 req-73e7ebce-1851-4b29-9080-0d6f8b302d37 service nova] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Received unexpected event network-vif-unplugged-0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1 for instance with vm_state rescued and task_state unrescuing.
Nov 15 00:22:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:22:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:22:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:22:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:22:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:22:07 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Instance destroyed successfully.
Nov 15 00:22:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:22:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:22:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:22:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:22:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:22:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:22:08 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:22:08 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:22:08 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:22:08 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:22:08 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:22:09 user nova-compute[75341]: DEBUG nova.compute.manager [req-35ea89b0-6e0f-4bea-bc35-b8b3866225b8 req-5196d974-6142-4bc7-8eac-ae0c24976e3d service nova] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Received event network-vif-plugged-0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:22:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-35ea89b0-6e0f-4bea-bc35-b8b3866225b8 req-5196d974-6142-4bc7-8eac-ae0c24976e3d service nova] Acquiring lock "8712f776-9a39-432c-814b-0ced1f51f15b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:22:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-35ea89b0-6e0f-4bea-bc35-b8b3866225b8 req-5196d974-6142-4bc7-8eac-ae0c24976e3d service nova] Lock "8712f776-9a39-432c-814b-0ced1f51f15b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:22:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-35ea89b0-6e0f-4bea-bc35-b8b3866225b8 req-5196d974-6142-4bc7-8eac-ae0c24976e3d service nova] Lock "8712f776-9a39-432c-814b-0ced1f51f15b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:22:09 user nova-compute[75341]: DEBUG nova.compute.manager [req-35ea89b0-6e0f-4bea-bc35-b8b3866225b8 req-5196d974-6142-4bc7-8eac-ae0c24976e3d service nova] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] No waiting events found dispatching network-vif-plugged-0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:22:09 user nova-compute[75341]: WARNING nova.compute.manager [req-35ea89b0-6e0f-4bea-bc35-b8b3866225b8 req-5196d974-6142-4bc7-8eac-ae0c24976e3d service nova] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Received unexpected event network-vif-plugged-0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1 for instance with vm_state rescued and task_state unrescuing.
Nov 15 00:22:09 user nova-compute[75341]: DEBUG nova.compute.manager [req-35ea89b0-6e0f-4bea-bc35-b8b3866225b8 req-5196d974-6142-4bc7-8eac-ae0c24976e3d service nova] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Received event network-vif-plugged-0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:22:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-35ea89b0-6e0f-4bea-bc35-b8b3866225b8 req-5196d974-6142-4bc7-8eac-ae0c24976e3d service nova] Acquiring lock "8712f776-9a39-432c-814b-0ced1f51f15b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:22:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-35ea89b0-6e0f-4bea-bc35-b8b3866225b8 req-5196d974-6142-4bc7-8eac-ae0c24976e3d service nova] Lock "8712f776-9a39-432c-814b-0ced1f51f15b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:22:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-35ea89b0-6e0f-4bea-bc35-b8b3866225b8 req-5196d974-6142-4bc7-8eac-ae0c24976e3d service nova] Lock "8712f776-9a39-432c-814b-0ced1f51f15b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:22:09 user nova-compute[75341]: DEBUG nova.compute.manager [req-35ea89b0-6e0f-4bea-bc35-b8b3866225b8 req-5196d974-6142-4bc7-8eac-ae0c24976e3d service nova] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] No waiting events found dispatching network-vif-plugged-0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:22:09 user nova-compute[75341]: WARNING nova.compute.manager [req-35ea89b0-6e0f-4bea-bc35-b8b3866225b8 req-5196d974-6142-4bc7-8eac-ae0c24976e3d service nova] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Received unexpected event network-vif-plugged-0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1 for instance with vm_state rescued and task_state unrescuing.
Nov 15 00:22:09 user nova-compute[75341]: DEBUG nova.compute.manager [req-35ea89b0-6e0f-4bea-bc35-b8b3866225b8 req-5196d974-6142-4bc7-8eac-ae0c24976e3d service nova] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Received event network-vif-plugged-0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:22:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-35ea89b0-6e0f-4bea-bc35-b8b3866225b8 req-5196d974-6142-4bc7-8eac-ae0c24976e3d service nova] Acquiring lock "8712f776-9a39-432c-814b-0ced1f51f15b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:22:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-35ea89b0-6e0f-4bea-bc35-b8b3866225b8 req-5196d974-6142-4bc7-8eac-ae0c24976e3d service nova] Lock "8712f776-9a39-432c-814b-0ced1f51f15b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:22:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-35ea89b0-6e0f-4bea-bc35-b8b3866225b8 req-5196d974-6142-4bc7-8eac-ae0c24976e3d service nova] Lock "8712f776-9a39-432c-814b-0ced1f51f15b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:22:09 user nova-compute[75341]: DEBUG nova.compute.manager [req-35ea89b0-6e0f-4bea-bc35-b8b3866225b8 req-5196d974-6142-4bc7-8eac-ae0c24976e3d service nova] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] No waiting events found dispatching network-vif-plugged-0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:22:09 user nova-compute[75341]: WARNING nova.compute.manager [req-35ea89b0-6e0f-4bea-bc35-b8b3866225b8 req-5196d974-6142-4bc7-8eac-ae0c24976e3d service nova] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Received unexpected event network-vif-plugged-0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1 for instance with vm_state rescued and task_state unrescuing.
Nov 15 00:22:09 user nova-compute[75341]: DEBUG nova.compute.manager [req-35ea89b0-6e0f-4bea-bc35-b8b3866225b8 req-5196d974-6142-4bc7-8eac-ae0c24976e3d service nova] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Received event network-vif-unplugged-0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:22:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-35ea89b0-6e0f-4bea-bc35-b8b3866225b8 req-5196d974-6142-4bc7-8eac-ae0c24976e3d service nova] Acquiring lock "8712f776-9a39-432c-814b-0ced1f51f15b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:22:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-35ea89b0-6e0f-4bea-bc35-b8b3866225b8 req-5196d974-6142-4bc7-8eac-ae0c24976e3d service nova] Lock "8712f776-9a39-432c-814b-0ced1f51f15b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:22:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-35ea89b0-6e0f-4bea-bc35-b8b3866225b8 req-5196d974-6142-4bc7-8eac-ae0c24976e3d service nova] Lock "8712f776-9a39-432c-814b-0ced1f51f15b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:22:09 user nova-compute[75341]: DEBUG nova.compute.manager [req-35ea89b0-6e0f-4bea-bc35-b8b3866225b8 req-5196d974-6142-4bc7-8eac-ae0c24976e3d service nova] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] No waiting events found dispatching network-vif-unplugged-0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:22:09 user nova-compute[75341]: WARNING nova.compute.manager [req-35ea89b0-6e0f-4bea-bc35-b8b3866225b8 req-5196d974-6142-4bc7-8eac-ae0c24976e3d service nova] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Received unexpected event network-vif-unplugged-0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1 for instance with vm_state rescued and task_state unrescuing.
Nov 15 00:22:09 user nova-compute[75341]: DEBUG nova.compute.manager [req-35ea89b0-6e0f-4bea-bc35-b8b3866225b8 req-5196d974-6142-4bc7-8eac-ae0c24976e3d service nova] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Received event network-vif-plugged-0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:22:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-35ea89b0-6e0f-4bea-bc35-b8b3866225b8 req-5196d974-6142-4bc7-8eac-ae0c24976e3d service nova] Acquiring lock "8712f776-9a39-432c-814b-0ced1f51f15b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:22:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-35ea89b0-6e0f-4bea-bc35-b8b3866225b8 req-5196d974-6142-4bc7-8eac-ae0c24976e3d service nova] Lock "8712f776-9a39-432c-814b-0ced1f51f15b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:22:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-35ea89b0-6e0f-4bea-bc35-b8b3866225b8 req-5196d974-6142-4bc7-8eac-ae0c24976e3d service nova] Lock "8712f776-9a39-432c-814b-0ced1f51f15b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:22:09 user nova-compute[75341]: DEBUG nova.compute.manager [req-35ea89b0-6e0f-4bea-bc35-b8b3866225b8 req-5196d974-6142-4bc7-8eac-ae0c24976e3d service nova] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] No waiting events found dispatching network-vif-plugged-0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:22:09 user nova-compute[75341]: WARNING nova.compute.manager [req-35ea89b0-6e0f-4bea-bc35-b8b3866225b8 req-5196d974-6142-4bc7-8eac-ae0c24976e3d service nova] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Received unexpected event network-vif-plugged-0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1 for instance with vm_state rescued and task_state unrescuing.
Nov 15 00:22:09 user nova-compute[75341]: DEBUG nova.compute.manager [req-35ea89b0-6e0f-4bea-bc35-b8b3866225b8 req-5196d974-6142-4bc7-8eac-ae0c24976e3d service nova] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Received event network-vif-plugged-0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:22:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-35ea89b0-6e0f-4bea-bc35-b8b3866225b8 req-5196d974-6142-4bc7-8eac-ae0c24976e3d service nova] Acquiring lock "8712f776-9a39-432c-814b-0ced1f51f15b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:22:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-35ea89b0-6e0f-4bea-bc35-b8b3866225b8 req-5196d974-6142-4bc7-8eac-ae0c24976e3d service nova] Lock "8712f776-9a39-432c-814b-0ced1f51f15b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:22:09 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-35ea89b0-6e0f-4bea-bc35-b8b3866225b8 req-5196d974-6142-4bc7-8eac-ae0c24976e3d service nova] Lock "8712f776-9a39-432c-814b-0ced1f51f15b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:22:09 user nova-compute[75341]: DEBUG nova.compute.manager [req-35ea89b0-6e0f-4bea-bc35-b8b3866225b8 req-5196d974-6142-4bc7-8eac-ae0c24976e3d service nova] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] No waiting events found dispatching network-vif-plugged-0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:22:09 user nova-compute[75341]: WARNING nova.compute.manager [req-35ea89b0-6e0f-4bea-bc35-b8b3866225b8 req-5196d974-6142-4bc7-8eac-ae0c24976e3d service nova] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Received unexpected event network-vif-plugged-0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1 for instance with vm_state rescued and task_state unrescuing.
Nov 15 00:22:10 user nova-compute[75341]: DEBUG nova.compute.manager [None req-8aa70034-44d4-45d5-a069-c70709e38b88 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 00:22:11 user nova-compute[75341]: DEBUG nova.compute.manager [req-5d45bbc4-1bdc-4308-bdba-4bd5d3e64509 req-3c7304e8-5d71-4216-beb8-2c8afe0e59e9 service nova] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Received event network-vif-plugged-0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:22:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-5d45bbc4-1bdc-4308-bdba-4bd5d3e64509 req-3c7304e8-5d71-4216-beb8-2c8afe0e59e9 service nova] Acquiring lock "8712f776-9a39-432c-814b-0ced1f51f15b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:22:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-5d45bbc4-1bdc-4308-bdba-4bd5d3e64509 req-3c7304e8-5d71-4216-beb8-2c8afe0e59e9 service nova] Lock "8712f776-9a39-432c-814b-0ced1f51f15b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:22:11 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-5d45bbc4-1bdc-4308-bdba-4bd5d3e64509 req-3c7304e8-5d71-4216-beb8-2c8afe0e59e9 service nova] Lock "8712f776-9a39-432c-814b-0ced1f51f15b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:22:11 user nova-compute[75341]: DEBUG nova.compute.manager [req-5d45bbc4-1bdc-4308-bdba-4bd5d3e64509 req-3c7304e8-5d71-4216-beb8-2c8afe0e59e9 service nova] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] No waiting events found dispatching network-vif-plugged-0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:22:11 user nova-compute[75341]: WARNING nova.compute.manager [req-5d45bbc4-1bdc-4308-bdba-4bd5d3e64509 req-3c7304e8-5d71-4216-beb8-2c8afe0e59e9 service nova] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Received unexpected event network-vif-plugged-0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1 for instance with vm_state active and task_state None.
Nov 15 00:22:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:22:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:22:16 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:22:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:22:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:22:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:22:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:22:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:22:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:22:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:22:23 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:22:23 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75341) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 00:22:25 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:22:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:22:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:22:27 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:22:30 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:22:30 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:22:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:22:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:22:32 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:22:32 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:22:32 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Starting heal instance info cache {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 00:22:33 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "refresh_cache-b4dbe374-f603-4970-be0c-473ccc467e49" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:22:33 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquired lock "refresh_cache-b4dbe374-f603-4970-be0c-473ccc467e49" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:22:33 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] Forcefully refreshing network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 00:22:33 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] Updating instance_info_cache with network_info: [{"id": "92b4fa25-bd9f-40bb-b7a4-d153db0a1857", "address": "fa:16:3e:94:44:86", "network": {"id": "aed56292-815e-4004-9101-59ff735cf236", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cde913b393e4b1095ae6e8e4a74b5fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92b4fa25-bd", "ovs_interfaceid": "92b4fa25-bd9f-40bb-b7a4-d153db0a1857", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:22:33 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Releasing lock "refresh_cache-b4dbe374-f603-4970-be0c-473ccc467e49" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:22:33 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] Updated the network info_cache for instance {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 00:22:33 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:22:33 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:22:33 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:22:33 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:22:33 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75341) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 00:22:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4dbe374-f603-4970-be0c-473ccc467e49/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:22:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4dbe374-f603-4970-be0c-473ccc467e49/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:22:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4dbe374-f603-4970-be0c-473ccc467e49/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:22:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4dbe374-f603-4970-be0c-473ccc467e49/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:22:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:22:34 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:22:34 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:22:34 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:22:34 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 00:22:34 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 00:22:34 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:22:34 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:22:34 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Hypervisor/Node resource view: name=user free_ram=8748MB free_disk=25.071636199951172GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75341) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 00:22:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:22:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:22:34 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance c332ad29-e892-4caf-aa37-fd66fb41f9ec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:22:34 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 5a57dc05-73fa-45a8-98d9-c355f2f35d17 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:22:34 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance b4dbe374-f603-4970-be0c-473ccc467e49 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:22:34 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 8712f776-9a39-432c-814b-0ced1f51f15b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:22:34 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 00:22:34 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 00:22:35 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 00:22:35 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 00:22:35 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Compute_service record updated for user:user {{(pid=75341) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 00:22:35 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.296s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:22:37 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:22:37 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:22:42 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:22:42 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:22:46 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:22:47 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:22:47 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:22:47 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:22:47 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:22:47 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:22:47 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:22:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:22:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:22:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:22:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:22:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:22:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:22:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:23:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:23:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:23:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:23:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:23:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:23:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:23:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:23:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:23:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:23:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:23:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:23:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:23:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:23:16 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:23:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:23:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:23:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:23:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:23:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:23:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:23:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:23:25 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:23:25 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75341) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 00:23:26 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:23:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:23:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:23:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:23:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:23:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:23:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:23:28 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:23:30 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:23:30 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:23:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:23:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:23:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:23:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:23:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:23:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:23:32 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:23:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:23:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:23:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:23:32 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75341) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 00:23:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4dbe374-f603-4970-be0c-473ccc467e49/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:23:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4dbe374-f603-4970-be0c-473ccc467e49/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:23:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4dbe374-f603-4970-be0c-473ccc467e49/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:23:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4dbe374-f603-4970-be0c-473ccc467e49/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:23:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:23:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:23:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:23:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:23:33 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 00:23:33 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 00:23:34 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:23:34 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:23:34 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Hypervisor/Node resource view: name=user free_ram=8834MB free_disk=25.071075439453125GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75341) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 00:23:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:23:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:23:34 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance c332ad29-e892-4caf-aa37-fd66fb41f9ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:23:34 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 5a57dc05-73fa-45a8-98d9-c355f2f35d17 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:23:34 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance b4dbe374-f603-4970-be0c-473ccc467e49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:23:34 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 8712f776-9a39-432c-814b-0ced1f51f15b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:23:34 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 00:23:34 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 00:23:34 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 00:23:34 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 00:23:34 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Compute_service record updated for user:user {{(pid=75341) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 00:23:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.247s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:23:36 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:23:36 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:23:36 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Starting heal instance info cache {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 00:23:36 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "refresh_cache-8712f776-9a39-432c-814b-0ced1f51f15b" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:23:36 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquired lock "refresh_cache-8712f776-9a39-432c-814b-0ced1f51f15b" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:23:36 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Forcefully refreshing network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 00:23:36 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Updating instance_info_cache with network_info: [{"id": "0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1", "address": "fa:16:3e:53:d2:59", "network": {"id": "aed56292-815e-4004-9101-59ff735cf236", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cde913b393e4b1095ae6e8e4a74b5fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0beb622d-8d", "ovs_interfaceid": "0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:23:36 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Releasing lock "refresh_cache-8712f776-9a39-432c-814b-0ced1f51f15b" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:23:36 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Updated the network info_cache for instance {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 00:23:37 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:23:42 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:23:42 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:23:42 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:23:42 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:23:42 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:23:42 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:23:47 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:23:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:23:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:23:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:23:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:23:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:23:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:23:56 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8a976fb0-b797-4076-a83f-d1117af47b2f tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Acquiring lock "8712f776-9a39-432c-814b-0ced1f51f15b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:23:56 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8a976fb0-b797-4076-a83f-d1117af47b2f tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "8712f776-9a39-432c-814b-0ced1f51f15b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:23:56 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8a976fb0-b797-4076-a83f-d1117af47b2f tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Acquiring lock "8712f776-9a39-432c-814b-0ced1f51f15b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:23:56 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8a976fb0-b797-4076-a83f-d1117af47b2f tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "8712f776-9a39-432c-814b-0ced1f51f15b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:23:56 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8a976fb0-b797-4076-a83f-d1117af47b2f tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "8712f776-9a39-432c-814b-0ced1f51f15b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:23:56 user nova-compute[75341]: INFO nova.compute.manager [None req-8a976fb0-b797-4076-a83f-d1117af47b2f tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Terminating instance
Nov 15 00:23:56 user nova-compute[75341]: DEBUG nova.compute.manager [None req-8a976fb0-b797-4076-a83f-d1117af47b2f tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Start destroying the instance on the hypervisor. {{(pid=75341) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 00:23:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:23:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG nova.compute.manager [req-92141537-6bb3-4509-9807-c804604dc1fa req-40cf50c5-4ccd-42ca-94c9-7b5d3e174ce7 service nova] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Received event network-vif-unplugged-0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-92141537-6bb3-4509-9807-c804604dc1fa req-40cf50c5-4ccd-42ca-94c9-7b5d3e174ce7 service nova] Acquiring lock "8712f776-9a39-432c-814b-0ced1f51f15b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-92141537-6bb3-4509-9807-c804604dc1fa req-40cf50c5-4ccd-42ca-94c9-7b5d3e174ce7 service nova] Lock "8712f776-9a39-432c-814b-0ced1f51f15b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-92141537-6bb3-4509-9807-c804604dc1fa req-40cf50c5-4ccd-42ca-94c9-7b5d3e174ce7 service nova] Lock "8712f776-9a39-432c-814b-0ced1f51f15b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG nova.compute.manager [req-92141537-6bb3-4509-9807-c804604dc1fa req-40cf50c5-4ccd-42ca-94c9-7b5d3e174ce7 service nova] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] No waiting events found dispatching network-vif-unplugged-0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG nova.compute.manager [req-92141537-6bb3-4509-9807-c804604dc1fa req-40cf50c5-4ccd-42ca-94c9-7b5d3e174ce7 service nova] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Received event network-vif-unplugged-0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1 for instance with task_state deleting. {{(pid=75341) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:23:57 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Instance destroyed successfully.
Nov 15 00:23:57 user nova-compute[75341]: DEBUG nova.objects.instance [None req-8a976fb0-b797-4076-a83f-d1117af47b2f tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lazy-loading 'resources' on Instance uuid 8712f776-9a39-432c-814b-0ced1f51f15b {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-8a976fb0-b797-4076-a83f-d1117af47b2f tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T00:18:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-779236539',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-779236539',id=50,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T00:20:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5cde913b393e4b1095ae6e8e4a74b5fb',ramdisk_id='',reservation_id='r-pg4m6ojg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1181444554',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T00:22:11Z,user_data=None,user_id='abb41e7d020d4c99a55b5029cd2124a9',uuid=8712f776-9a39-432c-814b-0ced1f51f15b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1", "address": "fa:16:3e:53:d2:59", "network": {"id": "aed56292-815e-4004-9101-59ff735cf236", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cde913b393e4b1095ae6e8e4a74b5fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0beb622d-8d", "ovs_interfaceid": "0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-8a976fb0-b797-4076-a83f-d1117af47b2f tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Converting VIF {"id": "0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1", "address": "fa:16:3e:53:d2:59", "network": {"id": "aed56292-815e-4004-9101-59ff735cf236", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cde913b393e4b1095ae6e8e4a74b5fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0beb622d-8d", "ovs_interfaceid": "0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-8a976fb0-b797-4076-a83f-d1117af47b2f tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:d2:59,bridge_name='br-int',has_traffic_filtering=True,id=0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1,network=Network(aed56292-815e-4004-9101-59ff735cf236),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0beb622d-8d') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG os_vif [None req-8a976fb0-b797-4076-a83f-d1117af47b2f tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:d2:59,bridge_name='br-int',has_traffic_filtering=True,id=0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1,network=Network(aed56292-815e-4004-9101-59ff735cf236),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0beb622d-8d') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0beb622d-8d, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=49660dbc-cfce-4d5d-abcb-67fba8bd87eb) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:23:57 user nova-compute[75341]: INFO os_vif [None req-8a976fb0-b797-4076-a83f-d1117af47b2f tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:d2:59,bridge_name='br-int',has_traffic_filtering=True,id=0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1,network=Network(aed56292-815e-4004-9101-59ff735cf236),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0beb622d-8d')
Nov 15 00:23:57 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a976fb0-b797-4076-a83f-d1117af47b2f tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] calling os-brick to detach iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a976fb0-b797-4076-a83f-d1117af47b2f tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, {'target_iqn': 'iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dOWXjHIQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 00:23:57 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-8a976fb0-b797-4076-a83f-d1117af47b2f tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 00:23:57 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-8a976fb0-b797-4076-a83f-d1117af47b2f tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-8a976fb0-b797-4076-a83f-d1117af47b2f tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[7edfce6f-bba9-4306-b538-478c321811a1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a976fb0-b797-4076-a83f-d1117af47b2f tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 00:23:57 user nova-compute[75341]: No targets found.
Nov 15 00:23:57 user nova-compute[75341]: iSNS:
Nov 15 00:23:57 user nova-compute[75341]: No targets found.
Nov 15 00:23:57 user nova-compute[75341]: STATIC:
Nov 15 00:23:57 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e
Nov 15 00:23:57 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 15 00:23:57 user nova-compute[75341]:                 Iface Name: default
Nov 15 00:23:57 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277
Nov 15 00:23:57 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 15 00:23:57 user nova-compute[75341]:                 Iface Name: default
Nov 15 00:23:57 user nova-compute[75341]: FIRMWARE:
Nov 15 00:23:57 user nova-compute[75341]: No targets found.
Nov 15 00:23:57 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a976fb0-b797-4076-a83f-d1117af47b2f tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 00:23:57 user nova-compute[75341]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 00:23:57 user nova-compute[75341]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75341) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a976fb0-b797-4076-a83f-d1117af47b2f tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277', 0)] {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[f534b6ea-00d5-4227-ad14-88a1f4ca4f4d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7cd370-3f56-4f6b-ac36-b09ca7575cb2]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a976fb0-b797-4076-a83f-d1117af47b2f tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e (non-flash)
Nov 15 00:23:57 user nova-compute[75341]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277 (non-flash)
Nov 15 00:23:57 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a976fb0-b797-4076-a83f-d1117af47b2f tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e (non-flash)
Nov 15 00:23:57 user nova-compute[75341]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277 (non-flash)
Nov 15 00:23:57 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a976fb0-b797-4076-a83f-d1117af47b2f tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f185072f130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277'): ({'sdc'}, set())}) {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-8a976fb0-b797-4076-a83f-d1117af47b2f tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Removing single pathed devices sdc {{(pid=75341) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0f8b06-0de9-44ad-95e0-a4e846219b72]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1a13c8-2cd7-4c6f-a016-8956620b0245]: (4, ('ok\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-8a976fb0-b797-4076-a83f-d1117af47b2f tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Flushing IO for device /dev/sdc {{(pid=75341) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7daf22-2d98-4291-aff2-a1e1575687c8]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-8a976fb0-b797-4076-a83f-d1117af47b2f tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75341) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0582a2d-7f50-4c61-b4cf-e9fec5ce3bc0]: (4, ('1', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-8a976fb0-b797-4076-a83f-d1117af47b2f tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-8a976fb0-b797-4076-a83f-d1117af47b2f tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] SCSI volumes sdc have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23034376564633232', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_e9e08ab7', '/dev/disk/by-id/scsi-1SCST_BIOe9e08ab7-047edc22fd0171a7') {{(pid=86063) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f17898-3ae8-4831-a50e-eb70f1f6fcbd]: (4, None) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a976fb0-b797-4076-a83f-d1117af47b2f tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277')] {{(pid=75341) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ea79c2-b89d-45df-b0ce-d1f88a282d86]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a976fb0-b797-4076-a83f-d1117af47b2f tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277 -p 172.16.0.220:3260 --logout {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee05686c-ce88-44d2-a5a5-4303db2b9fe2]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a976fb0-b797-4076-a83f-d1117af47b2f tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277, portal: 172.16.0.220,3260]
Nov 15 00:23:57 user nova-compute[75341]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277, portal: 172.16.0.220,3260] successful.
Nov 15 00:23:57 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277 -p 172.16.0.220:3260 --op delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285b4532-a4ca-4c05-8697-54877e819277 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[5baabf79-d678-489c-968c-7920fc2473f7]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a976fb0-b797-4076-a83f-d1117af47b2f tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-8a976fb0-b797-4076-a83f-d1117af47b2f tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a976fb0-b797-4076-a83f-d1117af47b2f tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] <== disconnect_volume: return (308ms) None {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 00:23:57 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a976fb0-b797-4076-a83f-d1117af47b2f tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Disconnected iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 00:23:57 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-8a976fb0-b797-4076-a83f-d1117af47b2f tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Deleting instance files /opt/stack/data/nova/instances/8712f776-9a39-432c-814b-0ced1f51f15b_del
Nov 15 00:23:57 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-8a976fb0-b797-4076-a83f-d1117af47b2f tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Deletion of /opt/stack/data/nova/instances/8712f776-9a39-432c-814b-0ced1f51f15b_del complete
Nov 15 00:23:58 user nova-compute[75341]: INFO nova.compute.manager [None req-8a976fb0-b797-4076-a83f-d1117af47b2f tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 15 00:23:58 user nova-compute[75341]: DEBUG oslo.service.loopingcall [None req-8a976fb0-b797-4076-a83f-d1117af47b2f tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75341) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 00:23:58 user nova-compute[75341]: DEBUG nova.compute.manager [-] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Deallocating network for instance {{(pid=75341) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 00:23:58 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] deallocate_for_instance() {{(pid=75341) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 00:23:58 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:23:58 user nova-compute[75341]: INFO nova.compute.manager [-] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Took 0.46 seconds to deallocate network for instance.
Nov 15 00:23:59 user nova-compute[75341]: DEBUG nova.compute.manager [req-2cb5384d-2b73-4568-8e48-f87618938db8 req-939e57f1-ac05-409e-bafb-af78b874ae5f service nova] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Received event network-vif-plugged-0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:23:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-2cb5384d-2b73-4568-8e48-f87618938db8 req-939e57f1-ac05-409e-bafb-af78b874ae5f service nova] Acquiring lock "8712f776-9a39-432c-814b-0ced1f51f15b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:23:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-2cb5384d-2b73-4568-8e48-f87618938db8 req-939e57f1-ac05-409e-bafb-af78b874ae5f service nova] Lock "8712f776-9a39-432c-814b-0ced1f51f15b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:23:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-2cb5384d-2b73-4568-8e48-f87618938db8 req-939e57f1-ac05-409e-bafb-af78b874ae5f service nova] Lock "8712f776-9a39-432c-814b-0ced1f51f15b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:23:59 user nova-compute[75341]: DEBUG nova.compute.manager [req-2cb5384d-2b73-4568-8e48-f87618938db8 req-939e57f1-ac05-409e-bafb-af78b874ae5f service nova] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] No waiting events found dispatching network-vif-plugged-0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:23:59 user nova-compute[75341]: WARNING nova.compute.manager [req-2cb5384d-2b73-4568-8e48-f87618938db8 req-939e57f1-ac05-409e-bafb-af78b874ae5f service nova] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Received unexpected event network-vif-plugged-0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1 for instance with vm_state active and task_state deleting.
Nov 15 00:23:59 user nova-compute[75341]: DEBUG nova.compute.manager [req-2cb5384d-2b73-4568-8e48-f87618938db8 req-939e57f1-ac05-409e-bafb-af78b874ae5f service nova] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Received event network-vif-deleted-0beb622d-8dc2-4bbe-ba3f-b7443a68d0f1 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:23:59 user nova-compute[75341]: INFO nova.compute.manager [None req-8a976fb0-b797-4076-a83f-d1117af47b2f tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 8712f776-9a39-432c-814b-0ced1f51f15b] Took 0.75 seconds to detach 1 volumes for instance.
Nov 15 00:23:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8a976fb0-b797-4076-a83f-d1117af47b2f tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:23:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8a976fb0-b797-4076-a83f-d1117af47b2f tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:23:59 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-8a976fb0-b797-4076-a83f-d1117af47b2f tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 00:23:59 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-8a976fb0-b797-4076-a83f-d1117af47b2f tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 00:23:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8a976fb0-b797-4076-a83f-d1117af47b2f tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.178s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:23:59 user nova-compute[75341]: INFO nova.scheduler.client.report [None req-8a976fb0-b797-4076-a83f-d1117af47b2f tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Deleted allocations for instance 8712f776-9a39-432c-814b-0ced1f51f15b
Nov 15 00:23:59 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-8a976fb0-b797-4076-a83f-d1117af47b2f tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "8712f776-9a39-432c-814b-0ced1f51f15b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.762s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:24:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:24:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:24:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:24:16 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:24:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:24:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:24:25 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:24:25 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75341) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 00:24:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:24:28 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:24:28 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:24:31 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:24:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:24:32 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:24:32 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:24:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:24:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:24:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:24:32 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75341) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 00:24:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4dbe374-f603-4970-be0c-473ccc467e49/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:24:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4dbe374-f603-4970-be0c-473ccc467e49/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:24:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4dbe374-f603-4970-be0c-473ccc467e49/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:24:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4dbe374-f603-4970-be0c-473ccc467e49/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:24:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:24:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:24:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:24:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:24:33 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 00:24:34 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:24:34 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:24:34 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Hypervisor/Node resource view: name=user free_ram=8893MB free_disk=25.07028579711914GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75341) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 00:24:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:24:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:24:34 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance c332ad29-e892-4caf-aa37-fd66fb41f9ec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:24:34 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 5a57dc05-73fa-45a8-98d9-c355f2f35d17 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:24:34 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance b4dbe374-f603-4970-be0c-473ccc467e49 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:24:34 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 00:24:34 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 00:24:34 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 00:24:34 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 00:24:34 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Compute_service record updated for user:user {{(pid=75341) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 00:24:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.228s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:24:36 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:24:36 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:24:36 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Starting heal instance info cache {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 00:24:36 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Rebuilding the list of instances to heal {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 00:24:36 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "refresh_cache-c332ad29-e892-4caf-aa37-fd66fb41f9ec" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:24:36 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquired lock "refresh_cache-c332ad29-e892-4caf-aa37-fd66fb41f9ec" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:24:36 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Forcefully refreshing network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 00:24:36 user nova-compute[75341]: DEBUG nova.objects.instance [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lazy-loading 'info_cache' on Instance uuid c332ad29-e892-4caf-aa37-fd66fb41f9ec {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:24:37 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Updating instance_info_cache with network_info: [{"id": "9f65f96b-aa09-4c3a-a23b-ed444c9dacec", "address": "fa:16:3e:c6:2e:8d", "network": {"id": "aed56292-815e-4004-9101-59ff735cf236", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cde913b393e4b1095ae6e8e4a74b5fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f65f96b-aa", "ovs_interfaceid": "9f65f96b-aa09-4c3a-a23b-ed444c9dacec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:24:37 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Releasing lock "refresh_cache-c332ad29-e892-4caf-aa37-fd66fb41f9ec" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:24:37 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Updated the network info_cache for instance {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 00:24:37 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:24:42 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:24:42 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:24:42 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:24:42 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:24:42 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:24:42 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:24:47 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4996-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:24:47 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-5be89c61-98e7-48b4-a234-a30136bbbf8c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Acquiring lock "b4dbe374-f603-4970-be0c-473ccc467e49" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:24:47 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-5be89c61-98e7-48b4-a234-a30136bbbf8c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "b4dbe374-f603-4970-be0c-473ccc467e49" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:24:47 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-5be89c61-98e7-48b4-a234-a30136bbbf8c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Acquiring lock "b4dbe374-f603-4970-be0c-473ccc467e49-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:24:47 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-5be89c61-98e7-48b4-a234-a30136bbbf8c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "b4dbe374-f603-4970-be0c-473ccc467e49-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:24:47 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-5be89c61-98e7-48b4-a234-a30136bbbf8c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "b4dbe374-f603-4970-be0c-473ccc467e49-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:24:47 user nova-compute[75341]: INFO nova.compute.manager [None req-5be89c61-98e7-48b4-a234-a30136bbbf8c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] Terminating instance
Nov 15 00:24:47 user nova-compute[75341]: DEBUG nova.compute.manager [None req-5be89c61-98e7-48b4-a234-a30136bbbf8c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] Start destroying the instance on the hypervisor. {{(pid=75341) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 00:24:47 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:24:47 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:24:48 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:24:48 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:24:48 user nova-compute[75341]: DEBUG nova.compute.manager [req-caef2266-fa4e-4997-bbcf-a97343f2f428 req-d450c9af-7fec-4bfe-b289-e092ec7d2206 service nova] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] Received event network-vif-unplugged-92b4fa25-bd9f-40bb-b7a4-d153db0a1857 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:24:48 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-caef2266-fa4e-4997-bbcf-a97343f2f428 req-d450c9af-7fec-4bfe-b289-e092ec7d2206 service nova] Acquiring lock "b4dbe374-f603-4970-be0c-473ccc467e49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:24:48 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-caef2266-fa4e-4997-bbcf-a97343f2f428 req-d450c9af-7fec-4bfe-b289-e092ec7d2206 service nova] Lock "b4dbe374-f603-4970-be0c-473ccc467e49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:24:48 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-caef2266-fa4e-4997-bbcf-a97343f2f428 req-d450c9af-7fec-4bfe-b289-e092ec7d2206 service nova] Lock "b4dbe374-f603-4970-be0c-473ccc467e49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:24:48 user nova-compute[75341]: DEBUG nova.compute.manager [req-caef2266-fa4e-4997-bbcf-a97343f2f428 req-d450c9af-7fec-4bfe-b289-e092ec7d2206 service nova] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] No waiting events found dispatching network-vif-unplugged-92b4fa25-bd9f-40bb-b7a4-d153db0a1857 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:24:48 user nova-compute[75341]: DEBUG nova.compute.manager [req-caef2266-fa4e-4997-bbcf-a97343f2f428 req-d450c9af-7fec-4bfe-b289-e092ec7d2206 service nova] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] Received event network-vif-unplugged-92b4fa25-bd9f-40bb-b7a4-d153db0a1857 for instance with task_state deleting. {{(pid=75341) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 00:24:48 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:24:48 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] Instance destroyed successfully.
Nov 15 00:24:48 user nova-compute[75341]: DEBUG nova.objects.instance [None req-5be89c61-98e7-48b4-a234-a30136bbbf8c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lazy-loading 'resources' on Instance uuid b4dbe374-f603-4970-be0c-473ccc467e49 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:24:48 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-5be89c61-98e7-48b4-a234-a30136bbbf8c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T00:15:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-410137495',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-410137495',id=49,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T00:15:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5cde913b393e4b1095ae6e8e4a74b5fb',ramdisk_id='',reservation_id='r-avsccmp0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1181444554',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T00:17:22Z,user_data=None,user_id='abb41e7d020d4c99a55b5029cd2124a9',uuid=b4dbe374-f603-4970-be0c-473ccc467e49,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "92b4fa25-bd9f-40bb-b7a4-d153db0a1857", "address": "fa:16:3e:94:44:86", "network": {"id": "aed56292-815e-4004-9101-59ff735cf236", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cde913b393e4b1095ae6e8e4a74b5fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92b4fa25-bd", "ovs_interfaceid": "92b4fa25-bd9f-40bb-b7a4-d153db0a1857", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 00:24:48 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-5be89c61-98e7-48b4-a234-a30136bbbf8c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Converting VIF {"id": "92b4fa25-bd9f-40bb-b7a4-d153db0a1857", "address": "fa:16:3e:94:44:86", "network": {"id": "aed56292-815e-4004-9101-59ff735cf236", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cde913b393e4b1095ae6e8e4a74b5fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92b4fa25-bd", "ovs_interfaceid": "92b4fa25-bd9f-40bb-b7a4-d153db0a1857", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 00:24:48 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-5be89c61-98e7-48b4-a234-a30136bbbf8c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:94:44:86,bridge_name='br-int',has_traffic_filtering=True,id=92b4fa25-bd9f-40bb-b7a4-d153db0a1857,network=Network(aed56292-815e-4004-9101-59ff735cf236),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92b4fa25-bd') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 00:24:48 user nova-compute[75341]: DEBUG os_vif [None req-5be89c61-98e7-48b4-a234-a30136bbbf8c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:44:86,bridge_name='br-int',has_traffic_filtering=True,id=92b4fa25-bd9f-40bb-b7a4-d153db0a1857,network=Network(aed56292-815e-4004-9101-59ff735cf236),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92b4fa25-bd') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 00:24:48 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:24:48 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap92b4fa25-bd, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:24:48 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:24:48 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:24:48 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:24:48 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=90fb9b82-613b-46a0-8b29-c39cbb94564f) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:24:48 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:24:48 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:24:48 user nova-compute[75341]: INFO os_vif [None req-5be89c61-98e7-48b4-a234-a30136bbbf8c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:44:86,bridge_name='br-int',has_traffic_filtering=True,id=92b4fa25-bd9f-40bb-b7a4-d153db0a1857,network=Network(aed56292-815e-4004-9101-59ff735cf236),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92b4fa25-bd')
Nov 15 00:24:48 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-5be89c61-98e7-48b4-a234-a30136bbbf8c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] Deleting instance files /opt/stack/data/nova/instances/b4dbe374-f603-4970-be0c-473ccc467e49_del
Nov 15 00:24:48 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-5be89c61-98e7-48b4-a234-a30136bbbf8c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] Deletion of /opt/stack/data/nova/instances/b4dbe374-f603-4970-be0c-473ccc467e49_del complete
Nov 15 00:24:48 user nova-compute[75341]: INFO nova.compute.manager [None req-5be89c61-98e7-48b4-a234-a30136bbbf8c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] Took 0.68 seconds to destroy the instance on the hypervisor.
Nov 15 00:24:48 user nova-compute[75341]: DEBUG oslo.service.loopingcall [None req-5be89c61-98e7-48b4-a234-a30136bbbf8c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75341) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 00:24:48 user nova-compute[75341]: DEBUG nova.compute.manager [-] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] Deallocating network for instance {{(pid=75341) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 00:24:48 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] deallocate_for_instance() {{(pid=75341) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 00:24:48 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:24:48 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:24:48 user nova-compute[75341]: INFO nova.compute.manager [-] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] Took 0.40 seconds to deallocate network for instance.
Nov 15 00:24:48 user nova-compute[75341]: DEBUG nova.compute.manager [req-337bef5d-7d1e-441b-9984-b08a4a9f766a req-362f4011-56af-473f-b273-b4df93d59273 service nova] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] Received event network-vif-deleted-92b4fa25-bd9f-40bb-b7a4-d153db0a1857 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:24:48 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-5be89c61-98e7-48b4-a234-a30136bbbf8c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:24:48 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-5be89c61-98e7-48b4-a234-a30136bbbf8c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:24:49 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-5be89c61-98e7-48b4-a234-a30136bbbf8c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 00:24:49 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-5be89c61-98e7-48b4-a234-a30136bbbf8c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 00:24:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-5be89c61-98e7-48b4-a234-a30136bbbf8c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.154s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:24:49 user nova-compute[75341]: INFO nova.scheduler.client.report [None req-5be89c61-98e7-48b4-a234-a30136bbbf8c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Deleted allocations for instance b4dbe374-f603-4970-be0c-473ccc467e49
Nov 15 00:24:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-5be89c61-98e7-48b4-a234-a30136bbbf8c tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "b4dbe374-f603-4970-be0c-473ccc467e49" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.449s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:24:50 user nova-compute[75341]: DEBUG nova.compute.manager [req-05a187ac-5f26-4162-9ae2-ce3e82f2231b req-1cd9bb56-bfcb-4be0-a3f2-7aa43653daae service nova] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] Received event network-vif-plugged-92b4fa25-bd9f-40bb-b7a4-d153db0a1857 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:24:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-05a187ac-5f26-4162-9ae2-ce3e82f2231b req-1cd9bb56-bfcb-4be0-a3f2-7aa43653daae service nova] Acquiring lock "b4dbe374-f603-4970-be0c-473ccc467e49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:24:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-05a187ac-5f26-4162-9ae2-ce3e82f2231b req-1cd9bb56-bfcb-4be0-a3f2-7aa43653daae service nova] Lock "b4dbe374-f603-4970-be0c-473ccc467e49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:24:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-05a187ac-5f26-4162-9ae2-ce3e82f2231b req-1cd9bb56-bfcb-4be0-a3f2-7aa43653daae service nova] Lock "b4dbe374-f603-4970-be0c-473ccc467e49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:24:50 user nova-compute[75341]: DEBUG nova.compute.manager [req-05a187ac-5f26-4162-9ae2-ce3e82f2231b req-1cd9bb56-bfcb-4be0-a3f2-7aa43653daae service nova] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] No waiting events found dispatching network-vif-plugged-92b4fa25-bd9f-40bb-b7a4-d153db0a1857 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:24:50 user nova-compute[75341]: WARNING nova.compute.manager [req-05a187ac-5f26-4162-9ae2-ce3e82f2231b req-1cd9bb56-bfcb-4be0-a3f2-7aa43653daae service nova] [instance: b4dbe374-f603-4970-be0c-473ccc467e49] Received unexpected event network-vif-plugged-92b4fa25-bd9f-40bb-b7a4-d153db0a1857 for instance with vm_state deleted and task_state None.
Nov 15 00:24:53 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:24:58 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:25:03 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:25:08 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:25:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:25:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:25:18 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:25:23 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:25:27 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:25:27 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75341) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 00:25:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:25:28 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:25:29 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:25:31 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:25:32 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:25:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:25:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:25:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:25:32 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75341) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 00:25:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:25:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:25:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:25:33 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:25:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:25:33 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 00:25:33 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:25:33 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:25:33 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Hypervisor/Node resource view: name=user free_ram=8980MB free_disk=25.19487762451172GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75341) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 00:25:33 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:25:33 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:25:33 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance c332ad29-e892-4caf-aa37-fd66fb41f9ec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:25:33 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 5a57dc05-73fa-45a8-98d9-c355f2f35d17 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:25:33 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 00:25:33 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 00:25:34 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 00:25:34 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 00:25:34 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Compute_service record updated for user:user {{(pid=75341) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 00:25:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.231s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:25:36 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:25:36 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:25:36 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:25:36 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Starting heal instance info cache {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 00:25:37 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "refresh_cache-5a57dc05-73fa-45a8-98d9-c355f2f35d17" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:25:37 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquired lock "refresh_cache-5a57dc05-73fa-45a8-98d9-c355f2f35d17" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:25:37 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Forcefully refreshing network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 00:25:37 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Updating instance_info_cache with network_info: [{"id": "6b89e652-396c-42ad-9a1a-402e18e1a9f3", "address": "fa:16:3e:f1:b5:9c", "network": {"id": "aed56292-815e-4004-9101-59ff735cf236", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cde913b393e4b1095ae6e8e4a74b5fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b89e652-39", "ovs_interfaceid": "6b89e652-396c-42ad-9a1a-402e18e1a9f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:25:37 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Releasing lock "refresh_cache-5a57dc05-73fa-45a8-98d9-c355f2f35d17" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:25:37 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Updated the network info_cache for instance {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 00:25:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6b5ccf01-60cb-4262-a8e7-d125c19fc604 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Acquiring lock "5a57dc05-73fa-45a8-98d9-c355f2f35d17" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:25:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6b5ccf01-60cb-4262-a8e7-d125c19fc604 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "5a57dc05-73fa-45a8-98d9-c355f2f35d17" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:25:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6b5ccf01-60cb-4262-a8e7-d125c19fc604 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Acquiring lock "5a57dc05-73fa-45a8-98d9-c355f2f35d17-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:25:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6b5ccf01-60cb-4262-a8e7-d125c19fc604 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "5a57dc05-73fa-45a8-98d9-c355f2f35d17-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:25:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6b5ccf01-60cb-4262-a8e7-d125c19fc604 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "5a57dc05-73fa-45a8-98d9-c355f2f35d17-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:25:38 user nova-compute[75341]: INFO nova.compute.manager [None req-6b5ccf01-60cb-4262-a8e7-d125c19fc604 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Terminating instance
Nov 15 00:25:38 user nova-compute[75341]: DEBUG nova.compute.manager [None req-6b5ccf01-60cb-4262-a8e7-d125c19fc604 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Start destroying the instance on the hypervisor. {{(pid=75341) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 00:25:38 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:25:38 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:25:38 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:25:38 user nova-compute[75341]: DEBUG nova.compute.manager [req-487bf025-590c-497e-9c93-203c9b58d7fd req-806d3ce9-c4b4-45f5-8ed3-baa7d1847308 service nova] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Received event network-vif-unplugged-6b89e652-396c-42ad-9a1a-402e18e1a9f3 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:25:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-487bf025-590c-497e-9c93-203c9b58d7fd req-806d3ce9-c4b4-45f5-8ed3-baa7d1847308 service nova] Acquiring lock "5a57dc05-73fa-45a8-98d9-c355f2f35d17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:25:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-487bf025-590c-497e-9c93-203c9b58d7fd req-806d3ce9-c4b4-45f5-8ed3-baa7d1847308 service nova] Lock "5a57dc05-73fa-45a8-98d9-c355f2f35d17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:25:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-487bf025-590c-497e-9c93-203c9b58d7fd req-806d3ce9-c4b4-45f5-8ed3-baa7d1847308 service nova] Lock "5a57dc05-73fa-45a8-98d9-c355f2f35d17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:25:38 user nova-compute[75341]: DEBUG nova.compute.manager [req-487bf025-590c-497e-9c93-203c9b58d7fd req-806d3ce9-c4b4-45f5-8ed3-baa7d1847308 service nova] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] No waiting events found dispatching network-vif-unplugged-6b89e652-396c-42ad-9a1a-402e18e1a9f3 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:25:38 user nova-compute[75341]: DEBUG nova.compute.manager [req-487bf025-590c-497e-9c93-203c9b58d7fd req-806d3ce9-c4b4-45f5-8ed3-baa7d1847308 service nova] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Received event network-vif-unplugged-6b89e652-396c-42ad-9a1a-402e18e1a9f3 for instance with task_state deleting. {{(pid=75341) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 00:25:38 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:25:38 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:25:38 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:25:38 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:25:39 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Instance destroyed successfully.
Nov 15 00:25:39 user nova-compute[75341]: DEBUG nova.objects.instance [None req-6b5ccf01-60cb-4262-a8e7-d125c19fc604 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lazy-loading 'resources' on Instance uuid 5a57dc05-73fa-45a8-98d9-c355f2f35d17 {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-6b5ccf01-60cb-4262-a8e7-d125c19fc604 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T00:09:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-771342845',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-771342845',id=48,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T00:11:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5cde913b393e4b1095ae6e8e4a74b5fb',ramdisk_id='',reservation_id='r-h0zbeakv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1181444554',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T00:13:38Z,user_data=None,user_id='abb41e7d020d4c99a55b5029cd2124a9',uuid=5a57dc05-73fa-45a8-98d9-c355f2f35d17,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6b89e652-396c-42ad-9a1a-402e18e1a9f3", "address": "fa:16:3e:f1:b5:9c", "network": {"id": "aed56292-815e-4004-9101-59ff735cf236", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cde913b393e4b1095ae6e8e4a74b5fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b89e652-39", "ovs_interfaceid": "6b89e652-396c-42ad-9a1a-402e18e1a9f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-6b5ccf01-60cb-4262-a8e7-d125c19fc604 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Converting VIF {"id": "6b89e652-396c-42ad-9a1a-402e18e1a9f3", "address": "fa:16:3e:f1:b5:9c", "network": {"id": "aed56292-815e-4004-9101-59ff735cf236", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cde913b393e4b1095ae6e8e4a74b5fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b89e652-39", "ovs_interfaceid": "6b89e652-396c-42ad-9a1a-402e18e1a9f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-6b5ccf01-60cb-4262-a8e7-d125c19fc604 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:b5:9c,bridge_name='br-int',has_traffic_filtering=True,id=6b89e652-396c-42ad-9a1a-402e18e1a9f3,network=Network(aed56292-815e-4004-9101-59ff735cf236),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b89e652-39') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG os_vif [None req-6b5ccf01-60cb-4262-a8e7-d125c19fc604 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:b5:9c,bridge_name='br-int',has_traffic_filtering=True,id=6b89e652-396c-42ad-9a1a-402e18e1a9f3,network=Network(aed56292-815e-4004-9101-59ff735cf236),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b89e652-39') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6b89e652-39, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7e066a86-c4b1-4f7d-a58f-8b6ce33f08aa) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:25:39 user nova-compute[75341]: INFO os_vif [None req-6b5ccf01-60cb-4262-a8e7-d125c19fc604 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:b5:9c,bridge_name='br-int',has_traffic_filtering=True,id=6b89e652-396c-42ad-9a1a-402e18e1a9f3,network=Network(aed56292-815e-4004-9101-59ff735cf236),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b89e652-39')
Nov 15 00:25:39 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b5ccf01-60cb-4262-a8e7-d125c19fc604 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] calling os-brick to detach iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b5ccf01-60cb-4262-a8e7-d125c19fc604 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, {'target_iqn': 'iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sFmYiKyv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 00:25:39 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-6b5ccf01-60cb-4262-a8e7-d125c19fc604 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 00:25:39 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-6b5ccf01-60cb-4262-a8e7-d125c19fc604 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-6b5ccf01-60cb-4262-a8e7-d125c19fc604 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67dc114-1f7b-426d-94d0-9786f98767f5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b5ccf01-60cb-4262-a8e7-d125c19fc604 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 00:25:39 user nova-compute[75341]: No targets found.
Nov 15 00:25:39 user nova-compute[75341]: iSNS:
Nov 15 00:25:39 user nova-compute[75341]: No targets found.
Nov 15 00:25:39 user nova-compute[75341]: STATIC:
Nov 15 00:25:39 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e
Nov 15 00:25:39 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 15 00:25:39 user nova-compute[75341]:                 Iface Name: default
Nov 15 00:25:39 user nova-compute[75341]: FIRMWARE:
Nov 15 00:25:39 user nova-compute[75341]: No targets found.
Nov 15 00:25:39 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b5ccf01-60cb-4262-a8e7-d125c19fc604 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 00:25:39 user nova-compute[75341]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 00:25:39 user nova-compute[75341]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75341) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b5ccf01-60cb-4262-a8e7-d125c19fc604 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e', 0)] {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c26bbb-c074-4bd4-b3b9-71e91f12a919]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac87c1a-8b22-4d14-8aa8-d0371fcb7bdf]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b5ccf01-60cb-4262-a8e7-d125c19fc604 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e (non-flash)
Nov 15 00:25:39 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b5ccf01-60cb-4262-a8e7-d125c19fc604 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e (non-flash)
Nov 15 00:25:39 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b5ccf01-60cb-4262-a8e7-d125c19fc604 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f18505136d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e'): ({'sdb'}, set())}) {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-6b5ccf01-60cb-4262-a8e7-d125c19fc604 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Removing single pathed devices sdb {{(pid=75341) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3079614-d963-46d2-8980-15a267a575b9]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c5bfa7a-ae94-45d2-b2e1-ed0ac94c06d8]: (4, ('ok\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-6b5ccf01-60cb-4262-a8e7-d125c19fc604 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Flushing IO for device /dev/sdb {{(pid=75341) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[643287f3-0fe1-4fd1-967e-a16b81ad7527]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-6b5ccf01-60cb-4262-a8e7-d125c19fc604 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75341) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d45d6b2-363b-4ba9-872c-a2cc2bc94c7d]: (4, ('1', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-6b5ccf01-60cb-4262-a8e7-d125c19fc604 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-6b5ccf01-60cb-4262-a8e7-d125c19fc604 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] SCSI volumes sdb have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b5ccf01-60cb-4262-a8e7-d125c19fc604 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e')] {{(pid=75341) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb122422-de87-4bfa-8974-4c05ea81951f]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b5ccf01-60cb-4262-a8e7-d125c19fc604 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e -p 172.16.0.220:3260 --logout {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e -p 172.16.0.220:3260 --logout" returned: 0 in 0.041s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ae7972-3129-44f6-9892-72e4b39c08fd]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b5ccf01-60cb-4262-a8e7-d125c19fc604 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e, portal: 172.16.0.220,3260]
Nov 15 00:25:39 user nova-compute[75341]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e, portal: 172.16.0.220,3260] successful.
Nov 15 00:25:39 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e -p 172.16.0.220:3260 --op delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7500ff6d-ab61-40fe-b910-9ae8a4160f4e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.056s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[49af5055-e08c-4d05-b1b2-25d25874cae5]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b5ccf01-60cb-4262-a8e7-d125c19fc604 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-6b5ccf01-60cb-4262-a8e7-d125c19fc604 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b5ccf01-60cb-4262-a8e7-d125c19fc604 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] <== disconnect_volume: return (324ms) None {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b5ccf01-60cb-4262-a8e7-d125c19fc604 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Disconnected iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 00:25:39 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-6b5ccf01-60cb-4262-a8e7-d125c19fc604 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Deleting instance files /opt/stack/data/nova/instances/5a57dc05-73fa-45a8-98d9-c355f2f35d17_del
Nov 15 00:25:39 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-6b5ccf01-60cb-4262-a8e7-d125c19fc604 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Deletion of /opt/stack/data/nova/instances/5a57dc05-73fa-45a8-98d9-c355f2f35d17_del complete
Nov 15 00:25:39 user nova-compute[75341]: INFO nova.compute.manager [None req-6b5ccf01-60cb-4262-a8e7-d125c19fc604 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 15 00:25:39 user nova-compute[75341]: DEBUG oslo.service.loopingcall [None req-6b5ccf01-60cb-4262-a8e7-d125c19fc604 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75341) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG nova.compute.manager [-] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Deallocating network for instance {{(pid=75341) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] deallocate_for_instance() {{(pid=75341) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:25:39 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:25:39 user nova-compute[75341]: INFO nova.compute.manager [-] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Took 0.41 seconds to deallocate network for instance.
Nov 15 00:25:39 user nova-compute[75341]: DEBUG nova.compute.manager [req-5394f77b-1c8f-49ae-b525-fa48a4ef9523 req-9cbe6745-7761-4703-820f-5dfb08d0b5c2 service nova] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Received event network-vif-deleted-6b89e652-396c-42ad-9a1a-402e18e1a9f3 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:25:40 user nova-compute[75341]: DEBUG nova.compute.manager [req-7bfe80cf-f6be-403c-a06f-5e93531fa332 req-a85fbba3-0ab6-42ca-9bb2-807737ded809 service nova] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Received event network-vif-plugged-6b89e652-396c-42ad-9a1a-402e18e1a9f3 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:25:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-7bfe80cf-f6be-403c-a06f-5e93531fa332 req-a85fbba3-0ab6-42ca-9bb2-807737ded809 service nova] Acquiring lock "5a57dc05-73fa-45a8-98d9-c355f2f35d17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:25:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-7bfe80cf-f6be-403c-a06f-5e93531fa332 req-a85fbba3-0ab6-42ca-9bb2-807737ded809 service nova] Lock "5a57dc05-73fa-45a8-98d9-c355f2f35d17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:25:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-7bfe80cf-f6be-403c-a06f-5e93531fa332 req-a85fbba3-0ab6-42ca-9bb2-807737ded809 service nova] Lock "5a57dc05-73fa-45a8-98d9-c355f2f35d17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:25:40 user nova-compute[75341]: DEBUG nova.compute.manager [req-7bfe80cf-f6be-403c-a06f-5e93531fa332 req-a85fbba3-0ab6-42ca-9bb2-807737ded809 service nova] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] No waiting events found dispatching network-vif-plugged-6b89e652-396c-42ad-9a1a-402e18e1a9f3 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:25:40 user nova-compute[75341]: WARNING nova.compute.manager [req-7bfe80cf-f6be-403c-a06f-5e93531fa332 req-a85fbba3-0ab6-42ca-9bb2-807737ded809 service nova] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Received unexpected event network-vif-plugged-6b89e652-396c-42ad-9a1a-402e18e1a9f3 for instance with vm_state active and task_state deleting.
Nov 15 00:25:40 user nova-compute[75341]: DEBUG nova.compute.manager [req-7bfe80cf-f6be-403c-a06f-5e93531fa332 req-a85fbba3-0ab6-42ca-9bb2-807737ded809 service nova] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Received event network-vif-plugged-6b89e652-396c-42ad-9a1a-402e18e1a9f3 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:25:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-7bfe80cf-f6be-403c-a06f-5e93531fa332 req-a85fbba3-0ab6-42ca-9bb2-807737ded809 service nova] Acquiring lock "5a57dc05-73fa-45a8-98d9-c355f2f35d17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:25:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-7bfe80cf-f6be-403c-a06f-5e93531fa332 req-a85fbba3-0ab6-42ca-9bb2-807737ded809 service nova] Lock "5a57dc05-73fa-45a8-98d9-c355f2f35d17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:25:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-7bfe80cf-f6be-403c-a06f-5e93531fa332 req-a85fbba3-0ab6-42ca-9bb2-807737ded809 service nova] Lock "5a57dc05-73fa-45a8-98d9-c355f2f35d17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:25:40 user nova-compute[75341]: DEBUG nova.compute.manager [req-7bfe80cf-f6be-403c-a06f-5e93531fa332 req-a85fbba3-0ab6-42ca-9bb2-807737ded809 service nova] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] No waiting events found dispatching network-vif-plugged-6b89e652-396c-42ad-9a1a-402e18e1a9f3 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:25:40 user nova-compute[75341]: WARNING nova.compute.manager [req-7bfe80cf-f6be-403c-a06f-5e93531fa332 req-a85fbba3-0ab6-42ca-9bb2-807737ded809 service nova] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Received unexpected event network-vif-plugged-6b89e652-396c-42ad-9a1a-402e18e1a9f3 for instance with vm_state active and task_state deleting.
Nov 15 00:25:40 user nova-compute[75341]: DEBUG nova.compute.manager [req-7bfe80cf-f6be-403c-a06f-5e93531fa332 req-a85fbba3-0ab6-42ca-9bb2-807737ded809 service nova] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Received event network-vif-plugged-6b89e652-396c-42ad-9a1a-402e18e1a9f3 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:25:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-7bfe80cf-f6be-403c-a06f-5e93531fa332 req-a85fbba3-0ab6-42ca-9bb2-807737ded809 service nova] Acquiring lock "5a57dc05-73fa-45a8-98d9-c355f2f35d17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:25:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-7bfe80cf-f6be-403c-a06f-5e93531fa332 req-a85fbba3-0ab6-42ca-9bb2-807737ded809 service nova] Lock "5a57dc05-73fa-45a8-98d9-c355f2f35d17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:25:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-7bfe80cf-f6be-403c-a06f-5e93531fa332 req-a85fbba3-0ab6-42ca-9bb2-807737ded809 service nova] Lock "5a57dc05-73fa-45a8-98d9-c355f2f35d17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:25:40 user nova-compute[75341]: DEBUG nova.compute.manager [req-7bfe80cf-f6be-403c-a06f-5e93531fa332 req-a85fbba3-0ab6-42ca-9bb2-807737ded809 service nova] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] No waiting events found dispatching network-vif-plugged-6b89e652-396c-42ad-9a1a-402e18e1a9f3 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:25:40 user nova-compute[75341]: WARNING nova.compute.manager [req-7bfe80cf-f6be-403c-a06f-5e93531fa332 req-a85fbba3-0ab6-42ca-9bb2-807737ded809 service nova] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Received unexpected event network-vif-plugged-6b89e652-396c-42ad-9a1a-402e18e1a9f3 for instance with vm_state active and task_state deleting.
Nov 15 00:25:40 user nova-compute[75341]: DEBUG nova.compute.manager [req-7bfe80cf-f6be-403c-a06f-5e93531fa332 req-a85fbba3-0ab6-42ca-9bb2-807737ded809 service nova] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Received event network-vif-unplugged-6b89e652-396c-42ad-9a1a-402e18e1a9f3 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:25:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-7bfe80cf-f6be-403c-a06f-5e93531fa332 req-a85fbba3-0ab6-42ca-9bb2-807737ded809 service nova] Acquiring lock "5a57dc05-73fa-45a8-98d9-c355f2f35d17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:25:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-7bfe80cf-f6be-403c-a06f-5e93531fa332 req-a85fbba3-0ab6-42ca-9bb2-807737ded809 service nova] Lock "5a57dc05-73fa-45a8-98d9-c355f2f35d17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:25:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-7bfe80cf-f6be-403c-a06f-5e93531fa332 req-a85fbba3-0ab6-42ca-9bb2-807737ded809 service nova] Lock "5a57dc05-73fa-45a8-98d9-c355f2f35d17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:25:40 user nova-compute[75341]: DEBUG nova.compute.manager [req-7bfe80cf-f6be-403c-a06f-5e93531fa332 req-a85fbba3-0ab6-42ca-9bb2-807737ded809 service nova] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] No waiting events found dispatching network-vif-unplugged-6b89e652-396c-42ad-9a1a-402e18e1a9f3 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:25:40 user nova-compute[75341]: DEBUG nova.compute.manager [req-7bfe80cf-f6be-403c-a06f-5e93531fa332 req-a85fbba3-0ab6-42ca-9bb2-807737ded809 service nova] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Received event network-vif-unplugged-6b89e652-396c-42ad-9a1a-402e18e1a9f3 for instance with task_state deleting. {{(pid=75341) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 00:25:40 user nova-compute[75341]: DEBUG nova.compute.manager [req-7bfe80cf-f6be-403c-a06f-5e93531fa332 req-a85fbba3-0ab6-42ca-9bb2-807737ded809 service nova] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Received event network-vif-plugged-6b89e652-396c-42ad-9a1a-402e18e1a9f3 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:25:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-7bfe80cf-f6be-403c-a06f-5e93531fa332 req-a85fbba3-0ab6-42ca-9bb2-807737ded809 service nova] Acquiring lock "5a57dc05-73fa-45a8-98d9-c355f2f35d17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:25:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-7bfe80cf-f6be-403c-a06f-5e93531fa332 req-a85fbba3-0ab6-42ca-9bb2-807737ded809 service nova] Lock "5a57dc05-73fa-45a8-98d9-c355f2f35d17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:25:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-7bfe80cf-f6be-403c-a06f-5e93531fa332 req-a85fbba3-0ab6-42ca-9bb2-807737ded809 service nova] Lock "5a57dc05-73fa-45a8-98d9-c355f2f35d17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:25:40 user nova-compute[75341]: DEBUG nova.compute.manager [req-7bfe80cf-f6be-403c-a06f-5e93531fa332 req-a85fbba3-0ab6-42ca-9bb2-807737ded809 service nova] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] No waiting events found dispatching network-vif-plugged-6b89e652-396c-42ad-9a1a-402e18e1a9f3 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:25:40 user nova-compute[75341]: WARNING nova.compute.manager [req-7bfe80cf-f6be-403c-a06f-5e93531fa332 req-a85fbba3-0ab6-42ca-9bb2-807737ded809 service nova] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Received unexpected event network-vif-plugged-6b89e652-396c-42ad-9a1a-402e18e1a9f3 for instance with vm_state active and task_state deleting.
Nov 15 00:25:40 user nova-compute[75341]: INFO nova.compute.manager [None req-6b5ccf01-60cb-4262-a8e7-d125c19fc604 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: 5a57dc05-73fa-45a8-98d9-c355f2f35d17] Took 0.72 seconds to detach 1 volumes for instance.
Nov 15 00:25:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6b5ccf01-60cb-4262-a8e7-d125c19fc604 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:25:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6b5ccf01-60cb-4262-a8e7-d125c19fc604 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:25:40 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-6b5ccf01-60cb-4262-a8e7-d125c19fc604 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 00:25:40 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-6b5ccf01-60cb-4262-a8e7-d125c19fc604 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 00:25:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6b5ccf01-60cb-4262-a8e7-d125c19fc604 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.167s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:25:40 user nova-compute[75341]: INFO nova.scheduler.client.report [None req-6b5ccf01-60cb-4262-a8e7-d125c19fc604 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Deleted allocations for instance 5a57dc05-73fa-45a8-98d9-c355f2f35d17
Nov 15 00:25:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-6b5ccf01-60cb-4262-a8e7-d125c19fc604 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "5a57dc05-73fa-45a8-98d9-c355f2f35d17" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.648s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:25:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:25:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:25:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:25:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:25:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:25:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:25:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:25:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:25:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:25:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:25:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:25:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:25:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:25:59 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:26:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:26:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:26:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:26:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:26:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:26:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:26:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:26:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:26:15 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:26:19 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:26:20 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:26:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:26:27 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:26:27 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75341) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 00:26:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-35e70c55-4da6-44b9-ad07-fb82f4539ce0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Acquiring lock "c332ad29-e892-4caf-aa37-fd66fb41f9ec" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:26:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-35e70c55-4da6-44b9-ad07-fb82f4539ce0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "c332ad29-e892-4caf-aa37-fd66fb41f9ec" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:26:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-35e70c55-4da6-44b9-ad07-fb82f4539ce0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Acquiring lock "c332ad29-e892-4caf-aa37-fd66fb41f9ec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:26:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-35e70c55-4da6-44b9-ad07-fb82f4539ce0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "c332ad29-e892-4caf-aa37-fd66fb41f9ec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:26:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-35e70c55-4da6-44b9-ad07-fb82f4539ce0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "c332ad29-e892-4caf-aa37-fd66fb41f9ec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:26:29 user nova-compute[75341]: INFO nova.compute.manager [None req-35e70c55-4da6-44b9-ad07-fb82f4539ce0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Terminating instance
Nov 15 00:26:29 user nova-compute[75341]: DEBUG nova.compute.manager [None req-35e70c55-4da6-44b9-ad07-fb82f4539ce0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Start destroying the instance on the hypervisor. {{(pid=75341) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 00:26:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:26:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:26:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:26:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:26:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:26:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:26:29 user nova-compute[75341]: DEBUG nova.compute.manager [req-4843cef8-b2eb-4997-9a92-1e04fac8147c req-81f757c1-0f50-43a2-9487-ce02a965d768 service nova] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Received event network-vif-unplugged-9f65f96b-aa09-4c3a-a23b-ed444c9dacec {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:26:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4843cef8-b2eb-4997-9a92-1e04fac8147c req-81f757c1-0f50-43a2-9487-ce02a965d768 service nova] Acquiring lock "c332ad29-e892-4caf-aa37-fd66fb41f9ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:26:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4843cef8-b2eb-4997-9a92-1e04fac8147c req-81f757c1-0f50-43a2-9487-ce02a965d768 service nova] Lock "c332ad29-e892-4caf-aa37-fd66fb41f9ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:26:29 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4843cef8-b2eb-4997-9a92-1e04fac8147c req-81f757c1-0f50-43a2-9487-ce02a965d768 service nova] Lock "c332ad29-e892-4caf-aa37-fd66fb41f9ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:26:29 user nova-compute[75341]: DEBUG nova.compute.manager [req-4843cef8-b2eb-4997-9a92-1e04fac8147c req-81f757c1-0f50-43a2-9487-ce02a965d768 service nova] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] No waiting events found dispatching network-vif-unplugged-9f65f96b-aa09-4c3a-a23b-ed444c9dacec {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:26:29 user nova-compute[75341]: DEBUG nova.compute.manager [req-4843cef8-b2eb-4997-9a92-1e04fac8147c req-81f757c1-0f50-43a2-9487-ce02a965d768 service nova] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Received event network-vif-unplugged-9f65f96b-aa09-4c3a-a23b-ed444c9dacec for instance with task_state deleting. {{(pid=75341) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 00:26:29 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Instance destroyed successfully.
Nov 15 00:26:29 user nova-compute[75341]: DEBUG nova.objects.instance [None req-35e70c55-4da6-44b9-ad07-fb82f4539ce0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lazy-loading 'resources' on Instance uuid c332ad29-e892-4caf-aa37-fd66fb41f9ec {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:26:29 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-35e70c55-4da6-44b9-ad07-fb82f4539ce0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T00:06:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1075278355',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1075278355',id=47,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T00:06:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5cde913b393e4b1095ae6e8e4a74b5fb',ramdisk_id='',reservation_id='r-1iwc0cun',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1181444554',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T00:08:50Z,user_data=None,user_id='abb41e7d020d4c99a55b5029cd2124a9',uuid=c332ad29-e892-4caf-aa37-fd66fb41f9ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9f65f96b-aa09-4c3a-a23b-ed444c9dacec", "address": "fa:16:3e:c6:2e:8d", "network": {"id": "aed56292-815e-4004-9101-59ff735cf236", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cde913b393e4b1095ae6e8e4a74b5fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f65f96b-aa", "ovs_interfaceid": "9f65f96b-aa09-4c3a-a23b-ed444c9dacec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 00:26:29 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-35e70c55-4da6-44b9-ad07-fb82f4539ce0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Converting VIF {"id": "9f65f96b-aa09-4c3a-a23b-ed444c9dacec", "address": "fa:16:3e:c6:2e:8d", "network": {"id": "aed56292-815e-4004-9101-59ff735cf236", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-532509797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cde913b393e4b1095ae6e8e4a74b5fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f65f96b-aa", "ovs_interfaceid": "9f65f96b-aa09-4c3a-a23b-ed444c9dacec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 00:26:29 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-35e70c55-4da6-44b9-ad07-fb82f4539ce0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:2e:8d,bridge_name='br-int',has_traffic_filtering=True,id=9f65f96b-aa09-4c3a-a23b-ed444c9dacec,network=Network(aed56292-815e-4004-9101-59ff735cf236),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f65f96b-aa') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 00:26:29 user nova-compute[75341]: DEBUG os_vif [None req-35e70c55-4da6-44b9-ad07-fb82f4539ce0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:2e:8d,bridge_name='br-int',has_traffic_filtering=True,id=9f65f96b-aa09-4c3a-a23b-ed444c9dacec,network=Network(aed56292-815e-4004-9101-59ff735cf236),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f65f96b-aa') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 00:26:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:26:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9f65f96b-aa, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:26:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:26:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:26:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=64faf72f-dbf7-48e8-94c6-13e8b57a5d4f) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:26:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:26:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:26:29 user nova-compute[75341]: INFO os_vif [None req-35e70c55-4da6-44b9-ad07-fb82f4539ce0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:2e:8d,bridge_name='br-int',has_traffic_filtering=True,id=9f65f96b-aa09-4c3a-a23b-ed444c9dacec,network=Network(aed56292-815e-4004-9101-59ff735cf236),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f65f96b-aa')
Nov 15 00:26:29 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-35e70c55-4da6-44b9-ad07-fb82f4539ce0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Deleting instance files /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec_del
Nov 15 00:26:29 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-35e70c55-4da6-44b9-ad07-fb82f4539ce0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Deletion of /opt/stack/data/nova/instances/c332ad29-e892-4caf-aa37-fd66fb41f9ec_del complete
Nov 15 00:26:29 user nova-compute[75341]: INFO nova.compute.manager [None req-35e70c55-4da6-44b9-ad07-fb82f4539ce0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 15 00:26:29 user nova-compute[75341]: DEBUG oslo.service.loopingcall [None req-35e70c55-4da6-44b9-ad07-fb82f4539ce0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75341) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 00:26:29 user nova-compute[75341]: DEBUG nova.compute.manager [-] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Deallocating network for instance {{(pid=75341) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 00:26:29 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] deallocate_for_instance() {{(pid=75341) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 00:26:30 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:26:30 user nova-compute[75341]: INFO nova.compute.manager [-] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Took 0.46 seconds to deallocate network for instance.
Nov 15 00:26:30 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-35e70c55-4da6-44b9-ad07-fb82f4539ce0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:26:30 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-35e70c55-4da6-44b9-ad07-fb82f4539ce0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:26:30 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-35e70c55-4da6-44b9-ad07-fb82f4539ce0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 00:26:30 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-35e70c55-4da6-44b9-ad07-fb82f4539ce0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 00:26:30 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-35e70c55-4da6-44b9-ad07-fb82f4539ce0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.122s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:26:30 user nova-compute[75341]: INFO nova.scheduler.client.report [None req-35e70c55-4da6-44b9-ad07-fb82f4539ce0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Deleted allocations for instance c332ad29-e892-4caf-aa37-fd66fb41f9ec
Nov 15 00:26:30 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-35e70c55-4da6-44b9-ad07-fb82f4539ce0 tempest-ServerBootFromVolumeStableRescueTest-1181444554 tempest-ServerBootFromVolumeStableRescueTest-1181444554-project-member] Lock "c332ad29-e892-4caf-aa37-fd66fb41f9ec" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.622s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:26:30 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:26:31 user nova-compute[75341]: DEBUG nova.compute.manager [req-3f156708-4ccd-42d5-87bc-8ff5018bd7da req-d444a6cc-105b-45bc-a5fd-84732764baa2 service nova] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Received event network-vif-plugged-9f65f96b-aa09-4c3a-a23b-ed444c9dacec {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:26:31 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-3f156708-4ccd-42d5-87bc-8ff5018bd7da req-d444a6cc-105b-45bc-a5fd-84732764baa2 service nova] Acquiring lock "c332ad29-e892-4caf-aa37-fd66fb41f9ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:26:31 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-3f156708-4ccd-42d5-87bc-8ff5018bd7da req-d444a6cc-105b-45bc-a5fd-84732764baa2 service nova] Lock "c332ad29-e892-4caf-aa37-fd66fb41f9ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:26:31 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-3f156708-4ccd-42d5-87bc-8ff5018bd7da req-d444a6cc-105b-45bc-a5fd-84732764baa2 service nova] Lock "c332ad29-e892-4caf-aa37-fd66fb41f9ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:26:31 user nova-compute[75341]: DEBUG nova.compute.manager [req-3f156708-4ccd-42d5-87bc-8ff5018bd7da req-d444a6cc-105b-45bc-a5fd-84732764baa2 service nova] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] No waiting events found dispatching network-vif-plugged-9f65f96b-aa09-4c3a-a23b-ed444c9dacec {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:26:31 user nova-compute[75341]: WARNING nova.compute.manager [req-3f156708-4ccd-42d5-87bc-8ff5018bd7da req-d444a6cc-105b-45bc-a5fd-84732764baa2 service nova] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Received unexpected event network-vif-plugged-9f65f96b-aa09-4c3a-a23b-ed444c9dacec for instance with vm_state deleted and task_state None.
Nov 15 00:26:31 user nova-compute[75341]: DEBUG nova.compute.manager [req-3f156708-4ccd-42d5-87bc-8ff5018bd7da req-d444a6cc-105b-45bc-a5fd-84732764baa2 service nova] [instance: c332ad29-e892-4caf-aa37-fd66fb41f9ec] Received event network-vif-deleted-9f65f96b-aa09-4c3a-a23b-ed444c9dacec {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:26:31 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:26:31 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:26:32 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:26:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:26:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:26:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:26:32 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75341) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 00:26:33 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:26:33 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:26:33 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Hypervisor/Node resource view: name=user free_ram=9120MB free_disk=25.319190979003906GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75341) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 00:26:33 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:26:33 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:26:33 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 00:26:33 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 00:26:33 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 00:26:33 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 00:26:33 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Compute_service record updated for user:user {{(pid=75341) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 00:26:33 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.302s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:26:34 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:26:35 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:26:36 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:26:36 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Starting heal instance info cache {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 00:26:36 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Didn't find any instances for network info cache update. {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 00:26:36 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:26:37 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:26:37 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Cleaning up deleted instances {{(pid=75341) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 00:26:37 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] There are 0 instances to clean {{(pid=75341) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 00:26:39 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:26:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:26:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:26:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:26:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:26:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:26:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:26:45 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:26:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:26:51 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:26:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:26:59 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:27:02 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:27:02 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75341) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 00:27:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:27:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:27:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:27:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:27:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:27:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:27:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:27:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:27:19 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:27:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:27:21 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:27:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:27:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:27:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:27:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:27:28 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:27:28 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75341) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 00:27:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:27:30 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:27:31 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Acquiring lock "1cd08fb1-2fab-4381-924d-c394ef259c8d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:27:31 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Lock "1cd08fb1-2fab-4381-924d-c394ef259c8d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:27:32 user nova-compute[75341]: DEBUG nova.compute.manager [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Starting instance... {{(pid=75341) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 00:27:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:27:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:27:32 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75341) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 00:27:32 user nova-compute[75341]: INFO nova.compute.claims [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Claim successful on node user
Nov 15 00:27:32 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Refreshing inventories for resource provider 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 00:27:32 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Updating ProviderTree inventory for provider 8fa114cc-b541-418f-865c-16c44294e72d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 00:27:32 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Updating inventory in ProviderTree for provider 8fa114cc-b541-418f-865c-16c44294e72d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 00:27:32 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Refreshing aggregate associations for resource provider 8fa114cc-b541-418f-865c-16c44294e72d, aggregates: None {{(pid=75341) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 00:27:32 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Refreshing trait associations for resource provider 8fa114cc-b541-418f-865c-16c44294e72d, traits: COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_MMX,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000E {{(pid=75341) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 00:27:32 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 00:27:32 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 00:27:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.312s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:27:32 user nova-compute[75341]: DEBUG nova.compute.manager [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Start building networks asynchronously for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 00:27:32 user nova-compute[75341]: DEBUG nova.compute.manager [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Allocating IP information in the background. {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 00:27:32 user nova-compute[75341]: DEBUG nova.network.neutron [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] allocate_for_instance() {{(pid=75341) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 00:27:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:27:32 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 00:27:32 user nova-compute[75341]: DEBUG nova.compute.manager [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Start building block device mappings for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 00:27:32 user nova-compute[75341]: DEBUG nova.policy [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ffaaabcda33f40cba01e3d5181f10b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e31ba430fd1d4d5fb882c3ccb3e7c0a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75341) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 00:27:32 user nova-compute[75341]: DEBUG nova.compute.manager [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Start spawning the instance on the hypervisor. {{(pid=75341) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 00:27:32 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Creating instance directory {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 00:27:32 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Creating image(s)
Nov 15 00:27:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Acquiring lock "/opt/stack/data/nova/instances/1cd08fb1-2fab-4381-924d-c394ef259c8d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:27:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Lock "/opt/stack/data/nova/instances/1cd08fb1-2fab-4381-924d-c394ef259c8d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:27:32 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Lock "/opt/stack/data/nova/instances/1cd08fb1-2fab-4381-924d-c394ef259c8d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:27:32 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:27:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.168s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:27:33 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Acquiring lock "4754efee9a6d73d3647f2add2cfe86c291949740" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:27:33 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.005s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:27:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:27:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.179s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:27:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/1cd08fb1-2fab-4381-924d-c394ef259c8d/disk 1073741824 {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:27:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/1cd08fb1-2fab-4381-924d-c394ef259c8d/disk 1073741824" returned: 0 in 0.062s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:27:33 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:27:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:27:33 user nova-compute[75341]: DEBUG nova.network.neutron [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Successfully created port: dc987f35-ca2f-4c53-b5d1-07e07674ab27 {{(pid=75341) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 00:27:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.169s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:27:33 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1cd08fb1-2fab-4381-924d-c394ef259c8d/disk. size=1073741824 {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 00:27:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd08fb1-2fab-4381-924d-c394ef259c8d/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:27:33 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd08fb1-2fab-4381-924d-c394ef259c8d/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:27:33 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Cannot resize image /opt/stack/data/nova/instances/1cd08fb1-2fab-4381-924d-c394ef259c8d/disk to a smaller size. {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 00:27:33 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Created local disks {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 00:27:33 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Ensure instance console log exists: /opt/stack/data/nova/instances/1cd08fb1-2fab-4381-924d-c394ef259c8d/console.log {{(pid=75341) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 00:27:33 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:27:33 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:27:33 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:27:33 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:27:33 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:27:33 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:27:33 user nova-compute[75341]: DEBUG nova.network.neutron [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Successfully updated port: dc987f35-ca2f-4c53-b5d1-07e07674ab27 {{(pid=75341) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 00:27:33 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:27:33 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:27:33 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:27:33 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75341) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 00:27:33 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Acquiring lock "refresh_cache-1cd08fb1-2fab-4381-924d-c394ef259c8d" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:27:33 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Acquired lock "refresh_cache-1cd08fb1-2fab-4381-924d-c394ef259c8d" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:27:33 user nova-compute[75341]: DEBUG nova.network.neutron [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 00:27:34 user nova-compute[75341]: DEBUG nova.network.neutron [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Instance cache missing network info. {{(pid=75341) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 00:27:34 user nova-compute[75341]: DEBUG nova.compute.manager [req-0058cded-e359-4fed-8237-b4300b1d6978 req-7f8f6594-bb14-4f71-b22f-6fb6c0b923b5 service nova] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Received event network-changed-dc987f35-ca2f-4c53-b5d1-07e07674ab27 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:27:34 user nova-compute[75341]: DEBUG nova.compute.manager [req-0058cded-e359-4fed-8237-b4300b1d6978 req-7f8f6594-bb14-4f71-b22f-6fb6c0b923b5 service nova] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Refreshing instance network info cache due to event network-changed-dc987f35-ca2f-4c53-b5d1-07e07674ab27. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 00:27:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-0058cded-e359-4fed-8237-b4300b1d6978 req-7f8f6594-bb14-4f71-b22f-6fb6c0b923b5 service nova] Acquiring lock "refresh_cache-1cd08fb1-2fab-4381-924d-c394ef259c8d" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:27:34 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:27:34 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:27:34 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Hypervisor/Node resource view: name=user free_ram=9133MB free_disk=25.309600830078125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75341) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 00:27:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:27:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:27:34 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 1cd08fb1-2fab-4381-924d-c394ef259c8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:27:34 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 00:27:34 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 00:27:34 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 00:27:34 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 00:27:34 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Compute_service record updated for user:user {{(pid=75341) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 00:27:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.209s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:27:34 user nova-compute[75341]: DEBUG nova.network.neutron [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Updating instance_info_cache with network_info: [{"id": "dc987f35-ca2f-4c53-b5d1-07e07674ab27", "address": "fa:16:3e:ad:fe:44", "network": {"id": "04cba7ef-eb1c-4a35-b10a-25685666e9b6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-130493983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31ba430fd1d4d5fb882c3ccb3e7c0a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc987f35-ca", "ovs_interfaceid": "dc987f35-ca2f-4c53-b5d1-07e07674ab27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:27:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Releasing lock "refresh_cache-1cd08fb1-2fab-4381-924d-c394ef259c8d" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:27:34 user nova-compute[75341]: DEBUG nova.compute.manager [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Instance network_info: |[{"id": "dc987f35-ca2f-4c53-b5d1-07e07674ab27", "address": "fa:16:3e:ad:fe:44", "network": {"id": "04cba7ef-eb1c-4a35-b10a-25685666e9b6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-130493983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31ba430fd1d4d5fb882c3ccb3e7c0a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc987f35-ca", "ovs_interfaceid": "dc987f35-ca2f-4c53-b5d1-07e07674ab27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 00:27:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-0058cded-e359-4fed-8237-b4300b1d6978 req-7f8f6594-bb14-4f71-b22f-6fb6c0b923b5 service nova] Acquired lock "refresh_cache-1cd08fb1-2fab-4381-924d-c394ef259c8d" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:27:34 user nova-compute[75341]: DEBUG nova.network.neutron [req-0058cded-e359-4fed-8237-b4300b1d6978 req-7f8f6594-bb14-4f71-b22f-6fb6c0b923b5 service nova] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Refreshing network info cache for port dc987f35-ca2f-4c53-b5d1-07e07674ab27 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 00:27:34 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Start _get_guest_xml network_info=[{"id": "dc987f35-ca2f-4c53-b5d1-07e07674ab27", "address": "fa:16:3e:ad:fe:44", "network": {"id": "04cba7ef-eb1c-4a35-b10a-25685666e9b6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-130493983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31ba430fd1d4d5fb882c3ccb3e7c0a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc987f35-ca", "ovs_interfaceid": "dc987f35-ca2f-4c53-b5d1-07e07674ab27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encrypted': False, 'image_id': 'e46abb82-b810-490e-a8a1-ccdc5fa1a796'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 00:27:34 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:27:34 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:27:34 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 00:27:34 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 00:27:34 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 00:27:34 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 00:27:34 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 00:27:34 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 00:27:34 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 00:27:34 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 00:27:34 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 00:27:34 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 00:27:34 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 00:27:34 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 00:27:34 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 00:27:34 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 00:27:34 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 00:27:34 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 00:27:34 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T00:27:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1308851418',display_name='tempest-ServerStableDeviceRescueTest-server-1308851418',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1308851418',id=51,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPUBbTti5ImaVvFPl1ksjWyA2etJEO3JrirbrNGJ7x3OEQAK2OV2Mv0XzIZH+ewbmuWIAv9zgEddufLnFhHRM3HFxlLT/AR1GIqnFC5fgy17RWIdk9ka6i8ljxBYVZs6Pg==',key_name='tempest-keypair-140295017',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e31ba430fd1d4d5fb882c3ccb3e7c0a0',ramdisk_id='',reservation_id='r-t3c7p9fx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1724574070',owner_user_name='tempest-ServerStableDeviceRescueTest-1724574070-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T00:27:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ffaaabcda33f40cba01e3d5181f10b4d',uuid=1cd08fb1-2fab-4381-924d-c394ef259c8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc987f35-ca2f-4c53-b5d1-07e07674ab27", "address": "fa:16:3e:ad:fe:44", "network": {"id": "04cba7ef-eb1c-4a35-b10a-25685666e9b6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-130493983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31ba430fd1d4d5fb882c3ccb3e7c0a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc987f35-ca", "ovs_interfaceid": "dc987f35-ca2f-4c53-b5d1-07e07674ab27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 00:27:34 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Converting VIF {"id": "dc987f35-ca2f-4c53-b5d1-07e07674ab27", "address": "fa:16:3e:ad:fe:44", "network": {"id": "04cba7ef-eb1c-4a35-b10a-25685666e9b6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-130493983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31ba430fd1d4d5fb882c3ccb3e7c0a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc987f35-ca", "ovs_interfaceid": "dc987f35-ca2f-4c53-b5d1-07e07674ab27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 00:27:34 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:fe:44,bridge_name='br-int',has_traffic_filtering=True,id=dc987f35-ca2f-4c53-b5d1-07e07674ab27,network=Network(04cba7ef-eb1c-4a35-b10a-25685666e9b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc987f35-ca') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 00:27:34 user nova-compute[75341]: DEBUG nova.objects.instance [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Lazy-loading 'pci_devices' on Instance uuid 1cd08fb1-2fab-4381-924d-c394ef259c8d {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:27:34 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] End _get_guest_xml xml=<domain type="kvm">
Nov 15 00:27:34 user nova-compute[75341]:   <uuid>1cd08fb1-2fab-4381-924d-c394ef259c8d</uuid>
Nov 15 00:27:34 user nova-compute[75341]:   <name>instance-00000033</name>
Nov 15 00:27:34 user nova-compute[75341]:   <memory>524288</memory>
Nov 15 00:27:34 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 15 00:27:34 user nova-compute[75341]:   <metadata>
Nov 15 00:27:34 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 00:27:34 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 15 00:27:34 user nova-compute[75341]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1308851418</nova:name>
Nov 15 00:27:34 user nova-compute[75341]:       <nova:creationTime>2023-11-15 00:27:34</nova:creationTime>
Nov 15 00:27:34 user nova-compute[75341]:       <nova:flavor name="m1.tiny">
Nov 15 00:27:34 user nova-compute[75341]:         <nova:memory>512</nova:memory>
Nov 15 00:27:34 user nova-compute[75341]:         <nova:disk>1</nova:disk>
Nov 15 00:27:34 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 15 00:27:34 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 00:27:34 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 15 00:27:34 user nova-compute[75341]:       </nova:flavor>
Nov 15 00:27:34 user nova-compute[75341]:       <nova:owner>
Nov 15 00:27:34 user nova-compute[75341]:         <nova:user uuid="ffaaabcda33f40cba01e3d5181f10b4d">tempest-ServerStableDeviceRescueTest-1724574070-project-member</nova:user>
Nov 15 00:27:34 user nova-compute[75341]:         <nova:project uuid="e31ba430fd1d4d5fb882c3ccb3e7c0a0">tempest-ServerStableDeviceRescueTest-1724574070</nova:project>
Nov 15 00:27:34 user nova-compute[75341]:       </nova:owner>
Nov 15 00:27:34 user nova-compute[75341]:       <nova:root type="image" uuid="e46abb82-b810-490e-a8a1-ccdc5fa1a796"/>
Nov 15 00:27:34 user nova-compute[75341]:       <nova:ports>
Nov 15 00:27:34 user nova-compute[75341]:         <nova:port uuid="dc987f35-ca2f-4c53-b5d1-07e07674ab27">
Nov 15 00:27:34 user nova-compute[75341]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 00:27:34 user nova-compute[75341]:         </nova:port>
Nov 15 00:27:34 user nova-compute[75341]:       </nova:ports>
Nov 15 00:27:34 user nova-compute[75341]:     </nova:instance>
Nov 15 00:27:34 user nova-compute[75341]:   </metadata>
Nov 15 00:27:34 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 15 00:27:34 user nova-compute[75341]:     <system>
Nov 15 00:27:34 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 00:27:34 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 15 00:27:34 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 15 00:27:34 user nova-compute[75341]:       <entry name="serial">1cd08fb1-2fab-4381-924d-c394ef259c8d</entry>
Nov 15 00:27:34 user nova-compute[75341]:       <entry name="uuid">1cd08fb1-2fab-4381-924d-c394ef259c8d</entry>
Nov 15 00:27:34 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 15 00:27:34 user nova-compute[75341]:     </system>
Nov 15 00:27:34 user nova-compute[75341]:   </sysinfo>
Nov 15 00:27:34 user nova-compute[75341]:   <os>
Nov 15 00:27:34 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 00:27:34 user nova-compute[75341]:     <boot dev="hd"/>
Nov 15 00:27:34 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 15 00:27:34 user nova-compute[75341]:   </os>
Nov 15 00:27:34 user nova-compute[75341]:   <features>
Nov 15 00:27:34 user nova-compute[75341]:     <acpi/>
Nov 15 00:27:34 user nova-compute[75341]:     <apic/>
Nov 15 00:27:34 user nova-compute[75341]:     <vmcoreinfo/>
Nov 15 00:27:34 user nova-compute[75341]:   </features>
Nov 15 00:27:34 user nova-compute[75341]:   <clock offset="utc">
Nov 15 00:27:34 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 00:27:34 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 00:27:34 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 15 00:27:34 user nova-compute[75341]:   </clock>
Nov 15 00:27:34 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 15 00:27:34 user nova-compute[75341]:     <model>Nehalem</model>
Nov 15 00:27:34 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 00:27:34 user nova-compute[75341]:   </cpu>
Nov 15 00:27:34 user nova-compute[75341]:   <devices>
Nov 15 00:27:34 user nova-compute[75341]:     <disk type="file" device="disk">
Nov 15 00:27:34 user nova-compute[75341]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 00:27:34 user nova-compute[75341]:       <source file="/opt/stack/data/nova/instances/1cd08fb1-2fab-4381-924d-c394ef259c8d/disk"/>
Nov 15 00:27:34 user nova-compute[75341]:       <target dev="vda" bus="virtio"/>
Nov 15 00:27:34 user nova-compute[75341]:     </disk>
Nov 15 00:27:34 user nova-compute[75341]:     <interface type="ethernet">
Nov 15 00:27:34 user nova-compute[75341]:       <mac address="fa:16:3e:ad:fe:44"/>
Nov 15 00:27:34 user nova-compute[75341]:       <model type="virtio"/>
Nov 15 00:27:34 user nova-compute[75341]:       <mtu size="1442"/>
Nov 15 00:27:34 user nova-compute[75341]:       <target dev="tapdc987f35-ca"/>
Nov 15 00:27:34 user nova-compute[75341]:     </interface>
Nov 15 00:27:34 user nova-compute[75341]:     <serial type="pty">
Nov 15 00:27:34 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/1cd08fb1-2fab-4381-924d-c394ef259c8d/console.log" append="off"/>
Nov 15 00:27:34 user nova-compute[75341]:     </serial>
Nov 15 00:27:34 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 00:27:34 user nova-compute[75341]:     <video>
Nov 15 00:27:34 user nova-compute[75341]:       <model type="virtio"/>
Nov 15 00:27:34 user nova-compute[75341]:     </video>
Nov 15 00:27:34 user nova-compute[75341]:     <rng model="virtio">
Nov 15 00:27:34 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 15 00:27:34 user nova-compute[75341]:     </rng>
Nov 15 00:27:34 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 15 00:27:34 user nova-compute[75341]:     <memballoon model="virtio">
Nov 15 00:27:34 user nova-compute[75341]:       <stats period="10"/>
Nov 15 00:27:34 user nova-compute[75341]:     </memballoon>
Nov 15 00:27:34 user nova-compute[75341]:   </devices>
Nov 15 00:27:34 user nova-compute[75341]: </domain>
Nov 15 00:27:34 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 00:27:34 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T00:27:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1308851418',display_name='tempest-ServerStableDeviceRescueTest-server-1308851418',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1308851418',id=51,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPUBbTti5ImaVvFPl1ksjWyA2etJEO3JrirbrNGJ7x3OEQAK2OV2Mv0XzIZH+ewbmuWIAv9zgEddufLnFhHRM3HFxlLT/AR1GIqnFC5fgy17RWIdk9ka6i8ljxBYVZs6Pg==',key_name='tempest-keypair-140295017',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e31ba430fd1d4d5fb882c3ccb3e7c0a0',ramdisk_id='',reservation_id='r-t3c7p9fx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1724574070',owner_user_name='tempest-ServerStableDeviceRescueTest-1724574070-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T00:27:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ffaaabcda33f40cba01e3d5181f10b4d',uuid=1cd08fb1-2fab-4381-924d-c394ef259c8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc987f35-ca2f-4c53-b5d1-07e07674ab27", "address": "fa:16:3e:ad:fe:44", "network": {"id": "04cba7ef-eb1c-4a35-b10a-25685666e9b6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-130493983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31ba430fd1d4d5fb882c3ccb3e7c0a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc987f35-ca", "ovs_interfaceid": "dc987f35-ca2f-4c53-b5d1-07e07674ab27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 00:27:34 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Converting VIF {"id": "dc987f35-ca2f-4c53-b5d1-07e07674ab27", "address": "fa:16:3e:ad:fe:44", "network": {"id": "04cba7ef-eb1c-4a35-b10a-25685666e9b6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-130493983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31ba430fd1d4d5fb882c3ccb3e7c0a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc987f35-ca", "ovs_interfaceid": "dc987f35-ca2f-4c53-b5d1-07e07674ab27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 00:27:34 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:fe:44,bridge_name='br-int',has_traffic_filtering=True,id=dc987f35-ca2f-4c53-b5d1-07e07674ab27,network=Network(04cba7ef-eb1c-4a35-b10a-25685666e9b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc987f35-ca') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 00:27:34 user nova-compute[75341]: DEBUG os_vif [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:fe:44,bridge_name='br-int',has_traffic_filtering=True,id=dc987f35-ca2f-4c53-b5d1-07e07674ab27,network=Network(04cba7ef-eb1c-4a35-b10a-25685666e9b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc987f35-ca') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 00:27:34 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:27:34 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:27:34 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 00:27:34 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:27:34 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8bc385b2-da12-5d79-acad-1e019cdaa103', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:27:34 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:27:34 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:27:34 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:27:34 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdc987f35-ca, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:27:34 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdc987f35-ca, col_values=(('qos', UUID('3773dda6-63c7-4871-9a63-8d4657a5b913')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:27:34 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdc987f35-ca, col_values=(('external_ids', {'iface-id': 'dc987f35-ca2f-4c53-b5d1-07e07674ab27', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:fe:44', 'vm-uuid': '1cd08fb1-2fab-4381-924d-c394ef259c8d'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:27:34 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:27:34 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:27:34 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:27:34 user nova-compute[75341]: INFO os_vif [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:fe:44,bridge_name='br-int',has_traffic_filtering=True,id=dc987f35-ca2f-4c53-b5d1-07e07674ab27,network=Network(04cba7ef-eb1c-4a35-b10a-25685666e9b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc987f35-ca')
Nov 15 00:27:34 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 00:27:34 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] No VIF found with MAC fa:16:3e:ad:fe:44, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 00:27:34 user nova-compute[75341]: DEBUG nova.network.neutron [req-0058cded-e359-4fed-8237-b4300b1d6978 req-7f8f6594-bb14-4f71-b22f-6fb6c0b923b5 service nova] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Updated VIF entry in instance network info cache for port dc987f35-ca2f-4c53-b5d1-07e07674ab27. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 00:27:34 user nova-compute[75341]: DEBUG nova.network.neutron [req-0058cded-e359-4fed-8237-b4300b1d6978 req-7f8f6594-bb14-4f71-b22f-6fb6c0b923b5 service nova] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Updating instance_info_cache with network_info: [{"id": "dc987f35-ca2f-4c53-b5d1-07e07674ab27", "address": "fa:16:3e:ad:fe:44", "network": {"id": "04cba7ef-eb1c-4a35-b10a-25685666e9b6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-130493983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31ba430fd1d4d5fb882c3ccb3e7c0a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc987f35-ca", "ovs_interfaceid": "dc987f35-ca2f-4c53-b5d1-07e07674ab27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:27:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-0058cded-e359-4fed-8237-b4300b1d6978 req-7f8f6594-bb14-4f71-b22f-6fb6c0b923b5 service nova] Releasing lock "refresh_cache-1cd08fb1-2fab-4381-924d-c394ef259c8d" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:27:35 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:27:35 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:27:35 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:27:36 user nova-compute[75341]: DEBUG nova.compute.manager [req-beba30dc-66d3-43b4-b993-e0f189fa2233 req-e5546041-f19a-4272-9ab8-81147a300c1a service nova] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Received event network-vif-plugged-dc987f35-ca2f-4c53-b5d1-07e07674ab27 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:27:36 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-beba30dc-66d3-43b4-b993-e0f189fa2233 req-e5546041-f19a-4272-9ab8-81147a300c1a service nova] Acquiring lock "1cd08fb1-2fab-4381-924d-c394ef259c8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:27:36 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-beba30dc-66d3-43b4-b993-e0f189fa2233 req-e5546041-f19a-4272-9ab8-81147a300c1a service nova] Lock "1cd08fb1-2fab-4381-924d-c394ef259c8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:27:36 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-beba30dc-66d3-43b4-b993-e0f189fa2233 req-e5546041-f19a-4272-9ab8-81147a300c1a service nova] Lock "1cd08fb1-2fab-4381-924d-c394ef259c8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:27:36 user nova-compute[75341]: DEBUG nova.compute.manager [req-beba30dc-66d3-43b4-b993-e0f189fa2233 req-e5546041-f19a-4272-9ab8-81147a300c1a service nova] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] No waiting events found dispatching network-vif-plugged-dc987f35-ca2f-4c53-b5d1-07e07674ab27 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:27:36 user nova-compute[75341]: WARNING nova.compute.manager [req-beba30dc-66d3-43b4-b993-e0f189fa2233 req-e5546041-f19a-4272-9ab8-81147a300c1a service nova] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Received unexpected event network-vif-plugged-dc987f35-ca2f-4c53-b5d1-07e07674ab27 for instance with vm_state building and task_state spawning.
Nov 15 00:27:36 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:27:36 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:27:36 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:27:36 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:27:37 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:27:37 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:27:37 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:27:38 user nova-compute[75341]: DEBUG nova.compute.manager [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Instance event wait completed in 0 seconds for  {{(pid=75341) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 00:27:38 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Guest created on hypervisor {{(pid=75341) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 00:27:38 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Instance spawned successfully.
Nov 15 00:27:38 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 00:27:38 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Found default for hw_cdrom_bus of ide {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 00:27:38 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Found default for hw_disk_bus of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 00:27:38 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Found default for hw_input_bus of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 00:27:38 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Found default for hw_pointer_model of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 00:27:38 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Found default for hw_video_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 00:27:38 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Found default for hw_vif_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 00:27:38 user nova-compute[75341]: INFO nova.compute.manager [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Took 5.30 seconds to spawn the instance on the hypervisor.
Nov 15 00:27:38 user nova-compute[75341]: DEBUG nova.compute.manager [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 00:27:38 user nova-compute[75341]: DEBUG nova.compute.manager [req-44c02671-7f45-42dc-bed4-a80610f47128 req-9e150141-3644-4fe9-b354-1b232bd2170f service nova] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Received event network-vif-plugged-dc987f35-ca2f-4c53-b5d1-07e07674ab27 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:27:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-44c02671-7f45-42dc-bed4-a80610f47128 req-9e150141-3644-4fe9-b354-1b232bd2170f service nova] Acquiring lock "1cd08fb1-2fab-4381-924d-c394ef259c8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:27:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-44c02671-7f45-42dc-bed4-a80610f47128 req-9e150141-3644-4fe9-b354-1b232bd2170f service nova] Lock "1cd08fb1-2fab-4381-924d-c394ef259c8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:27:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-44c02671-7f45-42dc-bed4-a80610f47128 req-9e150141-3644-4fe9-b354-1b232bd2170f service nova] Lock "1cd08fb1-2fab-4381-924d-c394ef259c8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:27:38 user nova-compute[75341]: DEBUG nova.compute.manager [req-44c02671-7f45-42dc-bed4-a80610f47128 req-9e150141-3644-4fe9-b354-1b232bd2170f service nova] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] No waiting events found dispatching network-vif-plugged-dc987f35-ca2f-4c53-b5d1-07e07674ab27 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:27:38 user nova-compute[75341]: WARNING nova.compute.manager [req-44c02671-7f45-42dc-bed4-a80610f47128 req-9e150141-3644-4fe9-b354-1b232bd2170f service nova] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Received unexpected event network-vif-plugged-dc987f35-ca2f-4c53-b5d1-07e07674ab27 for instance with vm_state building and task_state spawning.
Nov 15 00:27:38 user nova-compute[75341]: INFO nova.compute.manager [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Took 5.94 seconds to build instance.
Nov 15 00:27:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-b6e54d76-f91c-4d1a-8d2a-18ffb0a92e4d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Lock "1cd08fb1-2fab-4381-924d-c394ef259c8d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.282s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:27:38 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:27:38 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Starting heal instance info cache {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 00:27:38 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Rebuilding the list of instances to heal {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 00:27:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "refresh_cache-1cd08fb1-2fab-4381-924d-c394ef259c8d" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:27:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquired lock "refresh_cache-1cd08fb1-2fab-4381-924d-c394ef259c8d" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:27:38 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Forcefully refreshing network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 00:27:38 user nova-compute[75341]: DEBUG nova.objects.instance [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lazy-loading 'info_cache' on Instance uuid 1cd08fb1-2fab-4381-924d-c394ef259c8d {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:27:39 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Updating instance_info_cache with network_info: [{"id": "dc987f35-ca2f-4c53-b5d1-07e07674ab27", "address": "fa:16:3e:ad:fe:44", "network": {"id": "04cba7ef-eb1c-4a35-b10a-25685666e9b6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-130493983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31ba430fd1d4d5fb882c3ccb3e7c0a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc987f35-ca", "ovs_interfaceid": "dc987f35-ca2f-4c53-b5d1-07e07674ab27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:27:39 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Releasing lock "refresh_cache-1cd08fb1-2fab-4381-924d-c394ef259c8d" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:27:39 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Updated the network info_cache for instance {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 00:27:39 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:27:42 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:27:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:27:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:27:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:27:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:27:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:27:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:27:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:27:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:27:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:27:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:27:59 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:28:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:28:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:28:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:28:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:28:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:28:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:28:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:28:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:28:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:28:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:28:19 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4996-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:28:23 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:28:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:28:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:28:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:28:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:28:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:28:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:28:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:28:29 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:28:29 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75341) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 00:28:30 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:28:33 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:28:34 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:28:34 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:28:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:28:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:28:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:28:34 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75341) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 00:28:35 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd08fb1-2fab-4381-924d-c394ef259c8d/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:28:35 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd08fb1-2fab-4381-924d-c394ef259c8d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:28:35 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd08fb1-2fab-4381-924d-c394ef259c8d/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:28:35 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd08fb1-2fab-4381-924d-c394ef259c8d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:28:35 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:28:35 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:28:35 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Hypervisor/Node resource view: name=user free_ram=9000MB free_disk=25.28057861328125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75341) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 00:28:35 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:28:35 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:28:35 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 1cd08fb1-2fab-4381-924d-c394ef259c8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:28:35 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 00:28:35 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 00:28:35 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 00:28:35 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 00:28:35 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Compute_service record updated for user:user {{(pid=75341) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 00:28:35 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.189s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:28:36 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:28:37 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:28:38 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:28:39 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:28:39 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:28:39 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Starting heal instance info cache {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 00:28:39 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Rebuilding the list of instances to heal {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 00:28:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "refresh_cache-1cd08fb1-2fab-4381-924d-c394ef259c8d" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:28:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquired lock "refresh_cache-1cd08fb1-2fab-4381-924d-c394ef259c8d" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:28:40 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Forcefully refreshing network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 00:28:40 user nova-compute[75341]: DEBUG nova.objects.instance [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lazy-loading 'info_cache' on Instance uuid 1cd08fb1-2fab-4381-924d-c394ef259c8d {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:28:40 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Updating instance_info_cache with network_info: [{"id": "dc987f35-ca2f-4c53-b5d1-07e07674ab27", "address": "fa:16:3e:ad:fe:44", "network": {"id": "04cba7ef-eb1c-4a35-b10a-25685666e9b6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-130493983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31ba430fd1d4d5fb882c3ccb3e7c0a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc987f35-ca", "ovs_interfaceid": "dc987f35-ca2f-4c53-b5d1-07e07674ab27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:28:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Releasing lock "refresh_cache-1cd08fb1-2fab-4381-924d-c394ef259c8d" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:28:40 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Updated the network info_cache for instance {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 00:28:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:28:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:28:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:28:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:28:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:28:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:28:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:28:53 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:28:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:28:59 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:29:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:29:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:29:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:29:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:29:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:29:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:29:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:29:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:29:19 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:29:19 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:29:19 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:29:19 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:29:19 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:29:19 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:29:22 user nova-compute[75341]: DEBUG nova.compute.manager [req-f0d5db3e-2d1f-4599-a88c-2b64eb261071 req-638865ff-5827-4f01-8994-2f0f90b4f39c service nova] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Received event network-changed-dc987f35-ca2f-4c53-b5d1-07e07674ab27 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:29:22 user nova-compute[75341]: DEBUG nova.compute.manager [req-f0d5db3e-2d1f-4599-a88c-2b64eb261071 req-638865ff-5827-4f01-8994-2f0f90b4f39c service nova] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Refreshing instance network info cache due to event network-changed-dc987f35-ca2f-4c53-b5d1-07e07674ab27. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 00:29:22 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-f0d5db3e-2d1f-4599-a88c-2b64eb261071 req-638865ff-5827-4f01-8994-2f0f90b4f39c service nova] Acquiring lock "refresh_cache-1cd08fb1-2fab-4381-924d-c394ef259c8d" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:29:22 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-f0d5db3e-2d1f-4599-a88c-2b64eb261071 req-638865ff-5827-4f01-8994-2f0f90b4f39c service nova] Acquired lock "refresh_cache-1cd08fb1-2fab-4381-924d-c394ef259c8d" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:29:22 user nova-compute[75341]: DEBUG nova.network.neutron [req-f0d5db3e-2d1f-4599-a88c-2b64eb261071 req-638865ff-5827-4f01-8994-2f0f90b4f39c service nova] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Refreshing network info cache for port dc987f35-ca2f-4c53-b5d1-07e07674ab27 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 00:29:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:29:23 user nova-compute[75341]: DEBUG nova.network.neutron [req-f0d5db3e-2d1f-4599-a88c-2b64eb261071 req-638865ff-5827-4f01-8994-2f0f90b4f39c service nova] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Updated VIF entry in instance network info cache for port dc987f35-ca2f-4c53-b5d1-07e07674ab27. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 00:29:23 user nova-compute[75341]: DEBUG nova.network.neutron [req-f0d5db3e-2d1f-4599-a88c-2b64eb261071 req-638865ff-5827-4f01-8994-2f0f90b4f39c service nova] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Updating instance_info_cache with network_info: [{"id": "dc987f35-ca2f-4c53-b5d1-07e07674ab27", "address": "fa:16:3e:ad:fe:44", "network": {"id": "04cba7ef-eb1c-4a35-b10a-25685666e9b6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-130493983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31ba430fd1d4d5fb882c3ccb3e7c0a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc987f35-ca", "ovs_interfaceid": "dc987f35-ca2f-4c53-b5d1-07e07674ab27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:29:23 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-f0d5db3e-2d1f-4599-a88c-2b64eb261071 req-638865ff-5827-4f01-8994-2f0f90b4f39c service nova] Releasing lock "refresh_cache-1cd08fb1-2fab-4381-924d-c394ef259c8d" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:29:23 user nova-compute[75341]: DEBUG nova.compute.manager [None req-d3b0194a-9d7f-4dbe-a366-a8b411acb1a9 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 00:29:23 user nova-compute[75341]: INFO nova.compute.manager [None req-d3b0194a-9d7f-4dbe-a366-a8b411acb1a9 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] instance snapshotting
Nov 15 00:29:23 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-d3b0194a-9d7f-4dbe-a366-a8b411acb1a9 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Beginning live snapshot process
Nov 15 00:29:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-d3b0194a-9d7f-4dbe-a366-a8b411acb1a9 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd08fb1-2fab-4381-924d-c394ef259c8d/disk --force-share --output=json -f qcow2 {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:29:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-d3b0194a-9d7f-4dbe-a366-a8b411acb1a9 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd08fb1-2fab-4381-924d-c394ef259c8d/disk --force-share --output=json -f qcow2" returned: 0 in 0.194s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:29:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-d3b0194a-9d7f-4dbe-a366-a8b411acb1a9 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd08fb1-2fab-4381-924d-c394ef259c8d/disk --force-share --output=json -f qcow2 {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:29:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-d3b0194a-9d7f-4dbe-a366-a8b411acb1a9 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd08fb1-2fab-4381-924d-c394ef259c8d/disk --force-share --output=json -f qcow2" returned: 0 in 0.205s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:29:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-d3b0194a-9d7f-4dbe-a366-a8b411acb1a9 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:29:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-d3b0194a-9d7f-4dbe-a366-a8b411acb1a9 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.169s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:29:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-d3b0194a-9d7f-4dbe-a366-a8b411acb1a9 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpyu95hzme/ba3d4a99221e47d0a5cebb9ee1851c1e.delta 1073741824 {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:29:24 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-d3b0194a-9d7f-4dbe-a366-a8b411acb1a9 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpyu95hzme/ba3d4a99221e47d0a5cebb9ee1851c1e.delta 1073741824" returned: 0 in 0.052s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:29:24 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-d3b0194a-9d7f-4dbe-a366-a8b411acb1a9 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 15 00:29:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:29:25 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-d3b0194a-9d7f-4dbe-a366-a8b411acb1a9 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75341) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 00:29:25 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-d3b0194a-9d7f-4dbe-a366-a8b411acb1a9 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75341) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 00:29:25 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-d3b0194a-9d7f-4dbe-a366-a8b411acb1a9 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 15 00:29:25 user nova-compute[75341]: DEBUG nova.privsep.utils [None req-d3b0194a-9d7f-4dbe-a366-a8b411acb1a9 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75341) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 00:29:25 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-d3b0194a-9d7f-4dbe-a366-a8b411acb1a9 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpyu95hzme/ba3d4a99221e47d0a5cebb9ee1851c1e.delta /opt/stack/data/nova/instances/snapshots/tmpyu95hzme/ba3d4a99221e47d0a5cebb9ee1851c1e {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:29:25 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:29:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-d3b0194a-9d7f-4dbe-a366-a8b411acb1a9 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpyu95hzme/ba3d4a99221e47d0a5cebb9ee1851c1e.delta /opt/stack/data/nova/instances/snapshots/tmpyu95hzme/ba3d4a99221e47d0a5cebb9ee1851c1e" returned: 0 in 0.582s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:29:26 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-d3b0194a-9d7f-4dbe-a366-a8b411acb1a9 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Snapshot extracted, beginning image upload
Nov 15 00:29:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:29:28 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-d3b0194a-9d7f-4dbe-a366-a8b411acb1a9 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Snapshot image upload complete
Nov 15 00:29:28 user nova-compute[75341]: INFO nova.compute.manager [None req-d3b0194a-9d7f-4dbe-a366-a8b411acb1a9 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Took 5.14 seconds to snapshot the instance on the hypervisor.
Nov 15 00:29:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:29:29 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:29:29 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75341) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 00:29:31 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:29:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:29:33 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:29:34 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:29:34 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:29:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:29:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:29:34 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:29:34 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75341) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 00:29:35 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd08fb1-2fab-4381-924d-c394ef259c8d/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:29:35 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd08fb1-2fab-4381-924d-c394ef259c8d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:29:35 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd08fb1-2fab-4381-924d-c394ef259c8d/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:29:35 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd08fb1-2fab-4381-924d-c394ef259c8d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:29:35 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:29:35 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:29:35 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Hypervisor/Node resource view: name=user free_ram=9006MB free_disk=25.230987548828125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75341) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 00:29:35 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:29:35 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:29:35 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 1cd08fb1-2fab-4381-924d-c394ef259c8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:29:35 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 00:29:35 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 00:29:35 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 00:29:35 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 00:29:35 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Compute_service record updated for user:user {{(pid=75341) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 00:29:35 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.163s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:29:36 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:29:37 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:29:38 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:29:39 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:29:39 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:29:39 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:29:39 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Starting heal instance info cache {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 00:29:39 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Rebuilding the list of instances to heal {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 00:29:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "refresh_cache-1cd08fb1-2fab-4381-924d-c394ef259c8d" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:29:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquired lock "refresh_cache-1cd08fb1-2fab-4381-924d-c394ef259c8d" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:29:40 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Forcefully refreshing network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 00:29:40 user nova-compute[75341]: DEBUG nova.objects.instance [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lazy-loading 'info_cache' on Instance uuid 1cd08fb1-2fab-4381-924d-c394ef259c8d {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:29:40 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Updating instance_info_cache with network_info: [{"id": "dc987f35-ca2f-4c53-b5d1-07e07674ab27", "address": "fa:16:3e:ad:fe:44", "network": {"id": "04cba7ef-eb1c-4a35-b10a-25685666e9b6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-130493983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31ba430fd1d4d5fb882c3ccb3e7c0a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc987f35-ca", "ovs_interfaceid": "dc987f35-ca2f-4c53-b5d1-07e07674ab27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:29:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Releasing lock "refresh_cache-1cd08fb1-2fab-4381-924d-c394ef259c8d" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:29:40 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Updated the network info_cache for instance {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 00:29:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:29:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:29:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:29:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:29:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:29:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:29:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:29:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:29:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:29:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:29:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:29:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:29:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:29:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:29:59 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:30:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:30:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:30:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:30:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:30:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:30:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:30:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:30:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:30:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:30:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:30:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:30:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:30:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:30:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:30:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:30:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:30:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:30:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:30:19 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:30:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:30:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:30:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:30:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:30:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:30:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:30:26 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:30:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:30:30 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:30:30 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75341) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 00:30:31 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:30:33 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:30:34 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:30:36 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:30:36 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:30:36 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:30:36 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:30:36 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75341) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 00:30:37 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd08fb1-2fab-4381-924d-c394ef259c8d/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:30:37 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd08fb1-2fab-4381-924d-c394ef259c8d/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:30:37 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd08fb1-2fab-4381-924d-c394ef259c8d/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:30:37 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd08fb1-2fab-4381-924d-c394ef259c8d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:30:37 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:30:37 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:30:37 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Hypervisor/Node resource view: name=user free_ram=9016MB free_disk=25.23040008544922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75341) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 00:30:37 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:30:37 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:30:37 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 1cd08fb1-2fab-4381-924d-c394ef259c8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:30:37 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 00:30:37 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 00:30:38 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 00:30:38 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 00:30:38 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Compute_service record updated for user:user {{(pid=75341) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 00:30:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.191s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:30:39 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:30:39 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:30:39 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:30:39 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:30:41 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:30:41 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Starting heal instance info cache {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 00:30:41 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Rebuilding the list of instances to heal {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 00:30:42 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "refresh_cache-1cd08fb1-2fab-4381-924d-c394ef259c8d" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:30:42 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquired lock "refresh_cache-1cd08fb1-2fab-4381-924d-c394ef259c8d" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:30:42 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Forcefully refreshing network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 00:30:42 user nova-compute[75341]: DEBUG nova.objects.instance [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lazy-loading 'info_cache' on Instance uuid 1cd08fb1-2fab-4381-924d-c394ef259c8d {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:30:42 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Updating instance_info_cache with network_info: [{"id": "dc987f35-ca2f-4c53-b5d1-07e07674ab27", "address": "fa:16:3e:ad:fe:44", "network": {"id": "04cba7ef-eb1c-4a35-b10a-25685666e9b6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-130493983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31ba430fd1d4d5fb882c3ccb3e7c0a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc987f35-ca", "ovs_interfaceid": "dc987f35-ca2f-4c53-b5d1-07e07674ab27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:30:42 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Releasing lock "refresh_cache-1cd08fb1-2fab-4381-924d-c394ef259c8d" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:30:42 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Updated the network info_cache for instance {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 00:30:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:30:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:30:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:30:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:30:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:30:44 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:30:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:30:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:30:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:30:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:30:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:30:49 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:30:54 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:30:55 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:30:59 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:31:04 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:31:09 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:31:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:31:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ae791df8-f8a4-4117-9580-269150fe9df2 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Acquiring lock "1cd08fb1-2fab-4381-924d-c394ef259c8d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:31:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ae791df8-f8a4-4117-9580-269150fe9df2 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Lock "1cd08fb1-2fab-4381-924d-c394ef259c8d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:31:15 user nova-compute[75341]: DEBUG nova.objects.instance [None req-ae791df8-f8a4-4117-9580-269150fe9df2 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Lazy-loading 'flavor' on Instance uuid 1cd08fb1-2fab-4381-924d-c394ef259c8d {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:31:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ae791df8-f8a4-4117-9580-269150fe9df2 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Lock "1cd08fb1-2fab-4381-924d-c394ef259c8d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:31:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ae791df8-f8a4-4117-9580-269150fe9df2 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Acquiring lock "1cd08fb1-2fab-4381-924d-c394ef259c8d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:31:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ae791df8-f8a4-4117-9580-269150fe9df2 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Lock "1cd08fb1-2fab-4381-924d-c394ef259c8d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:31:15 user nova-compute[75341]: INFO nova.compute.manager [None req-ae791df8-f8a4-4117-9580-269150fe9df2 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Attaching volume fb942950-6a65-46f6-9c81-f0daf87040a5 to /dev/vdb
Nov 15 00:31:15 user nova-compute[75341]: DEBUG os_brick.utils [None req-ae791df8-f8a4-4117-9580-269150fe9df2 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 00:31:15 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:31:15 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:31:15 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b2ecb5-0dcc-448b-bd44-5140952ad341]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6d1cfca09c9\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:31:15 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:31:15 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:31:15 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d7e6d5b-fd3e-491a-9fc5-5a25a784d30a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:31:15 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:31:15 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:31:15 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1bb5fe-2d80-45c3-bbd9-d03d1f0dba80]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:31:15 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[0132c1d8-ac29-4210-adb2-3573b59dfdf7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:31:15 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-ae791df8-f8a4-4117-9580-269150fe9df2 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Running cmd (subprocess): nvme version {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:31:15 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-ae791df8-f8a4-4117-9580-269150fe9df2 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] 'nvme version' failed. Not Retrying. {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 00:31:15 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ae791df8-f8a4-4117-9580-269150fe9df2 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] nvme not present on system {{(pid=75341) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 00:31:15 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:31:15 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 00:31:15 user nova-compute[75341]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 00:31:15 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5778b82-79a5-4a8a-95bb-4d2d2d82bbfe]: (4, '') {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:31:15 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-ae791df8-f8a4-4117-9580-269150fe9df2 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75341) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 00:31:15 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-ae791df8-f8a4-4117-9580-269150fe9df2 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 00:31:15 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.lightos [None req-ae791df8-f8a4-4117-9580-269150fe9df2 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] LIGHTOS: no hostnqn found. {{(pid=75341) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 00:31:15 user nova-compute[75341]: DEBUG os_brick.utils [None req-ae791df8-f8a4-4117-9580-269150fe9df2 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6d1cfca09c9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 00:31:15 user nova-compute[75341]: DEBUG nova.virt.block_device [None req-ae791df8-f8a4-4117-9580-269150fe9df2 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Updating existing volume attachment record: b91a2f1b-2ebc-4a5f-b495-df3768aad735 {{(pid=75341) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 00:31:19 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:31:20 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae791df8-f8a4-4117-9580-269150fe9df2 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Calling os-brick to attach iSCSI Volume {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 00:31:20 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae791df8-f8a4-4117-9580-269150fe9df2 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PWyMvbij', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 00:31:20 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-ae791df8-f8a4-4117-9580-269150fe9df2 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 00:31:20 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-ae791df8-f8a4-4117-9580-269150fe9df2 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 00:31:20 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-ae791df8-f8a4-4117-9580-269150fe9df2 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 00:31:20 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-ae791df8-f8a4-4117-9580-269150fe9df2 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 00:31:20 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-ae791df8-f8a4-4117-9580-269150fe9df2 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 00:31:20 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-ae791df8-f8a4-4117-9580-269150fe9df2 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 00:31:20 user nova-compute[75341]: INFO os_brick.initiator.connectors.iscsi [None req-ae791df8-f8a4-4117-9580-269150fe9df2 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 00:31:20 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5 -p 172.16.0.220:3260 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:31:20 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:31:20 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a9308e-c9fe-4d60-8b70-cbfd8e2eb447]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:31:20 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae791df8-f8a4-4117-9580-269150fe9df2 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 00:31:20 user nova-compute[75341]:  {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:31:20 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:31:20 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:31:20 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[48754cbf-6c2e-452d-8c64-0af36033a65f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5] added\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:31:20 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae791df8-f8a4-4117-9580-269150fe9df2 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5] added
Nov 15 00:31:20 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:31:20 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:31:20 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:31:20 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[8635e56e-c63a-4e62-b5cd-0a5161da6178]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:31:20 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae791df8-f8a4-4117-9580-269150fe9df2 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:31:20 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:31:20 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:31:20 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb2b300-24b9-4089-9529-60a91632b927]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:31:20 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae791df8-f8a4-4117-9580-269150fe9df2 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:31:20 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PWyMvbij {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:31:20 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PWyMvbij" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:31:20 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42becda-7e84-40d3-9ec7-5135ea1cb3bc]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:31:20 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae791df8-f8a4-4117-9580-269150fe9df2 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PWyMvbij'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:31:20 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:31:20 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:31:20 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[53de65a0-5920-4e5b-bb9b-b9d7061e9dd2]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:31:20 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae791df8-f8a4-4117-9580-269150fe9df2 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:31:20 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:31:20 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:31:20 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[53efb2d6-5e24-4d01-a763-b306ea6d76af]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:31:20 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae791df8-f8a4-4117-9580-269150fe9df2 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 00:31:20 user nova-compute[75341]:  {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 00:31:20 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae791df8-f8a4-4117-9580-269150fe9df2 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 00:31:20 user nova-compute[75341]:  {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 00:31:20 user nova-compute[75341]: WARNING os_brick.initiator.connectors.iscsi [None req-ae791df8-f8a4-4117-9580-269150fe9df2 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 00:31:20 user nova-compute[75341]: 
Nov 15 00:31:20 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5 -p 172.16.0.220:3260 --login {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:31:20 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:31:20 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9fc678-974e-4f86-989f-23993de28443]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:31:20 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae791df8-f8a4-4117-9580-269150fe9df2 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5, portal: 172.16.0.220,3260]
Nov 15 00:31:20 user nova-compute[75341]: Login to [iface: default, target: iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5, portal: 172.16.0.220,3260] successful.
Nov 15 00:31:20 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:31:20 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:31:20 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:31:20 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b316fa7-de47-40ca-bac9-d5c5c7f416a6]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:31:20 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae791df8-f8a4-4117-9580-269150fe9df2 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:31:20 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:31:20 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:31:20 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec27a57-1237-4b85-b9a4-86ad11b9a10d]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:31:20 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae791df8-f8a4-4117-9580-269150fe9df2 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5 (non-flash)
Nov 15 00:31:20 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 00:31:20 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae791df8-f8a4-4117-9580-269150fe9df2 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5 (non-flash)
Nov 15 00:31:20 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 00:31:20 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-ae791df8-f8a4-4117-9580-269150fe9df2 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 00:31:20 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae791df8-f8a4-4117-9580-269150fe9df2 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Connected to 172.16.0.220:3260 {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 00:31:20 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-ae791df8-f8a4-4117-9580-269150fe9df2 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=75341) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 00:31:20 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-ae791df8-f8a4-4117-9580-269150fe9df2 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75341) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 00:31:20 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:31:20 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:31:20 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[874f5832-0d5d-4378-bba7-6ea09be0d158]: (4, ('- - 0', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:31:20 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-ae791df8-f8a4-4117-9580-269150fe9df2 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: None {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 00:31:20 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:31:21 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-ae791df8-f8a4-4117-9580-269150fe9df2 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 00:31:21 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae791df8-f8a4-4117-9580-269150fe9df2 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PWyMvbij', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 00:31:21 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-ae791df8-f8a4-4117-9580-269150fe9df2 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 00:31:21 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae791df8-f8a4-4117-9580-269150fe9df2 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '26330623338656561', 'path': '/dev/sdb'} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 00:31:21 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae791df8-f8a4-4117-9580-269150fe9df2 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26330623338656561', 'path': '/dev/sdb'} {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 00:31:21 user nova-compute[75341]: DEBUG nova.objects.instance [None req-ae791df8-f8a4-4117-9580-269150fe9df2 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Lazy-loading 'flavor' on Instance uuid 1cd08fb1-2fab-4381-924d-c394ef259c8d {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:31:21 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-ae791df8-f8a4-4117-9580-269150fe9df2 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 00:31:21 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 00:31:21 user nova-compute[75341]:   <source dev="/dev/sdb"/>
Nov 15 00:31:21 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 15 00:31:21 user nova-compute[75341]:   <serial>fb942950-6a65-46f6-9c81-f0daf87040a5</serial>
Nov 15 00:31:21 user nova-compute[75341]: </disk>
Nov 15 00:31:21 user nova-compute[75341]:  {{(pid=75341) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 00:31:22 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-ae791df8-f8a4-4117-9580-269150fe9df2 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 00:31:22 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-ae791df8-f8a4-4117-9580-269150fe9df2 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 00:31:22 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-ae791df8-f8a4-4117-9580-269150fe9df2 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] No VIF found with MAC fa:16:3e:ad:fe:44, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 00:31:22 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-ae791df8-f8a4-4117-9580-269150fe9df2 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Lock "1cd08fb1-2fab-4381-924d-c394ef259c8d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.078s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:31:23 user nova-compute[75341]: INFO nova.compute.manager [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Rescuing
Nov 15 00:31:23 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Acquiring lock "refresh_cache-1cd08fb1-2fab-4381-924d-c394ef259c8d" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:31:23 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Acquired lock "refresh_cache-1cd08fb1-2fab-4381-924d-c394ef259c8d" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:31:23 user nova-compute[75341]: DEBUG nova.network.neutron [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 00:31:23 user nova-compute[75341]: DEBUG nova.network.neutron [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Updating instance_info_cache with network_info: [{"id": "dc987f35-ca2f-4c53-b5d1-07e07674ab27", "address": "fa:16:3e:ad:fe:44", "network": {"id": "04cba7ef-eb1c-4a35-b10a-25685666e9b6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-130493983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31ba430fd1d4d5fb882c3ccb3e7c0a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc987f35-ca", "ovs_interfaceid": "dc987f35-ca2f-4c53-b5d1-07e07674ab27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:31:23 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Releasing lock "refresh_cache-1cd08fb1-2fab-4381-924d-c394ef259c8d" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:31:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:31:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:31:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:31:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:31:24 user nova-compute[75341]: DEBUG nova.compute.manager [req-cb6e2f2b-b413-488c-a47d-bc8119d31c36 req-b7ac8b9b-4db6-4337-96c1-582ba2f3eada service nova] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Received event network-vif-unplugged-dc987f35-ca2f-4c53-b5d1-07e07674ab27 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:31:24 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-cb6e2f2b-b413-488c-a47d-bc8119d31c36 req-b7ac8b9b-4db6-4337-96c1-582ba2f3eada service nova] Acquiring lock "1cd08fb1-2fab-4381-924d-c394ef259c8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:31:24 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-cb6e2f2b-b413-488c-a47d-bc8119d31c36 req-b7ac8b9b-4db6-4337-96c1-582ba2f3eada service nova] Lock "1cd08fb1-2fab-4381-924d-c394ef259c8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:31:24 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-cb6e2f2b-b413-488c-a47d-bc8119d31c36 req-b7ac8b9b-4db6-4337-96c1-582ba2f3eada service nova] Lock "1cd08fb1-2fab-4381-924d-c394ef259c8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:31:24 user nova-compute[75341]: DEBUG nova.compute.manager [req-cb6e2f2b-b413-488c-a47d-bc8119d31c36 req-b7ac8b9b-4db6-4337-96c1-582ba2f3eada service nova] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] No waiting events found dispatching network-vif-unplugged-dc987f35-ca2f-4c53-b5d1-07e07674ab27 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:31:24 user nova-compute[75341]: WARNING nova.compute.manager [req-cb6e2f2b-b413-488c-a47d-bc8119d31c36 req-b7ac8b9b-4db6-4337-96c1-582ba2f3eada service nova] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Received unexpected event network-vif-unplugged-dc987f35-ca2f-4c53-b5d1-07e07674ab27 for instance with vm_state active and task_state rescuing.
Nov 15 00:31:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:31:24 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Instance destroyed successfully.
Nov 15 00:31:24 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Attempting a stable device rescue
Nov 15 00:31:24 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75341) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 00:31:24 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Instance directory exists: not creating {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 00:31:24 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Creating image(s)
Nov 15 00:31:24 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Acquiring lock "/opt/stack/data/nova/instances/1cd08fb1-2fab-4381-924d-c394ef259c8d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:31:24 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Lock "/opt/stack/data/nova/instances/1cd08fb1-2fab-4381-924d-c394ef259c8d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:31:24 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Lock "/opt/stack/data/nova/instances/1cd08fb1-2fab-4381-924d-c394ef259c8d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:31:24 user nova-compute[75341]: DEBUG nova.objects.instance [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1cd08fb1-2fab-4381-924d-c394ef259c8d {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:31:24 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Acquiring lock "a65c9f2322e971cd4aafb5e6f45dc7db1e80fed4" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:31:24 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Lock "a65c9f2322e971cd4aafb5e6f45dc7db1e80fed4" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:31:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:31:25 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a65c9f2322e971cd4aafb5e6f45dc7db1e80fed4.part --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:31:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a65c9f2322e971cd4aafb5e6f45dc7db1e80fed4.part --force-share --output=json" returned: 0 in 0.185s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:31:26 user nova-compute[75341]: DEBUG nova.virt.images [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] 403396b6-d2a4-4d49-a1c3-c68aeb1dfc5e was qcow2, converting to raw {{(pid=75341) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 00:31:26 user nova-compute[75341]: DEBUG nova.privsep.utils [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75341) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 00:31:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a65c9f2322e971cd4aafb5e6f45dc7db1e80fed4.part /opt/stack/data/nova/instances/_base/a65c9f2322e971cd4aafb5e6f45dc7db1e80fed4.converted {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:31:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a65c9f2322e971cd4aafb5e6f45dc7db1e80fed4.part /opt/stack/data/nova/instances/_base/a65c9f2322e971cd4aafb5e6f45dc7db1e80fed4.converted" returned: 0 in 0.268s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:31:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a65c9f2322e971cd4aafb5e6f45dc7db1e80fed4.converted --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:31:26 user nova-compute[75341]: DEBUG nova.compute.manager [req-e997b444-f56a-47bb-9368-3baab1972936 req-f1ecd798-5307-4445-9288-bdfa42ab219d service nova] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Received event network-vif-plugged-dc987f35-ca2f-4c53-b5d1-07e07674ab27 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:31:26 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-e997b444-f56a-47bb-9368-3baab1972936 req-f1ecd798-5307-4445-9288-bdfa42ab219d service nova] Acquiring lock "1cd08fb1-2fab-4381-924d-c394ef259c8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:31:26 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-e997b444-f56a-47bb-9368-3baab1972936 req-f1ecd798-5307-4445-9288-bdfa42ab219d service nova] Lock "1cd08fb1-2fab-4381-924d-c394ef259c8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:31:26 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-e997b444-f56a-47bb-9368-3baab1972936 req-f1ecd798-5307-4445-9288-bdfa42ab219d service nova] Lock "1cd08fb1-2fab-4381-924d-c394ef259c8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:31:26 user nova-compute[75341]: DEBUG nova.compute.manager [req-e997b444-f56a-47bb-9368-3baab1972936 req-f1ecd798-5307-4445-9288-bdfa42ab219d service nova] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] No waiting events found dispatching network-vif-plugged-dc987f35-ca2f-4c53-b5d1-07e07674ab27 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:31:26 user nova-compute[75341]: WARNING nova.compute.manager [req-e997b444-f56a-47bb-9368-3baab1972936 req-f1ecd798-5307-4445-9288-bdfa42ab219d service nova] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Received unexpected event network-vif-plugged-dc987f35-ca2f-4c53-b5d1-07e07674ab27 for instance with vm_state active and task_state rescuing.
Nov 15 00:31:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a65c9f2322e971cd4aafb5e6f45dc7db1e80fed4.converted --force-share --output=json" returned: 0 in 0.182s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:31:26 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Lock "a65c9f2322e971cd4aafb5e6f45dc7db1e80fed4" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.754s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:31:26 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Acquiring lock "a65c9f2322e971cd4aafb5e6f45dc7db1e80fed4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:31:26 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Lock "a65c9f2322e971cd4aafb5e6f45dc7db1e80fed4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:31:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a65c9f2322e971cd4aafb5e6f45dc7db1e80fed4 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:31:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a65c9f2322e971cd4aafb5e6f45dc7db1e80fed4 --force-share --output=json" returned: 0 in 0.173s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:31:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a65c9f2322e971cd4aafb5e6f45dc7db1e80fed4,backing_fmt=raw /opt/stack/data/nova/instances/1cd08fb1-2fab-4381-924d-c394ef259c8d/disk.rescue {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:31:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a65c9f2322e971cd4aafb5e6f45dc7db1e80fed4,backing_fmt=raw /opt/stack/data/nova/instances/1cd08fb1-2fab-4381-924d-c394ef259c8d/disk.rescue" returned: 0 in 0.049s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:31:26 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Lock "a65c9f2322e971cd4aafb5e6f45dc7db1e80fed4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:31:26 user nova-compute[75341]: DEBUG nova.objects.instance [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Lazy-loading 'migration_context' on Instance uuid 1cd08fb1-2fab-4381-924d-c394ef259c8d {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:31:26 user nova-compute[75341]: DEBUG nova.objects.base [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Object Instance<1cd08fb1-2fab-4381-924d-c394ef259c8d> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75341) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 00:31:26 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Created local disks {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 00:31:26 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Start _get_guest_xml network_info=[{"id": "dc987f35-ca2f-4c53-b5d1-07e07674ab27", "address": "fa:16:3e:ad:fe:44", "network": {"id": "04cba7ef-eb1c-4a35-b10a-25685666e9b6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-130493983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-130493983-network", "vif_mac": "fa:16:3e:ad:fe:44"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31ba430fd1d4d5fb882c3ccb3e7c0a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc987f35-ca", "ovs_interfaceid": "dc987f35-ca2f-4c53-b5d1-07e07674ab27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '403396b6-d2a4-4d49-a1c3-c68aeb1dfc5e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encrypted': False, 'image_id': 'e46abb82-b810-490e-a8a1-ccdc5fa1a796'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': None, 'attachment_id': 'b91a2f1b-2ebc-4a5f-b495-df3768aad735', 'mount_device': '/dev/vdb', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PWyMvbij', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '1cd08fb1-2fab-4381-924d-c394ef259c8d', 'attached_at': '', 'detached_at': '', 'volume_id': 'fb942950-6a65-46f6-9c81-f0daf87040a5', 'serial': 'fb942950-6a65-46f6-9c81-f0daf87040a5'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 00:31:26 user nova-compute[75341]: DEBUG nova.objects.instance [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Lazy-loading 'resources' on Instance uuid 1cd08fb1-2fab-4381-924d-c394ef259c8d {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:31:26 user nova-compute[75341]: DEBUG nova.objects.base [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Object Instance<1cd08fb1-2fab-4381-924d-c394ef259c8d> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75341) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 00:31:26 user nova-compute[75341]: DEBUG nova.objects.instance [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Lazy-loading 'numa_topology' on Instance uuid 1cd08fb1-2fab-4381-924d-c394ef259c8d {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:31:26 user nova-compute[75341]: DEBUG nova.objects.base [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Object Instance<1cd08fb1-2fab-4381-924d-c394ef259c8d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75341) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 00:31:26 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:31:26 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:31:26 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 00:31:26 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 00:31:26 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 00:31:26 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 00:31:26 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 00:31:26 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 00:31:26 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 00:31:26 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 00:31:26 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 00:31:26 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 00:31:26 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 00:31:26 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 00:31:26 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 00:31:26 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 00:31:26 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 00:31:26 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 00:31:26 user nova-compute[75341]: DEBUG nova.objects.instance [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1cd08fb1-2fab-4381-924d-c394ef259c8d {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:31:26 user nova-compute[75341]: DEBUG nova.objects.base [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Object Instance<1cd08fb1-2fab-4381-924d-c394ef259c8d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75341) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 00:31:26 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Calling os-brick to attach iSCSI Volume {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 00:31:26 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PWyMvbij', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 00:31:26 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 00:31:26 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 00:31:26 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 00:31:26 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 00:31:26 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 00:31:26 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 00:31:26 user nova-compute[75341]: INFO os_brick.initiator.connectors.iscsi [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 00:31:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5 -p 172.16.0.220:3260 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:31:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:31:26 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[9657e3c3-bf3d-4ee1-88ff-1681cf9bdf7e]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = PWyMvbij\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:31:26 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 15 00:31:26 user nova-compute[75341]: node.name = iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5
Nov 15 00:31:26 user nova-compute[75341]: node.tpgt = -1
Nov 15 00:31:26 user nova-compute[75341]: node.startup = automatic
Nov 15 00:31:26 user nova-compute[75341]: node.leading_login = No
Nov 15 00:31:26 user nova-compute[75341]: iface.iscsi_ifacename = default
Nov 15 00:31:26 user nova-compute[75341]: iface.net_ifacename = <empty>
Nov 15 00:31:26 user nova-compute[75341]: iface.ipaddress = <empty>
Nov 15 00:31:26 user nova-compute[75341]: iface.prefix_len = 0
Nov 15 00:31:26 user nova-compute[75341]: iface.hwaddress = <empty>
Nov 15 00:31:26 user nova-compute[75341]: iface.transport_name = tcp
Nov 15 00:31:26 user nova-compute[75341]: iface.initiatorname = <empty>
Nov 15 00:31:26 user nova-compute[75341]: iface.state = <empty>
Nov 15 00:31:26 user nova-compute[75341]: iface.vlan_id = 0
Nov 15 00:31:26 user nova-compute[75341]: iface.vlan_priority = 0
Nov 15 00:31:26 user nova-compute[75341]: iface.vlan_state = <empty>
Nov 15 00:31:26 user nova-compute[75341]: iface.iface_num = 0
Nov 15 00:31:26 user nova-compute[75341]: iface.mtu = 0
Nov 15 00:31:26 user nova-compute[75341]: iface.port = 0
Nov 15 00:31:26 user nova-compute[75341]: iface.bootproto = <empty>
Nov 15 00:31:26 user nova-compute[75341]: iface.subnet_mask = <empty>
Nov 15 00:31:26 user nova-compute[75341]: iface.gateway = <empty>
Nov 15 00:31:26 user nova-compute[75341]: iface.dhcp_alt_client_id_state = <empty>
Nov 15 00:31:26 user nova-compute[75341]: iface.dhcp_alt_client_id = <empty>
Nov 15 00:31:26 user nova-compute[75341]: iface.dhcp_dns = <empty>
Nov 15 00:31:26 user nova-compute[75341]: iface.dhcp_learn_iqn = <empty>
Nov 15 00:31:26 user nova-compute[75341]: iface.dhcp_req_vendor_id_state = <empty>
Nov 15 00:31:26 user nova-compute[75341]: iface.dhcp_vendor_id_state = <empty>
Nov 15 00:31:26 user nova-compute[75341]: iface.dhcp_vendor_id = <empty>
Nov 15 00:31:26 user nova-compute[75341]: iface.dhcp_slp_da = <empty>
Nov 15 00:31:26 user nova-compute[75341]: iface.fragmentation = <empty>
Nov 15 00:31:26 user nova-compute[75341]: iface.gratuitous_arp = <empty>
Nov 15 00:31:26 user nova-compute[75341]: iface.incoming_forwarding = <empty>
Nov 15 00:31:26 user nova-compute[75341]: iface.tos_state = <empty>
Nov 15 00:31:26 user nova-compute[75341]: iface.tos = 0
Nov 15 00:31:26 user nova-compute[75341]: iface.ttl = 0
Nov 15 00:31:26 user nova-compute[75341]: iface.delayed_ack = <empty>
Nov 15 00:31:26 user nova-compute[75341]: iface.tcp_nagle = <empty>
Nov 15 00:31:26 user nova-compute[75341]: iface.tcp_wsf_state = <empty>
Nov 15 00:31:26 user nova-compute[75341]: iface.tcp_wsf = 0
Nov 15 00:31:26 user nova-compute[75341]: iface.tcp_timer_scale = 0
Nov 15 00:31:26 user nova-compute[75341]: iface.tcp_timestamp = <empty>
Nov 15 00:31:26 user nova-compute[75341]: iface.redirect = <empty>
Nov 15 00:31:26 user nova-compute[75341]: iface.def_task_mgmt_timeout = 0
Nov 15 00:31:26 user nova-compute[75341]: iface.header_digest = <empty>
Nov 15 00:31:26 user nova-compute[75341]: iface.data_digest = <empty>
Nov 15 00:31:26 user nova-compute[75341]: iface.immediate_data = <empty>
Nov 15 00:31:26 user nova-compute[75341]: iface.initial_r2t = <empty>
Nov 15 00:31:26 user nova-compute[75341]: iface.data_seq_inorder = <empty>
Nov 15 00:31:26 user nova-compute[75341]: iface.data_pdu_inorder = <empty>
Nov 15 00:31:26 user nova-compute[75341]: iface.erl = 0
Nov 15 00:31:26 user nova-compute[75341]: iface.max_receive_data_len = 0
Nov 15 00:31:26 user nova-compute[75341]: iface.first_burst_len = 0
Nov 15 00:31:26 user nova-compute[75341]: iface.max_outstanding_r2t = 0
Nov 15 00:31:26 user nova-compute[75341]: iface.max_burst_len = 0
Nov 15 00:31:26 user nova-compute[75341]: iface.chap_auth = <empty>
Nov 15 00:31:26 user nova-compute[75341]: iface.bidi_chap = <empty>
Nov 15 00:31:26 user nova-compute[75341]: iface.strict_login_compliance = <empty>
Nov 15 00:31:26 user nova-compute[75341]: iface.discovery_auth = <empty>
Nov 15 00:31:26 user nova-compute[75341]: iface.discovery_logout = <empty>
Nov 15 00:31:26 user nova-compute[75341]: node.discovery_address = <empty>
Nov 15 00:31:26 user nova-compute[75341]: node.discovery_port = 0
Nov 15 00:31:26 user nova-compute[75341]: node.discovery_type = static
Nov 15 00:31:26 user nova-compute[75341]: node.session.initial_cmdsn = 0
Nov 15 00:31:26 user nova-compute[75341]: node.session.initial_login_retry_max = 8
Nov 15 00:31:26 user nova-compute[75341]: node.session.xmit_thread_priority = -20
Nov 15 00:31:26 user nova-compute[75341]: node.session.cmds_max = 128
Nov 15 00:31:26 user nova-compute[75341]: node.session.queue_depth = 32
Nov 15 00:31:26 user nova-compute[75341]: node.session.nr_sessions = 1
Nov 15 00:31:26 user nova-compute[75341]: node.session.auth.authmethod = CHAP
Nov 15 00:31:26 user nova-compute[75341]: node.session.auth.username = PWyMvbij
Nov 15 00:31:26 user nova-compute[75341]: node.session.auth.password = ***
Nov 15 00:31:26 user nova-compute[75341]: node.session.auth.username_in = <empty>
Nov 15 00:31:26 user nova-compute[75341]: node.session.auth.password_in = <empty>
Nov 15 00:31:26 user nova-compute[75341]: node.session.auth.chap_algs = MD5
Nov 15 00:31:26 user nova-compute[75341]: node.session.timeo.replacement_timeout = 120
Nov 15 00:31:26 user nova-compute[75341]: node.session.err_timeo.abort_timeout = 15
Nov 15 00:31:26 user nova-compute[75341]: node.session.err_timeo.lu_reset_timeout = 30
Nov 15 00:31:26 user nova-compute[75341]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 15 00:31:26 user nova-compute[75341]: node.session.err_timeo.host_reset_timeout = 60
Nov 15 00:31:26 user nova-compute[75341]: node.session.iscsi.FastAbort = Yes
Nov 15 00:31:26 user nova-compute[75341]: node.session.iscsi.InitialR2T = No
Nov 15 00:31:26 user nova-compute[75341]: node.session.iscsi.ImmediateData = Yes
Nov 15 00:31:26 user nova-compute[75341]: node.session.iscsi.FirstBurstLength = 262144
Nov 15 00:31:26 user nova-compute[75341]: node.session.iscsi.MaxBurstLength = 16776192
Nov 15 00:31:26 user nova-compute[75341]: node.session.iscsi.DefaultTime2Retain = 0
Nov 15 00:31:26 user nova-compute[75341]: node.session.iscsi.DefaultTime2Wait = 2
Nov 15 00:31:26 user nova-compute[75341]: node.session.iscsi.MaxConnections = 1
Nov 15 00:31:26 user nova-compute[75341]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 15 00:31:26 user nova-compute[75341]: node.session.iscsi.ERL = 0
Nov 15 00:31:26 user nova-compute[75341]: node.session.scan = manual
Nov 15 00:31:26 user nova-compute[75341]: node.session.reopen_max = 0
Nov 15 00:31:26 user nova-compute[75341]: node.conn[0].address = 172.16.0.220
Nov 15 00:31:26 user nova-compute[75341]: node.conn[0].port = 3260
Nov 15 00:31:26 user nova-compute[75341]: node.conn[0].startup = manual
Nov 15 00:31:26 user nova-compute[75341]: node.conn[0].tcp.window_size = 524288
Nov 15 00:31:26 user nova-compute[75341]: node.conn[0].tcp.type_of_service = 0
Nov 15 00:31:26 user nova-compute[75341]: node.conn[0].timeo.logout_timeout = 15
Nov 15 00:31:26 user nova-compute[75341]: node.conn[0].timeo.login_timeout = 15
Nov 15 00:31:26 user nova-compute[75341]: node.conn[0].timeo.auth_timeout = 45
Nov 15 00:31:26 user nova-compute[75341]: node.conn[0].timeo.noop_out_interval = 5
Nov 15 00:31:26 user nova-compute[75341]: node.conn[0].timeo.noop_out_timeout = 5
Nov 15 00:31:26 user nova-compute[75341]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 15 00:31:26 user nova-compute[75341]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 15 00:31:26 user nova-compute[75341]: node.conn[0].iscsi.HeaderDigest = None
Nov 15 00:31:26 user nova-compute[75341]: node.conn[0].iscsi.DataDigest = None
Nov 15 00:31:26 user nova-compute[75341]: node.conn[0].iscsi.IFMarker = No
Nov 15 00:31:26 user nova-compute[75341]: node.conn[0].iscsi.OFMarker = No
Nov 15 00:31:26 user nova-compute[75341]: # END RECORD
Nov 15 00:31:26 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:31:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:31:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:31:26 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[694a899a-071c-4de6-ace1-bc44926b5f1b]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:31:26 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:31:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:31:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:31:26 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f63088-cc32-499d-892c-44475db80d0c]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:31:26 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:31:26 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PWyMvbij {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:31:27 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PWyMvbij" returned: 0 in 0.026s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:31:27 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[80685644-cfaa-491a-a5af-add03371ab91]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:31:27 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PWyMvbij'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:31:27 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:31:27 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:31:27 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2bf4dc-227d-4925-a3ed-7d69cf74c143]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:31:27 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:31:27 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:31:27 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:31:27 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b40013-5a9a-4f77-8bb4-00904e99eb76]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:31:27 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5 (non-flash)
Nov 15 00:31:27 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 00:31:27 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5 (non-flash)
Nov 15 00:31:27 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 00:31:27 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.158s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 00:31:27 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Connected to 172.16.0.220:3260 {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 00:31:27 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] HCTL ('33', '0', '0', 0) found on session 60 with lun 0 {{(pid=75341) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 00:31:27 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75341) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 00:31:27 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:31:27 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.014s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:31:27 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf8ec89-7cc0-40ba-b5e4-530e5d6f182f]: (4, ('0 0 0', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:31:27 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Searching for a device in session 60 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75341) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 00:31:27 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PWyMvbij', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75341) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 00:31:27 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.181s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 00:31:27 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] <== connect_volume: return (182ms) {'type': 'block', 'scsi_wwn': '26330623338656561', 'path': '/dev/sdb'} {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 00:31:27 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26330623338656561', 'path': '/dev/sdb'} {{(pid=75341) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 00:31:27 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T00:27:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1308851418',display_name='tempest-ServerStableDeviceRescueTest-server-1308851418',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1308851418',id=51,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPUBbTti5ImaVvFPl1ksjWyA2etJEO3JrirbrNGJ7x3OEQAK2OV2Mv0XzIZH+ewbmuWIAv9zgEddufLnFhHRM3HFxlLT/AR1GIqnFC5fgy17RWIdk9ka6i8ljxBYVZs6Pg==',key_name='tempest-keypair-140295017',keypairs=<?>,launch_index=0,launched_at=2023-11-15T00:27:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e31ba430fd1d4d5fb882c3ccb3e7c0a0',ramdisk_id='',reservation_id='r-t3c7p9fx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1724574070',owner_user_name='tempest-ServerStableDeviceRescueTest-1724574070-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T00:29:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ffaaabcda33f40cba01e3d5181f10b4d',uuid=1cd08fb1-2fab-4381-924d-c394ef259c8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dc987f35-ca2f-4c53-b5d1-07e07674ab27", "address": "fa:16:3e:ad:fe:44", "network": {"id": "04cba7ef-eb1c-4a35-b10a-25685666e9b6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-130493983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-130493983-network", "vif_mac": "fa:16:3e:ad:fe:44"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31ba430fd1d4d5fb882c3ccb3e7c0a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc987f35-ca", "ovs_interfaceid": "dc987f35-ca2f-4c53-b5d1-07e07674ab27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 00:31:27 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Converting VIF {"id": "dc987f35-ca2f-4c53-b5d1-07e07674ab27", "address": "fa:16:3e:ad:fe:44", "network": {"id": "04cba7ef-eb1c-4a35-b10a-25685666e9b6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-130493983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-130493983-network", "vif_mac": "fa:16:3e:ad:fe:44"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31ba430fd1d4d5fb882c3ccb3e7c0a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc987f35-ca", "ovs_interfaceid": "dc987f35-ca2f-4c53-b5d1-07e07674ab27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 00:31:27 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ad:fe:44,bridge_name='br-int',has_traffic_filtering=True,id=dc987f35-ca2f-4c53-b5d1-07e07674ab27,network=Network(04cba7ef-eb1c-4a35-b10a-25685666e9b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc987f35-ca') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 00:31:27 user nova-compute[75341]: DEBUG nova.objects.instance [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Lazy-loading 'pci_devices' on Instance uuid 1cd08fb1-2fab-4381-924d-c394ef259c8d {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:31:27 user nova-compute[75341]: DEBUG nova.objects.base [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Object Instance<1cd08fb1-2fab-4381-924d-c394ef259c8d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75341) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 00:31:27 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] End _get_guest_xml xml=<domain type="kvm">
Nov 15 00:31:27 user nova-compute[75341]:   <uuid>1cd08fb1-2fab-4381-924d-c394ef259c8d</uuid>
Nov 15 00:31:27 user nova-compute[75341]:   <name>instance-00000033</name>
Nov 15 00:31:27 user nova-compute[75341]:   <memory>524288</memory>
Nov 15 00:31:27 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 15 00:31:27 user nova-compute[75341]:   <metadata>
Nov 15 00:31:27 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 00:31:27 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 15 00:31:27 user nova-compute[75341]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1308851418</nova:name>
Nov 15 00:31:27 user nova-compute[75341]:       <nova:creationTime>2023-11-15 00:31:26</nova:creationTime>
Nov 15 00:31:27 user nova-compute[75341]:       <nova:flavor name="m1.tiny">
Nov 15 00:31:27 user nova-compute[75341]:         <nova:memory>512</nova:memory>
Nov 15 00:31:27 user nova-compute[75341]:         <nova:disk>1</nova:disk>
Nov 15 00:31:27 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 15 00:31:27 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 00:31:27 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 15 00:31:27 user nova-compute[75341]:       </nova:flavor>
Nov 15 00:31:27 user nova-compute[75341]:       <nova:owner>
Nov 15 00:31:27 user nova-compute[75341]:         <nova:user uuid="ffaaabcda33f40cba01e3d5181f10b4d">tempest-ServerStableDeviceRescueTest-1724574070-project-member</nova:user>
Nov 15 00:31:27 user nova-compute[75341]:         <nova:project uuid="e31ba430fd1d4d5fb882c3ccb3e7c0a0">tempest-ServerStableDeviceRescueTest-1724574070</nova:project>
Nov 15 00:31:27 user nova-compute[75341]:       </nova:owner>
Nov 15 00:31:27 user nova-compute[75341]:       <nova:root type="image" uuid="e46abb82-b810-490e-a8a1-ccdc5fa1a796"/>
Nov 15 00:31:27 user nova-compute[75341]:       <nova:ports>
Nov 15 00:31:27 user nova-compute[75341]:         <nova:port uuid="dc987f35-ca2f-4c53-b5d1-07e07674ab27">
Nov 15 00:31:27 user nova-compute[75341]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 00:31:27 user nova-compute[75341]:         </nova:port>
Nov 15 00:31:27 user nova-compute[75341]:       </nova:ports>
Nov 15 00:31:27 user nova-compute[75341]:     </nova:instance>
Nov 15 00:31:27 user nova-compute[75341]:   </metadata>
Nov 15 00:31:27 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 15 00:31:27 user nova-compute[75341]:     <system>
Nov 15 00:31:27 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 00:31:27 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 15 00:31:27 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 15 00:31:27 user nova-compute[75341]:       <entry name="serial">1cd08fb1-2fab-4381-924d-c394ef259c8d</entry>
Nov 15 00:31:27 user nova-compute[75341]:       <entry name="uuid">1cd08fb1-2fab-4381-924d-c394ef259c8d</entry>
Nov 15 00:31:27 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 15 00:31:27 user nova-compute[75341]:     </system>
Nov 15 00:31:27 user nova-compute[75341]:   </sysinfo>
Nov 15 00:31:27 user nova-compute[75341]:   <os>
Nov 15 00:31:27 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 00:31:27 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 15 00:31:27 user nova-compute[75341]:   </os>
Nov 15 00:31:27 user nova-compute[75341]:   <features>
Nov 15 00:31:27 user nova-compute[75341]:     <acpi/>
Nov 15 00:31:27 user nova-compute[75341]:     <apic/>
Nov 15 00:31:27 user nova-compute[75341]:     <vmcoreinfo/>
Nov 15 00:31:27 user nova-compute[75341]:   </features>
Nov 15 00:31:27 user nova-compute[75341]:   <clock offset="utc">
Nov 15 00:31:27 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 00:31:27 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 00:31:27 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 15 00:31:27 user nova-compute[75341]:   </clock>
Nov 15 00:31:27 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 15 00:31:27 user nova-compute[75341]:     <model>Nehalem</model>
Nov 15 00:31:27 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 00:31:27 user nova-compute[75341]:   </cpu>
Nov 15 00:31:27 user nova-compute[75341]:   <devices>
Nov 15 00:31:27 user nova-compute[75341]:     <disk type="file" device="disk">
Nov 15 00:31:27 user nova-compute[75341]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 00:31:27 user nova-compute[75341]:       <source file="/opt/stack/data/nova/instances/1cd08fb1-2fab-4381-924d-c394ef259c8d/disk"/>
Nov 15 00:31:27 user nova-compute[75341]:       <target dev="vda" bus="virtio"/>
Nov 15 00:31:27 user nova-compute[75341]:     </disk>
Nov 15 00:31:27 user nova-compute[75341]:     <disk type="block" device="disk">
Nov 15 00:31:27 user nova-compute[75341]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 00:31:27 user nova-compute[75341]:       <source dev="/dev/sdb"/>
Nov 15 00:31:27 user nova-compute[75341]:       <target dev="vdb" bus="virtio"/>
Nov 15 00:31:27 user nova-compute[75341]:       <serial>fb942950-6a65-46f6-9c81-f0daf87040a5</serial>
Nov 15 00:31:27 user nova-compute[75341]:     </disk>
Nov 15 00:31:27 user nova-compute[75341]:     <disk type="file" device="disk">
Nov 15 00:31:27 user nova-compute[75341]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 00:31:27 user nova-compute[75341]:       <source file="/opt/stack/data/nova/instances/1cd08fb1-2fab-4381-924d-c394ef259c8d/disk.rescue"/>
Nov 15 00:31:27 user nova-compute[75341]:       <target dev="vdc" bus="virtio"/>
Nov 15 00:31:27 user nova-compute[75341]:       <boot order="1"/>
Nov 15 00:31:27 user nova-compute[75341]:     </disk>
Nov 15 00:31:27 user nova-compute[75341]:     <interface type="ethernet">
Nov 15 00:31:27 user nova-compute[75341]:       <mac address="fa:16:3e:ad:fe:44"/>
Nov 15 00:31:27 user nova-compute[75341]:       <model type="virtio"/>
Nov 15 00:31:27 user nova-compute[75341]:       <mtu size="1442"/>
Nov 15 00:31:27 user nova-compute[75341]:       <target dev="tapdc987f35-ca"/>
Nov 15 00:31:27 user nova-compute[75341]:     </interface>
Nov 15 00:31:27 user nova-compute[75341]:     <serial type="pty">
Nov 15 00:31:27 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/1cd08fb1-2fab-4381-924d-c394ef259c8d/console.log" append="off"/>
Nov 15 00:31:27 user nova-compute[75341]:     </serial>
Nov 15 00:31:27 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 00:31:27 user nova-compute[75341]:     <video>
Nov 15 00:31:27 user nova-compute[75341]:       <model type="virtio"/>
Nov 15 00:31:27 user nova-compute[75341]:     </video>
Nov 15 00:31:27 user nova-compute[75341]:     <rng model="virtio">
Nov 15 00:31:27 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 15 00:31:27 user nova-compute[75341]:     </rng>
Nov 15 00:31:27 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 15 00:31:27 user nova-compute[75341]:     <memballoon model="virtio">
Nov 15 00:31:27 user nova-compute[75341]:       <stats period="10"/>
Nov 15 00:31:27 user nova-compute[75341]:     </memballoon>
Nov 15 00:31:27 user nova-compute[75341]:   </devices>
Nov 15 00:31:27 user nova-compute[75341]: </domain>
Nov 15 00:31:27 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 00:31:27 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Instance destroyed successfully.
Nov 15 00:31:27 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 00:31:27 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 00:31:27 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 00:31:27 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] No VIF found with MAC fa:16:3e:ad:fe:44, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 00:31:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:31:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:31:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:31:28 user nova-compute[75341]: DEBUG nova.compute.manager [req-ca90b0c5-dfd1-4ef7-b4b2-1e2a3ad39cf6 req-419808b4-9519-42bd-8b93-8b3b6d462677 service nova] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Received event network-vif-plugged-dc987f35-ca2f-4c53-b5d1-07e07674ab27 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:31:28 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ca90b0c5-dfd1-4ef7-b4b2-1e2a3ad39cf6 req-419808b4-9519-42bd-8b93-8b3b6d462677 service nova] Acquiring lock "1cd08fb1-2fab-4381-924d-c394ef259c8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:31:28 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ca90b0c5-dfd1-4ef7-b4b2-1e2a3ad39cf6 req-419808b4-9519-42bd-8b93-8b3b6d462677 service nova] Lock "1cd08fb1-2fab-4381-924d-c394ef259c8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:31:28 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-ca90b0c5-dfd1-4ef7-b4b2-1e2a3ad39cf6 req-419808b4-9519-42bd-8b93-8b3b6d462677 service nova] Lock "1cd08fb1-2fab-4381-924d-c394ef259c8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:31:28 user nova-compute[75341]: DEBUG nova.compute.manager [req-ca90b0c5-dfd1-4ef7-b4b2-1e2a3ad39cf6 req-419808b4-9519-42bd-8b93-8b3b6d462677 service nova] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] No waiting events found dispatching network-vif-plugged-dc987f35-ca2f-4c53-b5d1-07e07674ab27 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:31:28 user nova-compute[75341]: WARNING nova.compute.manager [req-ca90b0c5-dfd1-4ef7-b4b2-1e2a3ad39cf6 req-419808b4-9519-42bd-8b93-8b3b6d462677 service nova] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Received unexpected event network-vif-plugged-dc987f35-ca2f-4c53-b5d1-07e07674ab27 for instance with vm_state active and task_state rescuing.
Nov 15 00:31:28 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:31:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:31:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:31:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:31:29 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:31:30 user nova-compute[75341]: DEBUG nova.compute.manager [req-1b01fef7-7b48-41a6-a9a7-b0c7d6ce4d04 req-eec0d11c-8ee0-4651-8742-ae2e841f0289 service nova] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Received event network-vif-plugged-dc987f35-ca2f-4c53-b5d1-07e07674ab27 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:31:30 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-1b01fef7-7b48-41a6-a9a7-b0c7d6ce4d04 req-eec0d11c-8ee0-4651-8742-ae2e841f0289 service nova] Acquiring lock "1cd08fb1-2fab-4381-924d-c394ef259c8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:31:30 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-1b01fef7-7b48-41a6-a9a7-b0c7d6ce4d04 req-eec0d11c-8ee0-4651-8742-ae2e841f0289 service nova] Lock "1cd08fb1-2fab-4381-924d-c394ef259c8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:31:30 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-1b01fef7-7b48-41a6-a9a7-b0c7d6ce4d04 req-eec0d11c-8ee0-4651-8742-ae2e841f0289 service nova] Lock "1cd08fb1-2fab-4381-924d-c394ef259c8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:31:30 user nova-compute[75341]: DEBUG nova.compute.manager [req-1b01fef7-7b48-41a6-a9a7-b0c7d6ce4d04 req-eec0d11c-8ee0-4651-8742-ae2e841f0289 service nova] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] No waiting events found dispatching network-vif-plugged-dc987f35-ca2f-4c53-b5d1-07e07674ab27 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:31:30 user nova-compute[75341]: WARNING nova.compute.manager [req-1b01fef7-7b48-41a6-a9a7-b0c7d6ce4d04 req-eec0d11c-8ee0-4651-8742-ae2e841f0289 service nova] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Received unexpected event network-vif-plugged-dc987f35-ca2f-4c53-b5d1-07e07674ab27 for instance with vm_state active and task_state rescuing.
Nov 15 00:31:30 user nova-compute[75341]: DEBUG nova.compute.manager [None req-db6457f1-a5bf-445c-8f91-b32726e1c49d tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 00:31:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:31:32 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:31:32 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:31:32 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75341) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 00:31:33 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:31:34 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:31:38 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:31:38 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:31:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:31:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:31:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:31:38 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75341) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 00:31:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd08fb1-2fab-4381-924d-c394ef259c8d/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:31:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd08fb1-2fab-4381-924d-c394ef259c8d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:31:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd08fb1-2fab-4381-924d-c394ef259c8d/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:31:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd08fb1-2fab-4381-924d-c394ef259c8d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:31:39 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 00:31:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd08fb1-2fab-4381-924d-c394ef259c8d/disk.rescue --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:31:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd08fb1-2fab-4381-924d-c394ef259c8d/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:31:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd08fb1-2fab-4381-924d-c394ef259c8d/disk.rescue --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:31:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd08fb1-2fab-4381-924d-c394ef259c8d/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:31:40 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:31:40 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:31:40 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:31:40 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Hypervisor/Node resource view: name=user free_ram=8974MB free_disk=25.13458251953125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75341) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 00:31:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:31:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:31:40 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 1cd08fb1-2fab-4381-924d-c394ef259c8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:31:40 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 00:31:40 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 00:31:40 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 00:31:40 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 00:31:40 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Compute_service record updated for user:user {{(pid=75341) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 00:31:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.286s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:31:42 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:31:42 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:31:42 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:31:42 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Cleaning up deleted instances {{(pid=75341) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 00:31:42 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] There are 0 instances to clean {{(pid=75341) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 00:31:43 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:31:43 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Starting heal instance info cache {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 00:31:43 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Rebuilding the list of instances to heal {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 00:31:44 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "refresh_cache-1cd08fb1-2fab-4381-924d-c394ef259c8d" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:31:44 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquired lock "refresh_cache-1cd08fb1-2fab-4381-924d-c394ef259c8d" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:31:44 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Forcefully refreshing network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 00:31:44 user nova-compute[75341]: DEBUG nova.objects.instance [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lazy-loading 'info_cache' on Instance uuid 1cd08fb1-2fab-4381-924d-c394ef259c8d {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:31:44 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Updating instance_info_cache with network_info: [{"id": "dc987f35-ca2f-4c53-b5d1-07e07674ab27", "address": "fa:16:3e:ad:fe:44", "network": {"id": "04cba7ef-eb1c-4a35-b10a-25685666e9b6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-130493983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31ba430fd1d4d5fb882c3ccb3e7c0a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc987f35-ca", "ovs_interfaceid": "dc987f35-ca2f-4c53-b5d1-07e07674ab27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:31:44 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Releasing lock "refresh_cache-1cd08fb1-2fab-4381-924d-c394ef259c8d" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:31:44 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Updated the network info_cache for instance {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 00:31:45 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:31:45 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:31:45 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:31:45 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:31:45 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:31:45 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:31:47 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:31:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:31:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:31:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:31:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:32:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:32:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:32:05 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:32:09 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:32:09 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75341) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 00:32:10 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:32:15 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:32:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:32:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:32:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:32:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:32:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:32:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:32:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:32:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:32:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:32:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:32:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:32:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:32:28 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:32:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:32:33 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:32:33 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:32:33 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:32:33 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75341) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 00:32:35 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:32:38 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:32:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:32:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:32:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:32:38 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75341) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 00:32:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd08fb1-2fab-4381-924d-c394ef259c8d/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:32:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd08fb1-2fab-4381-924d-c394ef259c8d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:32:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd08fb1-2fab-4381-924d-c394ef259c8d/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:32:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd08fb1-2fab-4381-924d-c394ef259c8d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:32:39 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 00:32:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd08fb1-2fab-4381-924d-c394ef259c8d/disk.rescue --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:32:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd08fb1-2fab-4381-924d-c394ef259c8d/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:32:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd08fb1-2fab-4381-924d-c394ef259c8d/disk.rescue --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:32:39 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd08fb1-2fab-4381-924d-c394ef259c8d/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:32:40 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:32:40 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:32:40 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:32:40 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Hypervisor/Node resource view: name=user free_ram=8995MB free_disk=25.13290023803711GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75341) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 00:32:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:32:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:32:40 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 1cd08fb1-2fab-4381-924d-c394ef259c8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:32:40 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 00:32:40 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 00:32:40 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Refreshing inventories for resource provider 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 00:32:40 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Updating ProviderTree inventory for provider 8fa114cc-b541-418f-865c-16c44294e72d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 00:32:40 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Updating inventory in ProviderTree for provider 8fa114cc-b541-418f-865c-16c44294e72d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 00:32:40 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Refreshing aggregate associations for resource provider 8fa114cc-b541-418f-865c-16c44294e72d, aggregates: None {{(pid=75341) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 00:32:40 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Refreshing trait associations for resource provider 8fa114cc-b541-418f-865c-16c44294e72d, traits: COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_MMX,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000E {{(pid=75341) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 00:32:40 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 00:32:40 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 00:32:40 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Compute_service record updated for user:user {{(pid=75341) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 00:32:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.292s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:32:42 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:32:43 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:32:43 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:32:43 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Starting heal instance info cache {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 00:32:43 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Rebuilding the list of instances to heal {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 00:32:44 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "refresh_cache-1cd08fb1-2fab-4381-924d-c394ef259c8d" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:32:44 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquired lock "refresh_cache-1cd08fb1-2fab-4381-924d-c394ef259c8d" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:32:44 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Forcefully refreshing network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 00:32:44 user nova-compute[75341]: DEBUG nova.objects.instance [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lazy-loading 'info_cache' on Instance uuid 1cd08fb1-2fab-4381-924d-c394ef259c8d {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:32:44 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Updating instance_info_cache with network_info: [{"id": "dc987f35-ca2f-4c53-b5d1-07e07674ab27", "address": "fa:16:3e:ad:fe:44", "network": {"id": "04cba7ef-eb1c-4a35-b10a-25685666e9b6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-130493983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31ba430fd1d4d5fb882c3ccb3e7c0a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc987f35-ca", "ovs_interfaceid": "dc987f35-ca2f-4c53-b5d1-07e07674ab27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:32:44 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Releasing lock "refresh_cache-1cd08fb1-2fab-4381-924d-c394ef259c8d" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:32:44 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Updated the network info_cache for instance {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 00:32:44 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:32:45 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:32:45 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:32:45 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:32:45 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:32:45 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:32:45 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:32:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:32:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:32:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:32:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:32:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:32:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:32:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:32:56 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:33:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:33:05 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:33:10 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:33:10 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:33:10 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:33:10 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:33:10 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:33:10 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:33:14 user nova-compute[75341]: INFO nova.compute.manager [None req-c816ec02-c7b7-405e-8725-6628629a5d74 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Unrescuing
Nov 15 00:33:14 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c816ec02-c7b7-405e-8725-6628629a5d74 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Acquiring lock "refresh_cache-1cd08fb1-2fab-4381-924d-c394ef259c8d" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:33:14 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c816ec02-c7b7-405e-8725-6628629a5d74 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Acquired lock "refresh_cache-1cd08fb1-2fab-4381-924d-c394ef259c8d" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:33:14 user nova-compute[75341]: DEBUG nova.network.neutron [None req-c816ec02-c7b7-405e-8725-6628629a5d74 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 00:33:14 user nova-compute[75341]: DEBUG nova.network.neutron [None req-c816ec02-c7b7-405e-8725-6628629a5d74 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Updating instance_info_cache with network_info: [{"id": "dc987f35-ca2f-4c53-b5d1-07e07674ab27", "address": "fa:16:3e:ad:fe:44", "network": {"id": "04cba7ef-eb1c-4a35-b10a-25685666e9b6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-130493983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31ba430fd1d4d5fb882c3ccb3e7c0a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc987f35-ca", "ovs_interfaceid": "dc987f35-ca2f-4c53-b5d1-07e07674ab27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:33:14 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-c816ec02-c7b7-405e-8725-6628629a5d74 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Releasing lock "refresh_cache-1cd08fb1-2fab-4381-924d-c394ef259c8d" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:33:14 user nova-compute[75341]: DEBUG nova.objects.instance [None req-c816ec02-c7b7-405e-8725-6628629a5d74 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Lazy-loading 'flavor' on Instance uuid 1cd08fb1-2fab-4381-924d-c394ef259c8d {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:33:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:33:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:33:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:33:14 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:33:14 user nova-compute[75341]: DEBUG nova.compute.manager [req-862b2ce0-3cdf-49ac-b4e5-1777e651c5a4 req-4c6680bf-aaee-4f7a-b9fd-a96108256e5a service nova] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Received event network-vif-unplugged-dc987f35-ca2f-4c53-b5d1-07e07674ab27 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:33:14 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-862b2ce0-3cdf-49ac-b4e5-1777e651c5a4 req-4c6680bf-aaee-4f7a-b9fd-a96108256e5a service nova] Acquiring lock "1cd08fb1-2fab-4381-924d-c394ef259c8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:33:14 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-862b2ce0-3cdf-49ac-b4e5-1777e651c5a4 req-4c6680bf-aaee-4f7a-b9fd-a96108256e5a service nova] Lock "1cd08fb1-2fab-4381-924d-c394ef259c8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:33:14 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-862b2ce0-3cdf-49ac-b4e5-1777e651c5a4 req-4c6680bf-aaee-4f7a-b9fd-a96108256e5a service nova] Lock "1cd08fb1-2fab-4381-924d-c394ef259c8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:33:14 user nova-compute[75341]: DEBUG nova.compute.manager [req-862b2ce0-3cdf-49ac-b4e5-1777e651c5a4 req-4c6680bf-aaee-4f7a-b9fd-a96108256e5a service nova] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] No waiting events found dispatching network-vif-unplugged-dc987f35-ca2f-4c53-b5d1-07e07674ab27 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:33:14 user nova-compute[75341]: WARNING nova.compute.manager [req-862b2ce0-3cdf-49ac-b4e5-1777e651c5a4 req-4c6680bf-aaee-4f7a-b9fd-a96108256e5a service nova] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Received unexpected event network-vif-unplugged-dc987f35-ca2f-4c53-b5d1-07e07674ab27 for instance with vm_state rescued and task_state unrescuing.
Nov 15 00:33:15 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:33:15 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:33:15 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Instance destroyed successfully.
Nov 15 00:33:15 user nova-compute[75341]: DEBUG nova.compute.manager [req-4ced3ac7-67a7-486d-99b1-75e6f6f0a2dc req-d3a61270-6ffa-4245-a258-d70ff31e8fff service nova] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Received event network-changed-dc987f35-ca2f-4c53-b5d1-07e07674ab27 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:33:15 user nova-compute[75341]: DEBUG nova.compute.manager [req-4ced3ac7-67a7-486d-99b1-75e6f6f0a2dc req-d3a61270-6ffa-4245-a258-d70ff31e8fff service nova] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Refreshing instance network info cache due to event network-changed-dc987f35-ca2f-4c53-b5d1-07e07674ab27. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 00:33:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4ced3ac7-67a7-486d-99b1-75e6f6f0a2dc req-d3a61270-6ffa-4245-a258-d70ff31e8fff service nova] Acquiring lock "refresh_cache-1cd08fb1-2fab-4381-924d-c394ef259c8d" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:33:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4ced3ac7-67a7-486d-99b1-75e6f6f0a2dc req-d3a61270-6ffa-4245-a258-d70ff31e8fff service nova] Acquired lock "refresh_cache-1cd08fb1-2fab-4381-924d-c394ef259c8d" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:33:15 user nova-compute[75341]: DEBUG nova.network.neutron [req-4ced3ac7-67a7-486d-99b1-75e6f6f0a2dc req-d3a61270-6ffa-4245-a258-d70ff31e8fff service nova] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Refreshing network info cache for port dc987f35-ca2f-4c53-b5d1-07e07674ab27 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 00:33:15 user nova-compute[75341]: DEBUG nova.network.neutron [req-4ced3ac7-67a7-486d-99b1-75e6f6f0a2dc req-d3a61270-6ffa-4245-a258-d70ff31e8fff service nova] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Updated VIF entry in instance network info cache for port dc987f35-ca2f-4c53-b5d1-07e07674ab27. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 00:33:15 user nova-compute[75341]: DEBUG nova.network.neutron [req-4ced3ac7-67a7-486d-99b1-75e6f6f0a2dc req-d3a61270-6ffa-4245-a258-d70ff31e8fff service nova] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Updating instance_info_cache with network_info: [{"id": "dc987f35-ca2f-4c53-b5d1-07e07674ab27", "address": "fa:16:3e:ad:fe:44", "network": {"id": "04cba7ef-eb1c-4a35-b10a-25685666e9b6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-130493983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31ba430fd1d4d5fb882c3ccb3e7c0a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc987f35-ca", "ovs_interfaceid": "dc987f35-ca2f-4c53-b5d1-07e07674ab27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:33:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-4ced3ac7-67a7-486d-99b1-75e6f6f0a2dc req-d3a61270-6ffa-4245-a258-d70ff31e8fff service nova] Releasing lock "refresh_cache-1cd08fb1-2fab-4381-924d-c394ef259c8d" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:33:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:33:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:33:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:33:16 user nova-compute[75341]: DEBUG nova.compute.manager [req-0c1008bc-82fc-4065-b4d0-d422594fa73d req-43287f1d-764d-45ca-8c70-0b25bf38fc2a service nova] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Received event network-vif-plugged-dc987f35-ca2f-4c53-b5d1-07e07674ab27 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:33:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-0c1008bc-82fc-4065-b4d0-d422594fa73d req-43287f1d-764d-45ca-8c70-0b25bf38fc2a service nova] Acquiring lock "1cd08fb1-2fab-4381-924d-c394ef259c8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:33:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-0c1008bc-82fc-4065-b4d0-d422594fa73d req-43287f1d-764d-45ca-8c70-0b25bf38fc2a service nova] Lock "1cd08fb1-2fab-4381-924d-c394ef259c8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:33:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-0c1008bc-82fc-4065-b4d0-d422594fa73d req-43287f1d-764d-45ca-8c70-0b25bf38fc2a service nova] Lock "1cd08fb1-2fab-4381-924d-c394ef259c8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:33:16 user nova-compute[75341]: DEBUG nova.compute.manager [req-0c1008bc-82fc-4065-b4d0-d422594fa73d req-43287f1d-764d-45ca-8c70-0b25bf38fc2a service nova] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] No waiting events found dispatching network-vif-plugged-dc987f35-ca2f-4c53-b5d1-07e07674ab27 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:33:16 user nova-compute[75341]: WARNING nova.compute.manager [req-0c1008bc-82fc-4065-b4d0-d422594fa73d req-43287f1d-764d-45ca-8c70-0b25bf38fc2a service nova] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Received unexpected event network-vif-plugged-dc987f35-ca2f-4c53-b5d1-07e07674ab27 for instance with vm_state rescued and task_state unrescuing.
Nov 15 00:33:16 user nova-compute[75341]: DEBUG nova.compute.manager [req-0c1008bc-82fc-4065-b4d0-d422594fa73d req-43287f1d-764d-45ca-8c70-0b25bf38fc2a service nova] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Received event network-vif-plugged-dc987f35-ca2f-4c53-b5d1-07e07674ab27 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:33:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-0c1008bc-82fc-4065-b4d0-d422594fa73d req-43287f1d-764d-45ca-8c70-0b25bf38fc2a service nova] Acquiring lock "1cd08fb1-2fab-4381-924d-c394ef259c8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:33:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-0c1008bc-82fc-4065-b4d0-d422594fa73d req-43287f1d-764d-45ca-8c70-0b25bf38fc2a service nova] Lock "1cd08fb1-2fab-4381-924d-c394ef259c8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:33:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-0c1008bc-82fc-4065-b4d0-d422594fa73d req-43287f1d-764d-45ca-8c70-0b25bf38fc2a service nova] Lock "1cd08fb1-2fab-4381-924d-c394ef259c8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:33:16 user nova-compute[75341]: DEBUG nova.compute.manager [req-0c1008bc-82fc-4065-b4d0-d422594fa73d req-43287f1d-764d-45ca-8c70-0b25bf38fc2a service nova] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] No waiting events found dispatching network-vif-plugged-dc987f35-ca2f-4c53-b5d1-07e07674ab27 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:33:16 user nova-compute[75341]: WARNING nova.compute.manager [req-0c1008bc-82fc-4065-b4d0-d422594fa73d req-43287f1d-764d-45ca-8c70-0b25bf38fc2a service nova] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Received unexpected event network-vif-plugged-dc987f35-ca2f-4c53-b5d1-07e07674ab27 for instance with vm_state rescued and task_state unrescuing.
Nov 15 00:33:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:33:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:33:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:33:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:33:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:33:17 user nova-compute[75341]: DEBUG nova.compute.manager [req-7bc72860-4cf4-4920-9bba-6b6c167f6919 req-3361e75f-3049-48f8-818b-13613cd76169 service nova] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Received event network-changed-dc987f35-ca2f-4c53-b5d1-07e07674ab27 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:33:17 user nova-compute[75341]: DEBUG nova.compute.manager [req-7bc72860-4cf4-4920-9bba-6b6c167f6919 req-3361e75f-3049-48f8-818b-13613cd76169 service nova] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Refreshing instance network info cache due to event network-changed-dc987f35-ca2f-4c53-b5d1-07e07674ab27. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 00:33:17 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-7bc72860-4cf4-4920-9bba-6b6c167f6919 req-3361e75f-3049-48f8-818b-13613cd76169 service nova] Acquiring lock "refresh_cache-1cd08fb1-2fab-4381-924d-c394ef259c8d" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:33:17 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-7bc72860-4cf4-4920-9bba-6b6c167f6919 req-3361e75f-3049-48f8-818b-13613cd76169 service nova] Acquired lock "refresh_cache-1cd08fb1-2fab-4381-924d-c394ef259c8d" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:33:17 user nova-compute[75341]: DEBUG nova.network.neutron [req-7bc72860-4cf4-4920-9bba-6b6c167f6919 req-3361e75f-3049-48f8-818b-13613cd76169 service nova] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Refreshing network info cache for port dc987f35-ca2f-4c53-b5d1-07e07674ab27 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 00:33:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:33:18 user nova-compute[75341]: DEBUG nova.network.neutron [req-7bc72860-4cf4-4920-9bba-6b6c167f6919 req-3361e75f-3049-48f8-818b-13613cd76169 service nova] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Updated VIF entry in instance network info cache for port dc987f35-ca2f-4c53-b5d1-07e07674ab27. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 00:33:18 user nova-compute[75341]: DEBUG nova.network.neutron [req-7bc72860-4cf4-4920-9bba-6b6c167f6919 req-3361e75f-3049-48f8-818b-13613cd76169 service nova] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Updating instance_info_cache with network_info: [{"id": "dc987f35-ca2f-4c53-b5d1-07e07674ab27", "address": "fa:16:3e:ad:fe:44", "network": {"id": "04cba7ef-eb1c-4a35-b10a-25685666e9b6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-130493983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31ba430fd1d4d5fb882c3ccb3e7c0a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc987f35-ca", "ovs_interfaceid": "dc987f35-ca2f-4c53-b5d1-07e07674ab27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:33:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-7bc72860-4cf4-4920-9bba-6b6c167f6919 req-3361e75f-3049-48f8-818b-13613cd76169 service nova] Releasing lock "refresh_cache-1cd08fb1-2fab-4381-924d-c394ef259c8d" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:33:18 user nova-compute[75341]: DEBUG nova.compute.manager [None req-c816ec02-c7b7-405e-8725-6628629a5d74 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 00:33:18 user nova-compute[75341]: DEBUG nova.compute.manager [req-f33037ce-5553-43d0-aeaf-f8f1037a4af2 req-6d8cc991-86d6-41e7-9a9a-196fe59bdd0c service nova] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Received event network-vif-plugged-dc987f35-ca2f-4c53-b5d1-07e07674ab27 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:33:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-f33037ce-5553-43d0-aeaf-f8f1037a4af2 req-6d8cc991-86d6-41e7-9a9a-196fe59bdd0c service nova] Acquiring lock "1cd08fb1-2fab-4381-924d-c394ef259c8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:33:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-f33037ce-5553-43d0-aeaf-f8f1037a4af2 req-6d8cc991-86d6-41e7-9a9a-196fe59bdd0c service nova] Lock "1cd08fb1-2fab-4381-924d-c394ef259c8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:33:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-f33037ce-5553-43d0-aeaf-f8f1037a4af2 req-6d8cc991-86d6-41e7-9a9a-196fe59bdd0c service nova] Lock "1cd08fb1-2fab-4381-924d-c394ef259c8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:33:18 user nova-compute[75341]: DEBUG nova.compute.manager [req-f33037ce-5553-43d0-aeaf-f8f1037a4af2 req-6d8cc991-86d6-41e7-9a9a-196fe59bdd0c service nova] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] No waiting events found dispatching network-vif-plugged-dc987f35-ca2f-4c53-b5d1-07e07674ab27 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:33:18 user nova-compute[75341]: WARNING nova.compute.manager [req-f33037ce-5553-43d0-aeaf-f8f1037a4af2 req-6d8cc991-86d6-41e7-9a9a-196fe59bdd0c service nova] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Received unexpected event network-vif-plugged-dc987f35-ca2f-4c53-b5d1-07e07674ab27 for instance with vm_state active and task_state None.
Nov 15 00:33:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:33:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:33:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:33:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:33:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:33:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:33:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:33:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:33:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:33:30 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:33:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:33:33 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:33:33 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75341) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 00:33:34 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:33:35 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:33:35 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:33:37 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:33:40 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:33:40 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:33:40 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:33:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:33:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:33:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:33:40 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75341) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 00:33:41 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd08fb1-2fab-4381-924d-c394ef259c8d/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:33:41 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd08fb1-2fab-4381-924d-c394ef259c8d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:33:41 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd08fb1-2fab-4381-924d-c394ef259c8d/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:33:41 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd08fb1-2fab-4381-924d-c394ef259c8d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:33:41 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75341) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 00:33:41 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:33:41 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:33:41 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Hypervisor/Node resource view: name=user free_ram=8968MB free_disk=25.13275146484375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75341) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 00:33:41 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:33:41 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:33:41 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 1cd08fb1-2fab-4381-924d-c394ef259c8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:33:41 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 00:33:41 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 00:33:42 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 00:33:42 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 00:33:42 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Compute_service record updated for user:user {{(pid=75341) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 00:33:42 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.305s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:33:42 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:33:45 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:33:45 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:33:45 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Starting heal instance info cache {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 00:33:45 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Rebuilding the list of instances to heal {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 00:33:45 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "refresh_cache-1cd08fb1-2fab-4381-924d-c394ef259c8d" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:33:45 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquired lock "refresh_cache-1cd08fb1-2fab-4381-924d-c394ef259c8d" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:33:45 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Forcefully refreshing network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 00:33:45 user nova-compute[75341]: DEBUG nova.objects.instance [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lazy-loading 'info_cache' on Instance uuid 1cd08fb1-2fab-4381-924d-c394ef259c8d {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:33:45 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:33:45 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Updating instance_info_cache with network_info: [{"id": "dc987f35-ca2f-4c53-b5d1-07e07674ab27", "address": "fa:16:3e:ad:fe:44", "network": {"id": "04cba7ef-eb1c-4a35-b10a-25685666e9b6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-130493983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31ba430fd1d4d5fb882c3ccb3e7c0a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc987f35-ca", "ovs_interfaceid": "dc987f35-ca2f-4c53-b5d1-07e07674ab27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:33:45 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Releasing lock "refresh_cache-1cd08fb1-2fab-4381-924d-c394ef259c8d" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:33:45 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Updated the network info_cache for instance {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 00:33:45 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:33:47 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-9e4fc92c-a3fe-4c1b-a6d4-89e9e7d534e0 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Acquiring lock "1cd08fb1-2fab-4381-924d-c394ef259c8d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:33:47 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-9e4fc92c-a3fe-4c1b-a6d4-89e9e7d534e0 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Lock "1cd08fb1-2fab-4381-924d-c394ef259c8d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:33:47 user nova-compute[75341]: INFO nova.compute.manager [None req-9e4fc92c-a3fe-4c1b-a6d4-89e9e7d534e0 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Detaching volume fb942950-6a65-46f6-9c81-f0daf87040a5
Nov 15 00:33:47 user nova-compute[75341]: INFO nova.virt.block_device [None req-9e4fc92c-a3fe-4c1b-a6d4-89e9e7d534e0 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Attempting to driver detach volume fb942950-6a65-46f6-9c81-f0daf87040a5 from mountpoint /dev/vdb
Nov 15 00:33:47 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9e4fc92c-a3fe-4c1b-a6d4-89e9e7d534e0 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Attempting to detach device vdb from instance 1cd08fb1-2fab-4381-924d-c394ef259c8d from the persistent domain config. {{(pid=75341) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 00:33:47 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-9e4fc92c-a3fe-4c1b-a6d4-89e9e7d534e0 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 00:33:47 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 00:33:47 user nova-compute[75341]:   <source dev="/dev/sdb"/>
Nov 15 00:33:47 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 15 00:33:47 user nova-compute[75341]:   <serial>fb942950-6a65-46f6-9c81-f0daf87040a5</serial>
Nov 15 00:33:47 user nova-compute[75341]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 00:33:47 user nova-compute[75341]: </disk>
Nov 15 00:33:47 user nova-compute[75341]:  {{(pid=75341) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 00:33:47 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-9e4fc92c-a3fe-4c1b-a6d4-89e9e7d534e0 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Successfully detached device vdb from instance 1cd08fb1-2fab-4381-924d-c394ef259c8d from the persistent domain config.
Nov 15 00:33:47 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9e4fc92c-a3fe-4c1b-a6d4-89e9e7d534e0 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1cd08fb1-2fab-4381-924d-c394ef259c8d from the live domain config. {{(pid=75341) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 00:33:47 user nova-compute[75341]: DEBUG nova.virt.libvirt.guest [None req-9e4fc92c-a3fe-4c1b-a6d4-89e9e7d534e0 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 00:33:47 user nova-compute[75341]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 00:33:47 user nova-compute[75341]:   <source dev="/dev/sdb"/>
Nov 15 00:33:47 user nova-compute[75341]:   <target dev="vdb" bus="virtio"/>
Nov 15 00:33:47 user nova-compute[75341]:   <serial>fb942950-6a65-46f6-9c81-f0daf87040a5</serial>
Nov 15 00:33:47 user nova-compute[75341]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 00:33:47 user nova-compute[75341]: </disk>
Nov 15 00:33:47 user nova-compute[75341]:  {{(pid=75341) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 00:33:47 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:33:47 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-9e4fc92c-a3fe-4c1b-a6d4-89e9e7d534e0 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1cd08fb1-2fab-4381-924d-c394ef259c8d {{(pid=75341) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 00:33:50 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:33:55 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:34:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:34:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:34:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:34:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:34:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:34:00 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:34:05 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:34:07 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-9e4fc92c-a3fe-4c1b-a6d4-89e9e7d534e0 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1cd08fb1-2fab-4381-924d-c394ef259c8d is timed out.
Nov 15 00:34:07 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-9e4fc92c-a3fe-4c1b-a6d4-89e9e7d534e0 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Successfully detached device vdb from instance 1cd08fb1-2fab-4381-924d-c394ef259c8d from the live domain config.
Nov 15 00:34:07 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e4fc92c-a3fe-4c1b-a6d4-89e9e7d534e0 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] calling os-brick to detach iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 00:34:07 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4fc92c-a3fe-4c1b-a6d4-89e9e7d534e0 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f187062b3d0>, {'target_iqn': 'iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PWyMvbij', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 00:34:07 user nova-compute[75341]: WARNING os_brick.initiator.connectors.base [None req-9e4fc92c-a3fe-4c1b-a6d4-89e9e7d534e0 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 00:34:07 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-9e4fc92c-a3fe-4c1b-a6d4-89e9e7d534e0 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 00:34:07 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-9e4fc92c-a3fe-4c1b-a6d4-89e9e7d534e0 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 00:34:07 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:34:08 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:34:08 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2440ca-6849-4aff-9c5d-d53b7c478fa0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:34:08 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4fc92c-a3fe-4c1b-a6d4-89e9e7d534e0 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 00:34:08 user nova-compute[75341]: No targets found.
Nov 15 00:34:08 user nova-compute[75341]: iSNS:
Nov 15 00:34:08 user nova-compute[75341]: No targets found.
Nov 15 00:34:08 user nova-compute[75341]: STATIC:
Nov 15 00:34:08 user nova-compute[75341]: Target: iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5
Nov 15 00:34:08 user nova-compute[75341]:         Portal: 172.16.0.220:3260,-1
Nov 15 00:34:08 user nova-compute[75341]:                 Iface Name: default
Nov 15 00:34:08 user nova-compute[75341]: FIRMWARE:
Nov 15 00:34:08 user nova-compute[75341]: No targets found.
Nov 15 00:34:08 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 00:34:08 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4fc92c-a3fe-4c1b-a6d4-89e9e7d534e0 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 00:34:08 user nova-compute[75341]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 00:34:08 user nova-compute[75341]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75341) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 00:34:08 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4fc92c-a3fe-4c1b-a6d4-89e9e7d534e0 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5', 0)] {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 00:34:08 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:34:08 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:34:08 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ed1f94-43a9-4fad-a88a-cf3a1e4d44a6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:34:08 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:34:08 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:34:08 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3aa8ced-b060-4727-a4d9-66d58a1f61a5]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5 (non-flash)\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:34:08 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4fc92c-a3fe-4c1b-a6d4-89e9e7d534e0 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5 (non-flash)
Nov 15 00:34:08 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 00:34:08 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4fc92c-a3fe-4c1b-a6d4-89e9e7d534e0 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5 (non-flash)
Nov 15 00:34:08 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 00:34:08 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4fc92c-a3fe-4c1b-a6d4-89e9e7d534e0 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f189013a170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5'): ({'sdb'}, set())}) {{(pid=75341) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 00:34:08 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-9e4fc92c-a3fe-4c1b-a6d4-89e9e7d534e0 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Removing single pathed devices sdb {{(pid=75341) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 00:34:08 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:34:08 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:34:08 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e757c7-0e7a-4136-a94c-544633104acc]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:34:08 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:34:08 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:34:08 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d516c0-f5ba-42e7-bb92-773c6ae7b368]: (4, ('ok\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:34:08 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-9e4fc92c-a3fe-4c1b-a6d4-89e9e7d534e0 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Flushing IO for device /dev/sdb {{(pid=75341) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 00:34:08 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:34:08 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:34:08 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[37309e77-f48d-4ead-ad0c-75523edde390]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:34:08 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-9e4fc92c-a3fe-4c1b-a6d4-89e9e7d534e0 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75341) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 00:34:08 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:34:08 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:34:08 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[b76caaa0-6b37-43e8-a624-c1c7c95ee0c8]: (4, ('1', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:34:08 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-9e4fc92c-a3fe-4c1b-a6d4-89e9e7d534e0 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 00:34:08 user nova-compute[75341]: DEBUG os_brick.initiator.linuxscsi [None req-9e4fc92c-a3fe-4c1b-a6d4-89e9e7d534e0 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] SCSI volumes sdb have been removed. {{(pid=75341) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 00:34:08 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4fc92c-a3fe-4c1b-a6d4-89e9e7d534e0 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5')] {{(pid=75341) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 00:34:08 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:34:08 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:34:08 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ed2b94-a49a-4fec-b984-b4dbbbbb011c]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:34:08 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4fc92c-a3fe-4c1b-a6d4-89e9e7d534e0 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:34:08 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5 -p 172.16.0.220:3260 --logout {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:34:08 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:34:08 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[146824a2-dd7d-4367-b5bd-233a8aeb5668]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:34:08 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4fc92c-a3fe-4c1b-a6d4-89e9e7d534e0 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5, portal: 172.16.0.220,3260]
Nov 15 00:34:08 user nova-compute[75341]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5, portal: 172.16.0.220,3260] successful.
Nov 15 00:34:08 user nova-compute[75341]:  stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:34:08 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5 -p 172.16.0.220:3260 --op delete {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:34:08 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb942950-6a65-46f6-9c81-f0daf87040a5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86063) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:34:08 user nova-compute[75341]: DEBUG oslo.privsep.daemon [-] privsep: reply[3174bb67-6abb-40c0-95ff-249e7f0463e4]: (4, ('', '')) {{(pid=86063) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 00:34:08 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4fc92c-a3fe-4c1b-a6d4-89e9e7d534e0 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75341) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 00:34:08 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.base [None req-9e4fc92c-a3fe-4c1b-a6d4-89e9e7d534e0 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 00:34:08 user nova-compute[75341]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4fc92c-a3fe-4c1b-a6d4-89e9e7d534e0 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] <== disconnect_volume: return (288ms) None {{(pid=75341) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 00:34:08 user nova-compute[75341]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e4fc92c-a3fe-4c1b-a6d4-89e9e7d534e0 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Disconnected iSCSI Volume {{(pid=75341) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 00:34:08 user nova-compute[75341]: DEBUG nova.objects.instance [None req-9e4fc92c-a3fe-4c1b-a6d4-89e9e7d534e0 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Lazy-loading 'flavor' on Instance uuid 1cd08fb1-2fab-4381-924d-c394ef259c8d {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:34:08 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-9e4fc92c-a3fe-4c1b-a6d4-89e9e7d534e0 tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Lock "1cd08fb1-2fab-4381-924d-c394ef259c8d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.591s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:34:10 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:34:10 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:34:10 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:34:10 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:34:10 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:34:10 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:34:15 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:34:15 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:34:15 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:34:15 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:34:15 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:34:15 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:34:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:34:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:34:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:34:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:34:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:34:20 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:34:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:34:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:34:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:34:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:34:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:34:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:34:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:34:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:34:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:34:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:34:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:34:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:34:32 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:34:35 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:34:35 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:34:35 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:34:35 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:34:35 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75341) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 00:34:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-de3c2b14-0fb2-42ff-bbed-156b755403ce tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Acquiring lock "1cd08fb1-2fab-4381-924d-c394ef259c8d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:34:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-de3c2b14-0fb2-42ff-bbed-156b755403ce tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Lock "1cd08fb1-2fab-4381-924d-c394ef259c8d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:34:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-de3c2b14-0fb2-42ff-bbed-156b755403ce tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Acquiring lock "1cd08fb1-2fab-4381-924d-c394ef259c8d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:34:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-de3c2b14-0fb2-42ff-bbed-156b755403ce tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Lock "1cd08fb1-2fab-4381-924d-c394ef259c8d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:34:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-de3c2b14-0fb2-42ff-bbed-156b755403ce tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Lock "1cd08fb1-2fab-4381-924d-c394ef259c8d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:34:38 user nova-compute[75341]: INFO nova.compute.manager [None req-de3c2b14-0fb2-42ff-bbed-156b755403ce tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Terminating instance
Nov 15 00:34:38 user nova-compute[75341]: DEBUG nova.compute.manager [None req-de3c2b14-0fb2-42ff-bbed-156b755403ce tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Start destroying the instance on the hypervisor. {{(pid=75341) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 00:34:38 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:34:38 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:34:38 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:34:38 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:34:38 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:34:38 user nova-compute[75341]: DEBUG nova.compute.manager [req-1a154bad-70d1-411b-a37f-96d1efa8d657 req-81117a90-9de7-4f03-8cf4-ee8869c491eb service nova] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Received event network-vif-unplugged-dc987f35-ca2f-4c53-b5d1-07e07674ab27 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:34:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-1a154bad-70d1-411b-a37f-96d1efa8d657 req-81117a90-9de7-4f03-8cf4-ee8869c491eb service nova] Acquiring lock "1cd08fb1-2fab-4381-924d-c394ef259c8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:34:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-1a154bad-70d1-411b-a37f-96d1efa8d657 req-81117a90-9de7-4f03-8cf4-ee8869c491eb service nova] Lock "1cd08fb1-2fab-4381-924d-c394ef259c8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:34:38 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-1a154bad-70d1-411b-a37f-96d1efa8d657 req-81117a90-9de7-4f03-8cf4-ee8869c491eb service nova] Lock "1cd08fb1-2fab-4381-924d-c394ef259c8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:34:38 user nova-compute[75341]: DEBUG nova.compute.manager [req-1a154bad-70d1-411b-a37f-96d1efa8d657 req-81117a90-9de7-4f03-8cf4-ee8869c491eb service nova] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] No waiting events found dispatching network-vif-unplugged-dc987f35-ca2f-4c53-b5d1-07e07674ab27 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:34:38 user nova-compute[75341]: DEBUG nova.compute.manager [req-1a154bad-70d1-411b-a37f-96d1efa8d657 req-81117a90-9de7-4f03-8cf4-ee8869c491eb service nova] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Received event network-vif-unplugged-dc987f35-ca2f-4c53-b5d1-07e07674ab27 for instance with task_state deleting. {{(pid=75341) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 00:34:38 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:34:38 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Instance destroyed successfully.
Nov 15 00:34:38 user nova-compute[75341]: DEBUG nova.objects.instance [None req-de3c2b14-0fb2-42ff-bbed-156b755403ce tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Lazy-loading 'resources' on Instance uuid 1cd08fb1-2fab-4381-924d-c394ef259c8d {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:34:38 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-de3c2b14-0fb2-42ff-bbed-156b755403ce tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T00:27:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1308851418',display_name='tempest-ServerStableDeviceRescueTest-server-1308851418',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1308851418',id=51,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPUBbTti5ImaVvFPl1ksjWyA2etJEO3JrirbrNGJ7x3OEQAK2OV2Mv0XzIZH+ewbmuWIAv9zgEddufLnFhHRM3HFxlLT/AR1GIqnFC5fgy17RWIdk9ka6i8ljxBYVZs6Pg==',key_name='tempest-keypair-140295017',keypairs=<?>,launch_index=0,launched_at=2023-11-15T00:31:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e31ba430fd1d4d5fb882c3ccb3e7c0a0',ramdisk_id='',reservation_id='r-t3c7p9fx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1724574070',owner_user_name='tempest-ServerStableDeviceRescueTest-1724574070-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T00:33:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ffaaabcda33f40cba01e3d5181f10b4d',uuid=1cd08fb1-2fab-4381-924d-c394ef259c8d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dc987f35-ca2f-4c53-b5d1-07e07674ab27", "address": "fa:16:3e:ad:fe:44", "network": {"id": "04cba7ef-eb1c-4a35-b10a-25685666e9b6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-130493983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31ba430fd1d4d5fb882c3ccb3e7c0a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc987f35-ca", "ovs_interfaceid": "dc987f35-ca2f-4c53-b5d1-07e07674ab27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 00:34:38 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-de3c2b14-0fb2-42ff-bbed-156b755403ce tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Converting VIF {"id": "dc987f35-ca2f-4c53-b5d1-07e07674ab27", "address": "fa:16:3e:ad:fe:44", "network": {"id": "04cba7ef-eb1c-4a35-b10a-25685666e9b6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-130493983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e31ba430fd1d4d5fb882c3ccb3e7c0a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc987f35-ca", "ovs_interfaceid": "dc987f35-ca2f-4c53-b5d1-07e07674ab27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 00:34:38 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-de3c2b14-0fb2-42ff-bbed-156b755403ce tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ad:fe:44,bridge_name='br-int',has_traffic_filtering=True,id=dc987f35-ca2f-4c53-b5d1-07e07674ab27,network=Network(04cba7ef-eb1c-4a35-b10a-25685666e9b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc987f35-ca') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 00:34:38 user nova-compute[75341]: DEBUG os_vif [None req-de3c2b14-0fb2-42ff-bbed-156b755403ce tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:fe:44,bridge_name='br-int',has_traffic_filtering=True,id=dc987f35-ca2f-4c53-b5d1-07e07674ab27,network=Network(04cba7ef-eb1c-4a35-b10a-25685666e9b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc987f35-ca') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 00:34:38 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:34:38 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdc987f35-ca, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:34:38 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:34:38 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:34:38 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:34:38 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3773dda6-63c7-4871-9a63-8d4657a5b913) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:34:38 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:34:38 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:34:38 user nova-compute[75341]: INFO os_vif [None req-de3c2b14-0fb2-42ff-bbed-156b755403ce tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:fe:44,bridge_name='br-int',has_traffic_filtering=True,id=dc987f35-ca2f-4c53-b5d1-07e07674ab27,network=Network(04cba7ef-eb1c-4a35-b10a-25685666e9b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc987f35-ca')
Nov 15 00:34:38 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-de3c2b14-0fb2-42ff-bbed-156b755403ce tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Deleting instance files /opt/stack/data/nova/instances/1cd08fb1-2fab-4381-924d-c394ef259c8d_del
Nov 15 00:34:38 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-de3c2b14-0fb2-42ff-bbed-156b755403ce tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Deletion of /opt/stack/data/nova/instances/1cd08fb1-2fab-4381-924d-c394ef259c8d_del complete
Nov 15 00:34:38 user nova-compute[75341]: INFO nova.compute.manager [None req-de3c2b14-0fb2-42ff-bbed-156b755403ce tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Took 0.83 seconds to destroy the instance on the hypervisor.
Nov 15 00:34:38 user nova-compute[75341]: DEBUG oslo.service.loopingcall [None req-de3c2b14-0fb2-42ff-bbed-156b755403ce tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75341) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 00:34:38 user nova-compute[75341]: DEBUG nova.compute.manager [-] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Deallocating network for instance {{(pid=75341) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 00:34:38 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] deallocate_for_instance() {{(pid=75341) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 00:34:39 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:34:39 user nova-compute[75341]: INFO nova.compute.manager [-] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Took 0.68 seconds to deallocate network for instance.
Nov 15 00:34:39 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-de3c2b14-0fb2-42ff-bbed-156b755403ce tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:34:39 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-de3c2b14-0fb2-42ff-bbed-156b755403ce tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:34:39 user nova-compute[75341]: DEBUG nova.compute.manager [req-520a11aa-0283-47c7-a911-d531dc172561 req-17a88801-06dd-4abd-b34b-79278caf73f3 service nova] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Received event network-vif-deleted-dc987f35-ca2f-4c53-b5d1-07e07674ab27 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:34:39 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-de3c2b14-0fb2-42ff-bbed-156b755403ce tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 00:34:39 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-de3c2b14-0fb2-42ff-bbed-156b755403ce tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 00:34:39 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-de3c2b14-0fb2-42ff-bbed-156b755403ce tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.135s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:34:39 user nova-compute[75341]: INFO nova.scheduler.client.report [None req-de3c2b14-0fb2-42ff-bbed-156b755403ce tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Deleted allocations for instance 1cd08fb1-2fab-4381-924d-c394ef259c8d
Nov 15 00:34:39 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-de3c2b14-0fb2-42ff-bbed-156b755403ce tempest-ServerStableDeviceRescueTest-1724574070 tempest-ServerStableDeviceRescueTest-1724574070-project-member] Lock "1cd08fb1-2fab-4381-924d-c394ef259c8d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.832s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:34:40 user nova-compute[75341]: DEBUG nova.compute.manager [req-2f10eed7-2414-4bbf-b92e-e6ed9d19ecff req-d30986ba-8439-4ce2-88d7-0f7e8ea02811 service nova] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Received event network-vif-plugged-dc987f35-ca2f-4c53-b5d1-07e07674ab27 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:34:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-2f10eed7-2414-4bbf-b92e-e6ed9d19ecff req-d30986ba-8439-4ce2-88d7-0f7e8ea02811 service nova] Acquiring lock "1cd08fb1-2fab-4381-924d-c394ef259c8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:34:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-2f10eed7-2414-4bbf-b92e-e6ed9d19ecff req-d30986ba-8439-4ce2-88d7-0f7e8ea02811 service nova] Lock "1cd08fb1-2fab-4381-924d-c394ef259c8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:34:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-2f10eed7-2414-4bbf-b92e-e6ed9d19ecff req-d30986ba-8439-4ce2-88d7-0f7e8ea02811 service nova] Lock "1cd08fb1-2fab-4381-924d-c394ef259c8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:34:40 user nova-compute[75341]: DEBUG nova.compute.manager [req-2f10eed7-2414-4bbf-b92e-e6ed9d19ecff req-d30986ba-8439-4ce2-88d7-0f7e8ea02811 service nova] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] No waiting events found dispatching network-vif-plugged-dc987f35-ca2f-4c53-b5d1-07e07674ab27 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:34:40 user nova-compute[75341]: WARNING nova.compute.manager [req-2f10eed7-2414-4bbf-b92e-e6ed9d19ecff req-d30986ba-8439-4ce2-88d7-0f7e8ea02811 service nova] [instance: 1cd08fb1-2fab-4381-924d-c394ef259c8d] Received unexpected event network-vif-plugged-dc987f35-ca2f-4c53-b5d1-07e07674ab27 for instance with vm_state deleted and task_state None.
Nov 15 00:34:40 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:34:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:34:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:34:40 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:34:40 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75341) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 00:34:41 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:34:41 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:34:41 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Hypervisor/Node resource view: name=user free_ram=9135MB free_disk=25.257278442382812GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75341) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 00:34:41 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:34:41 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:34:41 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 00:34:41 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 00:34:41 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 00:34:41 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 00:34:41 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Compute_service record updated for user:user {{(pid=75341) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 00:34:41 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.134s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:34:43 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:34:43 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:34:44 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:34:44 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:34:44 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Starting heal instance info cache {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 00:34:44 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Rebuilding the list of instances to heal {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 00:34:44 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Didn't find any instances for network info cache update. {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 00:34:45 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:34:48 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:34:53 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:34:58 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:34:59 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:35:03 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:35:08 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:35:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:35:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:35:23 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:35:23 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:35:23 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:35:23 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:35:23 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:35:23 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:35:28 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:35:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:35:33 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:35:33 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:35:34 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:35:35 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:35:36 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:35:36 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:35:36 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75341) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 00:35:37 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:35:38 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:35:41 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:35:41 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:35:41 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:35:41 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:35:41 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75341) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 00:35:42 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:35:42 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:35:42 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Hypervisor/Node resource view: name=user free_ram=9143MB free_disk=25.25607681274414GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75341) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 00:35:42 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:35:42 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:35:42 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 00:35:42 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 00:35:42 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 00:35:42 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 00:35:42 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Compute_service record updated for user:user {{(pid=75341) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 00:35:42 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.129s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:35:43 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:35:43 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:35:45 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:35:46 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:35:46 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Starting heal instance info cache {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 00:35:46 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Rebuilding the list of instances to heal {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 00:35:46 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Didn't find any instances for network info cache update. {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 00:35:47 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:35:48 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:35:53 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:35:58 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:36:03 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:36:08 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:36:11 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:36:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:36:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:36:13 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:36:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:36:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:36:18 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:36:19 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:36:20 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] Acquiring lock "90d4f967-2b91-439e-9366-135e5909244f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:36:20 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] Lock "90d4f967-2b91-439e-9366-135e5909244f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:36:20 user nova-compute[75341]: DEBUG nova.compute.manager [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] [instance: 90d4f967-2b91-439e-9366-135e5909244f] Starting instance... {{(pid=75341) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 00:36:20 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:36:20 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:36:20 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75341) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 00:36:20 user nova-compute[75341]: INFO nova.compute.claims [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] [instance: 90d4f967-2b91-439e-9366-135e5909244f] Claim successful on node user
Nov 15 00:36:21 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 00:36:21 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 00:36:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.184s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:36:21 user nova-compute[75341]: DEBUG nova.compute.manager [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] [instance: 90d4f967-2b91-439e-9366-135e5909244f] Start building networks asynchronously for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 00:36:21 user nova-compute[75341]: DEBUG nova.compute.manager [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] [instance: 90d4f967-2b91-439e-9366-135e5909244f] Allocating IP information in the background. {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 00:36:21 user nova-compute[75341]: DEBUG nova.network.neutron [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] [instance: 90d4f967-2b91-439e-9366-135e5909244f] allocate_for_instance() {{(pid=75341) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 00:36:21 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] [instance: 90d4f967-2b91-439e-9366-135e5909244f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 00:36:21 user nova-compute[75341]: DEBUG nova.compute.manager [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] [instance: 90d4f967-2b91-439e-9366-135e5909244f] Start building block device mappings for instance. {{(pid=75341) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 00:36:21 user nova-compute[75341]: DEBUG nova.policy [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f59b807ce0a5430fb9e682d746b73a83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fed32b7fefd44136bfceb77d7412c7bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75341) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 00:36:21 user nova-compute[75341]: DEBUG nova.compute.manager [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] [instance: 90d4f967-2b91-439e-9366-135e5909244f] Start spawning the instance on the hypervisor. {{(pid=75341) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 00:36:21 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] [instance: 90d4f967-2b91-439e-9366-135e5909244f] Creating instance directory {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 00:36:21 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] [instance: 90d4f967-2b91-439e-9366-135e5909244f] Creating image(s)
Nov 15 00:36:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] Acquiring lock "/opt/stack/data/nova/instances/90d4f967-2b91-439e-9366-135e5909244f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:36:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] Lock "/opt/stack/data/nova/instances/90d4f967-2b91-439e-9366-135e5909244f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:36:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] Lock "/opt/stack/data/nova/instances/90d4f967-2b91-439e-9366-135e5909244f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:36:21 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:36:21 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.188s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:36:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] Acquiring lock "4754efee9a6d73d3647f2add2cfe86c291949740" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:36:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:36:21 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:36:21 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.184s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:36:21 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/90d4f967-2b91-439e-9366-135e5909244f/disk 1073741824 {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:36:21 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740,backing_fmt=raw /opt/stack/data/nova/instances/90d4f967-2b91-439e-9366-135e5909244f/disk 1073741824" returned: 0 in 0.054s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:36:21 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] Lock "4754efee9a6d73d3647f2add2cfe86c291949740" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:36:21 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:36:21 user nova-compute[75341]: DEBUG nova.network.neutron [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] [instance: 90d4f967-2b91-439e-9366-135e5909244f] Successfully created port: 8bd469d5-3831-42ad-bd96-98c97106b763 {{(pid=75341) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 00:36:21 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4754efee9a6d73d3647f2add2cfe86c291949740 --force-share --output=json" returned: 0 in 0.176s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:36:21 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] Checking if we can resize image /opt/stack/data/nova/instances/90d4f967-2b91-439e-9366-135e5909244f/disk. size=1073741824 {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 00:36:21 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d4f967-2b91-439e-9366-135e5909244f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:36:22 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d4f967-2b91-439e-9366-135e5909244f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:36:22 user nova-compute[75341]: DEBUG nova.virt.disk.api [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] Cannot resize image /opt/stack/data/nova/instances/90d4f967-2b91-439e-9366-135e5909244f/disk to a smaller size. {{(pid=75341) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 00:36:22 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] [instance: 90d4f967-2b91-439e-9366-135e5909244f] Created local disks {{(pid=75341) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 00:36:22 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] [instance: 90d4f967-2b91-439e-9366-135e5909244f] Ensure instance console log exists: /opt/stack/data/nova/instances/90d4f967-2b91-439e-9366-135e5909244f/console.log {{(pid=75341) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 00:36:22 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:36:22 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:36:22 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:36:22 user nova-compute[75341]: DEBUG nova.network.neutron [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] [instance: 90d4f967-2b91-439e-9366-135e5909244f] Successfully updated port: 8bd469d5-3831-42ad-bd96-98c97106b763 {{(pid=75341) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 00:36:22 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] Acquiring lock "refresh_cache-90d4f967-2b91-439e-9366-135e5909244f" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:36:22 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] Acquired lock "refresh_cache-90d4f967-2b91-439e-9366-135e5909244f" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:36:22 user nova-compute[75341]: DEBUG nova.network.neutron [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] [instance: 90d4f967-2b91-439e-9366-135e5909244f] Building network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 00:36:22 user nova-compute[75341]: DEBUG nova.compute.manager [req-f40475e4-f141-4edb-83c9-84af8919a348 req-6a20025a-7deb-42b2-a39e-ef015eff42ce service nova] [instance: 90d4f967-2b91-439e-9366-135e5909244f] Received event network-changed-8bd469d5-3831-42ad-bd96-98c97106b763 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:36:22 user nova-compute[75341]: DEBUG nova.compute.manager [req-f40475e4-f141-4edb-83c9-84af8919a348 req-6a20025a-7deb-42b2-a39e-ef015eff42ce service nova] [instance: 90d4f967-2b91-439e-9366-135e5909244f] Refreshing instance network info cache due to event network-changed-8bd469d5-3831-42ad-bd96-98c97106b763. {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 00:36:22 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-f40475e4-f141-4edb-83c9-84af8919a348 req-6a20025a-7deb-42b2-a39e-ef015eff42ce service nova] Acquiring lock "refresh_cache-90d4f967-2b91-439e-9366-135e5909244f" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:36:22 user nova-compute[75341]: DEBUG nova.network.neutron [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] [instance: 90d4f967-2b91-439e-9366-135e5909244f] Instance cache missing network info. {{(pid=75341) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 00:36:22 user nova-compute[75341]: DEBUG nova.network.neutron [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] [instance: 90d4f967-2b91-439e-9366-135e5909244f] Updating instance_info_cache with network_info: [{"id": "8bd469d5-3831-42ad-bd96-98c97106b763", "address": "fa:16:3e:35:7a:6b", "network": {"id": "c7278c61-5d7d-43d9-a0ae-38b29f98461a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1757487495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fed32b7fefd44136bfceb77d7412c7bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd469d5-38", "ovs_interfaceid": "8bd469d5-3831-42ad-bd96-98c97106b763", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:36:22 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] Releasing lock "refresh_cache-90d4f967-2b91-439e-9366-135e5909244f" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:36:22 user nova-compute[75341]: DEBUG nova.compute.manager [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] [instance: 90d4f967-2b91-439e-9366-135e5909244f] Instance network_info: |[{"id": "8bd469d5-3831-42ad-bd96-98c97106b763", "address": "fa:16:3e:35:7a:6b", "network": {"id": "c7278c61-5d7d-43d9-a0ae-38b29f98461a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1757487495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fed32b7fefd44136bfceb77d7412c7bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd469d5-38", "ovs_interfaceid": "8bd469d5-3831-42ad-bd96-98c97106b763", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75341) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 00:36:22 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-f40475e4-f141-4edb-83c9-84af8919a348 req-6a20025a-7deb-42b2-a39e-ef015eff42ce service nova] Acquired lock "refresh_cache-90d4f967-2b91-439e-9366-135e5909244f" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:36:22 user nova-compute[75341]: DEBUG nova.network.neutron [req-f40475e4-f141-4edb-83c9-84af8919a348 req-6a20025a-7deb-42b2-a39e-ef015eff42ce service nova] [instance: 90d4f967-2b91-439e-9366-135e5909244f] Refreshing network info cache for port 8bd469d5-3831-42ad-bd96-98c97106b763 {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 00:36:22 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] [instance: 90d4f967-2b91-439e-9366-135e5909244f] Start _get_guest_xml network_info=[{"id": "8bd469d5-3831-42ad-bd96-98c97106b763", "address": "fa:16:3e:35:7a:6b", "network": {"id": "c7278c61-5d7d-43d9-a0ae-38b29f98461a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1757487495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fed32b7fefd44136bfceb77d7412c7bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd469d5-38", "ovs_interfaceid": "8bd469d5-3831-42ad-bd96-98c97106b763", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'encrypted': False, 'image_id': 'e46abb82-b810-490e-a8a1-ccdc5fa1a796'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 00:36:22 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:36:22 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:36:22 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 00:36:22 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] CPU controller missing on host. {{(pid=75341) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 00:36:22 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 00:36:22 user nova-compute[75341]: DEBUG nova.virt.libvirt.host [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] CPU controller found on host. {{(pid=75341) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 00:36:22 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75341) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 00:36:22 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T23:35:54Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T23:36:06Z,direct_url=<?>,disk_format='qcow2',id=e46abb82-b810-490e-a8a1-ccdc5fa1a796,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='81b1e55661954a999e9fc78dcda9950b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T23:36:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 00:36:22 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] Flavor limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 00:36:22 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] Image limits 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 00:36:22 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] Flavor pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 00:36:22 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] Image pref 0:0:0 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 00:36:22 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 00:36:22 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 00:36:22 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 00:36:22 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] Got 1 possible topologies {{(pid=75341) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 00:36:22 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 00:36:22 user nova-compute[75341]: DEBUG nova.virt.hardware [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75341) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 00:36:22 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T00:36:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1137788412',display_name='tempest-VolumesActionsTest-instance-1137788412',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1137788412',id=52,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fed32b7fefd44136bfceb77d7412c7bd',ramdisk_id='',reservation_id='r-bpgb0svc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1203398487',owner_user_name='tempest-VolumesActionsTest-1203398487-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T00:36:21Z,user_data=None,user_id='f59b807ce0a5430fb9e682d746b73a83',uuid=90d4f967-2b91-439e-9366-135e5909244f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8bd469d5-3831-42ad-bd96-98c97106b763", "address": "fa:16:3e:35:7a:6b", "network": {"id": "c7278c61-5d7d-43d9-a0ae-38b29f98461a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1757487495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fed32b7fefd44136bfceb77d7412c7bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd469d5-38", "ovs_interfaceid": "8bd469d5-3831-42ad-bd96-98c97106b763", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75341) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 00:36:22 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] Converting VIF {"id": "8bd469d5-3831-42ad-bd96-98c97106b763", "address": "fa:16:3e:35:7a:6b", "network": {"id": "c7278c61-5d7d-43d9-a0ae-38b29f98461a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1757487495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fed32b7fefd44136bfceb77d7412c7bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd469d5-38", "ovs_interfaceid": "8bd469d5-3831-42ad-bd96-98c97106b763", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 00:36:22 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:7a:6b,bridge_name='br-int',has_traffic_filtering=True,id=8bd469d5-3831-42ad-bd96-98c97106b763,network=Network(c7278c61-5d7d-43d9-a0ae-38b29f98461a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bd469d5-38') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 00:36:22 user nova-compute[75341]: DEBUG nova.objects.instance [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] Lazy-loading 'pci_devices' on Instance uuid 90d4f967-2b91-439e-9366-135e5909244f {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:36:22 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] [instance: 90d4f967-2b91-439e-9366-135e5909244f] End _get_guest_xml xml=<domain type="kvm">
Nov 15 00:36:22 user nova-compute[75341]:   <uuid>90d4f967-2b91-439e-9366-135e5909244f</uuid>
Nov 15 00:36:22 user nova-compute[75341]:   <name>instance-00000034</name>
Nov 15 00:36:22 user nova-compute[75341]:   <memory>524288</memory>
Nov 15 00:36:22 user nova-compute[75341]:   <vcpu>1</vcpu>
Nov 15 00:36:22 user nova-compute[75341]:   <metadata>
Nov 15 00:36:22 user nova-compute[75341]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 00:36:22 user nova-compute[75341]:       <nova:package version="0.0.0"/>
Nov 15 00:36:22 user nova-compute[75341]:       <nova:name>tempest-VolumesActionsTest-instance-1137788412</nova:name>
Nov 15 00:36:22 user nova-compute[75341]:       <nova:creationTime>2023-11-15 00:36:22</nova:creationTime>
Nov 15 00:36:22 user nova-compute[75341]:       <nova:flavor name="m1.tiny">
Nov 15 00:36:22 user nova-compute[75341]:         <nova:memory>512</nova:memory>
Nov 15 00:36:22 user nova-compute[75341]:         <nova:disk>1</nova:disk>
Nov 15 00:36:22 user nova-compute[75341]:         <nova:swap>0</nova:swap>
Nov 15 00:36:22 user nova-compute[75341]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 00:36:22 user nova-compute[75341]:         <nova:vcpus>1</nova:vcpus>
Nov 15 00:36:22 user nova-compute[75341]:       </nova:flavor>
Nov 15 00:36:22 user nova-compute[75341]:       <nova:owner>
Nov 15 00:36:22 user nova-compute[75341]:         <nova:user uuid="f59b807ce0a5430fb9e682d746b73a83">tempest-VolumesActionsTest-1203398487-project-member</nova:user>
Nov 15 00:36:22 user nova-compute[75341]:         <nova:project uuid="fed32b7fefd44136bfceb77d7412c7bd">tempest-VolumesActionsTest-1203398487</nova:project>
Nov 15 00:36:22 user nova-compute[75341]:       </nova:owner>
Nov 15 00:36:22 user nova-compute[75341]:       <nova:root type="image" uuid="e46abb82-b810-490e-a8a1-ccdc5fa1a796"/>
Nov 15 00:36:22 user nova-compute[75341]:       <nova:ports>
Nov 15 00:36:22 user nova-compute[75341]:         <nova:port uuid="8bd469d5-3831-42ad-bd96-98c97106b763">
Nov 15 00:36:22 user nova-compute[75341]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 00:36:22 user nova-compute[75341]:         </nova:port>
Nov 15 00:36:22 user nova-compute[75341]:       </nova:ports>
Nov 15 00:36:22 user nova-compute[75341]:     </nova:instance>
Nov 15 00:36:22 user nova-compute[75341]:   </metadata>
Nov 15 00:36:22 user nova-compute[75341]:   <sysinfo type="smbios">
Nov 15 00:36:22 user nova-compute[75341]:     <system>
Nov 15 00:36:22 user nova-compute[75341]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 00:36:22 user nova-compute[75341]:       <entry name="product">OpenStack Nova</entry>
Nov 15 00:36:22 user nova-compute[75341]:       <entry name="version">0.0.0</entry>
Nov 15 00:36:22 user nova-compute[75341]:       <entry name="serial">90d4f967-2b91-439e-9366-135e5909244f</entry>
Nov 15 00:36:22 user nova-compute[75341]:       <entry name="uuid">90d4f967-2b91-439e-9366-135e5909244f</entry>
Nov 15 00:36:22 user nova-compute[75341]:       <entry name="family">Virtual Machine</entry>
Nov 15 00:36:22 user nova-compute[75341]:     </system>
Nov 15 00:36:22 user nova-compute[75341]:   </sysinfo>
Nov 15 00:36:22 user nova-compute[75341]:   <os>
Nov 15 00:36:22 user nova-compute[75341]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 00:36:22 user nova-compute[75341]:     <boot dev="hd"/>
Nov 15 00:36:22 user nova-compute[75341]:     <smbios mode="sysinfo"/>
Nov 15 00:36:22 user nova-compute[75341]:   </os>
Nov 15 00:36:22 user nova-compute[75341]:   <features>
Nov 15 00:36:22 user nova-compute[75341]:     <acpi/>
Nov 15 00:36:22 user nova-compute[75341]:     <apic/>
Nov 15 00:36:22 user nova-compute[75341]:     <vmcoreinfo/>
Nov 15 00:36:22 user nova-compute[75341]:   </features>
Nov 15 00:36:22 user nova-compute[75341]:   <clock offset="utc">
Nov 15 00:36:22 user nova-compute[75341]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 00:36:22 user nova-compute[75341]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 00:36:22 user nova-compute[75341]:     <timer name="hpet" present="no"/>
Nov 15 00:36:22 user nova-compute[75341]:   </clock>
Nov 15 00:36:22 user nova-compute[75341]:   <cpu mode="custom" match="exact">
Nov 15 00:36:22 user nova-compute[75341]:     <model>Nehalem</model>
Nov 15 00:36:22 user nova-compute[75341]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 00:36:22 user nova-compute[75341]:   </cpu>
Nov 15 00:36:22 user nova-compute[75341]:   <devices>
Nov 15 00:36:22 user nova-compute[75341]:     <disk type="file" device="disk">
Nov 15 00:36:22 user nova-compute[75341]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 00:36:22 user nova-compute[75341]:       <source file="/opt/stack/data/nova/instances/90d4f967-2b91-439e-9366-135e5909244f/disk"/>
Nov 15 00:36:22 user nova-compute[75341]:       <target dev="vda" bus="virtio"/>
Nov 15 00:36:22 user nova-compute[75341]:     </disk>
Nov 15 00:36:22 user nova-compute[75341]:     <interface type="ethernet">
Nov 15 00:36:22 user nova-compute[75341]:       <mac address="fa:16:3e:35:7a:6b"/>
Nov 15 00:36:22 user nova-compute[75341]:       <model type="virtio"/>
Nov 15 00:36:22 user nova-compute[75341]:       <mtu size="1442"/>
Nov 15 00:36:22 user nova-compute[75341]:       <target dev="tap8bd469d5-38"/>
Nov 15 00:36:22 user nova-compute[75341]:     </interface>
Nov 15 00:36:22 user nova-compute[75341]:     <serial type="pty">
Nov 15 00:36:22 user nova-compute[75341]:       <log file="/opt/stack/data/nova/instances/90d4f967-2b91-439e-9366-135e5909244f/console.log" append="off"/>
Nov 15 00:36:22 user nova-compute[75341]:     </serial>
Nov 15 00:36:22 user nova-compute[75341]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 00:36:22 user nova-compute[75341]:     <video>
Nov 15 00:36:22 user nova-compute[75341]:       <model type="virtio"/>
Nov 15 00:36:22 user nova-compute[75341]:     </video>
Nov 15 00:36:22 user nova-compute[75341]:     <rng model="virtio">
Nov 15 00:36:22 user nova-compute[75341]:       <backend model="random">/dev/urandom</backend>
Nov 15 00:36:22 user nova-compute[75341]:     </rng>
Nov 15 00:36:22 user nova-compute[75341]:     <controller type="usb" index="0" model="none"/>
Nov 15 00:36:22 user nova-compute[75341]:     <memballoon model="virtio">
Nov 15 00:36:22 user nova-compute[75341]:       <stats period="10"/>
Nov 15 00:36:22 user nova-compute[75341]:     </memballoon>
Nov 15 00:36:22 user nova-compute[75341]:   </devices>
Nov 15 00:36:22 user nova-compute[75341]: </domain>
Nov 15 00:36:22 user nova-compute[75341]:  {{(pid=75341) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 00:36:22 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T00:36:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1137788412',display_name='tempest-VolumesActionsTest-instance-1137788412',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1137788412',id=52,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fed32b7fefd44136bfceb77d7412c7bd',ramdisk_id='',reservation_id='r-bpgb0svc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1203398487',owner_user_name='tempest-VolumesActionsTest-1203398487-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T00:36:21Z,user_data=None,user_id='f59b807ce0a5430fb9e682d746b73a83',uuid=90d4f967-2b91-439e-9366-135e5909244f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8bd469d5-3831-42ad-bd96-98c97106b763", "address": "fa:16:3e:35:7a:6b", "network": {"id": "c7278c61-5d7d-43d9-a0ae-38b29f98461a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1757487495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fed32b7fefd44136bfceb77d7412c7bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd469d5-38", "ovs_interfaceid": "8bd469d5-3831-42ad-bd96-98c97106b763", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 00:36:22 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] Converting VIF {"id": "8bd469d5-3831-42ad-bd96-98c97106b763", "address": "fa:16:3e:35:7a:6b", "network": {"id": "c7278c61-5d7d-43d9-a0ae-38b29f98461a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1757487495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fed32b7fefd44136bfceb77d7412c7bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd469d5-38", "ovs_interfaceid": "8bd469d5-3831-42ad-bd96-98c97106b763", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 00:36:22 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:7a:6b,bridge_name='br-int',has_traffic_filtering=True,id=8bd469d5-3831-42ad-bd96-98c97106b763,network=Network(c7278c61-5d7d-43d9-a0ae-38b29f98461a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bd469d5-38') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 00:36:22 user nova-compute[75341]: DEBUG os_vif [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:7a:6b,bridge_name='br-int',has_traffic_filtering=True,id=8bd469d5-3831-42ad-bd96-98c97106b763,network=Network(c7278c61-5d7d-43d9-a0ae-38b29f98461a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bd469d5-38') {{(pid=75341) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 00:36:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:36:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:36:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 00:36:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:36:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd7695171-b348-5d51-8dfc-7ae975569472', '_type': 'linux-noop'}}, row=False) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:36:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:36:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:36:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:36:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8bd469d5-38, may_exist=True, interface_attrs={}) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:36:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8bd469d5-38, col_values=(('qos', UUID('42d1454d-a0d5-450b-9b78-49eb5a7bb215')),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:36:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8bd469d5-38, col_values=(('external_ids', {'iface-id': '8bd469d5-3831-42ad-bd96-98c97106b763', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:7a:6b', 'vm-uuid': '90d4f967-2b91-439e-9366-135e5909244f'}),), if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:36:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:36:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:36:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:36:22 user nova-compute[75341]: INFO os_vif [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:7a:6b,bridge_name='br-int',has_traffic_filtering=True,id=8bd469d5-3831-42ad-bd96-98c97106b763,network=Network(c7278c61-5d7d-43d9-a0ae-38b29f98461a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bd469d5-38')
Nov 15 00:36:22 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] No BDM found with device name vda, not building metadata. {{(pid=75341) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 00:36:22 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] No VIF found with MAC fa:16:3e:35:7a:6b, not building metadata {{(pid=75341) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 00:36:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:36:23 user nova-compute[75341]: DEBUG nova.network.neutron [req-f40475e4-f141-4edb-83c9-84af8919a348 req-6a20025a-7deb-42b2-a39e-ef015eff42ce service nova] [instance: 90d4f967-2b91-439e-9366-135e5909244f] Updated VIF entry in instance network info cache for port 8bd469d5-3831-42ad-bd96-98c97106b763. {{(pid=75341) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 00:36:23 user nova-compute[75341]: DEBUG nova.network.neutron [req-f40475e4-f141-4edb-83c9-84af8919a348 req-6a20025a-7deb-42b2-a39e-ef015eff42ce service nova] [instance: 90d4f967-2b91-439e-9366-135e5909244f] Updating instance_info_cache with network_info: [{"id": "8bd469d5-3831-42ad-bd96-98c97106b763", "address": "fa:16:3e:35:7a:6b", "network": {"id": "c7278c61-5d7d-43d9-a0ae-38b29f98461a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1757487495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fed32b7fefd44136bfceb77d7412c7bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd469d5-38", "ovs_interfaceid": "8bd469d5-3831-42ad-bd96-98c97106b763", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:36:23 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-f40475e4-f141-4edb-83c9-84af8919a348 req-6a20025a-7deb-42b2-a39e-ef015eff42ce service nova] Releasing lock "refresh_cache-90d4f967-2b91-439e-9366-135e5909244f" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:36:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:36:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:36:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:36:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:36:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:36:24 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:36:25 user nova-compute[75341]: DEBUG nova.compute.manager [req-6d1339a1-876e-49f5-84ae-471061cddbd4 req-54c2fc14-ac9a-4403-be38-66fb21ecdac7 service nova] [instance: 90d4f967-2b91-439e-9366-135e5909244f] Received event network-vif-plugged-8bd469d5-3831-42ad-bd96-98c97106b763 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:36:25 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6d1339a1-876e-49f5-84ae-471061cddbd4 req-54c2fc14-ac9a-4403-be38-66fb21ecdac7 service nova] Acquiring lock "90d4f967-2b91-439e-9366-135e5909244f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:36:25 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6d1339a1-876e-49f5-84ae-471061cddbd4 req-54c2fc14-ac9a-4403-be38-66fb21ecdac7 service nova] Lock "90d4f967-2b91-439e-9366-135e5909244f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:36:25 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6d1339a1-876e-49f5-84ae-471061cddbd4 req-54c2fc14-ac9a-4403-be38-66fb21ecdac7 service nova] Lock "90d4f967-2b91-439e-9366-135e5909244f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:36:25 user nova-compute[75341]: DEBUG nova.compute.manager [req-6d1339a1-876e-49f5-84ae-471061cddbd4 req-54c2fc14-ac9a-4403-be38-66fb21ecdac7 service nova] [instance: 90d4f967-2b91-439e-9366-135e5909244f] No waiting events found dispatching network-vif-plugged-8bd469d5-3831-42ad-bd96-98c97106b763 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:36:25 user nova-compute[75341]: WARNING nova.compute.manager [req-6d1339a1-876e-49f5-84ae-471061cddbd4 req-54c2fc14-ac9a-4403-be38-66fb21ecdac7 service nova] [instance: 90d4f967-2b91-439e-9366-135e5909244f] Received unexpected event network-vif-plugged-8bd469d5-3831-42ad-bd96-98c97106b763 for instance with vm_state building and task_state spawning.
Nov 15 00:36:26 user nova-compute[75341]: DEBUG nova.compute.manager [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] [instance: 90d4f967-2b91-439e-9366-135e5909244f] Instance event wait completed in 0 seconds for  {{(pid=75341) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 00:36:26 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] [instance: 90d4f967-2b91-439e-9366-135e5909244f] Guest created on hypervisor {{(pid=75341) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 00:36:26 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 90d4f967-2b91-439e-9366-135e5909244f] Instance spawned successfully.
Nov 15 00:36:26 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] [instance: 90d4f967-2b91-439e-9366-135e5909244f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 00:36:26 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] [instance: 90d4f967-2b91-439e-9366-135e5909244f] Found default for hw_cdrom_bus of ide {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 00:36:26 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] [instance: 90d4f967-2b91-439e-9366-135e5909244f] Found default for hw_disk_bus of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 00:36:26 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] [instance: 90d4f967-2b91-439e-9366-135e5909244f] Found default for hw_input_bus of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 00:36:26 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] [instance: 90d4f967-2b91-439e-9366-135e5909244f] Found default for hw_pointer_model of None {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 00:36:26 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] [instance: 90d4f967-2b91-439e-9366-135e5909244f] Found default for hw_video_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 00:36:26 user nova-compute[75341]: DEBUG nova.virt.libvirt.driver [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] [instance: 90d4f967-2b91-439e-9366-135e5909244f] Found default for hw_vif_model of virtio {{(pid=75341) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 00:36:26 user nova-compute[75341]: INFO nova.compute.manager [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] [instance: 90d4f967-2b91-439e-9366-135e5909244f] Took 5.29 seconds to spawn the instance on the hypervisor.
Nov 15 00:36:26 user nova-compute[75341]: DEBUG nova.compute.manager [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] [instance: 90d4f967-2b91-439e-9366-135e5909244f] Checking state {{(pid=75341) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 00:36:26 user nova-compute[75341]: INFO nova.compute.manager [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] [instance: 90d4f967-2b91-439e-9366-135e5909244f] Took 5.80 seconds to build instance.
Nov 15 00:36:26 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-96f76d67-4944-4a5c-be7e-866568fc65e6 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] Lock "90d4f967-2b91-439e-9366-135e5909244f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.896s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:36:27 user nova-compute[75341]: DEBUG nova.compute.manager [req-86019ba9-44f7-4b47-b5dc-23c009bf6973 req-12a0fe8b-2f93-494f-8e20-a1a9d7b0e59d service nova] [instance: 90d4f967-2b91-439e-9366-135e5909244f] Received event network-vif-plugged-8bd469d5-3831-42ad-bd96-98c97106b763 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:36:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-86019ba9-44f7-4b47-b5dc-23c009bf6973 req-12a0fe8b-2f93-494f-8e20-a1a9d7b0e59d service nova] Acquiring lock "90d4f967-2b91-439e-9366-135e5909244f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:36:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-86019ba9-44f7-4b47-b5dc-23c009bf6973 req-12a0fe8b-2f93-494f-8e20-a1a9d7b0e59d service nova] Lock "90d4f967-2b91-439e-9366-135e5909244f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:36:27 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-86019ba9-44f7-4b47-b5dc-23c009bf6973 req-12a0fe8b-2f93-494f-8e20-a1a9d7b0e59d service nova] Lock "90d4f967-2b91-439e-9366-135e5909244f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:36:27 user nova-compute[75341]: DEBUG nova.compute.manager [req-86019ba9-44f7-4b47-b5dc-23c009bf6973 req-12a0fe8b-2f93-494f-8e20-a1a9d7b0e59d service nova] [instance: 90d4f967-2b91-439e-9366-135e5909244f] No waiting events found dispatching network-vif-plugged-8bd469d5-3831-42ad-bd96-98c97106b763 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:36:27 user nova-compute[75341]: WARNING nova.compute.manager [req-86019ba9-44f7-4b47-b5dc-23c009bf6973 req-12a0fe8b-2f93-494f-8e20-a1a9d7b0e59d service nova] [instance: 90d4f967-2b91-439e-9366-135e5909244f] Received unexpected event network-vif-plugged-8bd469d5-3831-42ad-bd96-98c97106b763 for instance with vm_state active and task_state None.
Nov 15 00:36:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:36:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:36:30 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:36:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:36:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:36:34 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:36:36 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:36:36 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75341) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 00:36:37 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:36:37 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:36:38 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:36:42 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:36:42 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:36:42 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:36:42 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:36:42 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:36:42 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:36:42 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:36:42 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:36:42 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:36:42 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Cleaning up deleted instances {{(pid=75341) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 00:36:42 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] There are 0 instances to clean {{(pid=75341) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 00:36:43 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:36:43 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:36:43 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:36:43 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:36:43 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75341) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 00:36:44 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d4f967-2b91-439e-9366-135e5909244f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:36:44 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d4f967-2b91-439e-9366-135e5909244f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:36:44 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d4f967-2b91-439e-9366-135e5909244f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:36:44 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d4f967-2b91-439e-9366-135e5909244f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:36:44 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:36:44 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:36:44 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Hypervisor/Node resource view: name=user free_ram=8911MB free_disk=25.218399047851562GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75341) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 00:36:44 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:36:44 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:36:44 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 90d4f967-2b91-439e-9366-135e5909244f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:36:44 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 00:36:44 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 00:36:44 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 00:36:44 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 00:36:44 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Compute_service record updated for user:user {{(pid=75341) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 00:36:44 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.204s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:36:46 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:36:46 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:36:46 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Triggering sync for uuid 90d4f967-2b91-439e-9366-135e5909244f {{(pid=75341) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 00:36:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "90d4f967-2b91-439e-9366-135e5909244f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:36:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "90d4f967-2b91-439e-9366-135e5909244f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:36:47 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "90d4f967-2b91-439e-9366-135e5909244f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:36:47 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:36:47 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:36:48 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:36:48 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Starting heal instance info cache {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 00:36:48 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Rebuilding the list of instances to heal {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 00:36:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "refresh_cache-90d4f967-2b91-439e-9366-135e5909244f" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:36:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquired lock "refresh_cache-90d4f967-2b91-439e-9366-135e5909244f" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:36:49 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 90d4f967-2b91-439e-9366-135e5909244f] Forcefully refreshing network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 00:36:49 user nova-compute[75341]: DEBUG nova.objects.instance [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lazy-loading 'info_cache' on Instance uuid 90d4f967-2b91-439e-9366-135e5909244f {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:36:49 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 90d4f967-2b91-439e-9366-135e5909244f] Updating instance_info_cache with network_info: [{"id": "8bd469d5-3831-42ad-bd96-98c97106b763", "address": "fa:16:3e:35:7a:6b", "network": {"id": "c7278c61-5d7d-43d9-a0ae-38b29f98461a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1757487495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fed32b7fefd44136bfceb77d7412c7bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd469d5-38", "ovs_interfaceid": "8bd469d5-3831-42ad-bd96-98c97106b763", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:36:49 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Releasing lock "refresh_cache-90d4f967-2b91-439e-9366-135e5909244f" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:36:49 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 90d4f967-2b91-439e-9366-135e5909244f] Updated the network info_cache for instance {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 00:36:49 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:36:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:36:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:36:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:36:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:36:59 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:37:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:37:04 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:37:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:37:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:37:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:37:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:37:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:37:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:37:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:37:15 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:37:15 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75341) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 00:37:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:37:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:37:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:37:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:37:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:37:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:37:22 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:37:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:37:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:37:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:37:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:37:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:37:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:37:32 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:37:36 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:37:37 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:37:37 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:37:37 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:37:37 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:37:37 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:37:37 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:37:38 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:37:38 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75341) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 00:37:39 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:37:39 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:37:42 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:37:43 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:37:44 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:37:44 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:37:44 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:37:44 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:37:44 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75341) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 00:37:45 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d4f967-2b91-439e-9366-135e5909244f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:37:45 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d4f967-2b91-439e-9366-135e5909244f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:37:45 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d4f967-2b91-439e-9366-135e5909244f/disk --force-share --output=json {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 00:37:45 user nova-compute[75341]: DEBUG oslo_concurrency.processutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d4f967-2b91-439e-9366-135e5909244f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75341) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 00:37:45 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:37:45 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:37:45 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Hypervisor/Node resource view: name=user free_ram=8977MB free_disk=25.216144561767578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75341) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 00:37:45 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:37:45 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:37:45 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Instance 90d4f967-2b91-439e-9366-135e5909244f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75341) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 00:37:45 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 00:37:45 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 00:37:45 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Refreshing inventories for resource provider 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 00:37:45 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Updating ProviderTree inventory for provider 8fa114cc-b541-418f-865c-16c44294e72d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 00:37:45 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Updating inventory in ProviderTree for provider 8fa114cc-b541-418f-865c-16c44294e72d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 00:37:45 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Refreshing aggregate associations for resource provider 8fa114cc-b541-418f-865c-16c44294e72d, aggregates: None {{(pid=75341) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 00:37:45 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Refreshing trait associations for resource provider 8fa114cc-b541-418f-865c-16c44294e72d, traits: COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_MMX,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000E {{(pid=75341) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 00:37:46 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 00:37:46 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 00:37:46 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Compute_service record updated for user:user {{(pid=75341) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 00:37:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.288s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:37:47 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:37:47 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:37:49 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:37:49 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Starting heal instance info cache {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 00:37:49 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Rebuilding the list of instances to heal {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 00:37:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "refresh_cache-90d4f967-2b91-439e-9366-135e5909244f" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 00:37:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquired lock "refresh_cache-90d4f967-2b91-439e-9366-135e5909244f" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 00:37:50 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 90d4f967-2b91-439e-9366-135e5909244f] Forcefully refreshing network info cache for instance {{(pid=75341) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 00:37:50 user nova-compute[75341]: DEBUG nova.objects.instance [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lazy-loading 'info_cache' on Instance uuid 90d4f967-2b91-439e-9366-135e5909244f {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:37:50 user nova-compute[75341]: DEBUG nova.network.neutron [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 90d4f967-2b91-439e-9366-135e5909244f] Updating instance_info_cache with network_info: [{"id": "8bd469d5-3831-42ad-bd96-98c97106b763", "address": "fa:16:3e:35:7a:6b", "network": {"id": "c7278c61-5d7d-43d9-a0ae-38b29f98461a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1757487495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fed32b7fefd44136bfceb77d7412c7bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd469d5-38", "ovs_interfaceid": "8bd469d5-3831-42ad-bd96-98c97106b763", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:37:50 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Releasing lock "refresh_cache-90d4f967-2b91-439e-9366-135e5909244f" {{(pid=75341) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 00:37:50 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] [instance: 90d4f967-2b91-439e-9366-135e5909244f] Updated the network info_cache for instance {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 00:37:50 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:37:52 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:37:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:37:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:37:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:37:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:37:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:37:57 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:38:02 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:38:07 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:38:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:38:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:38:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:38:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:38:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:38:12 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:38:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f527acd2-e9c7-48de-92ba-4fa8f96a0f45 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] Acquiring lock "90d4f967-2b91-439e-9366-135e5909244f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:38:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f527acd2-e9c7-48de-92ba-4fa8f96a0f45 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] Lock "90d4f967-2b91-439e-9366-135e5909244f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:38:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f527acd2-e9c7-48de-92ba-4fa8f96a0f45 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] Acquiring lock "90d4f967-2b91-439e-9366-135e5909244f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:38:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f527acd2-e9c7-48de-92ba-4fa8f96a0f45 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] Lock "90d4f967-2b91-439e-9366-135e5909244f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:38:15 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f527acd2-e9c7-48de-92ba-4fa8f96a0f45 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] Lock "90d4f967-2b91-439e-9366-135e5909244f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:38:15 user nova-compute[75341]: INFO nova.compute.manager [None req-f527acd2-e9c7-48de-92ba-4fa8f96a0f45 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] [instance: 90d4f967-2b91-439e-9366-135e5909244f] Terminating instance
Nov 15 00:38:15 user nova-compute[75341]: DEBUG nova.compute.manager [None req-f527acd2-e9c7-48de-92ba-4fa8f96a0f45 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] [instance: 90d4f967-2b91-439e-9366-135e5909244f] Start destroying the instance on the hypervisor. {{(pid=75341) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 00:38:15 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:38:15 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:38:15 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:38:15 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:38:15 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:38:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:38:16 user nova-compute[75341]: DEBUG nova.compute.manager [req-0b4b22a6-6286-4e72-b9ef-7d1899d61033 req-759a05da-6353-4d84-9148-8660f32e4ebf service nova] [instance: 90d4f967-2b91-439e-9366-135e5909244f] Received event network-vif-unplugged-8bd469d5-3831-42ad-bd96-98c97106b763 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:38:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-0b4b22a6-6286-4e72-b9ef-7d1899d61033 req-759a05da-6353-4d84-9148-8660f32e4ebf service nova] Acquiring lock "90d4f967-2b91-439e-9366-135e5909244f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:38:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-0b4b22a6-6286-4e72-b9ef-7d1899d61033 req-759a05da-6353-4d84-9148-8660f32e4ebf service nova] Lock "90d4f967-2b91-439e-9366-135e5909244f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:38:16 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-0b4b22a6-6286-4e72-b9ef-7d1899d61033 req-759a05da-6353-4d84-9148-8660f32e4ebf service nova] Lock "90d4f967-2b91-439e-9366-135e5909244f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:38:16 user nova-compute[75341]: DEBUG nova.compute.manager [req-0b4b22a6-6286-4e72-b9ef-7d1899d61033 req-759a05da-6353-4d84-9148-8660f32e4ebf service nova] [instance: 90d4f967-2b91-439e-9366-135e5909244f] No waiting events found dispatching network-vif-unplugged-8bd469d5-3831-42ad-bd96-98c97106b763 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:38:16 user nova-compute[75341]: DEBUG nova.compute.manager [req-0b4b22a6-6286-4e72-b9ef-7d1899d61033 req-759a05da-6353-4d84-9148-8660f32e4ebf service nova] [instance: 90d4f967-2b91-439e-9366-135e5909244f] Received event network-vif-unplugged-8bd469d5-3831-42ad-bd96-98c97106b763 for instance with task_state deleting. {{(pid=75341) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 00:38:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:38:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:38:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:38:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:38:16 user nova-compute[75341]: INFO nova.virt.libvirt.driver [-] [instance: 90d4f967-2b91-439e-9366-135e5909244f] Instance destroyed successfully.
Nov 15 00:38:16 user nova-compute[75341]: DEBUG nova.objects.instance [None req-f527acd2-e9c7-48de-92ba-4fa8f96a0f45 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] Lazy-loading 'resources' on Instance uuid 90d4f967-2b91-439e-9366-135e5909244f {{(pid=75341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 00:38:16 user nova-compute[75341]: DEBUG nova.virt.libvirt.vif [None req-f527acd2-e9c7-48de-92ba-4fa8f96a0f45 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T00:36:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1137788412',display_name='tempest-VolumesActionsTest-instance-1137788412',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1137788412',id=52,image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T00:36:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fed32b7fefd44136bfceb77d7412c7bd',ramdisk_id='',reservation_id='r-bpgb0svc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e46abb82-b810-490e-a8a1-ccdc5fa1a796',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1203398487',owner_user_name='tempest-VolumesActionsTest-1203398487-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T00:36:27Z,user_data=None,user_id='f59b807ce0a5430fb9e682d746b73a83',uuid=90d4f967-2b91-439e-9366-135e5909244f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8bd469d5-3831-42ad-bd96-98c97106b763", "address": "fa:16:3e:35:7a:6b", "network": {"id": "c7278c61-5d7d-43d9-a0ae-38b29f98461a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1757487495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fed32b7fefd44136bfceb77d7412c7bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd469d5-38", "ovs_interfaceid": "8bd469d5-3831-42ad-bd96-98c97106b763", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 00:38:16 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-f527acd2-e9c7-48de-92ba-4fa8f96a0f45 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] Converting VIF {"id": "8bd469d5-3831-42ad-bd96-98c97106b763", "address": "fa:16:3e:35:7a:6b", "network": {"id": "c7278c61-5d7d-43d9-a0ae-38b29f98461a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1757487495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fed32b7fefd44136bfceb77d7412c7bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bd469d5-38", "ovs_interfaceid": "8bd469d5-3831-42ad-bd96-98c97106b763", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 00:38:16 user nova-compute[75341]: DEBUG nova.network.os_vif_util [None req-f527acd2-e9c7-48de-92ba-4fa8f96a0f45 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:7a:6b,bridge_name='br-int',has_traffic_filtering=True,id=8bd469d5-3831-42ad-bd96-98c97106b763,network=Network(c7278c61-5d7d-43d9-a0ae-38b29f98461a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bd469d5-38') {{(pid=75341) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 00:38:16 user nova-compute[75341]: DEBUG os_vif [None req-f527acd2-e9c7-48de-92ba-4fa8f96a0f45 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:7a:6b,bridge_name='br-int',has_traffic_filtering=True,id=8bd469d5-3831-42ad-bd96-98c97106b763,network=Network(c7278c61-5d7d-43d9-a0ae-38b29f98461a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bd469d5-38') {{(pid=75341) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 00:38:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:38:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8bd469d5-38, bridge=br-int, if_exists=True) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:38:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:38:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:38:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:38:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=42d1454d-a0d5-450b-9b78-49eb5a7bb215) {{(pid=75341) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 00:38:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:38:16 user nova-compute[75341]: INFO os_vif [None req-f527acd2-e9c7-48de-92ba-4fa8f96a0f45 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:7a:6b,bridge_name='br-int',has_traffic_filtering=True,id=8bd469d5-3831-42ad-bd96-98c97106b763,network=Network(c7278c61-5d7d-43d9-a0ae-38b29f98461a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bd469d5-38')
Nov 15 00:38:16 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-f527acd2-e9c7-48de-92ba-4fa8f96a0f45 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] [instance: 90d4f967-2b91-439e-9366-135e5909244f] Deleting instance files /opt/stack/data/nova/instances/90d4f967-2b91-439e-9366-135e5909244f_del
Nov 15 00:38:16 user nova-compute[75341]: INFO nova.virt.libvirt.driver [None req-f527acd2-e9c7-48de-92ba-4fa8f96a0f45 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] [instance: 90d4f967-2b91-439e-9366-135e5909244f] Deletion of /opt/stack/data/nova/instances/90d4f967-2b91-439e-9366-135e5909244f_del complete
Nov 15 00:38:16 user nova-compute[75341]: INFO nova.compute.manager [None req-f527acd2-e9c7-48de-92ba-4fa8f96a0f45 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] [instance: 90d4f967-2b91-439e-9366-135e5909244f] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 15 00:38:16 user nova-compute[75341]: DEBUG oslo.service.loopingcall [None req-f527acd2-e9c7-48de-92ba-4fa8f96a0f45 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75341) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 00:38:16 user nova-compute[75341]: DEBUG nova.compute.manager [-] [instance: 90d4f967-2b91-439e-9366-135e5909244f] Deallocating network for instance {{(pid=75341) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 00:38:16 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: 90d4f967-2b91-439e-9366-135e5909244f] deallocate_for_instance() {{(pid=75341) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 00:38:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:38:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:38:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:38:16 user nova-compute[75341]: DEBUG nova.network.neutron [-] [instance: 90d4f967-2b91-439e-9366-135e5909244f] Updating instance_info_cache with network_info: [] {{(pid=75341) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 00:38:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:38:16 user nova-compute[75341]: INFO nova.compute.manager [-] [instance: 90d4f967-2b91-439e-9366-135e5909244f] Took 0.53 seconds to deallocate network for instance.
Nov 15 00:38:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:38:17 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:38:17 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f527acd2-e9c7-48de-92ba-4fa8f96a0f45 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:38:17 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f527acd2-e9c7-48de-92ba-4fa8f96a0f45 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:38:17 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-f527acd2-e9c7-48de-92ba-4fa8f96a0f45 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 00:38:17 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-f527acd2-e9c7-48de-92ba-4fa8f96a0f45 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 00:38:17 user nova-compute[75341]: DEBUG nova.compute.manager [req-1cae9042-df17-40a9-9cea-ff4ba35c02c1 req-aca69b70-2c97-439b-9728-b6301a7b5a8a service nova] [instance: 90d4f967-2b91-439e-9366-135e5909244f] Received event network-vif-deleted-8bd469d5-3831-42ad-bd96-98c97106b763 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:38:17 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f527acd2-e9c7-48de-92ba-4fa8f96a0f45 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.130s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:38:17 user nova-compute[75341]: INFO nova.scheduler.client.report [None req-f527acd2-e9c7-48de-92ba-4fa8f96a0f45 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] Deleted allocations for instance 90d4f967-2b91-439e-9366-135e5909244f
Nov 15 00:38:17 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-f527acd2-e9c7-48de-92ba-4fa8f96a0f45 tempest-VolumesActionsTest-1203398487 tempest-VolumesActionsTest-1203398487-project-member] Lock "90d4f967-2b91-439e-9366-135e5909244f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.780s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:38:18 user nova-compute[75341]: DEBUG nova.compute.manager [req-6f48d548-2c9e-42de-b753-e5c652418e9c req-64ce497b-f47c-4008-98eb-72446aa518c8 service nova] [instance: 90d4f967-2b91-439e-9366-135e5909244f] Received event network-vif-plugged-8bd469d5-3831-42ad-bd96-98c97106b763 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:38:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6f48d548-2c9e-42de-b753-e5c652418e9c req-64ce497b-f47c-4008-98eb-72446aa518c8 service nova] Acquiring lock "90d4f967-2b91-439e-9366-135e5909244f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:38:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6f48d548-2c9e-42de-b753-e5c652418e9c req-64ce497b-f47c-4008-98eb-72446aa518c8 service nova] Lock "90d4f967-2b91-439e-9366-135e5909244f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:38:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6f48d548-2c9e-42de-b753-e5c652418e9c req-64ce497b-f47c-4008-98eb-72446aa518c8 service nova] Lock "90d4f967-2b91-439e-9366-135e5909244f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:38:18 user nova-compute[75341]: DEBUG nova.compute.manager [req-6f48d548-2c9e-42de-b753-e5c652418e9c req-64ce497b-f47c-4008-98eb-72446aa518c8 service nova] [instance: 90d4f967-2b91-439e-9366-135e5909244f] No waiting events found dispatching network-vif-plugged-8bd469d5-3831-42ad-bd96-98c97106b763 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:38:18 user nova-compute[75341]: WARNING nova.compute.manager [req-6f48d548-2c9e-42de-b753-e5c652418e9c req-64ce497b-f47c-4008-98eb-72446aa518c8 service nova] [instance: 90d4f967-2b91-439e-9366-135e5909244f] Received unexpected event network-vif-plugged-8bd469d5-3831-42ad-bd96-98c97106b763 for instance with vm_state deleted and task_state None.
Nov 15 00:38:18 user nova-compute[75341]: DEBUG nova.compute.manager [req-6f48d548-2c9e-42de-b753-e5c652418e9c req-64ce497b-f47c-4008-98eb-72446aa518c8 service nova] [instance: 90d4f967-2b91-439e-9366-135e5909244f] Received event network-vif-plugged-8bd469d5-3831-42ad-bd96-98c97106b763 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:38:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6f48d548-2c9e-42de-b753-e5c652418e9c req-64ce497b-f47c-4008-98eb-72446aa518c8 service nova] Acquiring lock "90d4f967-2b91-439e-9366-135e5909244f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:38:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6f48d548-2c9e-42de-b753-e5c652418e9c req-64ce497b-f47c-4008-98eb-72446aa518c8 service nova] Lock "90d4f967-2b91-439e-9366-135e5909244f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:38:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6f48d548-2c9e-42de-b753-e5c652418e9c req-64ce497b-f47c-4008-98eb-72446aa518c8 service nova] Lock "90d4f967-2b91-439e-9366-135e5909244f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:38:18 user nova-compute[75341]: DEBUG nova.compute.manager [req-6f48d548-2c9e-42de-b753-e5c652418e9c req-64ce497b-f47c-4008-98eb-72446aa518c8 service nova] [instance: 90d4f967-2b91-439e-9366-135e5909244f] No waiting events found dispatching network-vif-plugged-8bd469d5-3831-42ad-bd96-98c97106b763 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:38:18 user nova-compute[75341]: WARNING nova.compute.manager [req-6f48d548-2c9e-42de-b753-e5c652418e9c req-64ce497b-f47c-4008-98eb-72446aa518c8 service nova] [instance: 90d4f967-2b91-439e-9366-135e5909244f] Received unexpected event network-vif-plugged-8bd469d5-3831-42ad-bd96-98c97106b763 for instance with vm_state deleted and task_state None.
Nov 15 00:38:18 user nova-compute[75341]: DEBUG nova.compute.manager [req-6f48d548-2c9e-42de-b753-e5c652418e9c req-64ce497b-f47c-4008-98eb-72446aa518c8 service nova] [instance: 90d4f967-2b91-439e-9366-135e5909244f] Received event network-vif-plugged-8bd469d5-3831-42ad-bd96-98c97106b763 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:38:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6f48d548-2c9e-42de-b753-e5c652418e9c req-64ce497b-f47c-4008-98eb-72446aa518c8 service nova] Acquiring lock "90d4f967-2b91-439e-9366-135e5909244f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:38:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6f48d548-2c9e-42de-b753-e5c652418e9c req-64ce497b-f47c-4008-98eb-72446aa518c8 service nova] Lock "90d4f967-2b91-439e-9366-135e5909244f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:38:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6f48d548-2c9e-42de-b753-e5c652418e9c req-64ce497b-f47c-4008-98eb-72446aa518c8 service nova] Lock "90d4f967-2b91-439e-9366-135e5909244f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:38:18 user nova-compute[75341]: DEBUG nova.compute.manager [req-6f48d548-2c9e-42de-b753-e5c652418e9c req-64ce497b-f47c-4008-98eb-72446aa518c8 service nova] [instance: 90d4f967-2b91-439e-9366-135e5909244f] No waiting events found dispatching network-vif-plugged-8bd469d5-3831-42ad-bd96-98c97106b763 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:38:18 user nova-compute[75341]: WARNING nova.compute.manager [req-6f48d548-2c9e-42de-b753-e5c652418e9c req-64ce497b-f47c-4008-98eb-72446aa518c8 service nova] [instance: 90d4f967-2b91-439e-9366-135e5909244f] Received unexpected event network-vif-plugged-8bd469d5-3831-42ad-bd96-98c97106b763 for instance with vm_state deleted and task_state None.
Nov 15 00:38:18 user nova-compute[75341]: DEBUG nova.compute.manager [req-6f48d548-2c9e-42de-b753-e5c652418e9c req-64ce497b-f47c-4008-98eb-72446aa518c8 service nova] [instance: 90d4f967-2b91-439e-9366-135e5909244f] Received event network-vif-unplugged-8bd469d5-3831-42ad-bd96-98c97106b763 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:38:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6f48d548-2c9e-42de-b753-e5c652418e9c req-64ce497b-f47c-4008-98eb-72446aa518c8 service nova] Acquiring lock "90d4f967-2b91-439e-9366-135e5909244f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:38:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6f48d548-2c9e-42de-b753-e5c652418e9c req-64ce497b-f47c-4008-98eb-72446aa518c8 service nova] Lock "90d4f967-2b91-439e-9366-135e5909244f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:38:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6f48d548-2c9e-42de-b753-e5c652418e9c req-64ce497b-f47c-4008-98eb-72446aa518c8 service nova] Lock "90d4f967-2b91-439e-9366-135e5909244f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:38:18 user nova-compute[75341]: DEBUG nova.compute.manager [req-6f48d548-2c9e-42de-b753-e5c652418e9c req-64ce497b-f47c-4008-98eb-72446aa518c8 service nova] [instance: 90d4f967-2b91-439e-9366-135e5909244f] No waiting events found dispatching network-vif-unplugged-8bd469d5-3831-42ad-bd96-98c97106b763 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:38:18 user nova-compute[75341]: WARNING nova.compute.manager [req-6f48d548-2c9e-42de-b753-e5c652418e9c req-64ce497b-f47c-4008-98eb-72446aa518c8 service nova] [instance: 90d4f967-2b91-439e-9366-135e5909244f] Received unexpected event network-vif-unplugged-8bd469d5-3831-42ad-bd96-98c97106b763 for instance with vm_state deleted and task_state None.
Nov 15 00:38:18 user nova-compute[75341]: DEBUG nova.compute.manager [req-6f48d548-2c9e-42de-b753-e5c652418e9c req-64ce497b-f47c-4008-98eb-72446aa518c8 service nova] [instance: 90d4f967-2b91-439e-9366-135e5909244f] Received event network-vif-plugged-8bd469d5-3831-42ad-bd96-98c97106b763 {{(pid=75341) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 00:38:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6f48d548-2c9e-42de-b753-e5c652418e9c req-64ce497b-f47c-4008-98eb-72446aa518c8 service nova] Acquiring lock "90d4f967-2b91-439e-9366-135e5909244f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:38:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6f48d548-2c9e-42de-b753-e5c652418e9c req-64ce497b-f47c-4008-98eb-72446aa518c8 service nova] Lock "90d4f967-2b91-439e-9366-135e5909244f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:38:18 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [req-6f48d548-2c9e-42de-b753-e5c652418e9c req-64ce497b-f47c-4008-98eb-72446aa518c8 service nova] Lock "90d4f967-2b91-439e-9366-135e5909244f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:38:18 user nova-compute[75341]: DEBUG nova.compute.manager [req-6f48d548-2c9e-42de-b753-e5c652418e9c req-64ce497b-f47c-4008-98eb-72446aa518c8 service nova] [instance: 90d4f967-2b91-439e-9366-135e5909244f] No waiting events found dispatching network-vif-plugged-8bd469d5-3831-42ad-bd96-98c97106b763 {{(pid=75341) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 00:38:18 user nova-compute[75341]: WARNING nova.compute.manager [req-6f48d548-2c9e-42de-b753-e5c652418e9c req-64ce497b-f47c-4008-98eb-72446aa518c8 service nova] [instance: 90d4f967-2b91-439e-9366-135e5909244f] Received unexpected event network-vif-plugged-8bd469d5-3831-42ad-bd96-98c97106b763 for instance with vm_state deleted and task_state None.
Nov 15 00:38:21 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:38:26 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:38:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:38:36 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:38:37 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:38:39 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:38:39 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75341) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 00:38:40 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:38:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:38:41 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:38:43 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:38:46 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:38:46 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:38:46 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:38:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:38:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:38:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:38:46 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75341) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 00:38:47 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:38:47 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:38:47 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Hypervisor/Node resource view: name=user free_ram=9096MB free_disk=25.243000030517578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75341) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 00:38:47 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:38:47 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:38:47 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 00:38:47 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 00:38:47 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 00:38:47 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 00:38:47 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Compute_service record updated for user:user {{(pid=75341) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 00:38:47 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.228s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:38:50 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:38:50 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Starting heal instance info cache {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 00:38:50 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Rebuilding the list of instances to heal {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 00:38:50 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Didn't find any instances for network info cache update. {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 00:38:50 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:38:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:38:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:38:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:38:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:38:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:38:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:38:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:38:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:38:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:38:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:38:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:38:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:39:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:39:02 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:39:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:39:11 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:39:11 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:39:11 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:39:11 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:39:11 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:39:11 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:39:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:39:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:39:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:39:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:39:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:39:16 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:39:21 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:39:25 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:39:26 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:39:27 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:39:30 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:39:31 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:39:36 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:39:36 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:39:36 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:39:36 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:39:36 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:39:36 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:39:39 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:39:39 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:39:39 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75341) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 00:39:40 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:39:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:39:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:39:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:39:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:39:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:39:41 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:39:42 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:39:44 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:39:46 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:39:46 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:39:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:39:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:39:46 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:39:46 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75341) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 00:39:47 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:39:47 user nova-compute[75341]: WARNING nova.virt.libvirt.driver [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 00:39:47 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Hypervisor/Node resource view: name=user free_ram=9093MB free_disk=25.24081039428711GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75341) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 00:39:47 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 00:39:47 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 00:39:47 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 00:39:47 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75341) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 00:39:47 user nova-compute[75341]: DEBUG nova.compute.provider_tree [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed in ProviderTree for provider: 8fa114cc-b541-418f-865c-16c44294e72d {{(pid=75341) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 00:39:47 user nova-compute[75341]: DEBUG nova.scheduler.client.report [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Inventory has not changed for provider 8fa114cc-b541-418f-865c-16c44294e72d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75341) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 00:39:47 user nova-compute[75341]: DEBUG nova.compute.resource_tracker [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Compute_service record updated for user:user {{(pid=75341) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 00:39:47 user nova-compute[75341]: DEBUG oslo_concurrency.lockutils [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.136s {{(pid=75341) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 00:39:49 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:39:50 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:39:50 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Starting heal instance info cache {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 00:39:50 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Rebuilding the list of instances to heal {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 00:39:50 user nova-compute[75341]: DEBUG nova.compute.manager [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Didn't find any instances for network info cache update. {{(pid=75341) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 00:39:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:39:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:39:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:39:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:39:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:39:51 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:39:52 user nova-compute[75341]: DEBUG oslo_service.periodic_task [None req-a1fa47a5-aebc-4276-af4e-c389023b8fb8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75341) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 00:39:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:39:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:39:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:39:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:39:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:39:56 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:40:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 00:40:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:40:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75341) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 00:40:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:40:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75341) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 00:40:01 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:40:06 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 00:40:11 user nova-compute[75341]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75341) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}